Manuals
/
IBM
/
Computer Equipment
/
Server
IBM
DS6000 Series
manual
Models:
DS6000 Series
1
405
406
406
Download
406 pages
2.51 Kb
399
400
401
402
403
404
405
406
Troubleshooting
Workload characteristics
Install
Device adapter port indicators
Connecting to your DS6000
Maintenance
Real-time online configuration
Important Linux issues
Parallel Access Volumes PAV
Service and setup
Page 405
Image 405
Page 404
Page 406
Page 405
Image 405
Page 404
Page 406
Contents
Architecture
Page
IBM TotalStorage DS6000 Series Concepts and Architecture
First Edition March
Iii
Iv DS6000 Series Concepts and Architecture
Contents
IBM TotalStorage DS6000 model overview
Part 3. Planning and configuration
DS CLI Introduction Functionality
Page
Page
Page
Index
Copyright License
Trademarks
Changed information see change bars
March 2005, First Edition
Xvi DS6000 Series Concepts and Architecture
Xvii
Team that wrote this redbook
Xviii DS6000 Series Concepts and Architecture
Preface
Xx DS6000 Series Concepts and Architecture
Comments welcome
Become a published author
Xxii DS6000 Series Concepts and Architecture
Part 1 Introduction
DS6000 Series Concepts and Architecture
Introducing the IBM TotalStorage DS6000 series
Infrastructure simplification
DS6000 series, a member of the TotalStorage DS Family
Business continuity
Information lifecycle management
Scaling options of the DS6000 and DS8000 series
IBM TotalStorage DS6000 series unique benefits
Hardware overview
DS6800 controller enclosure Model
Processors
Disk drives
Switched FC-AL subsystem
Dense packaging
Host adapters
DS management console
Storage capacity
DS6000 expansion enclosure Model 1750-EX1
IBM TotalStorage DS Storage Manager
Simulated offline configuration
IBM TotalStorage DS Command-Line Interface
Real-time online configuration
Supported environment
Business continuance functions
Point-in-time Copy feature
Data Set FlashCopy
Multiple Relationship FlashCopy
Remote Mirror and Copy feature
Global Copy
Three sites solution
Global Mirror
Remote Mirror connections
Service and setup
Resiliency
Interoperability
Dynamic LUN/volume creation and deletion
Configuration flexibility
Large LUN and large CKD volume support
Flexible LUN to LSS association
Positioning the IBM TotalStorage DS6000 series
Simplified LUN masking
Summary
Common set of functions
Common management functions
DS6000 series compared to ESS
DS6000 series compared to DS4000 series
DS6000 series compared to DS8000 series
Performance
Tagged Command Queuing
Use with other virtualization products
Self-learning cache algorithms Sarc
IBM multipathing software
Parallel Access Volumes PAV
Performance for zSeries
Multiple Allegiance
20 DS6000 Series Concepts and Architecture
Part 2 Architecture
22 DS6000 Series Concepts and Architecture
Components
Lower RAID controller Battery backup units
Upper RAID controller Rear display panel Power supply
Server enclosure
Front display panel Disk drive modules
Expansion enclosure
Upper Sbod controller Rear display panel Power supply
Controller architecture
Lower Sbod controller
SAN fabric
Cache management
Server-based design
Randomseq
Disk subsystem
Non-switched FC-AL drawbacks
Industry standard FC-AL disk enclosure
Switched FC-AL advantages
Disk enclosure
DS6000 switched FC-AL implementation
DDMs
10 Switched disk expansion
Server enclosure RAID controller card
Technical details
Device adapter ports
Host adapter port indicators
Device adapter port indicators
Host adapter ports
SFPs
Health indicators
Expansion enclosure Sbod controller card
Ethernet and serial ports
Cabling
Indicators
15 Expansion enclosure cabling Disk Contrl ports on loop
Front panel
Rear panel
DS6000 front panel indicators
Enclosure ID indicator
Rack identify connector
DS6000 rear panel push buttons
18 DS6000 power supplies
Power subsystem
DS6800 battery backup unit indicators
Battery backup units
System service card
Storage Manager console
Cables
Summary
44 DS6000 Series Concepts and Architecture
RAS
Controller RAS
Failover and failback
Data flow
DS6800 normal data flow
Failover
Failback
NVS recovery after complete power loss
Host connection availability
Metadata checks
Single and preferred path
Controller
SAN/FICON switches
Open systems host connection
ZSeries host connection
Multipathing software
RAID-5 overview
Disk subsystem RAS
RAID-5 theory
RAID-5 implementation in the DS6000
Drive failure
RAID-10 overview
RAID-10 theory
RAID-10 implementation in the DS6000
Floating spares
Spare creation
Disk scrubbing
Predictive Failure Analysis PFA
Disk path redundancy
Hot plugable DDMs
DS6000 switched disk connections
Power subsystem RAS
Example 1 Using light path indicators to replace a DDM
System service
Example 2 Using the GUI to replace a power supply
Redundant cooling
Failed power supply
Power supply replacement via the GUI
System Identify Indicator blue light
System indicators
System Alert Indicator amber light
System Information Indicator amber light
Parts replacement
Parts installation and repairs
CRU parts versus FRU parts
Tier 1 CRU parts
Microcode updates
Installation process
Maintaining code
Summary
64 DS6000 Series Concepts and Architecture
Virtualization concepts
Abstraction layers for disk virtualization
Virtualization definition
Physical layer as the base for virtualization
Array sites
Array sites
Arrays
Creation of an array
Ranks
Forming an FB rank with 1 GB extents
Extent pools
Server0
Logical volumes
CKD volumes
Fixed block LUNs
Volume with
ISeries LUNs
Allocation and deletion of LUNs/CKD volumes
Logical subsystems LSS
DB2
Address groups
Volume access
Host attachment
Volume group
Summary of the virtualization hierarchy
10 Host attachments and volume groups
11 Virtualization hierarchy
Placement of data
12 Optimal distribution of data
Benefits of virtualization
82 DS6000 Series Concepts and Architecture
IBM TotalStorage DS6000 model overview
1 DS6800 Model
DS6000 highlights
DS6800 Model 1750-511 rear view
2 DS6000 Model 1750-EX1
DS6800 Model 1750-EX1 rear view
Designed to scale for capacity
DS6800 physical capacity examples
DS6800 capacity upgrade
O L
Copy Services
Introduction to Copy Services
Copy Services functions
Point-in-Time Copy FlashCopy
Read from the target volume
Read from the source volume
Write to the source volume
Write to the target volume
Refresh target volume also known as Incremental FlashCopy
Point-in-Time Copy function authorization
FlashCopy options
No background copy option
Incremental FlashCopy
Data Set FlashCopy
Data Set FlashCopy
Multiple Relationship FlashCopy
Consistency Group FlashCopy
What is Consistency Group FlashCopy?
FlashCopy Source Volume FlashCopy Target Volume
FlashCopy to Pprc Primary Volume
Remote Mirror and Copy Peer-to-Peer Remote Copy
Inband commands over remote mirror link
Persistent FlashCopy
Metro Mirror Synchronous Pprc
Metro Mirror
Global Copy PPRC-XD
Global Copy
Global Mirror Asynchronous Pprc
Global Mirror
How Global Mirror works
Global Mirror How it works
OS Global Mirror XRC
Ashynchronously
Comparison of the Remote Mirror and Copy functions
104 DS6000 Series Concepts and Architecture
What is data consistency?
What is Consistency Group?
12 Consistency Group Example
How does Consistency Group keep data consistency?
LSS13
14 Consistency Group Example
Interfaces for Copy Services
DS Storage Manager Web-based interface
DS Command-Line Interface CLI
DS open application programming interface API
Tip What is changed from the ESS CLI?
Future Plan
Interoperability with ESS
112 DS6000 Series Concepts and Architecture
113
Part 3 Planning and configuration
114 DS6000 Series Concepts and Architecture
115
Installation planning
Installation site preparation
General considerations
Floor and space requirements
Service clearance requirements
Floor load requirements
117
Environmental requirements
Power requirements
Input voltage requirements
DS6000 series input voltage requirements
Preparing the rack
System management interfaces
IBM TotalStorage DS Storage Manager
119
DS Open application programming interface
DS Command-Line Interface
121
Network settings
SAN environment
SAN requirements and considerations
Attaching to an Open System host
FICON-attached zSeries Host
123
Software requirements
Licensed features
125
Configuration planning
DS6000 Management Console
Configuration planning considerations
Configuration management of DS6000 system
Offline configuration
127
Express configuration
Online configuration
Local maintenance
DS Management Console connectivity
129
Remote service support
Copy Services management
Call home
DS6000 licensed functions
Simple Network Management Protocol Snmp
131
Operating Environment License OEL required feature
Operating environment license feature codes
License scope for each DS6000 licensed function
Point-in-Time Copy function PTC
Optional features
Remote Mirror and Copy functions RMC
133
Parallel Access Volume PAV feature codes
Parallel Access Volumes PAV
Server attachment license
Ordering license functions
User authorized to FlashCopy 25 TB of CKD data
135
Solution
137
Disk storage feature activation
Capacity planning
Physical configurations
139
Logical configurations
CKD RAID rank capacity
Configuration with the same type of DDMs
Sparing rules
141
Sparing Example 1 RAID
143
Configuration with different types of DDMs
Sparing Example 3 RAID
145
Data migration planning
Operating system mirroring
Basic commands
Software packages
Remote copy technologies
Migration appliances
6 z/OS data migration methods
147
Disk Magic
Planning for performance
Number of host ports
Parallel Access Volumes z/OS only
Remote copy
5 I/O priority queuing z/OS only
Preferred paths
Hot spot avoidance
151
DS Storage Manager Logical configuration
Storage configuration terminology
Configuration hierarchy, terminology, and concepts
Storage complex
Storage unit
PSeries2
Arrays
Array sites
Ranks
Extent pools
Extent Pool
Volume groups
Logical volumes
Volume Group
Address groups
Example of Volume Group, LUNs and host attachment definition
Extent Pool
Copy services Relationships
Raw DDMs
Planning
Array Site
Array layer
Logical Configuration flow
Logical volume layer
Raw or physical DDM layer
Array site layer
Connecting to your DS6000
Introducing the GUI and logical configuration panels
Introduction and Welcome panel
10 Entering the URL using the TCP/IP address for the SMC
12 View of the Welcome panel
Real-time manager configuration
Simulated manager configuration
Copy Services
Log
Express configuration
Create and define the users and passwords
Using the help panels Software information center
17 View of the information center
Navigating the GUI
19 View of the storage complexes in the work area
20 View of the Storage Complexes section
Radio buttons and check boxes
Configuring a storage complex
Logical configuration process
Configuring the storage unit
25 View of the General storage unit information panel
Configuration advancements steps
28 Specify the I/O adapter configuration panel
Configuring the logical host systems
30 View of Host Systems panel, with the Go button selected
32 View of Define Host Systems panel
34 View of the Select storage unit panel
Click Apply assignment and OK
Creating arrays from array sites
37View of the Array configuration Auto panel
38 View of the Add arrays to ranks panel, with FB selected
39 View of creating custom arrays from four disk array sites
40 View of the second array-site selection panel
Creating extent pools
42 View of Define properties panel
Creating FB volumes from extents
Even numbered LSSs
Radio button
Click Volume Groups
Creating volume groups
46 The Define volume group properties filled out
Deleting LUNs and recovering space in the extent pool
Assigning LUNs to the hosts
Click Host Systems
Creating CKD volumes
Click Volumes → zSeries
Creating CKD LCUs
Click Express Configuration Wizard
Using the Express Configuration Wizard
50 View of the Real-time Manager panel
Click Storage units
Wwnn number is displayed as shown in Figure
194 DS6000 Series Concepts and Architecture
195
Functionality
Introduction
Supported environments
Installation methods
ESS Copy Services command flow using ESS Copy Services CLI
Command flow
DS CLI command flow
Secure sockets
TCP/IP ports
DS8000 split network
DS6000 command flow
ESS CLI co-existence
Command flow for the DS6000
CLI co-existence
Storage management
Single command mode
Command modes
Example 10-1 Using DS CLI via a single command
User security
Script mode
Interactive mode
Example 10-4 Using DS CLI in interactive mode
Example 10-3 Creating a DS CLI script
Lists all available DS CLI commands
Syntax conventions
User assistance
Return codes
Example 10-8 Use of the help -lcommand
Man pages
DS CLI return codes
Example 10-11 Example of a configuration script
Usage examples
Example 10-10 Return code examples
Mixed device environments and migration
Which CLI to use based on what hardware you have installed
Migration tasks
DS CLI migration example
Determining the saved tasks to be migrated
Migration considerations
Collecting the task details
A portion of the tasks listed by using the GUI
Using the GUI to get the contents of a FlashCopy task
Converting the saved task to a DS CLI command
Converting a FlashCopy task to DS CLI
Example 10-14 Using interactive dscli mode without profiles
Using DS CLI commands via a single command or script
Procedure to create an encrypted password file
Creating a user ID for use only with ESS
Example 10-15 Example of a dscli.profile file
Setting up a profile
Issuing a DS CLI command and scripting it
Example 10-20 Using script mode
Example 10-19 Creating an executable file
216 DS6000 Series Concepts and Architecture
217
218 DS6000 Series Concepts and Architecture
219
Performance considerations
What is the challenge?
Speed gap between server and disk storage
New and enhanced functions
221
Where do we start?
SSA backend interconnection
Switch from Escon to Ficon ports
Arrays across loops
Pprc over Fibre Channel links
How does the DS6000 address the challenge?
Fibre Channel switched disk interconnection at the back end
FC-AL shortcomings
How DS6000 series overcomes FC-AL shortcomings
Fibre Channel switch
225
New four-port host adapters
Fibre Channel device adapter
227
Enterprise-class dual cluster design for the DS6800
Power PC
229
Vertical growth and scalability
Performance and sizing considerations for open systems
Workload characteristics
Data placement in the DS6000
LVM striping
231
10 Spreading data across ranks
Stripe size
Performance and sizing considerations for z/OS
Determining where to attach the host
Determining the number of paths to a LUN
Subsystem Device Driver SDD Dynamic I/O load balancing
Performance potential in z/OS environments
Connect to zSeries hosts
An appropriate DS6000 size in z/OS environments
Processor memory size considerations for z/OS environments
235
Disk array sizing considerations for z/OS environments
Or zSeries channel consolidation
Configuration recommendations for z/OS
Configure one extent pool for each single rank
237
Rank
Minimize the number of extent pools
Plan for a reasonable number of extent pools
239
14 Mix of extent pools
241
242 DS6000 Series Concepts and Architecture
243
ZSeries software enhancements
Software enhancements for the DS6000
12.2 z/OS enhancements
Scalability support
Read availability mask support
Large Volume Support LVS
Benefits of the scalability enhancements
245
Initial Program Load IPL enhancements
12.2.5 DS6000 definition to host software
Read Control Unit and Device Recognition for DS6000
New performance statistics
Resource Measurement Facility RMF
247
Preferred pathing
Devserv Paths command showing preferred pathing
12.4 z/VSE enhancements
12.3 z/VM enhancements
Migration considerations
Coexistence considerations
TPF enhancements
251
Data Migration in zSeries environments
Consolidate logical volumes
Define migration objectives in z/OS environments
Consolidate storage subsystems
Keep source and target volume at the current size
Summary of data migration objectives
253
Physical migration with DFSMSdss and other storage software
Data migration based on physical migration
Software- and hardware-based data migration
Data migration with Piper for z/OS
255
Piper hardware
257
Data migration with z/OS Global Mirror
Bridge from Escon to Ficon with Metro/Global Copy
Hardware- and microcode-based migration
259
Data migration with Metro Mirror or Global Copy
260 DS6000 Series Concepts and Architecture
Pprcopy DDNAMEDD02 Query
261
If PENDING/SUSPEND Count of Tracks Remaining to be Copied =
Example 13-2 All data is replicated
Data migration based on logical migration
263
Example 13-4 All data is replicated
FDR
Data Set Services Utility DFSMSdss
SMS Storage Groups migration source environment
Data migration within the system-managed storage environment
Example 13-6 Select SMS storage group in Scds
SG1 SG2
267
Volume Display, Define Alter or Delete Volume Information
ALL Volumes Altered
Example 13-10 Confirmation about SMS volume status change
269
Storgrp SG1
Combine physical and logical data migration
271
13.5 z/VM and VSE/ESA data migration
Summary of data migration
273
274 DS6000 Series Concepts and Architecture
275
Open systems support and software
Supported operating systems and servers
Open systems support
Where to look for updated and detailed information
Platform and operating system vendors’ pages
Differences to ESS
QLogic Corporation
Emulex Corporation
Boot support
Additional supported configurations RPQ
Differences in interoperability between DS6000 and DS8000
Subsystem Device Driver
DS CLI
Other multipathing solutions
IBM TotalStorage Productivity Center
IBM TotalStorage Productivity Center
MDM main panel
Device Manager
Sample Device Manager view
TCP for Disk
Example screenshot of TPC for Disk
TPC for Replication
Global Mirror Utility
Enterprise Remote Copy Management Facility eRCMF
289
Data migration in the open Systems environment
Few larger volumes
Comparison of migration methods
Host operating system-based migration
291
Copy raw devices
Basic copy commands
Migration using volume management software
Online copy and synchronization with rsync
293
Migration using LVM mirroring
Backup and Restore
295
Subsystem-based data migration
Combination of Metro Mirror and Global Copy
Metro Mirror and Global Copy
297
IBM Piper migration
Other migration applications
IBM migration services
299
Appendix A. Operating systems specifics
DS6000 Host Systems Attachment Guide
Data placement considerations
Planning
Capacity planning considerations
Iostat
Unix performance monitoring tools
301
Example A-1 AIX iostat output
Example A-2 SUN Solaris iostat output
System Activity Report SAR
Example A-3 SAR Sample Output
303
AIX host attachment scripts
Other publications
Finding the World Wide Port Names
Example A-4 Finding Fibre Channel adapter WWN
Useful SDD commands
Determine the installed SDD level
Managing multiple paths
Subsystem device driver SDD
Multipath I/O Mpio
Example A-7 lsvpcfg command
Useful Mpio commands
Determine the installed Sddpcm level
Example A-8 lspath command result
307
AIX access methods for I/O
LVM configuration
LVM striping
LVM Mirroring
AIX on IBM iSeries
Boot device support
Direct I/O
Concurrent I/O
Iostat
Monitoring I/O performance
Filemon
Example A-9 Filemon output file
311
Linux
Implementing Linux with IBM Disk Storage
Existing reference material
Linux with zSeries and ESS Essentials
Getting Started with zSeries Fibre Channel Protocol
Important Linux issues
Some Linux Scsi basics
Table A-1 Major numbers and special device files
Missing device files
315
Example A-10 Create new special device files for Scsi disks
Managing multiple paths
Limited number of Scsi devices
Scsi device assignment changes
Fibre Channel disks discovered before internal Scsi disks
RedHat Enterprise Linux RH-EL multiple LUN support
317
Example A-12 Sample /etc/modules.conf
Example A-13 SCSi disks attached at system start time
Adding FC disks dynamically
Linux on IBM iSeries
Gaps in the LUN sequence
319
/proc pseudo file system
Troubleshooting and monitoring
Example A-16 Sample /proc/scsi/scsi file
Example A-17 Sample /proc/scsi/qla2300/x
Performance monitoring with iostat
Microsoft Windows 2000/2003
Generic Scsi tools
321
SDD for Windows
HBA and operating system settings
323
Windows Server 2003 VDS support
Volume Shadow Copy Service
FC port configuration
HP OpenVMS
Geographically Dispersed Sites
325
Volume configuration
OpenVMS volume shadowing
Command Console LUN
327
328 DS6000 Series Concepts and Architecture
329
Appendix B. Using the DS6000 with iSeries
Table B-1 OS/400 logical volume sizes
Logical volume sizes
Supported environment
Hardware
Changing LUN protection
Protected versus unprotected volumes
Using 5250 interface
Adding volumes to iSeries configuration
Figure B-2 Work with Disk Units menu
Figure B-4 Specify ASPs to Add Units to
Adding volumes to an Independent Auxiliary Storage Pool
Figure B-6 iSeries Navigator initial panel
Figure B-8 iSeries Navigator Disk Units
Figure B-10 Create a new disk pool
Figure B-12 Defining a new disk pool
Figure B-14 Add disks to Disk Pool
Figure B-16 Confirm disks to be added to Disk Pool
Figure B-18 New Disk Pool Status
Multipath
Figure B-21 New logical volume shown on iSeries Navigator
Figure B-22 Single points of failure
Avoiding single points of failure
Figure B-23 Multipath removes single points of failure
Configuring multipath
Figure B-24 Example of multipath with iSeries
Adding multipath volumes to iSeries using 5250 interface
Figure B-25 Adding multipath volumes to an ASP
Adding volumes to iSeries using iSeries Navigator
Figure B-27 Adding a multipath volume
Figure B-28 New Disk Pool shown on iSeries Navigator
Figure B-30 Example of multipath logical units
Managing multipath volumes using iSeries Navigator
350 DS6000 Series Concepts and Architecture
Figure B-32 Multipath logical unit properties
Figure B-33 Multipath connections
Multipath rules for multiple iSeries systems or partitions
Sizing guidelines
Changing from single path to multipath
Preferred path for DS6000
Cache
Planning for arrays and DDMs
Size and number of LUNs
Number of iSeries Fibre Channel adapters
Recommended number of ranks
Table B-2 Capacity per I/O Adapter
Connecting via SAN switches
Sharing ranks between iSeries and other servers
Table B-3 Disk operations per second per RAID rank
Migration
OS/400 mirroring
Metro Mirror and Global Copy
OS/400 data migration
Figure B-36 Ending allocation for existing disk units
Copy Services for iSeries
FlashCopy
Remote Mirror and Copy
AIX on IBM iSeries
ISeries toolkit for Copy Services
Linux on IBM iSeries
363
Appendix C. Service and support offerings
IBM service offerings
IBM Web sites for service offerings
IBM Implementation Services for TotalStorage disk systems
IBM Implementation Services for TotalStorage Copy Functions
Enterprise Remote Copy Management Facility eRCMF
IBM Geographically Dispersed Parallel Sysplex Gdps
IBM eServer iSeries Copy Services
IBM Operational Support Services Support Line
Appendix C. Service and support offerings
368 DS6000 Series Concepts and Architecture
IBM Redbooks
Other publications
369
Online resources
Help from IBM
How to get IBM Redbooks
372 DS6000 Series Concepts and Architecture
373
Index
DS CLI
ESS
Interoperability with ESS
Page
Unix
DS6000 Series Concepts and Architecture
Page
Page
IBM TotalStorage DS6000 Series Concepts Architecture
Top
Page
Image
Contents