IBM DS8000 manual How to get IBM Redbooks, Help from IBM

Page 437

How to get IBM Redbooks

You can search for, view, or download Redbooks, Redpapers, Hints and Tips, draft publications and Additional materials, as well as order hardcopy Redbooks or CD-ROMs, at this Web site:

ibm.com/redbooks

Help from IBM

IBM Support and downloads

ibm.com/support

IBM Global Services

ibm.com/services

Related publications 415

Image 437

Contents IBM TotalStorage DS8000 Series Page IBM TotalStorage DS8000 Series Concepts and Architecture First Edition April Contents Page Benefits of virtualization Vi DS8000 Series Concepts and Architecture Summary Viii DS8000 Series Concepts and Architecture Page Page Index Xii DS8000 Series Concepts and Architecture Copyright License Dfsort TrademarksTeam that wrote this redbook PrefaceXvi DS8000 Series Concepts and Architecture Preface Xviii DS8000 Series Concepts and Architecture Comments welcome Become a published authorXx DS8000 Series Concepts and Architecture Part 1 Introduction DS8000 Series Concepts and Architecture Introduction to the DS8000 series Overview of the DS8000 series DS8000, a member of the TotalStorage DS familyInfrastructure Simplification Business ContinuityDS8000 Base frame Hardware overview Storage system logical partitions LPARs Storage capacityStorage Hardware Management Console S-HMC for the DS8000 IBM Standby Capacity on Demand offering for the DS8000Resiliency Family for Business Continuity Supported environmentsIBM TotalStorage Metro Mirror Synchronous Pprc IBM TotalStorage FlashCopyThree-site solution Service and setupInteroperability IBM TotalStorage Global Mirror Asynchronous PprcDS8000 compared to ESS PositioningCommon set of functions Common management functions IBM TotalStorage DS Command-Line Interface DS CLIDS8000 compared to DS6000 IBM TotalStorage DS Storage ManagerDS Open application programming interface Scalability and configuration flexibilityFuture directions of storage system LPARs Performance Sequential Prefetching in Adaptive Replacement Cache SarcIBM TotalStorage Multipath Subsystem Device Driver SDD Performance for zSeriesSummary 16 DS8000 Series Concepts and Architecture Part 2 Architecture 18 DS8000 Series Concepts and Architecture Components Base frame FramesRack operator panel Expansion frameRack operator panel ArchitectureSAN fabric Cache management Server-based SMP designComponents Randomseq Processor complexComponents Front view Service processor and SpcnRear view Processor memory2 I/O enclosures RIO-GDevice adapters Disk subsystemRear view DS8000 device adapter Disk enclosuresDS8000 disk enclosure Non-switched FC-AL drawbacks11 DS8000 disk enclosure Switched FC-AL advantages12 Disk enclosure switched connections DS8000 switched FC-AL implementationArrays and spares ExpansionArrays across loops 14 DS8000 switched loop layoutDDMs Host adaptersAAL benefits Control units and logical paths Ficon and Fibre Channel protocol host adaptersEscon distances Remote Mirror and Copy with EsconRack Power Control cards RPC Power and coolingFibre Channel supported servers Fibre Channel distancesProcessor and I/O enclosure power supplies Primary power suppliesDisk enclosure power and cooling Battery backup assembliesEthernet switches 42 DS8000 Series Concepts and Architecture Storage system LPARs Logical partitions Virtualization Engine technology Introduction to logical partitioningPartitioning concepts PartitionsLogical partitioning Lpar Building blockPhysical partitioning Ppar Dynamic logical partitioning Software and hardware fault isolationMicro-Partitioning Virtual I/OServer consolidation Why Logically Partition?Production and test environments Application isolationIncreased flexibility of resource allocation DS8000 and LparLpar and storage facility images DS8300 Model 9A2 Lpar and storage facility image 2 DS8300 Lpar implementationDS8300 Lpar resource allocation Storage facility image hardware componentsProcessor and memory allocations Storage Facility Image Processor complexRIO-G interconnect separation 4 DS8300 Model 9A2 configuration optionsModel conversion DS8300 example configurationModel conversions regarding Lpar functionality Lpar security through Power Hypervisor PhypLpar protection Power Hypervisor Lpar and Copy ServicesRemote mirroring Lpar benefitsFlashCopy Storage system LPARs Logical partitions Example of storage facility images in the DS8300 Addressing capabilities with storage facility imagesDS8300 addressing capabilities 60 DS8000 Series Concepts and Architecture RAS Storage complex NamingStorage unit Storage facility imageProcessor complex Processor complex RASPermanent monitoring Reliability, availability, and serviceability+1 redundancy Memory reliability, fault tolerance, and integritySelf-healing Concurrent Maintenance Fault maskingHypervisor Storage image independence Resource deallocationRIO-G a self-healing interconnect Server RAS2 I/O enclosure Metadata checksData flow Server failover and failbackNormal data flow FailoverFailback NVS recovery after complete power lossSingle or multiple path Host connection availabilityEnclosure Multi-pathing software SAN/FICON/ESCON switchesZSeries host connection Open systems host connectionDisk path redundancy Switched disk connectionsRAID-10 overview RAID-5 overviewRAID-5 theory RAID-5 implementation in the DS8000RAID-10 implementation in the DS8000 Spare creationRAID-10 theory Hot plugable DDMs Predictive Failure Analysis PFAFloating spares Rack power control card RPC Battery backup unitsDisk scrubbing Rack cooling fansPower fluctuation protection Building power lossPower control of the DS8000 Emergency power off EPOInstallation process Microcode updatesDifferent code versions across storage images Management consoleHMC considerations Virtualization concepts Storage system virtualization Virtualization definitionStorage Facility virtualization Abstraction layers for disk virtualizationPhysical layer as the base for virtualization Array sitesArray site ArraysCreation of an array RanksForming an FB rank with 1 GB extents Extent poolsServer0 Fixed Block LUNs Logical volumesCKD volumes Volume with ISeries LUNs Allocation and deletion of LUNs/CKD volumesLogical subsystems LSS DB2 Address groups Volume accessHost attachment Volume groupSummary of the virtualization hierarchy 11 Host attachments and volume groups12 Virtualization hierarchy Placement of dataBenefits of virtualization 13 Optimal placement of data101 102 DS8000 Series Concepts and Architecture 103 IBM TotalStorage DS8000 model overview and scalabilityModel naming conventions DS8000 highlights2 DS8100 Model 3 DS8300 Models 922 and 9A2 Maximum configuration for the ModelIBM TotalStorage DS8000 model overview and scalability Model comparison Scalability for capacity Designed for scalabilityLarge and scalable capacity DS8000 model comparisonAdding DDMs Scalability for performanceFuture plan Comparison of models for capacityLinear-scalable architecture Way I/O controllersBenefit of the DS8000 for scalability RIO-GModel conversions Model upgrades114 DS8000 Series Concepts and Architecture 115 Copy ServicesPoint-in-Time Copy FlashCopy Introduction to Copy ServicesCopy Services functions Write to the source volume Read from the source volumeRead from the target volume Refresh target volume also known as Incremental FlashCopy Point-in-Time Copy function authorizationFlashCopy options No background copy optionIncremental FlashCopy Data Set FlashCopyData Set FlashCopy Multiple Relationship FlashCopyConsistency Group FlashCopy What is Consistency Group FlashCopy?FlashCopy Source Volume FlashCopy Target Volume FlashCopy to Pprc Primary VolumeRemote Mirror and Copy Peer-to-Peer Remote Copy Inband Commands over Remote Mirror linkPersistent FlashCopy Metro Mirror Synchronous PprcMetro Mirror Global Copy PPRC-XDGlobal Copy Global Mirror Asynchronous PprcGlobal Mirror How Global Mirror worksGlobal Mirror How it works OS Global Mirror XRC 11 z/OS Global Mirror Secondary server12 z/OS Metro/Global Mirror Comparison of the Remote Mirror and Copy functionsGlobal Copy PPRC-XD What is data consistency? What is a Consistency Group?How does Consistency Group keep data consistency? 1st LSS13 Storage Hardware Management Console S-HMC Interfaces for Copy ServicesDS Storage Manager Web-based interface 16 DS8000 Copy Services network componentsDS Open application programming Interface API DS Command-Line Interface DS CLITip What is changed from the ESS CLI? Future Plans Interoperability with ESS140 DS8000 Series Concepts and Architecture 141 Part 3 Planning and configuration142 DS8000 Series Concepts and Architecture 143 Installation planningDelivery requirements Packaged dimensions and weight for DS8000 modelsGeneral considerations 145 Installation site preparationFloor and space requirements Calculating space requirements Installing on raised or nonraised floorsMeeting floor load requirements Power control Power requirementsDS8000 dimensions 147Input voltage requirements Power outlet requirementsPower consumption and environmental information Power connector requirementsEnvironmental requirements Fans and air intake areasCooling the storage complex Host attachmentAttaching to open systems hosts 151 ESCON-attached S/390 and zSeries hostsFICON-attached S/390 and zSeries hosts SAN Fabric products Where to get the updated information for host attachmentHost systems attachment HMC network requirements Network and SAN requirementsChannel extension technology products 153SAN requirements Remote power control requirementsRemote support connection requirements 155 156 DS8000 Series Concepts and Architecture 157 Configuration planningStorage Hardware Management Console S-HMC Configuration planning overviewExternal S-HMC S-HMC and Ethernet switchesDS Storage Manager Remote servicesHMC software components Required ports 161HMC network topology 163 Dial-up connectionSecure high-speed connection Call home Remote accessSecurity mechanism 1 Console must initiate session HMC security considerationsSecurity mechanism 2 Public key encryption 165HMC user management Security mechanism 3 Login securityFTP Offload option Licensed function indicators Operating environment license OEL required featureDS8000 licensed functions 167Operating environment license feature codes Optional featuresPoint-in-Time Copy function 2244 Model PTC License scope for each DS8000 licensed functionRemote Mirror and Copy RMC feature codes Point-in-Time Copy PTC feature codesRemote Mirror and Copy functions 2244 Model RMC Remote Mirror for z/OS 2244 Model RMZRemote Mirror for zSeries RMZ feature codes Parallel Access Volumes 2244 Model PAVParallel Access Volumes PAV feature codes Ordering licensed functionsUser authorize to FlashCopy 25 TB of CKD data 171Solution 173 Disk storage feature activationCapacity planning Logical configurationsScenarios for managing licensing Adding storage capacity to an existing licensed functionCKD RAID rank capacity 175FB RAID rank capacity Sparing rules177 Sparing examplesSparing Example 2 RAID-10 11 Sparing example 3 RAID-5 Different capacity, same RPM 179IBM Standby Capacity on Demand Standby CoD Sparing Example 4 RAID-5181 Capacity and well-balanced configurationDDM to DA Mapping -- 2-way 183 Data migration planningOperating system mirroring Basic commandsSoftware packages Remote copy technologies185 Migration services and appliances6 z/OS data migration methods 15 Different data migration methods Planning for performanceDisk Magic Parallel Access Volumes z/OS onlySize of cache storage Number of host ports/channelsHot spot avoidance 189 DS Storage Manager logical configurationStorage configuration terminology Configuration hierarchy, terminology, and conceptsPSeries1 PSeries2 Arrays Array sitesRanks Extent poolsExtent Pool Volume groups Logical volumesVolume Group Address groups Host System CExtent Pool Extent Pool Planning Array layer Raw or physical DDM layerArray site layer Logical volume layer Logical Configuration flowRank layer Extent pool layerConnecting to the DS8000 Introducing the GUI and logical configuration panelsWelcome panel 10 Entering the URL using the TCP/IP address for the S-HMC12 The Welcome panel Real-time Manager configurationSimulated Manager configuration Copy ServicesLog Creating and defining the users and passwords15 User administration panel Using the help panels information center17 View of the information center Navigating the GUI20 View of the Storage Complexes section 19 View of the storage complexes in the work area21 Storage unit view of the pull-down Radio buttons and check boxesConfiguring a storage complex Logical configuration processConfiguring the storage unit 25 The General storage unit information panel Configuration advancement steps 28 Specify I/O adapter configuration panel 29 Create host systems, screen Configuring the logical host systems31 View of the General host information panel 33 Define host ports panel, with updated host information Click Apply assignment and OK Creating arrays from array sites36 The Definition method panel 38 The Add arrays to ranks panel with FB selected Creating extent pools39 The Definition method panel Creating FB volumes from extents41 The Select extent pool panel 42 The Define volume properties panelClick Volume Groups Creating volume groups44 The Define volume group properties filled out Click Host Systems Deleting LUNs and recovering space in the extent poolAssigning LUNs to the hosts Click Volumes → zSeries Creating CKD volumesCreating CKD LCUs Click FinishClick Storage Units Displaying the storage unit Wwnn49 View of the Wwnn in the General panel 230 DS8000 Series Concepts and Architecture 231 Functionality IntroductionSupported environments Installation methodsESS Copy Services command flow using ESS Copy Services CLI Command flowTCP/IP ports DS CLI command flowSecure sockets DS8000 split network DS6000 command flowESS CLI co-existence Command flow for the DS6000CLI co-existence Storage managementSingle command mode Command modesExample 11-1 Using DS CLI via a single command User securityScript mode Interactive modeExample 11-4 Using DS CLI in interactive mode Example 11-3 Creating a DS CLI scriptLists all DS CLI commands with syntax information Lists all available DS CLI commandsSyntax conventions User assistanceReturn codes Example 11-8 Use of the help -lcommandMan pages DS CLI return codesExample 11-10 Return code examples Example 11-11 Example of a configuration scriptUsage examples Mixed device environments and migration Which CLI to use based on what hardware you have installedMigration tasks DS CLI migration exampleDetermining the saved tasks to be migrated Migration considerationsCollecting the task details A portion of the tasks listed by using the GUIUsing the GUI to get the contents of a FlashCopy task Converting the saved task to a DS CLI commandConverting a FlashCopy task to DS CLI Example 11-14 Using interactive dscli mode without profilesProcedure to create an encrypted password file Using DS CLI commands via a single command or scriptSetting up a profile Creating a user ID for use only with ESSExample 11-18 Establishing a FlashCopy with a single command Issuing a DS CLI command and scripting itExample 11-19 Creating an executable file Example 11-20 Using script mode252 DS8000 Series Concepts and Architecture 253 Performance considerationsNew and enhanced functions What is the challenge?Speed gap between server and disk storage 255 Where do we start?SSA backend interconnection Switch from Escon to Ficon portsArrays across loops Pprc over Fibre Channel linksHow does the DS8000 address the challenge? Fibre Channel switched disk interconnection at the back endFC-AL shortcomings How the DS8000 series overcomes FC-AL shortcomingsMemory 259 New four-port host adapters Fibre Channel device adapter261 POWER5 Heart of the DS8000 dual cluster designRIO-G Interconnect 263 RIO-G InterconnectVertical growth and scalability Performance and sizing considerations for open systemsData placement in the DS8000 Workload characteristicsCache size considerations for open systems 265266 DS8000 Series Concepts and Architecture LVM striping267 Stripe sizeSubsystem Device Driver SDD Dynamic I/O load-balancing Determining where to attach the hostDetermining the number of paths to a LUN 269 Performance and sizing considerations for z/OSConnect to zSeries hosts 12 DS8100 frontend connectivity example partial view Performance potential in z/OS environments271 Appropriate DS8000 size in z/OS environmentsProcessor memory size considerations for z/OS environments Or zSeries channel consolidation 273 Disk array sizing considerations for z/OS environmentsConfigure one extent pool for each single rank Configuration recommendations for z/OS275 Minimize the number of extent poolsPlan for a reasonable number of extent pools Extent pool0 Extent pool115 Mix of extent pools 277278 DS8000 Series Concepts and Architecture 279 280 DS8000 Series Concepts and Architecture 281 ZSeries software enhancementsScalability support Software enhancements for the DS800013.2 z/OS enhancements Read availability mask support Large Volume Support LVSBenefits of the scalability enhancements 283Read control unit and device recognition for DS8000 Initial Program Load IPL enhancements13.2.5 DS8000 definition to host software 285 New performance statisticsListdata Count Listdata Counts report of DS8000 287Listdata Status 289 Resource Management Facility RMF13.4 z/VSE enhancements 13.3 z/VM enhancementsMigration considerations Coexistence considerations291 TPF enhancements292 DS8000 Series Concepts and Architecture 293 Data migration in zSeries environmentsConsolidate storage subsystems Define migration objectives in z/OS environments295 Consolidate logical volumesConsiderations for new logical volume size Example 14-1 Data Classes with EF attribute Dynamic Parallel Access Volumes required for large volumes297 Keep source and target volume size at the current sizePhysical migration with DFSMSdss and other storage software Data migration based on physical migrationSummary of data migration objectives 299 Software- and hardware-based data migrationData migration with Piper for z/OS Piper hardware 301 Data migration with z/OS Global MirrorBridge from Escon to Ficon with Metro/Global Copy Hardware- or microcode-based migration303 Data migration with Metro Mirror or Global CopyPprcopy DDNAMEDD02 Query Example 14-3 All data is replicated 305Example 14-5 All data is replicated 491307 Data Set Services UtilityData migration based on logical migration System utilities Hierarchical Storage Manager, DFSMShsmSMS Storage Groups migration source environment 309Storage Group Application Selection Example 14-8 Select SMS storage group in Scds311 Alter Volume Statuses Pool Copy Pool Backup onlyALL Volumes Altered Example 14-12 Confirmation about SMS volume status change313 Combine physical and logical data migration 315 14.5 z/VM and VSE/ESA data migrationSummary of data migration 316 DS8000 Series Concepts and Architecture 317 318 DS8000 Series Concepts and Architecture 319 Open systems support and softwareSupported operating systems and servers Where to look for updated and detailed informationOpen systems support IBM HBA Search Tool DS8000 Interoperability MatrixDS8000 Host Systems Attachment Guide TotalStorage Proven programPlatform and operating system vendors’ pages Differences to the ESSEmulex Corporation AttoAdditional supported configurations RPQ Boot supportSubsystem Device Driver DS CLI Other multipathing solutionsIBM TotalStorage Productivity Center IBM TotalStorage Productivity CenterMDM main panel Sample Device Manager view Device ManagerSample screenshot of TPC for Disk TPC for DiskTPC for Replication Global Mirror UtilityEnterprise Remote Copy Management Facility eRCMF 332 DS8000 Series Concepts and Architecture 333 Data migration in the open Systems environmentTor Host operating system-based migration Comparison of migration methodsCopy raw devices Basic copy commandsOnline copy and synchronization with rsync Migration using volume management softwareMigration using LVM mirroring Backup and restoreSubsystem-based data migration Migration using backup and restoreCombination of Metro Mirror and Global Copy Metro Mirror and Global CopyPiper migration IBM Piper migrationOther migration applications IBM migration services343 Appendix A. Open systems operating systems specificsDS8000 Host Systems Attachment Guide Data placement considerationsPlanning Capacity planning considerationsExample A-1 AIX iostat output Unix performance monitoring toolsIostat Example A-2 SUN Solaris iostat output System Activity Report SARExample A-3 SAR Sample Output VmstatAIX host attachment scripts Other publicationsFinding the World Wide Port Names Example A-4 Finding Fibre Channel adapter WWNUseful SDD commands Determine the installed SDD levelManaging multiple paths Subsystem device driver SDDMultipath I/O Mpio Example A-7 lsvpcfg commandExample A-8 lspath command result Determine the installed Sddpcm levelUseful Mpio commands AIX access methods for I/O LVM configurationLVM striping LVM mirroringAIX on IBM iSeries Boot device supportDirect I/O Concurrent I/OIostat Monitoring I/O performanceFilemon Example A-9 Filemon output fileIBM Mpio FC Linux Implementing Linux with IBM Disk Storage Existing reference materialLinux with zSeries and ESS Essentials Getting Started with zSeries Fibre Channel ProtocolTable A-1 Major numbers and special device files Important Linux issuesSome Linux Scsi basics Example A-10 Create new special device files for Scsi disks Missing device filesScsi device assignment changes Managing multiple pathsLimited number of Scsi devices Fibre Channel disks discovered before internal Scsi disks RedHat Enterprise Linux RH-EL multiple LUN supportExample A-13 SCSi disks attached at system start time Adding FC disks dynamicallyExample A-12 Sample /etc/modules.conf Gaps in the LUN sequence Linux on IBM iSeriesExample A-16 Sample /proc/scsi/scsi file Troubleshooting and monitoring/proc pseudo file system Example A-17 Sample /proc/scsi/qla2300/x Performance monitoring with iostatGeneric Scsi tools SDD for Windows HBA and operating system settingsMicrosoft Windows 2000/2003 Figure A-1 Microsoft VDS Architecture Windows Server 2003 VDS supportVolume Shadow Copy Service FC port configurationHP OpenVMS Geographically Dispersed SitesConfigurations Volume configurationOpenVMS volume shadowing Command Console LUNAppendix A. Open systems operating systems specifics 372 DS8000 Series Concepts and Architecture 373 Appendix B. Using DS8000 with iSeriesTable B-1 OS/400 logical volume sizes Logical volume sizesSupported environment HardwareChanging LUN protection Protected versus unprotected volumesUsing 5250 interface Adding volumes to iSeries configurationFigure B-3 Work with Disk Configuration menu Figure B-5 Confirm Add Units Adding volumes to an Independent Auxiliary Storage PoolFigure B-7 iSeries Navigator Signon to iSeries window Figure B-9 SST Signon Figure B-11 New disk pool welcome Figure B-13 Confirm disk pool configuration Figure B-15 Choose the disks to add to the Disk Pool Figure B-17 New Disk Pool Summary Figure B-20 New Disk Pool shown on iSeries Navigator Avoiding single points of failure MultipathFigure B-22 Single points of failure Configuring multipathFigure B-24 Example of multipath with iSeries Adding multipath volumes to iSeries using 5250 interfaceFigure B-25 Adding multipath volumes to an ASP Figure B-27 Adding a multipath volume Adding volumes to iSeries using iSeries NavigatorFigure B-28 New Disk Pool shown on iSeries Navigator Figure B-30 Example of multipath logical units Managing multipath volumes using iSeries NavigatorAppendix B. Using DS8000 with iSeries Figure B-32 Multipath logical unit properties Figure B-33 Multipath connections Multipath rules for multiple iSeries systems or partitionsChanging from single path to multipath Sizing guidelinesCache Planning for arrays and DDMsTable B-2 Capacity per I/O Adapter Number of iSeries Fibre Channel adaptersSize and number of LUNs Table B-3 Disk operations per second per RAID rank Recommended number of ranksSharing ranks between iSeries and other servers Migration Connecting via SAN switchesOS/400 mirroring Metro Mirror and Global CopyOS/400 data migration Figure B-35 Using Metro Mirror to migrate from ESS to DS8000Figure B-36 Ending allocation for existing disk units Remote Mirror and Copy Copy Services for iSeriesFlashCopy AIX on IBM iSeries ISeries toolkit for Copy ServicesLinux on IBM iSeries 406 DS8000 Series Concepts and Architecture 407 Appendix C. Service and support offeringsIBM service offerings IBM Web sites for service offeringsIBM Implementation Services for TotalStorage disk systems IBM Implementation Services for TotalStorage Copy FunctionsEnterprise Remote Copy Management Facility eRCMF IBM Geographically Dispersed Parallel Sysplex GdpsIBM eServer iSeries Copy Services IBM Operational Support Services Support LineAppendix C. Service and support offerings 412 DS8000 Series Concepts and Architecture 413 IBM RedbooksOther publications Online resources Help from IBM How to get IBM Redbooks416 DS8000 Series Concepts and Architecture 417 IndexDS CLI OEL Escon Ficon RH-EL BBU Spcn VSE IBM TotalStorage DS8000 Series Concepts and Architecture Page Page IBM TotalStorage DS8000 Series Concepts Architecture

Related manuals

Manual 78 pages 25.99 Kb

Manual 374 pages 22.96 Kb