IBM Enterprise Storage Server

Transcription

1 IBM Enterprise Storage Server Understand the ESS characteristics and design Discover its powerful performance and copy features Learn the basics before planning and configuring Gustavo A. Castets Daniel Leplaideur Jose Alcino Bras Jason Galang ibm.com/redbooks

2

3 International Technical Support Organization SG IBM Enterprise Storage Server September 2001

4 Take Note! Before using this information and the product it supports, be sure to read the general information in Appendix G, Special notices on page 315. Second Edition (September 2001) This edition applies to the IBM 2105 Enterprise Storage Server model F. For other information you can see the Publications section of the IBM Announcement letter for the IBM Enterprise Storage Server and you can visit our Web site at Comments may be addressed to: IBM Corporation, International Technical Support Organization Dept. 471 Building 80-E2 650 Harry Road San Jose, California When you send information to IBM, you grant IBM a non-exclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. Copyright International Business Machines Corporation 1999, All rights reserved. Note to U.S Government Users - Documentation related to restricted rights - Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corp.

5 Contents Figures xiii Tables xvii Preface xix The team that wrote this redbook xix Comments welcome xxi Chapter 1. Introduction Benefits Terminology Host attachment Data architecture Server platforms Other terms Chapter 2. Hardware Enterprise Storage Server overview ESS Models and Expansion Enclosure Enterprise Storage Server models ESS Expansion Enclosure (feature 2100) Photograph of the ESS ESS major components ESS cages Cages Expansion Enclosure rack ESS disks pack Disk intermixing D40 drawers IBM drawer ESS RISC processors Processors Cache Non-volatile storage (NVS) Device adapters SSA 160 device adapters Disk drives per loop SSA loops SSA operation Loop availability Spatial reuse Host adapters Host adapter bays ESCON host adapters ESCON host adapters Logical paths ESCON distances SCSI host adapters SCSI host adapters SCSI supported servers Copyright IBM Corp iii

6 SCSI targets and LUNs Fibre Channel host adapters Fibre Channel host adapters Fibre Channel supported servers Fibre Channel distances Storage Area Network FICON host adapters FICON host adapter FICON supported servers Fibre distances Long wave host adapter Short wave host adapter Other interfaces Power supplies Power requirements Power redundancy Chapter 3. Architecture Overview Rank (array) types RAID rank Non-RAID rank Rank RAID operation RAID-5 configuration RAID managed by device adapter Device adapters and logical subsystems Logical subsystem (LSS) Host mapping to logical subsystem Hosts mapping concepts SCSI and Fibre Channel mapping CKD mapping Addressing characteristics Fixed-block implementation CKD implementation Data flow host adapters Each HA is connected to both clusters Failover Data flow read Host adapter Cluster Processor Complex (CPC) Device adapter Disk drives Data flow write Host adapter Cluster processor complex (CPC) Device adapter Cache and read operations Cache NVS and write operations NVS Write operations Fast write NVS LRU iv IBM Enterprise Storage Server

7 NVS location S/390 and z/os I/O accelerators Parallel Access Volumes (PAV) Multiple Allegiance I/O priority queuing Sequential operations read Sequential detection Software setting Sequential operations write CKD server view of ESS ESCON attached CKD server view of ESS FICON attached CKD server view of ESS CKD logical subsystem /8/16 logical control unit images per ESS Emulation of 9390/3990-6, , TPF SCSI server view of ESS FB logical subsystem SCSI attachment /8/16 logical subsystems per ESS SCSI ports per ESS Fibre Channel server view of ESS FB logical subsystem Fibre Channel attachment /8/16 logical subsystems per LSS Fibre Channel ports per ESS iseries Single level storage iseries storage management ESS availability features Fault tolerant subsystem Planned failover/failback Sparing Sparing in a RAID rank Spare capacity Array spare considerations Replacement DDM is new spare Cluster operation: failover/failback Normal operation before failover Failover Failback Maintenance strategy Call Home and Remote Support SSR dispatch Concurrent maintenance Concurrent logic maintenance Concurrent power maintenance Chapter 4. Configuration Physical configuration Standard capacity physical configurations Logical configuration Standard logical configurations The 2105 F10/F20 racks The 2105 Expansion Enclosure Mixing with racks v

8 4.5.1 Maximum configuration support Migration considerations Physical configuration Host adapters Cache Device adapters DA SSA loop configuration Standard configurations Step ahead configurations RAID-5 implementation JBOD implementation JBOD versus RAID-5 considerations Base and Expansion Enclosure loop configuration F20 upgrade with 8-packs Expansion Enclosure upgrade with 8-Packs The IBM TotalStorage ESS Specialist ESS Specialist configuration panels Standard logical configurations IBM TotalStorage ESS Specialist setup Web browser ESSNet User local-area network Physical setup ESS logical configuration Logical configuration process Defining logical subsystems CKD logical subsystems FB logical subsystems Disk groups ranks Configuring CKD ranks CKD interleaved partitions CKD non-interleaved partitions Defining interleaved volumes with ESS Specialist Configuring FB ranks Rank capacities Assigning logical volumes to a rank Configuring SCSI and Fibre Channel host adapters Configuring ESCON and FICON host adapters Defining FB logical devices Defining CKD logical devices Configuring CKD base/aliases LSS/ranks configuration example SCSI host connectivity Single host connection SCSI connection for availability Multi-connection without redundancy Daisy-chaining host SCSI adapters Fibre Channel host connectivity Fibre Channel topologies Fibre Channel connection for availability ESCON host connectivity ESCON control unit images ESCON logical paths establishment vi IBM Enterprise Storage Server

9 Calculating ESCON logical paths FICON host connectivity FICON control unit images FICON logical path establishment Calculating FICON logical paths ESCON and FICON connectivity intermix Standard logical configurations Chapter 5. Performance Performance accelerators Parallel Access Volume (PAV) Traditional z/os behavior Parallel I/O capability Benefits of Parallel Access Volume PAV base and alias addresses PAV tuning Configuring PAVs Querying PAVs PAV assignment WLM support for dynamic PAVs Reassignment of a PAV alias Mixing PAV types PAV support Multiple Allegiance Parallel I/O capability Eligible I/Os for parallel access Software support Benefits of Multiple Allegiance Priority I/O queuing Queuing of channel programs Priority queuing Efficient I/O operations z/os enhanced CCWs SCSI command tag queuing Custom volumes Caching algorithms Optimized cache usage Sequential pre-fetch I/O requests Backend high performance design Serial Storage Architecture (SSA) ESS striping RISC SMP processor FICON host adapters FICON benefits FICON I/O operation FICON benefits at your installation High performance disk drives Configuring for performance Host adapters RAID ranks JBOD Cache Logical volumes vii

10 5.13 Measurement tools RMF IBM TotalStorage ESS Expert Chapter 6. Copy functions Copy Services functions ESS Copy Services overview Web interface Command Line Interface (CLI) The Web interface Client/server setup ESS Copy Services panels Command Line Interface (CLI) FlashCopy Operation Consistency Invocation of FlashCopy zseries environments Open systems environments Concurrent Copy Concurrent Copy process Concurrent Copy on the ESS Concurrent Copy and FlashCopy Peer-to-Peer Remote Copy PPRC overview PPRC volume states The PPRC critical attribute Invocation of PPRC zseries environments Open systems environments PPRC Implementation on the ESS ESCON links PPRC logical paths Extended Remote Copy (XRC) Overview XRC Implementation on the ESS Support of XRC version 2 functions Support of XRC version 3 functions ESS XRC FICON support Invocation and management of XRC iseries 400 use of ESS copy functions The Load Source Unit (LSU) Mirrored internal DASD support LSU mirroring FlashCopy PPRC Geographically Dispersed Parallel Sysplex (GDPS) Combination of copy services Priced Copy Services features Chapter 7. Software support zseries environment support z/os support viii IBM Enterprise Storage Server

11 7.2.1 Transparency support Toleration support Exploitation support Other related support products z/vm support Exploitation of ESS functions VSE/ESA support VSE/ESA support level Exploitation of ESS functions TPF support Control unit emulation mode Multi Path Locking Facility TPF support levels Open systems support Compaq AlphaServer platforms Data General AViiON platforms Hewlett Packard platforms Intel based PC servers Sun Microsystems platforms IBM RS/6000, RS/6000 SP and pseries IBM iseries 400 and AS/ IBM NUMA-Q platforms FICON support z/os and OS/ z/vm and VM/ESA VSE/ESA TPF IBM TotalStorage ESS Specialist IBM TotalStorage ESS Expert AIX Windows Client access to the ESS Expert Peer-to-Peer Remote Copy (PPRC) Open systems environments zseries environments FlashCopy support zseries environments Open systems environments Command Line Interface (CLI) Subsystem Device Driver (SDD) GDPS Software Enterprise DB2 split mirror Chapter 8. Installation planning Major planning steps ESS installation planning ESS planning steps ESS pre-installation steps Physical installation ESS configuration steps ix

12 Chapter 9. Migration Defining and connecting the system Data migration in z/os environments Defining and initializing the volumes Migration considerations Migration methods Moving data in z/vm and VSE/ESA Data migration in UNIX environments Migration methods attachment Migrating from SCSI to Fibre Channel Migration procedures Migrating from SDG to Fibre Channel Migrating from ESCON to FICON IBM migration services Appendix A. IBM TotalStorage ESS Expert A.1 Asset management A.2 Capacity management A.3 Performance management Appendix B. Subsystem Device Driver (SSD) Appendix C. Split mirror backup C.1 Log write suspend C.2 Split-mirror backup Appendix D. Implementing disaster recovery D.1 Preliminary questions D.2 Remote copy technologies positioning D.2.1 XRC solution profile D.2.2 PPRC solution profile D.2.3 Recovery environment profiles D.3 Implementing a disaster/recovery solution D.4 The distance factor D.4.1 Distance extension technics D.4.2 Considerations on the distance factor D.5 Combination of copy services D.5.1 Point-in-time remote copy: FlashCopy + PPRC D.5.2 Intermediate site remote copy Appendix E. Feature codes E.1 ESS models E.2 Standard configurations E.2.1 Standard capacity configurations E.3 Step Ahead configurations E.4 Major feature codes E.4.1 Cache sizes E.4.2 Host adapters E.5 Advanced functions E.5.1 PAV and XRC E.5.2 PPRC and FlashCopy E.6 Additional feature codes E.6.1 Specify features x IBM Enterprise Storage Server

13 E.6.2 Special feature codes Appendix F. Related publications F.1 IBM Redbooks F.2 Other resources F.3 Referenced Web sites F.4 How to get IBM Redbooks F.4.1 IBM Redbooks collections Appendix G. Special notices Glossary List of abbreviations Index xi

14 xii IBM Enterprise Storage Server

15 Figures 1. Authors: Daniel Leplaideur, Alcino Bras, Jason Galang, Gustavo Castets... xix 2. IBM s Seascape Enterprise Storage Server ESS for storage consolidation Enterprise Storage Server capabilities Disaster recovery and availability Storage Area Network (SAN) ESCON and FICON attachment terminology SCSI and Fibre Channel attachment terminology IBM Enterprise Storage Server overview ESS models Photograph of the ESS (with front covers removed) ESS major components ESS cages ESS disks ESS RISC processors ESS device adapters SSA loops ESS host adapters Host adapters ESCON Host adapters SCSI Host adapters Fibre Channel Host adapters FICON Fiber distances ESS other interfaces ESS power supplies Overview Rank (array) types Rank RAID operation Device adapters and logical subsystems Logical subsystem (LSS) Host mapping to logical subsystem Architecture addressing characteristics ESS FB implementation for SCSI and FCP ESS CKD implementation for ESCON and FICON Data flow host adapters Data flow read Data flow write Cache and read operations NVS and write operations S/390 and z/os I/O accelerators Sequential operations read Sequential operations write CKD servers view of ESS Logical subsystem CKD SCSI-parallel view of ESS Logical subsystem SCSI FCP view of ESS Logical subsystem FCP ESS availability features Sparing Copyright IBM Corp xiii

16 51. Normal operation of cluster before failover Failover of cluster 1 onto cluster Failback ESS maintenance strategy Concurrent logic maintenance Concurrent power maintenance Configuration process Physical configuration options Logical configuration options F10 and F20 racks ESS Expansion Enclosure rack ESS with racks Block diagram of an ESS DA-Pair ESS loop configuration pack configuration 2105-F20 with Expansion Enclosure ESS Specialist Storage Allocation panel ESS Specialist setup Logical configuration terminology Logical configuration process Logical subsystem mapping ESS Specialist Configure LCU panel Disk groups and RAID ranks initial setup ESS Specialist Configure CKD Disk Group panel CKD interleaved and non-interleaved partitions ESS Specialist - Fixed Block Storage panel iseries 400 logical volumes per rank Fibre Channel adapter Configure Host Adapter Ports panel FICON connection FB logical device mapping for SCSI attached host FB logical device mapping for Fibre Channel attached host CKD logical device mapping LSS ranks assignment SCSI connectivity SCSI daisy-chain Fibre Channel connectivity ESCON connectivity example Establishment of logical paths for ESCON attachment FICON connectivity Establishment of logical paths for FICON attachment FICON connectivity example Over-defined paths system message ESS performance accelerators Traditional z/os behavior Parallel I/O capability using PAV Parallel Access Volumes (PAV) Potential performance impact of PAV PAV base and alias addresses PAV tuning Modify PAV Assignments panel Querying PAVs Assignment of alias addresses Dynamic PAVs in a sysplex Reassignment of dynamic PAV aliases xiv IBM Enterprise Storage Server

17 104.Activation of dynamic alias tuning for the WLM No mixing of PAV types ESS support modes Parallel I/O capability with Multiple Allegiance Multiple Allegiance Benefits of MA for mixing workloads I/O queueing Priority I/O Queuing CKD custom volumes RAID-5 logical volume striping RISC SMP processors ESCON cache hit I/O operation sequence ESCON cache miss I/O operation sequence FICON cache hit I/O operation sequence FICON cache miss I/O operation sequence IBM Ultrastar disk drive Performance measurement tools How Expert communicates with ESS IBM TotalStorage ESS Expert report matrix ESS Expert reported components ESS advanced copy functions ESS Copy Services server and clients ESS Copy Services Welcome menu ESS Copy Services - Volumes panel ESS Copy Services - Storage Servers panel ESS Copy Services - Paths panel ESS Copy Services - Task introduction panel FlashCopy Concurrent Copy ESS synchronous volume copy - PPRC PPRC improvements with ESS PPRC volume states PPRC configuration options with ESS PPRC links PPRC logical paths Extended Remote Copy (XRC) XRC implementation on the ESS ESS XRC unplanned outage support CXRC performance and scalability ESS/XRC FICON support iSeries and ESS PPRC implementation Advanced Copy Services combinations VM support overview Installation/implementation planning Planning considerations Preparation for zseries data migration UNIX data migration methods ESS and SAN Data Gateway setup ESS configuration with ESCON adapters Interim configuration with ESCON and FICON intermix Target FICON ESS migration configuration Subsystem Device Driver (SDD) ESS split mirror backup xv

18 157.Positioning GDPS/PPRC and GDPS/XRC Business continuance objectives Choosing a technology: synchronous versus asynchronous Methods of distance extension Distance options with fiber IBM XRC telecommunication distance Disk mirroring (ESCON) two solutions ESS PPRC + FlashCopy Remote copy with intermediate site in z/series environment Site 1 to site 1a connectivity PPRC/XRC failure processing xvi IBM Enterprise Storage Server

19 Tables 1. Rank capacities Open systems FB ranks available capacity CKD ranks available capacities CKD logical device capacities Processor and ESS PSP buckets for z/os and S/390 FICON support Processor PSP buckets for z/vm and VM/ESA FICON support Processor PSP buckets for z/vm and VSE/ESA FICON support Web browsers supported by ESS Specialist Standard capacity configurations (gigabytes)) Raid-5 array capacities (gigabytes) Step Ahead capacity increments (gigabytes) ESS cache capacities (gigabytes) ESS host adapters SCSI cables feature codes PAV and XRC feature codes PPRC and FlashCopy feature codes Copyright IBM Corp xvii

20 xviii IBM Enterprise Storage Server

21 Preface This IBM Redbook describes the Enterprise Storage Server (ESS), its design characteristics and advanced functions. This book will be useful for those who need to know the general characteristics of this powerful disk storage server, and also for those who need a more detailed understanding of how the ESS is designed and operates. This redbook describes, in detail, the architecture, hardware, and advanced functions of the Enterprise Storage Server. It covers Fibre Channel and FICON attachment. The information will help the IT Specialist in the field to understand the ESS, its components, its overall design, and how all of this works together. This understanding will be useful for proper planning and the logical configuration at the time of installation. The IT Specialist will find useful information when availability and disaster recovery solutions are to be implemented, with the explanation of the advanced copy functions that ESS has available: FlashCopy, Peer-to-Peer Remote Copy, Extended Remote Copy, and Concurrent Copy. Also the performance features of the ESS are explained, making all of these topics very helpful for the IT Specialist for the optimization of resources in the computing center. This book has been updated to support the announcement and general availability of the new Fibre Channel/FICON host adapters. Also, it has been updated to the ESS models F10 and F20, and to generally all that has been available since the initial announcement of Enterprise Storage Server. The team that wrote this redbook This redbook was produced by a team of specialists from around the world working at the International Technical Support Organization San Jose Center. Figure 1. Authors: Daniel Leplaideur, Alcino Bras, Jason Galang, Gustavo Castets Gustavo A. Castets is a Project Leader for Disk Storage Systems at the International Technical Support Organization, San Jose Center. Gustavo has worked for IBM for 22 years in many IT areas. Before joining the ITSO, Gustavo worked in Buenos Aires, Argentina, as a Storage Specialist. Copyright IBM Corp xix

22 Daniel Leplaideur joined IBM France in 1967 as Mathematician and Statistician to develop scientific subsystems and software packages. He has been a Systems Engineer in networking and large systems in the services, branch offices, and field support centers. He is now with the European Mainz Advanced Technical Support for ESS and Disaster Recovery. His job mainly deals with defining and implementing solutions for various complex environments. Jose Alcino Bras is a Certified IT Specialist from IBM Brazil. He has 30 years of experience in IT technical business, of which the last six years were spent on storage solutions. He started as a Customer Engineer and then was a Systems Engineer working on large accounts. He has practical experience in all IBM disk and tape storage products. He is now working for the Advanced Technical Support (ATS) organization. Jason Galang joined IBM Philippines in 1989 as an IT Specialist for both AS/400 and RS/6000. He has been doing country pre-sales technical support for AS/400 since 1995, and in 1999 he included the technical support for the RS/6000. Working in the RS/6000 environment he gained experience in storage solutions, mainly the ESS and its advanced functions. The authors of previous editions of this book are: Alison Pate, IBM UK Cay-Uwe Kulzer, IBM Germany Phil Norman, IBM UK Roland Wolf, IBM Germany Thanks to the following people for their invaluable contributions to this project: Eneo Baborsky, IBM Italy Marg Beal, IBM Poughkeepsie Michael Benhase, IBM Tucson Helen Burton, IBM Tucson Henry Caudillo, IBM San Jose Jerry Coale, IBM San Jose Paul Coles, IBM UK Arturo Dana Anello, IBM Argentina Omar Escola, IBM Argentina Amine Hajji, IBM San Jose Nick Harris, ITSO Rochester Rowell Hernandez, IBM ITSO Almaden Lee La Frese, IBM Tucson Phillip Mills, IBM San Jose Phil Norman, IBM UK Alison Pate, IBM UK John Ponder, IBM Tucson Dave Reeve, IBM UK Bill Worthington, IBM San Jose xx IBM Enterprise Storage Server

23 Comments welcome Your comments are important to us! We want our IBM Redbooks to be as helpful as possible. Send us your comments about this or other Redbooks in one of the following ways: Use the online Contact us review redbook form found at: ibm.com/redbooks Send your comments in an Internet note to: Mail your comments to the address on page ii. xxi

24 xxii IBM Enterprise Storage Server

25 Chapter 1. Introduction Powerful SeaScape Implementation RAID 5 or Non-RAID Fast SSA Drives Fast RISC Processors Fault Tolerant System ms ESS Storage Sharing: all IBM eseries, and non-ibm servers zseries Parallel I/O Instant Copy Solutions Disaster Recovery Solutions High Capacity Storage Subsystem - up to 11 TB Figure 2. IBM s Seascape Enterprise Storage Server The Enterprise Storage Server (ESS) is IBM s most powerful disk storage server developed using IBM s Seascape architecture. The ESS provides un-matchable functions for all the e-business servers of the new IBM server brand, and also for the non-ibm open servers. Across all of these environments the ESS features unique capabilities that allow it to meet the most demanding requirements of performance, capacity and availability that the computing business may require. The Seascape architecture is the key to the development of IBM s storage products. Seascape allows IBM to take the best of the technologies developed by the many IBM laboratories and integrate them producing flexible and upgradeable storage solutions. The Magstar Tape drives, the Magstar Virtual Tape Server, the award-winning Ultrastar disk drives, the Serial Interconnect technology, the 160 MB/sec. SSA adapters, Fibre Channel connectivity and the most recent FICON connectivity for the IBM ~ zseries servers, all of these are examples of the tremendous versatility of the Seascape architecture. e-business continues to drive storage at an ever-increasing rate. e-commerce applications are deployed on heterogeneous servers and require high-function, high-performance and scalable storage servers to meet the demanding requirements of Enterprise Resource Planning and Business Intelligence applications. The IBM Enterprise Storage Server (ESS) has set new standards in function, performance, and scalability in these most challenging environments and is now enhanced to provide: Direct connection to Storage Area Networks (SANs) Advanced storage management functions which provide fast data duplication and high-performance backup and disaster recovery capability. Copyright IBM Corp

26 The Enterprise Storage Servers Models F10 and F20 Since its initial availability with the Models E10 and E20, the ESS is the storage server solution that offers exceptional performance, extraordinary capacity scalability, heterogeneous server connectivity, and an extensive suite of advanced functions to support customers mission-critical, high-availability, multiplatform environments. The ESS set a new standard for storage servers back in 1999 when it was first available, and since then it kept up with the pace of customers needs, adding more sophisticated functions to the initial set, increasing the connectivity options, and powering its performance features. The Enterprise Storage Server Models F10 and F20 provide significantly improved levels of performance, throughput, and scalability while continuing to exploit performance innovations introduced with the Models E10 and E20, such as Parallel Access Volumes, Multiple Allegiance, and I/O Priority Queueing. These models are also supporting the introduction of many new enhancements that are dramatically improving the overall value of ESS in the marketplace and provide a strong base for strategic Storage Area Network initiatives. Among those enhancements are the new FICON and the new Fibre Channel long and shortwave attachment capabilities of the ESS. Additional enhancements include new levels of granularity for installed systems, remote copy services capabilities with synchronous and asynchronous options, and more cache options. Additional PCI buses, faster state-of-the-art IBM RISC microprocessors, plus up to 32 GB of cache memory all combine to provide unprecedented levels of performance and throughput for the F models. The increased bandwidth capabilities of the Models F10 and F20 allow for up to 100% greater throughput for sequential workloads, or 25% greater throughput for database workloads. This allows customers to install % larger configurations in the Model F20 than were previously possible with the Model E20, depending on access density and the nature of the workload, while maintaining industry leading performance. With these capabilities, the ESS is perfectly suited to enable customers to take advantage of the promise of SAN, while protecting the significant investments already made in storage and I/T infrastructures. The Seascape design of the ESS has allowed customers to transition from the initial E Models to the more recent F Models and its associated features. Customers investment has been protected, and the upgrades to keep technologically current have been non-traumatic, because of the Seascape design of the ESS. And so it will go on, for future innovations. 2 IBM Enterprise Storage Server