Virtual I/O Server - Shared Storage Pools (Phase 2)

Transcription

1 Common Tagung, 9. Mai 2012 Virtual I/O Server - Shared Storage Pools (Phase 2) René Akeret IBM Switzerland 2012 IBM Corporation

2 Agenda 1 PowerVM Editions 2 Cluster Aware AIX (CAA) 3 Shared Storage Pools (SSP) 4 Summary Common Tagung, 9. Mai IBM Corporation

3 PowerVM Editions PowerVM Editions Express Standard Enterprise Concurrent VMs 2 per server 10 per core (up to 1000) 10 per core (up to 1000) Virtual I/O Server NPIV Suspend/Resume Shared Processor Pools Live Partition Mobility Active Memory Sharing Shared Storage Pools (Phase 2) Active Memory De-duplication** Network Balancing Live Partition Mobility Performance Improvements ** Requires POWER7 System with efw7.4 Q Features Common Tagung, 9. Mai IBM Corporation

4 New PowerVM Features 4Q 2011 Feature Shared Storage Pools Function Creates pools of storage that can be used by virtualized workloads. This facility enables key functions like linked clones, snapshot / rollback and storage mobility. Benefit Improves storage utilization, reduces storage infrastructure costs, decreases time to provision new VMs and reduces administration costs. Active Memory De-duplication Network Balancing Live Partition Mobility Performance Improvements Detects and removes duplicate memory pages in Active Memory Sharing configurations. Network traffic is balanced across multiple shared Ethernet adapters in HA environments Improvements in network components and this doubles the number of data movers from 8 to 16. Optimizes physical memory usage for s in Active Memory Sharing configurations. Allows more partitions to fit on a system if memory is constrained. Improved utilization of shared Ethernet adapters in HA environments and better performance. Allows Live Partition Mobility to operate faster which enables quicker system evacuation for maintenance activities. Common Tagung, 9. Mai IBM Corporation

5 New features requiring FW 7.4 Firmware 7.4 Is required for new selected Power enhancements Is available only new on MTM 710 / 730: E1C & E2C 720 / 740: E4C & E6C 770 / 780: MMC & MHC No FW 7.4 support for older Power Systems Product Feature Express Standard Enterprise Requires EFW 7.4 PowerVM: Active Memory De-duplication PowerSC: Trusted Boot -- Common Tagung, 9. Mai IBM Corporation

6 PowerSC Editions PowerSC Express Basic compliance for AIX PowerSC Standard Security and compliance for virtual & cloud environments PowerSC Editions Express Standard Security and Compliance Automation Trusted Logging Trusted Boot** Trusted Network Connect and Patch Management ** Requires POWER7 System with efw7.4 Common Tagung, 9. Mai IBM Corporation

7 Agenda 1 PowerVM Editions 2 Cluster Aware AIX (CAA) 3 Shared Storage Pools (SSP) 4 Summary Common Tagung, 9. Mai IBM Corporation

8 Cluster Aware AIX (CAA) Exploiters DB2 IBM Director RSCT Consumers TSA HMC IBM Storage HPC PowerHA System Mirror Legacy RSCT Bundled Resource Managers RSCT With Cluster Aware AIX Bundled Resource Managers Group Services Resource Mgr Services Group Services Resource Mgr Services Messaging API Monitoring API Cluster Admin UI Messaging API Monitoring API Cluster Admin UI Cluster Messaging Cluster Monitoring Cluster CFG Repository Redesigned Cluster Layers Integrated Cluster to CAA Cluster Capabilities CFG Messaging Monitoring Repository Legacy AIX Cluster Repository Cluster Aware AIX CAA APIs and UIs Cluster Monitoring Cluster Messaging Cluster Events RSCT and Cluster Aware AIX together provide the foundation of strategic Power Systems SW RSCT integration with CAA extends simplified cluster management along with optimized and robust cluster monitoring, failure detection, and recovery to RSCT exploiters on Power / AIX Common Tagung, 9. Mai IBM Corporation

9 Agenda 1 PowerVM Editions 2 Cluster Aware AIX (CAA) 3 Shared Storage Pools (SSP) 4 Summary Common Tagung, 9. Mai IBM Corporation

10 Storage Options Shared Storage Pool Whole local Disk & SAN LUN SAN LUN Logical Volume from VG Pool File backed from a file system Power HyperVisor NPIV LUN NPIV over vfc vscsi Common Tagung, 9. Mai IBM Corporation

11 Extending Integrated Storage Virtualization Beyond a Single System PowerVM PowerVM with Shared Storage Pools Power HyperVisor Power HyperVisor Power HyperVisor Power HyperVisor Power HyperVisor Power HyperVisor Storage Pool Storage Pool Storage Pool Shared Storage Pool SAN SAN Predominant PowerVM usage model today High value extension of today s model Common Tagung, 9. Mai IBM Corporation

12 Shared Storage Pool Clustering Model nodes are joined together to form a cluster Ethernet All nodes see all disks for storage pools they access All nodes are eligible to read and write user data via the SAN Power HyperVisor Power HyperVisor Power HyperVisor One or more nodes are meta-data managers for sub-units of each storage pool Shared Storage Pool Non managers communicate meta-data access and update via the ethernet SAN Cluster-wide concurrent access to namespace and data available from any node LUN LUN LUN Based on Cluster Aware AIX (CAA), SF-Store and RSCT functions Common Tagung, 9. Mai IBM Corporation

13 Shared Storage Pool Motivation Simplify the aggregation of large numbers of disks Better utilize on a percentage basis the available storage Simplify administration /pool1/vdev1: /pool1/vdev2: A set of one or more disks managed as a block of storage that multiple file systems can reside within Managed as one entity with disks entering, leaving, and being managed thru a simplified set of commands File systems share this common storage pool unit Better storage utilization than the traditional dedicated storage that a (perhaps improperly sized) file system would necessitate Notion of a file system quota (follow-on) Shared Storage Pool Addressable on the thru a directory namespace rooted at /<poolname> Common Tagung, 9. Mai IBM Corporation

14 Thin or Thick Provisioning Motivation Storage utilization A Client vscsi device can be presented as a thinly or thickly partitioned device Power HyperVisor Thin provisioned device May present a much larger image than the current actual physical use Not fully backed by physical storage if the blocks are not in actual use Thin Thick Thick provisioned device Fully backed by physical storage no matter what the actual usage Storage Pool Common Tagung, 9. Mai IBM Corporation

15 Snapshots on VM disks and Cloning Persistently saved snapshot of a point in time, rollback to prior snapshot #1 #2 Consistency group snapshots Sub-second creation No practical limit on the number of snapshots that can be persisted Basis for: Capture / deploy Disaster Recovery Consolidated Backup / Restore Block virtualization /pool1/vdev1.0 /pool1/vdev1.1 /pool1/vdev1.2 Common Tagung, 9. Mai IBM Corporation

16 Live Storage Mobility Storage Mobility is a new function that allows data to be moved to new storage devices within Shared Storage Pools. Virtual machines remain completely active and available. This ability to move data to new devices can improve performance and allow for the retirement of old storage devices without incurring any application outages. Examples: Move I/O to newly acquired disk subsystem More evenly spread I/O load across devices Move the data to a different location (remote site) Remove data from retiring subsystem Common Tagung, 9. Mai IBM Corporation

17 Live Storage Mobility (Replace Disk) Neat IBM Ugly other vendor Fibre Channel Power HyperVisor Power HyperVisor Power HyperVisor vscsi vscsi vscsi Common Tagung, 9. Mai IBM Corporation

18 Live Storage Mobility (Disk Space Move)* Storage Pool A Mirror Blocks Storage Pool B Move Blocks Fibre Channel Power HyperVisor Power HyperVisor Power HyperVisor vscsi vscsi vscsi *Not on Phase 2 Common Tagung, 9. Mai IBM Corporation

19 Shared Storage Pool Requirements Platforms: POWER6 & POWER7 only (includes Power Blades) Storage Pool (minimums): Direct fibre-channel attached LUNs: 1 for repository ~10 GB 1 or more for data, 10 GB in practice lots more [like 1TB+] Pool Storage Redundancy: Repository & pool storage must be RAIDed name resolution to resolve hostnames Virtual I/O Server(s): Minimum CPU: 1 (shared, uncapped is good) Minimum Memory: 4 GB Read the Release Notes Common Tagung, 9. Mai IBM Corporation

20 Shared Storage Pool Limits (Phase 2) Max nodes: Max physical disks in a pool: 256 Max virtual disks (LUs) in a cluster: 1024 Number of Client s per 1 to 40 (that is, 40 clients per, or 40 clients per pair) 4 nodes Storage Pool Storage Pool Capacity of Physical Disks in Pool (each) Storage Capacity of Storage Pool (total) Capacity of each Virtual Disk (LU) in Pool Number of Repository Disks 5GB to 4TB 10GB to 128TB 1GB to 4TB 1 to 1 (CAA limit) Common Tagung, 9. Mai IBM Corporation

21 Shared Storage Pools Dedicated Virtual Device Shared Pool Virtual Devices Dedicated Virtual Device Power HyperVisor Power HyperVisor block virtualization block virtualization /bar/l1: /foo/f1: /bar/f2: SFStore Meta-Data /foo/f3: /bar/f4: /bar/l2: Dedicated LUN ** **Not currently supported Store Shared Pool Store Storage Pool Dedicated LUN ** Common Tagung, 9. Mai IBM Corporation

22 User Interface Command line Some feature will remain command line only like: cluster create cfgassist This is the version of smitty Menu driven interface for CLI Fully covers SSP functions Graphical User Interface HMC (V7 R7.4) System Director - Future release Already has Storage Pools concept and features Shared Storage Pool is just another storage pool type Then may adds new unique items like VMControl appliance deploy to SSP disk space or cloning Common Tagung, 9. Mai IBM Corporation

23 Agenda 1 PowerVM Editions 2 Cluster Aware AIX (CAA) 3 Shared Storage Pools (SSP) 4 Summary Common Tagung, 9. Mai IBM Corporation

24 Shared Storage Pools transforming the datacenter Dynamic Flexibility All operations online Improved utilization Thin Provisioning Greater utilization percentage LifeCycle Management (first time power is applied to the server s retirement) Image Management: capture, deploy Agility (linked-clones) Provisioning time Location transparency Availability Backup / Restore & Disaster Recovery Common Tagung, 9. Mai IBM Corporation

25 Technical Information Announcement letter CA&htmlfid=897/ENUS &appname=USN Release notes User Guide p7hb1.pdf Technical Hands-On Movies Common Tagung, 9. Mai IBM Corporation

26 René Akeret IBM Switzerland Common Tagung, 9. Mai IBM Corporation

27 Cluster Aware AIX (CAA) What is it? A set of services/tools embedded in AIX to help manage a cluster of AIX nodes and/or help run cluster software on AIX IBM cluster products (including RSCT, PowerHA, and the ) will use and/or call CAA services/tools. CAA services can assist in the management and monitoring of an arbitrary set of nodes and/or running a third-party cluster. CAA does not form a cluster by itself. It is a tool set. There is no notion of quorum. (If 20 nodes of a 21 node cluster are down, CAA still runs on the remaining node). CAA does not eject nodes from a cluster. CAA provides tools to fence a node but never fences a node and will continue to run on a fenced node. Common Tagung, 9. Mai IBM Corporation

28 Cluster Aware AIX (CAA) and RSCT Common Tagung, 9. Mai IBM Corporation

29 Shared Storage Pools (SSP) SSP is a server based storage virtualizer that is clustered across multiple Power servers It s an extension of PowerVM s existing storage virtualization ( vscsi) Combines existing SCSI emulation with clustering technology and a distributed data object repository Distributed data object repository is an advanced filesystem-like function developed specifically for storage virtualization SSP provides the same standard vscsi Target interface to client host Common Tagung, 9. Mai IBM Corporation

30 Why Shared Storage Pools? Fibre-Channel LUN & NPIV is complex SAN switch, SAN disk subsystem = hard work & weird GUI!! Typical LUN lead time: 4 minutes, 4 hours, 4 days, 4 weeks? With rapidly changing needs with mandatory responsiveness it is simply not good enough! Many smaller computer rooms have no dedicated SAN guy LPM hard work as most people don t pre-zone the target so have to Zone before the move = complexity, slow, error prone LPM = zero outage for Hardware & Firmware upgrades Shared Storage Pool Allocate LUNs to the Virtual I/O Servers once One command to allocate space to a VM Or use: cfgassist ( s smitty) Or use: HMC Virtual Storage Management GUI LPM any time you like Common Tagung, 9. Mai IBM Corporation

31 Shared Storage Pool Configuration (Phase 2) Feature Number of Nodes in Cluster Number of Physical Disks in Pool Number of Virtual Disks (LUs) Mappings in Pool Number of Client s per node Capacity of Physical Disks in Pool Storage Capacity of Storage Pool Capacity of a Virtual Disk (LU) in Pool Number of Repository Disks Min GB 10GB 1GB 1 Max TB 128TB 4TB 1 Common Tagung, 9. Mai IBM Corporation

32 Shared Storage Pool Software Stack Common Tagung, 9. Mai IBM Corporation

33 IBM Systems Director offers end-to-end platform management IBM Systems Director Editions Other Systems Management Software Enterprise Service Management Integrated Service Management VMControl Active Energy Manager Network Control Transition Mgr for HP SIM $$ BOFM Service & Support Manager VMControl Image Manager WPAR Manager Additional Plug-Ins Configuration Storage Control Advanced Managers & Priced Plug-Ins Automation Status Virtualization Discovery Update Remote Access Core Director Services Configuration System x & Blade Center System z Power Systems Storage Configuration Base Systems Director Managers & Hardware Platform Managers Resource Management Managed virtual and physical environments Hardware IBM and non-ibm hardware Common Tagung, 9. Mai IBM Corporation