IBM i PowerVM Virtualization 7.1 Update Gottfried Schimunek Senior IT Architect Application Design IBM STG Software Development Lab Services IBM ISV Enablement 3605 Highway 52 North Rochester, MN 55901 Tel 507-253-2367 Fax 845-491-2347 Gottfried@us.ibm.com Acknowlegements Thanks to Kris Whitney for providing this comprehensive and detailed presentation 2 1
IBM s History of Virtualization Leadership A 40+ year tradition continues with PowerVM and VM Control TM 1967 1973 1987 1999 2004 2007 2008 2009 IBM develops hypervisor that would become VM on the mainframe IBM announces first machines to do physical partitioning IBM announces LPAR on the mainframe IBM announces LPAR on POWER IBM intro s POWER Hypervisor for System p and System i IBM announces POWER6 Live Partition Mobility IBM announces PowerVM 3 PowerVM: Virtualization Without Limits Sold with more than 70% of Power Systems Improves IT resource utilization Reduces IT infrastructure costs Simplifies management 4 2
PowerVM Technologies The leading virtualization platform for UNIX, i and Linux enables a more agile and responsive infrastructure Hypervisor Support for multiple operating environments Dynamic Logical Partitioning Micro-partitioning, resource movement Multiple Shared Processor Pools Cap processor resources for a group of partitions Virtual I/O Server Virtualizes resources for client partitions Integrated Virtualization Manager Simplifies partition management for entry systems Lx86 Supports x86 Linux applications Live Partition Mobility Move running AIX and Linux partitions System Planning Tool Simplifies the planning for and installation of Power servers with PowerVM Power Hypervisor 5 PowerVM Editions: Built to Meet Client Virtualization Needs PowerVM Editions Express Standard Enterprise PowerVM Express Edition Evaluations, pilots, PoCs Single-server projects PowerVM Standard Edition Production deployments Server consolidation PowerVM Enterprise Edition Multi-server deployments Cloud infrastructure Maximum LPARs Management Virtual I/O Server PowerVM Lx86 Multiple Shared Processor Pools Live Partition Mobility 1+2 / Server VMControl IVM 10 / Core VMControl IVM, HMC 10 / Core VMControl IVM, HMC Active Memory Sharing PowerVM Editions offer a unified virtualization solution for any Power workloads 6 3
IBM i Virtualization Strategy Increased utilization of Power Systems hardware. Create a flexible infrastructure to allow for dynamic change. Begin to manage pools of systems as one. 7 Evolution towards: Fully Virtualized, Simplified, Lower cost Physical resource discovery / configuration / provisioning / update / system health OS provisioning Virtual IO Virtual Machine lifecycle mgmt Dynamic resource optimization within a physical system VLAN External virtualized storage + Mobility of Virtual Machines + Manually intensive server/storage/network mobility management + VM-based Availability/Resilience Mgmt + Storage Pools + IO virtualization and virtual switching + Hypervisor clustered fs access to virtual storage SW SW OS OS Virtl NW Virt Storage VM/LPAR VM/LPAR Virtual IO Svr Virtualization Storage vswitch Network Compute Memory +Mobility of workloads with automated and integrated server, network & storage provisioning + Workload-based Availability/Resilience Mgmt + Converged Datacenter Network fabric + Storage Pools with advanced capabilities (cloning, snapshot, thin provisioning, ) + Managing to QoS Policies (intelligent placement) + VM Security Appliance Image Library Virtual Appliance Image Image App Deployment App Image App OS Image OS App OS OS External virtualized switches Shared Network Workload Mobility SW OS SW OS Virtl NW Shared Storage Virtual Server Virtual Server Virt Storage Virtual IO Svr SW OS Virtl NW 8 Compute Virtualization Memory Storage Network Established: Physical systems with local virtualization VM/LPAR Compute Memory Virtualization Virt Storage Virtual IO Svr vswitch Storage Network Maturing: Multi-system virtualization managed across Physical Servers 11/23/2011 Optimized for. Availability Performance Energy Emerging: Virtual Appliances & Workload mobility within scalable and centrally managed System Pools (Ensembles) 4
Stage 1 Flexible I/O Infrastructure Current Support with IBM i 6.1 VSCSI Virtual Tape Virtual Optical Virtual Disk VETH IBM i server and IVM Current Support with IBM i 6.1.1 NPIV MPIO SSD Enhancements Virtualization Management Enhancements 9 Two I/O Server Options IBM i IBM i Hypervisor POWER6 IBM i Hypervisor POWER6 Built into IBM i Host Disk and Optical Consolidate Ethernet Traffic Same technology as hosting AIX, Linux, and iscsi Server Host Disk and Optical Bridge Ethernet Traffic Attach external storage Advance Virtualization Functions 10 5
IBM i Hosting IBM i IBM i-based Virtualization IBM i partition uses I/O resources from another IBM i partition Eliminates requirement to buy adapters and disk drives for each IBM i partition Supports simple creation of additional partitions. e.g., for test and development Requires POWER6 server with IBM i 6.1 PowerVM not required Can mix virtual and direct I/O in client Platform support IBM POWER6 and POWER7 servers (except blade) Storage support Determined by host IBM i partition (SAN, EXP24, 12S, other integrated disk) LPAR management HMC IBM i IBM i Hypervisor POWER6 * All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. 11 IBM i Host and Client Partitions: Overview FC 5294 EXP24/12S DS8000 NWSSTGs OPTxx IVE IBM i Host DVD DDxx Virtual SCSI connection Virtual LAN connection IBM i Client OPTxx CMNxx DDxx DVD Requirements POWER6 hardware IBM i 6.1 on host and client PowerVM not required HMC DASD Hardware assigned to host LPAR in HMC DASD can be integrated or SAN DASD virtualized as NWSSTG objects Optical DVD drive in host LPAR virtualized directly (OPTxx) Optical IMGCLG in host LPAR may be virtualized Networking Network adapter (such as IVE) and Virtual Ethernet adapter in host LPAR Virtual Ethernet adapter in client LPAR 12 6
IBM i Host VSCSI Virtual Optical -Load images into the IMGCLG on the Server. - Share the physical DVD/CD in the Server -Utilize them to install or save to in the Client. -Automatic switching of images 13 IBM or BP image or Physical media Ripping tool Current (v6.1, pre 4Q 09) supports loads of LPs, PTFs and data onto a v6.1 partition 4Q 09 upgrade/scratch ibm i v6.1.1 over existing 6.1 partition advantages OS install over LAN single copy of image breaks single CEC/PHYP limit requires: v6.1.1, phyp efw 3.5 and power 6 Electronic software distribution NFS image NFS image NFS Server (most any server except ) 2Q 10 support for ibm i v7.1 addition of power 7 4Q 10 scratch install of new partition requirements phyp efw 3.5 (or later) power 6 or power 7 HMC 7.7.2 (or later) or DPSM Power system ibm i v6.1 (CRTDEVOPT *SRVLAN) SAVSYS, SAVOBJ, SAVLICPGM 14 7
IBM i Hosting IBM i Positioning Same technology as IBM i hosting AIX, LINUX, and iscsi x86 servers Leverage existing hardware investment Create new IBM i 6.1 LPARs using only virtual hardware (No IOAs, IOPs, disk units, I/O slots necessary for client partitions), but may also use physical I/O. Rapidly deploy new workloads Virtual disk created with 1 command or several clicks in System i Navigator New LPAR, virtual resources deployed dynamically Create test environments without hardware provisioning Virtual resources allow new test environments of exact size to be created, deleted without moving hardware Test new applications, tools, fixes in virtual test LPAR Test the next release in the client partition IBM i IBM i Hypervisor POWER6 * All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. 15 -based Virtualization IBM i partition uses I/O resources from Virtual I/O Server () is included with all PowerVM Editions. Requires POWER6 systems with IBM i 6.1 Platform support IBM Power servers IBM BladeCenter JS12, JS22, JS23, JS43, PS701, PS702 Storage support Enables attachment to DS3000, DS4000, DS5000, SVC, XIV, DS8000 LPAR management HMC or IVM IBM i Hypervisor POWER6 Integrated Virtualization Manager Software for creating and managing partitions, part of Requires IBM i to use only virtual I/O resources 16 8
Virtual I/O Server () Disk IBM i -VSCSI disks are always 6B22-16 disks per virtual adapter -Thousands of virtual adapters DD001 (6B22) vtscsi1 hdisk1 (2107) DD002 DD003 (6B22) vtscsi2 vtscsi3 Storage Pool 1 hdisk2 (1815) hdisk2 hdisk3 (1815) (1815) hdisk3 (1815) hdisk4 (1815) hdisk4 (1815) -Flexible LUN sizes -Logical volume backed -File Backed DS8300 DS4800 17 Disk Virtualization with VSCSI 1 Use storage UI and Redbook for your environment to create LUNs for IBM i and attach to (or use TPC or SSPC where applicable) 512B open storage LUNs DS Storage Manager for DS3200, DS3400, DS4700, DS4800, DS5100, DS5300 DS8000 Storage Manager for DS8100 and DS8300 SVC Console for SVC XIV Storage GUI for XIV 18 9
Disk Virtualization with VSCSI 2 IBM i Use HMC to create one or more pair of VSCSI adapters VSCSI server in, VSCSI client in IBM i DLPAR-capable 19 Disk Virtualization with VSCSI 3 Use HMC to assign LUNs to IBM i LPAR (DLPAR-capable) 20 10
Virtualization Enhancements for IBM i 1. IBM i 6.1 partition can host IBM i 7.1 and 6.1 partitions AIX 5.2, 5.3, 6.1 and SLES and Red Hat Linux partitions iscsi attached System x and BladeCenter 1. IBM i 7.1 partition can host IBM i 7.1 and 6.1 partitions AIX 5.2, 5.3, 6.1 and SLES and Red Hat Linux partitions iscsi attached System x and BladeCenter 2. PowerVM can host IBM i 7.1 and 6.1 partitions AIX and Linux partitions supports advanced virtualization technologies including Active Memory Sharing and NPIV Storage Virtualization can reduce costs while improving IT infrastructure flexibility IBM i 6.1 IBM i 7.1 IBM i 7.1 IBM i 6.1 POWER6 & POWER7 IBM i 7.1 IBM i 6.1 POWER6 & POWER7 IBM i 7.1 IBM i 6.1 POWER6 & POWER7 21 VSCSI Virtual Optical IBM i -Support for Physical and File Backed Optical (FBO) Drives. OPT01 (632C) vtscsi1 OPT02 (632C) vtscsi2 Storage Pool 1 - Read Only images may be shared to multiple virtual optical drives concurrently. CD0 File Backed Images hdisk2 (1815) hdisk3 (1815) hdisk4 (1815) 22 11
Support for IBM Storage Systems with IBM i Table as of Feb 10, 2011 N Series @@ DS3200 DS3400 DS3500 DS3950 DS4700 DS4800 DS5020 Storwize V7000 DS5100 DS5300 DS6800 SVC XIV DS8100 DS8300 DS8700 DS8800 5.4 / 6.1 Rack / Tower Systems IBM i Version Hardware 5.4 / POWER5/6/7 NOT DS3200# DS3500## POWER5/6/7 Not 7.1 ### POWER5/6/7 5.4 / POWER5/6/7 5.4 / POWER5/6/7 IBM i Attach IFS/NFS (NAS) Direct* or Direct Direct or NPIV** Direct or NPIV** Power Blades IBM i Version Hardware IFS/NFS (NAS) @ (BCH) (BCH) Notes IBM i IFS/NFS n/a - This table Attach does not list (NAS) more detailed considerations, for example required levels of firmware or PTFs required or configuration performance NPIV** considerations NPIV** - POWER7 servers require IBM i 6.1 or later - This table can change over time as addition hardware/software capabilities/options are added # DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections ## DS3500 has either SAS or Fibre Channel connection. Ractk/Tower only uses Fibre Channel. Blades support either SAS or Fibre Channel ### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support * Supported with Smart Fibre Channel adapters NOT supported with IOP-based Fibre Channel adapters ** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches @ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500 @@ N Series can only be used as file server. No load source/boot support. Support only through IFS. No IBM i data base support (BCH) Not supported (BCH) (BCH) (BCH) (BCH) For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/ Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information 23 DS8300 Native, Through CPW Application Response Time (Milliseconds) 50 45 40 35 30 25 20 15 10 5 0 0 50000 100000 150000 200000 250000 Throughput (Transactions /Minute) DS8k native DS8k via Response Tim e (Milliseconds) CPW DB Disk Data Rate 12 10 8 6 4 2 0 0 50 100 150 200 Throughput (MB/Sec) Response Time (Milliseconds) CPW JO Disk Data Rate 2 1.8 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 0 0 20 40 60 80 100 Throughput (MB/Sec) DS8k native DS8k via DS8k native DS8k via 24 12
PowerVM Active Memory Sharing PowerVM Active Memory Sharing is an advanced memory virtualization technology which intelligently flows memory from one partition to another for increased utilization and flexibility of memory usage Memory virtualization enhancement for Power Systems Partitions share a pool of memory Memory dynamically allocated based on partition s workload demands Extends Power Systems Virtualization Leadership Capabilities not provided by Sun and HP virtualization offerings Designed for partitions with variable memory requirements Workloads that peak at different times across the partitions Active/inactive environments Test and Development environments Low average memory requirements Available with PowerVM Enterprise Edition Supports AIX 6.1, i 6.1, and SUSE Linux Enterprise Server 11 Partitions must use and shared processors POWER6 processor-based systems Memory Usage (GB) Memory Usage (GB) Memory Usage (GB) 15 10 5 0 15 10 5 0 15 10 5 0 Around the World Time Day and Night Time Infrequent Use Time Asia Americas Europe Night Day #10 #9 #8 #7 #6 #5 #4 #3 #2 #1 25 AMS Geographic Mirroring Environment SAS JS12 in BladeCenter DS3200 IBM i IBM i DS3200 DS3K BCS3B2P1 Paging Devices BCS3B2P2 BCS3B2P3 MEMORY 5 drive sysbas 5 drive sysbas 16 GB Total Physical Mem IBM i 1 12 GB IBM i 2 12 GB 10 drives IASP Geographic Mirroring 10 drives IASP 26 13
Virtual Tape with VSCSI + GAed 5/2009 IBM i 6.1 + ptfs LTO4, DAT72, DAT160 All BRMS and Save/Restore function available. Library support not available with VSCSI, must use NPIV Also supported on non-blade Power Systems 27 Fibre Channel Tape library support with NPIV + 28 10/2009 with 6.1.1 3584 (TS3500) with LTO drives 3573 (TS3100 TS3200) with LTO drives 2/2010 with 6.1.1 3577 (TS3400) with (TS1120/TS1130 ) drives 3584 (TS3500) with (TS1120/TS1130 ) drives 3576 (TS3310) with LTO drives TS7650, TS7610 14
SSD with Ability to share an array of SSDs among multiple partitions. With 6.1.1 IBM i will recognize the drive as SSD Also can be used as a shared memory pool paging device. IBM i DD001 (6B22 HDD) DD002 DD003 (6B22 SSD) vtscsi1 hdisk1 HDD vtscsi2 vtscsi3 Storage Pool 1 hdisk2 (SSD) hdisk3 (SSD) hdisk4 (SSD) 29 IBM i Multi Path I/O Support IBM i DD001 (6B22) vtscsi1 hdisk1 (2107) Option 1 Multipath from the out to the external storage box. FCS0 FCS1 lun1 30 15
IBM i Multi Path I/O Support DD001 (6B22) IBM i Logically mirrored disk Option 2 DD002 (6B22) -HMC managed systems -Mirroring across 2 LPARs - 2 copies of the data vtscsi1 1 hdisk1 (2107) vtscsi1 2 hdisk3 (2107) FCS0 FCS1 FCS0 FCS1 lun1 lun2 31 IBM i Multi Path I/O Support DD001 (6B22) IBM i DMP001 DD002 (6B22) - MPIO support across 2 LPARs (with HMC) - 1 copy of the data vtscsi1 1 hdisk1 (2107) vtscsi1 2 hdisk3 (2107) FCS0 FCS1 FCS0 FCS1 lun1 32 16
IBM i + NPIV ( Virtual Fiber ) System 1 Source System 2 8Gbs HBA IBM i Client (System 1) IBM i Client (System 1) IBM i Client (System 1) System 3 Hypervisor assigns 2 unique WWPNs to each Virtual fiber Hostconnect is created as an iseries hosttype, Requires 520 byte per sector LUNs to be assigned to the iseries hostconnect Can Migrate existing direct connect LUNS Virtual address example C001234567890001 Hypervisor POWER6 with IBM i 6.1.1 Note: Not available on blades until 4/2010 Note: an NPIV ( N_port ) capable switch is required to connect the to the DS8000 to use virtual fiber. 33 NPIV Configuration - Server Adapter Mappings 34 17
IBM i + NPIV ( Virtual Fiber ) with PowerHA Source SYSBAS 1 8Gbs HBA 2 IBM i Client 1 IASP 8Gbs HBA Each port is assigned separate WWPNs by the Hypervisor Each port is seen as a separate adapter by IBM i so PowerHA reset it individually. Reduces the hardware for a single partition from 4 to 2 adapters for PowerHA Hypervisor POWER6 with IBM i 6.1.1 Note, This configuration can support up to 64 IBM i partitions without adding any more adapters 35 NPIV Performance (work in progress) NPIV vs Direct Attach (DS8300) Application Response Time 0.01 0.009 0.008 0.007 0.006 0.005 0.004 0.003 0.002 0.001 0 0 20 40 60 80 100 120 CPW Use rs npiv run2 direct attach 36 18
PowerHA in the Virtual I/O Environment With VSCSI All Logical replication solutions supported including icluster PowerHA for i - Geographic mirroring With NPIV Metro Mirroring Global Mirroring Lun level switching 37 Virtualization Positioning Extend IBM i storage portfolio Existing investment in DS4000,SVC storage Allows consolidation of IBM i into existing SAN Lower end SAN attachment DS3000 New XIV attachment Existing environment Virtualization platform of choice is IBM i workloads can participate in existing virtualization environment IBM i Hypervisor POWER6 Positioning for future PowerVM advanced functions. Required for Blades. Provides lightweight partition management. 38 19
2.2 - Integrated Storage Virtualization Integrated Storage Virtualization increases Platform Value Client Benefits Automated storage provisioning Non-disruptive Few interactions storage lifecycle between management mgmt domains Simplified, integrated Director Mgmt Director Consolidated integration to deliver on-line high level backup values = Decreased complexity and cost Advanced image management Storage integrated with Server Mgmt Infrastructures Consistent capabilities with different storage Consistent capabilities across different storage Server System Administrators Admin Virtual Servers Storage System Administrators SAN 39 Servers Admin Servers CPU Memory Storage CPU Memory Storage SynerStor Integrated Server & Storage Management Integrated Storage Capabilities Storage Aggregation Physical Storage administration Storage Mobility Snapshots & clones Thin Provisioning IBM, EMC, Hitachi, Other SAN Storage pooling SAN Virtualization Migration File Virtualization Copy services Caching Thin provisioning Geo mirroring NAS SOFS, NetApp, EMC, Other NAS Heterogeneous Questions 40 20
41 Trademarks and Disclaimers 8 IBM Corporation 1994-2008. All rights reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country. Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml. Adobe, Acrobat, PostScript and all Adobe-based trademarks are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, other countries, or both. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Cell Broadband Engine and Cell/B.E. are trademarks of Sony Computer Entertainment, Inc., in the United States, other countries, or both and are used under license therefrom. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind. The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Information concerning non-ibm products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-ibm list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-ibm products. Questions on the capability of non-ibm products should be addressed to the supplier of those products. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here. Prices are suggested U.S. list prices and are subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. 42 21