Linux on POWER Server-Virtualisierung

Transcription

1 IBM Systems and Technology Group Technical Presales Linux on POWER Server-Virtualisierung

2 Agenda 1. Warum Virtualisierung 2. Virtualisierung auf Power HMC / Hypervisor CPU Virtualisierung Speicher und IO VIO Appliance Linux-Kernelmodule Empfehlungen 3. Virtualisierungsbeispiele SAP Beispiel Consolidation Express Entwicklungssysteme

3 Agenda 1.Warum Virtualisierung 2.Virtualisierung auf Power HMC / Hypervisor CPU Virtualisierung Speicher und IO VIO Appliance Linux-Kernelmodule Empfehlungen 3.Virtualisierungsbeispiele SAP Beispiel Consolidation Express Entwicklungssysteme

4 On Demand Operating Environment ERP CRM HR Mail Open Protocols WebServices, GRID Virtual Application-Servers Virtual Server + Disks Virtualization Layer AIX, Linux, zvm, Windows,... Server 1 Server 2 J2EE Database Messaging... Server 3 Locical Partitioning Hypervisor WebSphere, DB2, Lotus,... Ser ver 5 Phys. Part. Virtual Disks Storage Virtualization pseries zseries iseries xseries FastT, ESS,... Physical Systems

5 Systemauslastung traditionell Application 1 Application 2 Application 3 % utilization Bedarf über vorhandener Kapazität t t t Bis zu 40 mal mehr Resourcen durch unvorhersehbare Lasten

6 Systemauslastung in einem virtuellen Umfeld Application 1 Application 2 Application 3 Virtual Maschine Virtual Maschine Virtual Maschine % utilization Der tatsächliche Bedarf kann abgedeckt werden Weniger Resourcen und dennoch mehr Flexibilität

7 Motivation für Virtualisierung 1. Bessere Auslastung der Systemresourcen Es werden weniger installierte Resourcen benötigt Spitzenlasten können durch Resourcenverschiebung abgefangen werden 2. Hardware Consolidation 3. Flexibilität und Geschwindigkeit Schnelles Setup neuer (virtueller) Server Skalierbar, wenn benötigt Es werden keine dedizierten Resourcen für Test- und Entwicklungssysteme benötigt 4. Verfügbarkeit Loslösung der 1:1 Beziehung zwischen Hardwareresourcen und Anwendungen

8 Agenda 1. Warum Virtualisierung 2. Virtualisierung auf Power HMC / Hypervisor CPU Virtualisierung Speicher und IO VIO Appliance Linux-Kernelmodule Empfehlungen 3. Virtualisierungsbeispiele SAP Beispiel (siehe Folien von ) Consolidation Express (siehe cons. express Presentation) Entwicklungssysteme

9 POWER5 Server Portfolio High Volume Linux Workloads Stand alone Serving Application serving Low End Stand alone Serving Application serving Server Consolidation Midrange Application Server Midrange Database Server Server Consolidation Enterprise Server Consolidation Large Data Base. Production / Test Linux 4-way 1-4w SMP 4U 19" Rack, Deskside POWER5 Entry 4W 2-4w SMP 4U 19" Rack, Deskside POWER5 Building Blk 2-4w / 2-16w SMP 4U 19" Rack, Building Block POWER5 High End 2-8 Node / 8-64w SMP 24" Frame 12w Node0 Node1 Linux 1 /2 -way 1,2w SMP 2U 19" Rack,Deskside POWER5 Entry 2W 2w SMP 4U 19" Rack, Deskside* 2-4w Node0 8w Node2 16w Node0 Node1 Node0 Node2 Node1 Node3 Scale-Out Scale-Out Scale-Up & Out Scale-Up

10 POWER4 POWER5 Evolution POWER4+ design POWER5 design Benefit L1 cache 2-way associative 4-way associative Improved L1 cache performance L2 cache 8-way associative 1.5MB 10-way associative 1.9MB Fewer L2 cache misses Better performance L3 cache 32MB 8-way associative 118 clock cycles 36MB 12-way associative Reduced latency Better cache performance Simultaneous multi-threading No Better processor utilization 30%* system improvement Partitioning support 1 processor 1/10 th of processor Better usage of processor resources Floating-point registers Better performance Chip interconnect: Type Intra MCM data bus Inter MCM data bus Distributed switch ½ proc. speed ½ proc. speed Enhanced dist. switch Processor speed ½ proc. speed Better systems throughput Better performance Size 412mm 2 389mm 2 50% more transistors in the same space

11 IBM IBM Systems and Technology Group - Technical Presales LPAR- und Virtualisierungstopologie für POWER5 Systeme Admin LAN LAN zu den Partitionen Network Network Ethernet Service Netzwerk Rack mount HMC als Option Private Network Ethernet Verbindung zu allen Service Processoren

12 Hardware Management Console (HMC) PC-basierende Konsole Management "appliance" die alle notwendigen Tools zu Einrichtung und Administration von POWER5 Systemen mitbringt Benutzer sehen nur die eigentliche Management Anwendung Java-basierende Anwendung auf Linux Remote Command-Line Funktionalität vorhanden Wird an den Service Processor eines POWER5 Systemes angeschlossen Remote Zugriff möglich Designed to manage multiple systems Benötigt, um LPAR, Dynamic LPAR und Virtualisierung einzurichten und zu administrieren Standard bei den High-End p5 590 und p5-595 Eine zweite, redundante HMC möglich

13 IBM eserver POWER5 Virtualization Architecture Workload management and provisioning AIX 5L V5.3 partitions AIX 5L V5.2 Linux partitions i5/os Virtual I/O server Unassigned on demand resources Hardware Management Console Hypervisor AIX 5L kernels Linux kernels Virtual Network Virtual processors SLIC Virtual network & storage Virtual adapters Service processor Processors Memory Expansion slots Local devices & storage Networks and network storage

14 Jay Kruemcke IBM 2003 IBM Systems and Technology Group - Technical Presales Advanced POWER Virtualization Micro-Partitioning Virtual I/O server partition Storage sharing Etherne t sharing 2 CPUs Linux Dynamically resizable 2 CPUs AIX 5L V5.2 2 CPUs AIX 5L V5.3 Virtual I/O paths Hypervisor AIX 5L V5.3 Linux 6 CPUs Micro-partitioning Linux AIX 5L V5.3 AIX 5L V5.3 Virtual I/O Server AIX 5L V 5.3 Hardware Management Console (HMC) Micro Partitioned LPARs A single processor might be shared by up to 10 partitions Support for up to 256 partitions Requires an p5 or i5 system and AIX 5.3 or Linux Automatic CPU load balancing Enabled by the POWER Hypervisor and VIO Server hardware feature Entitled capacity in units of 1/100 of a CPU (minimum 1/10 of a CPU) Capped or uncapped partitions uncapped partitions can use excess pool capacity

15 Jay Kruemcke IBM 2003 IBM Systems and Technology Group - Technical Presales Advanced POWER Virtualization Virtual I/O Server Appliance partition to provide Virtual Disk Storage and Ethernet Adapter Sharing for the POWER5 Advanced Virtualization environment Virtual I/O server partition Storage sharing Etherne t sharing 2 CPUs Linux Dynamically resizable 2 CPUs AIX 5L V5.2 2 CPUs AIX 5L V5.3 Virtual I/O paths Hypervisor AIX 5L V5.3 Linux 6 CPUs Micro-partitioning Linux AIX 5L V5.3 AIX 5L V5.3 Virtual I/O Server AIX 5L V 5.3 Virtual I/O Server Provides appliance to serve virtual SCSI disks and layer 2 Ethernet Adapter sharing to client partitions. Not a general use partition dedicated to I/O Command line interface for configuration Alternativ: Using SLES9 and the IBM Virtualization Kernel modules. Virtual I/O Server can run in a dedicated partition or in a Micro-partition Client partitions can include dedicated and Micro-partitions Typical configuration will have multiple Virtual I/O Server partitions to provide redundancy and to improve performance Hardware Management Console (HMC) Advanced POWER Virtualization hardware feature

16 Virtual SCSI IBM Systems and Technology Group - Technical Presales Allows sharing of IO devices Vital for LPAR: Overcomes potential limit of adapter slots Supported for dedicated LPARs too Provided by kernel module ibmvscsis (or VIO server) Real disks, partitions and files can be used On a client side any device looks like scsi disk No data, only scsi commands are sent through the hosting partition Hosting Partition vscsi_host vscsis vscsi_host vscsis vscsi_host vscsis I/O Adapters Linux AI Linux X vscsic vscsi vscsi Hypervisor vscsic vscsic Linux vscsic vscsi Disks

17 Virtual SCSI HA Virtual I/O Server partition #1 Disk access Client partition #1 Client partition #2 Virtual I/O Server partition #2 Disk access Disk space #1 Disk space #2 SCSI disk #1 SCSI disk #2 SCSI disk #1 SCSI disk #2 Disk space #1 Disk space #2 VSCSI server adapter #1 VSCSI server adapter #2 VSCI client adapter #1 VSCI client adapter #2 VSCI client adapter #1 VSCI client adapter #2 VSCSI server adapter #1 VSCSI server adapter #2 Physical adapter POWER Hypervisor Physical adapter Physical disk (SCSI, FC) Physical disk (SCSI, FC)

18 Virtual Ethernet Memory based interpartition LAN Virtual LAN adapters appears to the OS as physical adapters Hosting partition Linux Linux Linux HMC generates MAC Addresses Bridge or NAT Virtual Ethernet driver Virtual Ethernet driver Virtual Ethernet driver Supports bootp 1-3 Gb/s transmission speed VLAN support Network adapters Virtual Ethernet switch Hypervisor LAN, WAN,

19 Network HA IBM Systems and Technology Group - Technical Presales

20 Linux on POWER 5 Systems Function Max. 254 Partitions Shared Processors partition with 0.1 granularity Capped Sharing Uncapped Sharing Dynamic Movement Whole processors Shared processors (Processing units) Memory I/O CUoD Processors Memory POWER5 Processor Support Base Enablement SMT VIO Server Storage (tape, disk, cd) client LAN (Ethernet) Console client Serial Improved EEH Handling Large page support AIX 5.3 Dynamic Dynamic RHEL 3 No No No No Static Static No No No SLES 9 /RHEL4 No Dynamic Static No NOTES: "AIX 5.3" refers to functionality presently available with AIX V5.3 on POWER5 hardware. "RHEL 3" refers to functionality with Red Hat Advanced Server Version 3 Update 3 (Linux kernel V2.4 based) running on POWER5 hardware. "SLES 9" und "RHEL4"refers to functionality with SUSE Linux Enterprise Server Version 9 (Linux kernel V2.6 based) running on POWER5 hardware.

21 Empfehlungen - virtualisiert oder dediziert Virtualisiert Entwicklung und Testsysteme (Disk I/O und Virtual LAN) Micropartitioning und Shared CPU Pools für Produktionsumgebungen Dediziert Produktionsumgebungen Systeme, die eine permanente I/O Load erzeugen (Disk und/oder LAN)

22 Agenda 1. Warum Virtualisierung 2. Virtualisierung auf Power HMC / Hypervisor CPU Virtualisierung Speicher und IO VIO Appliance Linux-Kernelmodule Empfehlungen 3. Virtualisierungsbeispiele SAP Beispiel Consolidation Express Entwicklungssysteme

23 mysap Projects depend on Flexibility How many components? ERP BW EP How many severs? Size of the servers? Size of Backbone Infrastructure? PRD PRD PRD INT INT INT DEV DEV DEV EDU EDU EDU DB-Server High Bandwidth LAN APP APP APP APP LAN

24 Observed CPU Utilization Average system utilization of a Mainframe? 85% of a UNIX server? 10-15% of a Windows Server? 5-10% 100 % Measurement at zseries customer

25 Effects of CPU Sharing Micro Spikes ERP-PRD EP-PRD ERP-DEV BW- INT ERP-EDU BW-DEV BW- PRD EP-INT ERP-INT EP-DEV BW- EDU EP-EDU ERP Production Portal Production Measurement: Peak 1 min = 76% Peak 1 hr avg = 21% Peak 8 hr avg = 10% Peak 24 hr avg = 4%

26 Effects of CPU Sharing Spare Capacity BW Production ERP-PRD EP-PRD BW- PRD EP-INT ERP-DEV BW- INT ERP-EDU BW-DEV ERP-INT EP-DEV BW- EDU EP-EDU NON Production

27 CPU Sharing is Key Pool of CPUs H P ERP PRD EP PRD ERP DEV BW INT ERP EDU BW DEV Hypervisor POWER5 adjusts resource allocation instantly on demand

28 POWER5 means Power POWER5 = 1,645 SAPS/CPU ( 4-way ) 100% Itanium = 1,108 SAPS/CPU ( 4-way ) 67% AMD = 892 SAPS/CPU ( 4-way ) 54% SPARCIV = 405 SAPS/CPU ( 8-cores) 25% ( 702 SAPS/CPU for Fujitsu 1.35GHz ) and Performance Scaling 16-way Power5 > 30-way Itanium > 72 cores SPARCIV

29 Fast start kit helps accelerate deployment Fast Start Kit Workloads stress tested Small, medium, large pre-tested Solution Starter Points tuned for optimal performance Sizing Guide for popular combinations of stack components Tested Solution Stack Single sign-on: All workloads authenticated through OpenLDAP Highly secure with optional Domain and Protocol firewall included Tailored installation and configuration scripts, including automated AOPV set-up Manual with tailored install, configure, integrate and tune instructions Available at no charge on Solution Fast Start Kit Download Page Apps OS HW Directory/Authentication: OpenLDAP Firewall: SUSEfirewall2 File and Print: Samba 3 Web Serving: IBM HTTP Server Mail: Bynari Insight Server SUSE LINUX Enterprise Server 9 for POWER Red Hat Enterprise Linux AS for POWER* OpenPower 710 and OpenPower 720 * SOD, planned availability in 1H/05 All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

30 OpenPower Consolidation Express - Before Profile Infrastructure on Windows NT Servers aging, underutilized OS no longer current Preserve or upgrade Directory Preserve Windows clients Win Win Win Windows NT Caching Windows NT File and Print Internet Firewall & Switch Windows NT Directory Windows NT IIS Web server Windows NT Exchange & Outlook UNIX or Windows NT App. Server

31 OpenPower Consolidation Express - After Samba 3 Results Less servers, lower cost Easier to manage Higher resource utilization Full secure and expandable Interoperate with Active Directory Win Win Win Active Directory OpenLDAP Samba OpenPower Internet Firewall & Switch Bynari SUSEfw2 HTTP UNIX or Windows NT App. Server

32 File and Print solutions: Samba NetBench: OpenPower 720 beats AMD and exhibits extraordinary scalability Challenges addressed UNIX servers aging Microsoft Windows NT support disappearing Servers underutilized Server sprawl Inflexible infrastructure Business Value Exceptional performance Large # of files, users Superior consolidation Fewer servers to manage Deploy with confidence Tested and qualified Sized for capacity planning Key challenges addressed IBM and partner support Throughput (Mb/s) NetBench Results for Windows vs. Linux on OpenPower 2-and 4-CPU IBM AMD IBM Dell HP Published Configurations HP Proliant DL 380 G3 (Pentium 4, 2.8 GHz x 2CPU) Windows 2003 Dell PowerEdge 2650 (Pentium 4, 3.2 GHz x 2CPU) Windows 2003 AMD (Opteron, 2.2 GHz x2cpu) Windows 2003 IBM ~ OpenPower 720 (POWER5, 1.65 GHz x 2) SLES 9 IBM ~ OpenPower 720 (POWER5, 1.65 GHz x 4) SLES 9 1 Based on published Ziff Davis Media NetBench benchmark result of 1, Mb/s on a 2-way 1.65 GHz POWER5 IBM eserver OpenPower 720 and 2, Mb/s on a 4-way 1.65 Ghz POWER5 IBM eserver OpenPower 720 ( HP results published in ( AMD and Dell results published in ( Results current as of January 15, 2005

33 Web Solutions: Apache WebBench: OpenPower 720 beats HP Opteron/Xeon and exhibits 97% scalability Challenges addressed UNIX servers aging Proprietary Solaris OS Uncompetitive price/performance Server sprawl Inflexible infrastructure Business value Exceptional performance Improved price/performance Familiar, open technology - Apache Simplify through consolidation Fewer servers to manage Deploy with confidence Tested and qualified Sized for capacity planning Key challenges addressed IBM and partner support Peak Requests Per Second WebBench Results for HP with Windows vs. OpenPower with Linux HP HP HP 5739 IBM Published Configurations HP ProLiant DL 380 G3 (Pentium 4, 3.2 GHz x 2CPU) Windows IBM HP ProLiant DL 380 G4 (Pentium 4 w/em64t, 3.6 GHz x 2CPU) Windows 2003 HP ProLiant DL 145 G4 (Opteron, 2.2 GHz x 2CPU) Windows 2003 IBM ~ OpenPower 710 (POWER5, 1.65 GHz x 2CPU) SLES 9 IBM ~ OpenPower 720 (POWER5, 1.65 GHz x 4CPU) SLES 9 1 Based on published Ziff Davis Media WebBench benchmark result of 5,739 requests/s on a 2-way 1.65 GHz POWER5 IBM eserver OpenPower 710 and 11,585 requests/s on a 4-way 1.65 Ghz POWER5 IBM eserver OpenPower 720 ( HP results published in (ftp://ftp.compaq.com/pub/products/servers/benchmarks/dl380g4-webbench.pdf). and ( Results current as of January 15, 2005

34 Entwicklungsumgebungen Application 1 Application 2 Application 3 Virtual Maschine Virtual Maschine Virtual Maschine % utilization Der tatsächliche Bedarf kann abgedeckt werden Weniger Resourcen und dennoch mehr Flexibilität

35 Quellen IBM Systems and Technology Group - Technical Presales WICHTIG! Dokumentation zur Inbetriebnahme WICHTIG! Service tools, zusätzliche IBM Pakete. WICHTIG! Open Power Overview & Introduction Redbook Die offizielle Seite Open Power Support Seite Consolidation Solution (Free download) Linux on Power Developers Corner Artikel: Linux on Power Performance Optimization

36 IBM Systems and Technology Group Technical Presales Linux on Power