Understanding the New Enterprise Cloud System September 24, 2014 Kershaw Mehta kershaw@us.ibm.com
Cloud on System z yields the Lowest Cost 35 very light workloads Public Cloud 48 reserved instances $3.9M (3yr TCO) 10 medium workloads Private Cloud (x86) 55 x86 cores 3 heavy I/O workloads 48 workloads Server configurations are based on consolidation ratios derived from IBM internal studies. Prices are in US currency and will vary by country. Public cloud case includes costs of hardware (instances, data in/out, storage, support, free tier/reserved tier discounts), software (middleware) and labor. zenterprise and x86 cases include costs of hardware (system, virtualization, OS), software ( cloud mgmt, middleware), power, floor space and labor. Private Cloud (zbc12) 34 and 73% less cost $1.6M (3yr TCO) 6 IFLs $1.0M (3yr TCO)
Reduce costs with a System z private cloud 4,500,000 4,000,000 Case Study: 48 Workloads 3,500,000 3,000,000 2,500,000 2,000,000 1,500,000 1,000,000 500,000 0 34 and 73% less cost Public Cloud x86 Cloud z Cloud Power, space Labor Software Hardware Server configurations are based on equivalence ratios derived from IBM internal studies. Prices are in US currency and will vary by country. Public cloud case includes costs of hardware (instances, data in/out, storage, support, free tier/reserved tier discounts), software (middleware) and labor. zenterprise and x86 cases include costs of hardware (system, virtualization, OS), software ( cloud mgmt, middleware), power, floor space and labor. 3
A private cloud on System z yields the lowest costs 272 very light workloads Public Cloud 398 reserved instances $37.0M (3yr TCO) 87 medium workloads Private Cloud (x86) 676 x86 cores 39 heavy I/O workloads 398 workloads Private Cloud (zec12) $18.3M (3yr TCO) 48 IFLs Server configurations are based on equivalence ratios derived from IBM internal studies. Prices are in US currency and will vary by country. Public cloud case includes costs of hardware (instances, data in/out, storage, support, free tier/reserved tier discounts), software (middleware) and labor. zenterprise and x86 cases include costs of hardware (system, virtualization, OS), software ( cloud mgmt, middleware), power, floor space and labor. 4 49 and 75% less cost $9.4M (3yr TCO)
Reduce costs with a System z private cloud Case Study: 398 Workloads 40,000,000 35,000,000 30,000,000 25,000,000 20,000,000 15,000,000 10,000,000 5,000,000 0 Public Cloud x86 Cloud 49 and 75% less cost z Cloud Power, space Labor Software Hardware Server configurations are based on equivalence ratios derived from IBM internal studies. Prices are in US currency and will vary by country. Public cloud case includes costs of hardware (instances, data in/out, storage, support, free tier/reserved tier discounts), software (middleware) and labor. zenterprise and x86 cases include costs of hardware (system, virtualization, OS), software ( cloud mgmt, middleware), power, floor space and labor. 5
Introduction to IBM Enterprise Cloud System Converged Infrastructure-as-a-Service solution, providing a highly available, secure, cloud platform based on System z technology Pre-configured and integrated system Includes Processor, Disk, Hypervisor, Cloud Management Software and Services Pre-installed cloud management software that leverages open source such OpenStack and Linux to deliver orchestration, provisioning and monitoring Linux Guests Linux Guests Linux Guests Linux Guests Integration performed at IBM s Customized Solution Center and onsite by STG Lab-Based Services Flexible configurations No fixed sizes - flexibility on hardware configurations allow customers to choose the right amount of resources for their workload Sample configurations will be provided to Sales Team as guidance and comparison Virtualization Management LPAR LPAR LPAR LPAR I/O and Network IFLs Memory 6
Composition of Enterprise Cloud System Server Storage or or Storwize V7000 zenterprise BC12 zenterprise EC12 DS8870 Software z/vm with following priced features: - Directory Maintenance - Resource Access Control Facility - Performance Toolkit - Single System Image IBM Wave for z/vm Cloud Management Suite for System z Operations Manager for z/vm Backup and Restore Manager for z/vm RHEL and/or SLES Linux for System z Services Integration Services - Performed by WW Customized Solutions Center in Poughkeepsie, NY - Will integrate server and storage devices and pre-install software prior to shipment to the customer On-Site Personalization Services - Performed by STG Lab Based Services to complete SW installation and personalize Enterprise Cloud System for the customer 7
Composition Notes for Enterprise Cloud System All components of Enterprise Cloud System are generally available today A customer can put together the same solution by themselves The secret sauce of Enterprise Cloud System is the integration. Integration means: Pre-loaded software The software is installed and configured at IBM prior to delivery to customer Pre-tested Server & Storage Configurations The server and storage are put together at IBM and pre-tested together prior to shipment to ensure no missing parts Single Order The IBM salesperson orders all parts of solution as part of the same order Single Simplified Contract Instead of having separate contracts for server, storage, software and services, a single contract is provided to the customer to sign Single Invoice A single invoice is provided to the customer that covers all four components Bottom Line Price A single bottom line price is provided to the customer for full solution Coordinated Planning & Delivery All components of the solution are in one shipment and arrive at same time at the customer 8
High Level Overview of Hardware for Enterprise Cloud System Server Choice between zbc12 and zec12 is based on: - Future growth potential - Price point - Footprint limitations zenterprise server is an IFL only machine - No general purpose CPs all CPs are assigned to be IFLs - No ziips, no zaaps, no ICFs Storage zbc12 zec12 For simplicity, Storwize V7000 will be for SCSI implementations, while DS8870 will be ECKD implementations - SCSI disks will be implemented as EDEV (Emulated Devices) under z/vm Choice between DS8870 and Storwize V7000 based on: - Future growth potential - Price point - Enterprise Class Qualities of Service - Footprint limitations - Need for SSI/LGR Storage unit will be control unit or base cabinet only - Expansion units will be handled outside of this order - DS8870 will be directly attached to zec12 or zbc12 - V7000 will be attached to SAN switch (customer supplied) 9 Storwize V7000 DS8870
High Level Overview of Software for Enterprise Cloud System z/vm V6.3 with following priced features: - Directory Maintenance (Dirmaint) feature - Resource Access Control Facility (RACF) feature - Performance Toolkit for VM feature - Single System Image (SSI) feature Industry leading hypervisor providing virtualization and efficiency at scale and OpenStack enablement IBM Wave for z/vm V1.1 A simple, intuitive graphical tool providing hypervisor management and automation for a z/vm environment, supporting Linux virtual servers. Cloud Management Suite for System z V1.1 which includes: - OMEGAMON XE on z/vm and Linux - Tivoli Storage Manager Extended Edition - SmartCloud Orchestrator A suite of products providing automated provisioning using OpenStack technology (via SmartCloud Orchestrator), Cloud Monitoring (via OMEGAMON XE on z/vm and Linux) and Cloud Backup and Recovery (via Tivoli Storage Manager Extended Edition) Operations Manager for z/vm V1.5 Supports automated operational monitoring and management of z/vm virtual machines and Linux guests. Backup and Restore Manager for z/vm V1.2 10 Enables the back up and restore of files and data on z/vm systems and Linux guest images.
Functional Mapping of Software Products Function Product Task Description User Interface Hypervisor Management IBM Wave for z/vm Discovers z/vm resources and the relationships among them View and manipulate the state of resources like network setup and storage configuration Simplify and automate the process of performing specific functions across multiple virtual machines and z/vm systems Java-based client running on Windows workstation Operational Monitoring and Automation Operations Manager for z/vm Monitoring of console messages for z/vm infrastructure service machines and Linux guests Monitoring state information for infrastructure service machines and Linux guests Monitoring spool and page space on the z/vm system CLI Resource Monitoring OMEGAMON XE on z/vm and Linux - part of Cloud Management Suite for System z Provides real-time monitoring Monitoring of individual Linux guest environments Ability to set service level thresholds and generate events when exceeded Historical view of monitoring data Browser-based 11
Functional Mapping of Software Products (cont) Function Product Task Description User Interface Data Management Backup and Restore Manager Tivoli Storage Manager Extended Edition - part of Cloud Management Suite for System z Backup selected files to disk Backup and restore Linux images Provides exit points that supports optional data compression and data encryption Provides file level backup of Linux data with automated scheduling Provide policy-based backup, archive, recovery and space management capabilities Allows for multiple versions of files to be archived CLI Browser-based CLI for TSM Server Cloud Management SmartCloud Orchestrator - part of Cloud Management Suite for System z Provision / deprovision a virtual system instance Stop and start a virtual system instance Provides OpenStack APIs for user extendibility Provides end-to-end automation and coordination across many data center domains Browser-based Security Management Resource Access Control Facility (RACF) feature of z/vm Provides fine-grained access controls of VM resources used by users and guests Provides auditing capabilities of "VM events" by ensuring security policy enforcement Separates the disciplines of security administrator, auditor and operations staff CLI 12
Inclusion of Linux with Enterprise Cloud System Given that many of the infrastructure service machines from IBM Wave, Tivoli Storage Manager and OMEGAMON XE run in a Linux environment, Enterprise Cloud System will deliver a distribution of Linux on System z from either Red Hat and/or SUSE. Moreover, SmartCloud Orchestrator specifically requires a RHEL (Red Hat Enterprise Linux) distribution to operate in both the z/vm environment and on the x86 server. An Enterprise Cloud System customer will first need to acquire a license for RHEL and/or SLES (SUSE Linux Enterprise Server) prior to the delivery of the Enterprise Cloud System solution from IBM. Legally speaking, this then allows IBM to deliver Linux for System z with Enterprise Cloud System on behalf of the customer or as an agent of the customer. Also, additional legal license agreements have been acquired from both Red Hat and SUSE to allow IBM to use our distribution of Linux for delivery with Enterprise Cloud System. Levels of Linux distributed with Enterprise Cloud System: SLES 11 SP3 plus patches A variety of RHEL 6.x Primarily RHEL 6.5 plus patches RHEL 6.3 (SCO sample master image) RHEL 6.4 (z Region server) 13
Overall Design Principles for Enterprise Cloud System 1. We have implemented IBM best practices in Enterprise Cloud System to help close skills gap and to provide a sound foundation for the customer to build on 2. Since we do not have fixed configurations (no T-shirt sizes) and allow for flexibility in hardware configurations for Enterprise Cloud System, we have designed the software stack to also be flexible so it can operate in a variety of different hardware configurations 3. In addition, the Enterprise Cloud System has been designed to scale when the customer decides to grow their environment in the future 4. Enterprise Cloud System is a disk only solution. Tape drives are not included in the solution. If the customer wants to add tape, this can be done after customer has taken delivery of Enterprise Cloud System. 5. The software stack for Enterprise Cloud System is fixed. No additional software can be added; no software products can be deleted. Additional software can be installed by the customer after delivery of the Enterprise Cloud System solution. Exception When the solution includes a DS8870, the Single System Image feature of z/vm will be included. When the solution includes a Storwize V7000, the Single System Image Feature of z/vm will not be included. 14
Overall Design Principles for Enterprise Cloud System (cont) 6. Enterprise Cloud System has been design to fit into a variety of different network implementations 7. Since Enterprise Cloud System can be delivered with either a SCSI or ECKD device, we have maintained similar implementations and only deviated from this principle where it made sense (ie. as a result of exploiting Single System Image functionality) 8. Perform as much customization as possible in the WW Customized Solution Center prior to shipment to the customer, in order to minimize the on-site activity 9. Any customization that is dependent on customer environment (ie. IP addresses) will be performed at the customer site. This activity is called personalization 10. We have selected shortwave technology for both FICON/FCP and OSA connections, since we believe this technology will satisfy our customer set. Shortwave has a distance limit of up to 100 meters for copper cables and 300 meters for fiber optic cables If longwave is required for FICON and OSA connects, additional cards can be purchased afterwards (MES) 15
Overall Design Principles for Enterprise Cloud System (cont) 11. All aspects of the configurations were designed in accordance to best practices. As such some minimum hardware requirements have been established, which should be followed when ordering Enterprise Cloud System 12. The I/O configuration has been constructed to accommodate future growth. Each I/O definition file will contain definitions for SCSI devices, ECKD devices, OSA connections, consoles, and CTC connections. 16
Implementation Architecture 17
Hardware Virtualization for Enterprise Cloud System All IFLs will be shared across all LPARs - No dedicated IFLs All Memory will be split evenly between LPARs Enterprise Cloud System will establish four LPARs - Two for Production - One for QA - One for Dev/Test Each LPAR will have its own page and spool volumes Customer can choose to add or delete additional LPARs as they see fit. Each LPAR will be running z/vm 6.3 and Single System Image will be established when Enterprise Cloud System configuration contains DS8870. z/vm 6.3 (SSI Member 1 if ECKD) z/vm 6.3 (SSI Member 2 if ECKD) z/vm 6.3 (SSI Member 3 if ECKD) z/vm 6.3 (SSI Member 4 if ECKD) PROD1 LPAR PROD2 LPAR QA LPAR DEVTEST LPAR IFLs and Memory 18
Enterprise Cloud System with Customer Workload - ECKD Setup 19
Differences Between ECKD and SCSI Setup in Enterprise Cloud System ECKD 1. Single xcat server running on one LPAR with multiple zhcp servers running on all LPARs 2. RACF database is shared between LPARs 3. User Directory is shared between LPARs 4. Directory Manager (DirMaint) running on one LPAR and DirMaint satellite servers running on others 5. Channel-to-Channel (CTC) connections used for communicating between LPARs SCSI 1. One xcat server and one zhcp server running on each LPAR 2. Each LPAR has their own RACF database 3. Each LPAR has their own User Directory 4. Directory Manager (DirMaint) running on all LPARs 5. No Channel-to-Channel (CTC) connections no communication between LPARs 20
Enterprise Cloud System with Customer Workload - SCSI Setup 21
Customer Tasks 22
Items that Customer Needs to Provide One to four x86-64 server with 620 GB of available Hard Disk space, 44 GB of available memory and 14 vcpu Must be running KVM as the virtualization technology 64-bit enabled 14 vcpu translates into a 4 processor server with 6-cores each (or equivalent) Example: An x3650 server with two 12-cores processors and 96 GB of memory (room for future growth) and 3 TB of internal disk (to also account for KVM install) One Ethernet switch or Hub to connect HMC to zenterprise with following characteristics: 16 auto-negotiation ports 10/100/1000 Mbps data rate Full or half duplex operation Auto-MDIX on all parts Port Status LEDs Two Ethernet switches with a total of 8 available shortwave (short range) ports that connect to customers Intranet Four RJ-45 modules Four 1GbE optic modules If configuration contains more OSA cards or 10GbE OSA cards, then appropriate number and type of modules are required 23
Items that Customer Needs to Provide (cont) Four copper cables to connect OSA 1000BASE-T ports to RJ-45 modules in Ethernet switches EIA/TIA Category 5 Unshielded Twisted Pair (UTP) cables with a maximum length of 100 meters Four fiber optic cables (shortwave) to connect OSA 1GbE ports to optic modules in Ethernet switches Multimode fiber optic cables (50 or 62.5 micron) with LC Duplex connector type and maximum length of 300 meters Two copper cables to connect Bulk Power Hub to Ethernet switch (for HMC) EIA/TIA Category 5 Unshielded Twisted Pair (UTP) cables with a maximum length of 100 meters License for RHEL for all IFLs in Enterprise Cloud System License for RHEL for x86 server also License for SLES for all IFLs in Enterprise Cloud System (if applicable) 24
Items that Customer Needs to Provide (cont) If Storwize V7000 is part of Enterprise Cloud System Two SAN switches with a total of 8 available shortwave (short range) ports Four ports in each switch two ports in, two ports out Space for 2U in a 19-inch industry-standard rack for Storwize V7000 control enclosure 25
Sample Configurations (Not fixed configurations) Config A B C D E F Machine Type zbc12- H06 zbc12-h13 zec12-h20 zec12-h43 zec12-h43 zec12-h66 IFLs 2 6 6 18 36 48 Memory 64 GB 176 GB 192 GB 512 GB 1008 GB 1264 GB OSA Express 5S 1000BASE-T OSA-Express 5S GbE SX FICON Express 8S SX Storage 4 ports = 2 cards 4 ports = 2 cards 4 cards = 8 ports Storwize V7000 Model 124 4 ports = 2 cards 4 ports = 2 cards 4 cards = 8 ports Storwize V7000 Model 124 4 ports = 2 cards 4 ports = 2 cards 4 cards = 8 ports Storwize V7000 Model 124 4 ports = 2 cards 4 ports = 2 cards 6 cards = 12 ports DS8870 Model 961 4 ports = 2 cards 4 ports = 2 cards 4 cards = 8 ports Storwize V7000 Model 124 4 ports = 2 cards 4 ports = 2 cards 6 cards = 12 ports DS8870 Model 961 Total Raw Data Space 4.8 TB 9.6 TB 9.6 TB 19.2 TB 28.8 TB 35.2 TB 600 GB 10K rpm 6Gb SAS HDD 8 16 1.2 TB 10K rpm 6Gb SAS HDD 8 8 16 24 16 400 GB 12 Gb SAS Flash Drive 16 Disk Space for Customer Use (assuming 4 LPARs) 1.8 TB 6.6 TB 6.6 TB 17.7 TB 25.8 TB 33.7 TB 26
IBM Enterprise Cloud System integrated solution for Cloud A simple, highly efficient, server designed for a dedicated Linux environment Supports 1000s of Linux virtual servers Includes all aspects (HW, SW, and Services) necessary to establish a Cloud environment on System z A solution that offers for future growth Built on Open Source technology that is becoming defacto standards Solution is customized and personalized for each customers needs 27
For More Information please contact Len Santalucia, CTO & Business Development Manager Vicom Infinity, Inc. One Penn Plaza Suite 2010 New York, NY 10119 212-799-9375 office 917-856-4493 mobile lsantalucia@vicominfinity.com About Vicom Infinity Account Presence Since Late 1990 s IBM Premier Business Partner Reseller of IBM Hardware, Software, and Maintenance Vendor Source for the Last 8 Generations of Mainframes/IBM Storage Professional and IT Architectural Services Vicom Family of Companies Also Offer Leasing & Financing, Computer Services, and IT Staffing & IT Project Management