Yann Guerin Cloud Architect IBM s SouthWest Europe Cloud Center of Excellence IBM Infrastructure Montpellier Customer Center (PSSC) Cloud Leader yann_guerin@fr.ibm.com Private Cloud Computing Architectural Concepts
Summary of the Cloud Concept CLOUD COMPUTING Reduced VIRTUALIZATION + STANDARDIZATION Cost + AUTOMATION Increased = Flexibility Public Hybrid Private The characteristics of the Cloud Computing IT delivery model are : 1) Based 2) Scalable & Elastic 3) Shared 4) Metered by use 5) Internet based Monitor & Manage s & Resources Cloud Administrator IT Cloud Catalog, Component Library Datacenter Infrastructure Consumers Access s Component Vendors/ Software Publishers Publish & Update Components, Templates
Operations have industrialized to become smarter Telcos automate traffic through switches to assure service and lower cost Manufacturers use robotics to improve quality and lower cost Banks use automated teller machines to improve service and lower cost Breakthroughs like these are enabled by service management systems
Self-service plus standardization drives lower costs and unlocks productivity for delivering workloads more effectively SELF-SERVE PORTAL SERVICE REQUEST SERVICE PROVISIONING DYNAMIC INFRASTRUCTURE
Architectural Building Blocks for Cloud Computing Request & Operations IT Infrastructure & Application Provider Creation & Deployment End User Requests & Operators Management User Request Management/Self Portal Lifecycle Management Virtual Image Management Image Lifecycle Management Provisioning Performance Management Availability/Backup/ Restore Design & Build Security: Identity, Access, Integrity, Isolation, Audit & Compliance Usage Accounting License Management Oriented Architecture Information Architecture Optimized Middleware (image deployment, integrated security, workload mgmt., high-availability) Image Library (Store) Deployment Catalog Request UI Operational UI Virtualized Infrastructure Virtual Resources & Aggregations Server Virt. Storage Virt. Network Virt. System Resources SMP Servers Blades Storage Servers Storage Network Hardware Operational Lifecycle of Images
IBM Cloud Reference Architecture Cloud Consumer Cloud Provider Cloud Developer Cloud s IT capability provided to Cloud Consumer Partner Clouds Customer In-house IT Virtualized Infrastructure Server, Storage, Network, Facilities Infrastructure for hosting Cloud s and Common Cloud Management Platform Common Cloud Management Platform BSS Business Support System Manages the business aspects of Cloud Instances Development Tools OSS Operational Support System Instantiates & Manages Cloud Instances Security & Resiliency
IBM s Common Cloud Model Platform (CCMP) Cloud Consumer Cloud Provider Cloud Developer Consumer End user Cloud s User Interface API Business-Process-as-a- Software-as-a- Platform-as-as- Infrastructure-as-a- Developer Partner Clouds Virtualized Infrastructure Server, Storage, Network, Facilities Consumer Business Manager Customer In-house IT Consumer Administrator Common Cloud Management Platform Delivery Portal API BSS Business Support System OSS Operational Support System Business Manager Offering Mgmt Order Mgmt Accounting & Billing Contract Mgmt Templates Request Management Provisioning Monitoring & Event Management Customer Mgmt Entitlements Invoicing SLA Reporting Metering, Analytics & Reporting Delivery Catalog Automation Management Configuration Mgmt Incident, Problem & Change Management IT Asset & License Management Virtualization Mgmt Provider Portal Transition Manager Pricing & Rating Subscriber Mgmt Peering & Settlement Offering Catalog Image Lifecycle Management IT Level Management Capacity & Performance Management Development Portal Operations Manager Development Tools Definition Tools Image Creation Tools Security & Resiliency Security Manager
Management Concerns in Cloud Architecture Cloud Consumer Virtualized Resource Management Deploy cloud services on virtualized resources Consumer End user Cloud s User Interface Manage virtual resources API Cloud Provider Business-Process-as-a- Software-as-a- Usage Metering and Accounting Cloud Developer Flexible support of delivery models Platform-as-as- Infrastructure-as-a- Developer Partner Clouds Consumer Business Manager Customer In-house IT Consumer Administrator Virtualized Infrastructure Server, Storage, Network, Facilities Common Cloud Management Platform BSS Business Support System Security Design for Multi-Tenancy Business Manager Offering Mgmt Order Mgmt Accounting & Billing Contract Mgmt Protect assets through Isolation, Delivery Portal integrity, image- risk and compliance management OSS API Operational Support System Templates Request Management Provisioning Monitoring & Event Management Heat and Power Management Control Energy Consumption Customer Mgmt Interpret and Pricing & Execute Rating Build- and EntitlementsManagement Subscriber Plans Mgmt SLA Reporting Metering, Analytics & Reporting Configuration Mgmt Provider Portal Operations Manager Development Tools Invoicing Orchestrate Peering Management & Settlement Componentry Delivery Catalog Automation Management Incident, Problem & Change Management IT Asset & License Management Virtualization Mgmt Transition Manager Automation Management Offering Catalog Capacity & Performance Management Development Portal Definition Tools Image Management Image Lifecycle Management Design, build and manage images IT Level Management for cloud services Image Creation Tools Security & Resiliency Security Manager
Cloud Management
Lifecycle of a Cloud from a User view On-boarding Provide additional IT asset information via portal for service initiation Configuration, pricing and ordering -Select a service, configure options, and price, and purchase -Interim Move, Add, Change, configuration change, reorders Customer Business Manager Customer IT Architect Pricing & Ordering Browse Catalog Configuration, Onboarding Cloud APPLICATION SERVICES PLATFORM SERVICES INFRASTRUCTURE SERVICES Production Termination Customer Administrator Production -Portal for service requests, reporting, notifications, and other cloud services -Billing -Payment Instance Termination Cancel service Catalog Browse Browse offerings of interest from menu via portal Consumer Management Platform Process Engine Middleware Virtualized and Standardized Resources Physical Assets Consumer
Lifecycle of a Cloud from a Provider view Offering Subscription & Instantiation -Select, specify parameters and SLA s -Automatically instantiate the Offering Creation & Registration Define based on Template and register it in the Catalog Template Definition Create Build- and Management Plans for Catalog Manager Subscriber (e.g. Line of Business) IBM / ISV / IT Dept Offering Definition Subscription & Instantiation Cloud APPLICATION SERVICES PLATFORM SERVICES INFRASTRUCTURE SERVICES Management Platform Process Engine Middleware Virtualized and Standardized Resources Physical Assets Production Termination Administrator / SLM Subscriber (e.g. Line of Business) Manual or Autonomic Execution of Management Plans leveraging Automation and Virtualization Ensure SLA Conformance Instance Termination Destroy and free up resources
PSSC Clouds Architecture Overview Diagram Request & Operations e-mail IT Infrastructure & Application Provider Creation & Deployment Web Portal Setup Manager Web Portal Reservation Engine OpenVPN Server Provisioning Manager Pre-production Environment Production Storage Managethrough Servers X86 Managethrough Servers Power Managethrough Servers User Managed z Manage-through Servers Storage Endpoint x86 Light Pool x86 Injection Pool POWER Endpoints z Pool
Management Center for Cloud Catalog Manager Operational Operational Interface Interface Tools Tools Requestor Request Interface Automation Manager Offering Offering Definition Subscriber Instance Interface Center Administrator Center Operator Center Management Operational Dashboard Process Process Automation Automation Task Task and and Resource Resource Automation Automation Products Products TPM, TPM, TSM, TSM, TPC, TPC, ITM, ITM, etc. etc. CCMDB Assets
Tivoli Automation Manager : What is it? An integration of existing Tivoli capabilities and additional new capabilities, workflows, and best practices packaged together as a single solution TSAM Tivoli Catalog Tivoli CCMDB (configuration mgmt) Tivoli process automation engine Monitoring Tivoli Provisioning
Tivoli Automation Manager (TSAM) Provides capabilities for deploying, requesting & managing Cloud s Self- request, instantiation and automated delivery of Cloud s Integrated Management of Cloud s along their lifecycle Automation based on templates and management plans including human and automated management components Allows end users and IT administrators to manage Cloud s as a first class resource An integration of existing Tivoli capabilities and additional new capabilities, workflows, and best practices packaged together as a single solution for our clients 15 3/17/2010
TSAM architecture and control flow Script I/F widgets TSRM GUI Dojo based TSRM Application service catalog offering service request CMDB TSAM Admin GUI TSAM Application service template instances topology/nodes mgmt plans TPM 7.1.1 Workflows LDOs query/set/.. DCM DCM Java I/F TPAE/Maximo GUI TSRM TSAM Interaction with end user Collect parameters for management plans Prepare service request from given input parameters Perform reservation of resources Approval and notifications on business level TPM Topology definition Management plan Orchestration by management plans fulfillment by executing Management plan definition TPM workflows/ldos Management plan execution or native scripts - push down on eg. TPM (or Script) or Java based actions Approval and notifications on or manual tasks technical level (admin) Situation governance Change resource state incl. error handling by admin Work assignments on admin level ( inbox )
Managed Through Capabilities : TPM for OSD value proposition Automate the installation of an Operating System (from scratch) Remotely manage target machines with no agents or boot disks required Configure hardware and Install applications as part of the process Configure OS parameters Make the process universal Inject drivers automatically to use a single image on multiple hardware targets Separate applications and settings from the image to reduce the number of images Have the same process for different target Operating Systems Major themes Data center management: Server support Common OSD technology for IBM solutions Business value Consolidate in the desktop market e ESX server 2006-2007 Sparc support for the sunv4 architecture Consolidate in the server market 2007-2008 Partial P2V support Linux LVM Hardware configuration on X86 and x(6-64 (DELL/IBM/HP) AIX on p deployment support Linux on p deployment Linux on cell deployment Director 6.1 integration TPM 7.1 integration Integrated as OSD technology in other products TPM7.1,Director 6.1,RDM 4.40,TCM 4.2 RDM integration TCM integration Automate the OS deployment of complex and large scale of desktop computers Secure hard-disk disposal Hardware support refresh Manage-to Windows 2008 Vista/Win2008 offline patching Enhanced driver injection
Lifecycle of a Virtual Image for Cloud Contents Management Dev-test Governance Flows Operations Design Build Store Deploy Manage Overall Orchestrator Graphical design environment for virtual images Image Library & Mgmt. Integration Build tooling & Metadata editing Import/ Export Copy Activation & Configuration Engine Build image repository Resides in Storage Network linked linked repository repository Golden Images Image Deployment Tooling (per Hypervisor) Z Capture Tooling P x86 Platform specific repositories Operational DSL (Images + other Soft.) CMDB Software Deployment Tooling Z P x86 App App App App App App App App App App App App OS OS OS OS OS OS Capture STORAGE System Z System P System x Patch/Software Install Network Sub system 18
TPM for Images : the evolution in the image management space Expand in High and Mid markets 2008-2011 Major themes Foundation for the automation of Data Center optimization best practices. Data center management: Server support Common OSD technology for IBM solutions Business value Consolidate in the desktop market 2006-2007 VMWare ESX server Sparc support for the sunv4 architecture Consolidate in the server market 2007-2008 Partial P2V support Linux LVM Hardware configuration on X86 and x(6-64 (DELL/IBM/HP) AIX on p deployment support Linux on p deployment Linux on cell deployment Director 6.1 integration TPM 7.1 integration Optimization tool at support of Dynamic Data Center & Cloud computing Virtualization VMWare,XEN/Microsoft support Full P2V/V2V/V2P migrations support Bare Metal Restore Hardware configuration on Sparc and PowerPC pseries cloning OS currency DTM integration Image management integration ( Zephyr/Encompass) Automate the OS deployment of complex and large scale of desktop computers RDM integration TCM integration Secure hard-disk disposal Hardware support refresh Manage-to Windows 2008 Vista/Win2008 offline patching Enhanced driver injection Engine improvements( WinPE/MCP) Standalone deployments(pull) FIPS compliance Cerificate based access MAC support OS currency 19 Time
Problems that TPM for Images solves How to handle Image Sprawl: Customer needs a way for organizing, inventorying, securing, managing and deploying images to the various virtualized platforms in a scalable manner. Discovery of VM instances and dormant images on different Virtualization infrastructure (Hyper-V, VMWare, xvm, KVM, XEN) Support of multiple image formats (VMDK, VHD, RAW, VDI) Consolidated view (images browser) of heterogeneous physical and virtual images How to efficiently store images: Sprawl introduces also the challenge of how to optimize the store of thousands of images (Image are large - many GBs) Image shared repository allowing efficient storage support for both block-based and file-based approach Smart sector mode capturing ( implicit disk and file system de-fragmentation ) Optimized image transfers by sending only unknown files or blocks through the network How to easily and seamlessly automate the management of heterogeneous virtual and physical servers using the same techniques, same integrated life cycle and same skill set? OSD built in technology ( universal image and driver injection capabilities) may enable any kind of image migration process ( P2P / P2V / V2V / V2P ) OSD provides an intuitive interface hiding the differences between heterogeneous virtualization infrastructures and between the physical and virtual world Dormant images needs maintenance too. (E.g. security patches) OSD offer the capability to patch offline different type of images ( VMDK,VHD, VDI, RAW, OSD, Physical) using the same techniques. This use case allows to do the following on dormant images: Install hot-fixes/patches Add new files in the image or modify existing ones Patch images immediately or keep a dormant patch until machine is powered up next time Customers need to protect their investments and not get trapped by one virtualization infrastracture OSD is a hypervisor-independent baseline for image management OSD is a part of the foundation of IBM Management strategy Strategic solution ready to integrate in the Tivoli family 20
Tivoli Portfolio for Provisioning the Datacenter IT Delivery for Cloud Tivoli IT Delivery for Cloud Automation Manager Cloudburst (HW Appliance) TSAM Included In CB Resource Provisioning and Configuration Management Tivoli Resource Provisioning Provisioning and Configuration Management Manager TPM Included in TSAM TPM Included in CloudBurst Image Management Tivoli Provisioning Manager For Images TPM for Images Chargeable Component Image Management TPM for Images Included in TSAM TPM for Images Included in CloudBurst Heterogeneous OS Deployment and Management Tivoli Provisioning Manager for OS Deployment TPM for TPM for OS OS Heterogeneous OS Deployment and Deployment management Deployment Included in TPM TPM for OS Included in TSAM TPM for OS Deployment Included in CloudBurst
Cloud Platform & Infrastructure Management
IBM Virtualization Strategy Improve Total Cost of Ownership (TCO) Decrease management costs Increase asset utilization Manage consolidated systems to drive down energy requirements Access through shared infrastructure Leverage common tools across many systems Improve business resilience and security Establish foundation for -Oriented Architecture (SOA) Increase flexibility Simplify by masking complexity Create pools of system resources Maintain freedom of choice with open standards LEVERAGE VIRTUALIZATION for SERVICE MANAGEMENT VIRTUALIZATION MANAGEMENT VALUE Physical and virtual platforms RESOURCE VIRTUALIZATION Clients Servers Network Storage
IBM UNIX Virtualization Leadership for Scale-Up Cloud Application A Application B Application C Sys3 Physical Flexible Resource Entitlement & Allocation - Dedicated or shared - Capped or uncapped Complete Resource Virtualization - Including LAN and Disks - In-roads in Memory Virtualization Combined with Business Offerings - Capacity upgrade on Demand Logical/ Dynamic Micro- Partitionin g Live Partition Mobility Sys2 Sys1 1967 1973 1987 1997 2001 2004 2008 IBM develops Hypervisor that would become VM on the mainframe IBM announces first machines to do Physical Partitioning IBM announces LPAR on the mainframe POWER LPAR design begins IBM introduces LPAR in POWER4 based systems with AIX / Linux Advanced POWER Virtualizatio n ships IBM announces PowerVM
Storage Virtualization to address the explosive growth of Storage? Storage area network (SAN) Make changes to the storage without disrupting host applications Improves application availability Non-disruptive data migration Virtual disk Virtual disk Virtual disk Virtual disk Virtual disk Apply common copy services across the storage pool disk vendor independent replication options IBM DS- 8000 IBM TotalStorage SAN Volume Controller advanced copy services HDS IBM DS- 4000 Storage pool EMC Combine the capacity from multiple arrays into a single pool of storage Optimized capacity utilisation Disk array vendor independence & integration HP Manage the storage pool from a central point Reduced management complexity
$300 $250 $200 $150 $100 IDC Shifting Management Requirements Spending (US$B) $50 $0 IDC projects that use of server virtualization will result in a significant increase in the number of servers (physical + virtual) to be managed The projected increase is not yet reflected in their forecast of server management costs Power and Cooling Costs Server Mgt and Admin Costs New Server Spending 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 60 60 55 50 45 40 35 30 25 20 15 10 5 0 Source: IDC, 2006 Virtual+Physical Server Installed Base (Millions) Physical Server Installed Base (Millions) Virtualization Management Gap
VMControl Unifies Virtualization Management Enabling consistent multi-platform management for IBM Systems Manages Power Systems, System z, System x, storage and network resources Integrates management of virtual servers, appliances, storage, networks and clouds Provides seamless integration into Tivoli enterprise service management solutions
System Pools: Next Step in Evolution of Virtualization Managing a pool of server resources with single systems simplicity Combines multiple virtual resources into one manageable entity Automates virtual image mobility for optimal utilization and resilience Optimizes virtual assets for performance, availability and energy use Integrates server, storage and network virtualization Mobility Virtualization Compute Memory Network Storage IT Resources Compute Memory Network Storage Virtual Images Optimized for Availability Performance Energy System Pools
Integration Example: IBM Cloudburst
IBM Cloudburst A complete solution to start your private cloud delivered with hardware, software and services The IBM Cloudburst functionnalities A user self service portal A services & product catalog An automation infrastructure Pre configured templates Network,hardware & software virtualization Accounting & Charging systems Built-in energy management 30
IBM CloudBurst Anatomy Optional Central TSAM 7.2 Customer SAN Network Optional WebSphere CloudBurst 10G Ethernet Switch MSIM-L Bay 9 Customer Ethernet Network 10G Ethernet Switch MSIM-L Bay 7 CloudBurst Infrastructure Management Manage External Resources CloudBurst Management Mid-plane AMM2 HS22 HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade HS22 Blade Blade AMM2 Mid-plane 20port FC SM 20port FC SM Bay 3 Bay 4 x3650 M2 24 port 1Gps Ethernet Switch 24 port 1Gps Ethernet Switch Controller A Controller B IBM Storage
IBM CloudBurst is the Cloud appliance proposition of the market aggregating software and hardware around TSAM BladeCenter H High Availability & Automation HS22 Blades 1 2 3 4 5 6 7 8 9 10 11 12 13 14 BladeCenter H Chassis 3650 M2 Server Cloud Management Self- Virtual Management Monitoring & Energy Image delivery Usage & Accounting IBM System Director IBM Active Energy IBM BladeCenter Open Fabric Manager TSRM TSAM PMP IBM Storage Manager TPM TPM for OSD TDS IBM ToolsCenter VMware Infrastructure Enterprise TPM for Images HTTP VMware Virtual Center Server TPAE ITM TEMS/TEPS NFS TUAM EE Microsoft SQL Server DB2 / WAS DB2 SAMBA DB2 Microsoft Windows Server SUSE SUSE SUSE SUSE Virtual Server Virtual Server Virtual Server Virtual Server IP1 IP2 IP3 IP4 VMware ESXi 3.5 u4 Hypervisor on imbedded HS22 USB
So, what layers does Cloudburst 1.2 cover? Cloud Consumer Cloud Provider Software as a Cloud Developer User TSAM Secure d, Self- servic e Portal Platform as a Infrastructure as a Consumer Business Manager Partner Clouds Consumer Administrator Ser vic e Del ive ry Por tal BSS OSS Consumer management Cost control IT Automation & control Offering Catalog Offering management TUAM Accounting & Billing Peering & Settlement Optional Audit ISS, & more compliance to come IT Level management TSAM, TSM Common operations TSAM Subscriber management Customer management Invoicing Pricing / Rating Release & deployment automation TSAM Management foundation automation SLA Reporting Entitlements Order management Contract management Tivoli Monitoring Metering, Reporting & Analytics TSAM / TPM quality & resiliency IT request & catalog Se rvi ce D ev el op m en t Po rta l Developer User TSAM Definition & Development Tools Rational contribution Customer in-house IT Virtualizat. Mgt Resources management IBM Systems Director Ensembles Flexible hosting Facility IBM Servers Cloudburst Storage Hardware Network Desktops
How to start?
Building Private Clouds - The Stages of Adoption and Benefits of a Dynamic Infrastructure Business Value Business Business Resilience, Resilience, Security Security Information Information Infrastructure Infrastructure Increase Increase Availability Availability and and Performance Performance Better Better manage manage IT IT Automate Automate systems systems and and data data management management tasks tasks Automation Automation React React with with Agility Agility and and Flexibility Flexibility Dynamically Dynamically respond respond to to changing changing business business needs needs Meet Meet service service level level agreements agreements Cloud Cloud Orchestration Orchestration Mgt Mgt Computing Computing Virtualization Virtualization Provisioning Provisioning Reduce Reduce Costs Costs Decrease Decrease complexity complexity Improve Improve operating operating efficiency efficiency Power Power Mgt Mgt Standardization Standardization Consolidation Consolidation Ability to Dynamically Respond
Workload Analysis Start Here Higher Gain From External Cloud CRM Numerical Application Dev t. & Test Higher Pain To Cloud Delivery Transaction Processing and Database DB, Data warehouse Transaction,Batch Systems Mgmt. Infrastructure [Low Data/Compute] Virtual Desktop Web Serving Mail & Collaboration conferencing Lower Pain To Cloud Delivery Business Applications ERPs, Specific apps Lower Gain From External Cloud
A practical approach to cloud computing Plan & Prepare Condition your existing infrastructure for cloud Virtualize and automate existing systems Add service management, service catalog Define cloud strategy & roadmap Assess cloud deployment models, service options and workloads Plan cloud strategy and roadmap Choose initial project Start with an isolated cloud deployment Choose low-risk workload such as test and development Test & Deploy Standardize applications and systems Deploy self-service portal Use trusted cloud services to supplement data center capabilities for: Infrastructure as a (IaaS) Platform as a (PaaS) Extend & Evolve Software as a (SaaS) 37
Merci! Any Questions? yann_guerin@fr.ibm.com http://www.ibm.com/ibm/cloud/ 38