Introduc)on of Pla/orm ISF Weina Ma Weina.Ma@uoit.ca
Agenda Pla/orm ISF Product Overview Pla/orm ISF Concepts & Terminologies Self- Service Applica)on Management Applica)on Example Deployment Examples
Pla/orm Compu)ng, Inc. Pla7orm Clusters, Grids, Clouds, Whatever Compu=ng The leader in cluster, grid and cloud management so3ware: o 17 years of profitable growth o 2,000 of the world s most demanding client organiza)ons o 5,000,000 CPUs under management o 500 professionals working across 13 global centers o Many Strategic rela)onships including Dell, Intel, MicrosoV, Red Hat and SAS
Pla/orm Product Por/olio Pla7orm Cluster Pla7orm MPI Pla7orm LSF Pla7orm Symphony Pla7orm ISF Clusters Grids Workload Management Resource Management Clouds Pla7orm Compu=ng
What is ISF? ISF: Infrastructure Sharing Facility End- to- end private cloud management sovware. Pla/orm ISF creates a shared compu)ng infrastructure from heterogeneous physical and virtual resources to deliver applica)on environments according to workload- smart and resource- aware policies.
Pla/orm ISF for IaaS Management SoVware layer purpose- built to manage private cloud data centers - All kinds of apps & workload - Heterogeneous resources Smart automa)on matches IT demand with supply - Workload smart - Resource aware - Dynamic flexing Policy- driven, governance, compliance, security Works with exis)ng mgmt tools Business Units Demand Cloud Management Supply
Key Pla/orm ISF Capaci)es Heterogeneous KVM / Xen + Physical + External Cloud Hierarchy Cloud Management Infrastructure To Multi-Tier Applications + Deep VMware Integration Rapid Provisioning and/or Flexing Multi-data Center Cloud Cockpit
Pla/orm ISF Overview Delivering applica)on environments according to workload- smart & resource- aware policies Pla7orm ISF Applica=on Middleware Integra=ons Ticke=ng System CMDB Opera=onal Manager Monitoring Alarms Events Opera=ons En=tlement System Authen=ca=on & Security
ISF is TOP1 in Private Cloud Analyst firm Forrester published an assessment report on private cloud sovware in 2011, and Pla/orm Compu)ng, with its ISF sovware, appears to have the most- complete offering based on Forrester s criteria
ISF Concepts & Terminologies
ISF Terminology Resource Management Concepts Host Hypervisor or physical host that can be used to sa)sfy provisioning requests Resource Adapter Pluggable module that implements an interface allowing ISF to talk to various provisioning and virtualiza)on management systems Agent: Pre- built module that supports interac)on with certain virtualiza)on management systems (e.g kvm) Resource Group Grouping of hosts used for tracking reserva)ons/alloca)ons for capacity management Mapped onto hypervisor groups e.g Vmware DataCenters Resource groups organized hierarchically
ISF Terminology Policy Based Automa)on Placement Policies Control where VMs will be placed on physical infrastructure Can be specified on applica)on component level or global (packing, striping, CPU- load, etc) Applica=on Policies Thresholds that trigger the adding or removing of resources to an applica)on based on memory, cpu, etc Resource Policies Thresholds that trigger automated ac)ons on hosts, VMs, applica)on instances such as power on/off/migrate Alarms Thresholds which trigger no)fica)on and change state of hosts, VMs, applica)ons to indicate opera)onal problems
ISF Terminology Account A way of grouping users and providing access to cloud resources for resource accoun)ng and quota purposes Mapped onto organiza)onal / departmental structure Applica=on Defini=on A blueprint specifying the steps to provision, monitor and manage an applica)on environment Made up of component consis)ng of a set of similar machines Defini)on can consist of a single component or mul)ple linked components Applica=on Instance A set of machine (VMs or physical machines) created from a blueprint by a user to run at specific )me with selectable deployment parameters Post- Provisioning Script Script that runs inside the VM that does set up of network parameters, applica)on installa)on/configura)on, management agents Applica=on Workflow Scripts that run on the ISF Master that co- ordinate the sequencing of ac)vi)es during the applica)on lifecycle (eg. crea)on, power on/off, delete)
Apache Web Server Tomcat App Server Quan)ty = 1 (min max) - Quan)ty = 2 (min max) Type = virtual - Type = Virtual # of CPUs (min max) = 1 - # of CPUs = 2 (min max) Memory (MB) (min Max)= 256 - Memory (MB) (min max) = 768 IP Address = DHCP - IP Address = DHCP Configure = Post Script - Configure Applica)on = Post Script Workflow = Script - Workflow = Script Applica=on Defini=on
Bladelogic App Provisioning BMC BladeLogic AppServer 1 ISF 2 VMWare vcenter 3 VMO Tools VM BL Scripts ESXi servers 1. User deploys applica)on through ISF GUI 2. Create VM through vcenter 3. Power On VM 4. VMOTools runs post- provisioning script in VM Install RSCD Agent Start Agent Invoke blcli to add VM to BL Invoke blcli to run DeploymentJob
External Approval Integra)on Want to integrate with Helpdesk Requests for applica)ons/machines should create a helpdesk )cket Ticket should contain request details Ticket should have Approve / Reject URL I need applica)on X for 2 weeks Request ISF Open Ticket Helpdesk Pickup Close Approve 2013-03- 18 16
Roles
Usage Data for Billing & Capacity Planning HPC Applica=on Repor=ng App JBOSS App Other Data External Billing System Pla7orm ISF Rate Defini)on Usage Data Reserved Amount & Time On- Demand Amount & Time CPU Usage Mem Usage By Account By Applica)on Def By User By Resource Group
Self- Service Applica=on Management
Applica)on Defini)on Prerequisite: A Linux Template is installed with VMTools Applica)on Defini)ons are blueprints for crea)ng an en)re applica)on environment App Def s will be discussed in more detail later on For now, we will create a simple App Def consis)ng of a RHEL VM Navigate to the Defini)ons tab from the Applica)ons link Instead of crea)ng an App Def from scratch, modify an exis)ng one:
Applica)on Defini)on Change the Quan))es to 1 and leave the rest of the fields as the default values
Applica)on Defini)on Click on SoVware Details and select your template from the list
Applica)on Defini)on Publish the Applica)on Defini)on: Make the App Def visible to specific accounts from the Publishing List:
Applica)on Instance The Applica)on Defini)on provides a template for an applica)on environment Deploying from the Applica)on Defini)on results in an Applica)on Instance The cockpit view displays a New Applica)on buton: This opens up the following window:
Applica)on Instance A request is made to the Cloud Admin and the status of the App Instance is Awai)ng Approval When approved, the user sees the following:
Opera)ons View Applica)on Instance Opera)ons: Power On Modify Power Off Add/Remove Machines Delete Performance Charts Cancel Take Snapshot Clone Configura)on Manage Snapshot VM Opera)ons Start Up Delete Shut Down Suspend Force Shut Down Resume Reboot Remote Console Force Reboot
Applica)on Instance Reserva)on Period The reserva)on period is the dura)on in which the resources for the applica)on instance are reserved When the reserva)on period has expired, the VMs in the App Instance are powered off and the instance is no longer usable The reserva)on period can be extended while the App Instance is in the Ac)ve state
Events and Details View The Events view helps to keep track of the status of deploying an applica)on instance The Details view displays proper)es of the applica)on instance
Applica)on Example
ISF Applica)on Instan)a)on Workflow Scenario: An IT Admin wants to deploy a Websphere Environment. ISF Client submits request to deploy WebSphere Environment. Request is approved by ISF Admin. ISF provisions 2 VMs, installs WebSphere and deploys an applica)on on each of them. AVer WebSphere VMs are provisioned, ISF provisions another VM with an Apache Load Balancer installed. ISF Client ISF Master Host VMware vcenter VMware ESX Servers Virtual Machines
ISF WebSphere Load Balancing Scenario Scenario: A client makes mul)ple requests to a proxy host. A client makes two requests in sequence. The Apache Load Balancer (proxy) receives each request. The first and second request will alternate between Applica)on Server 1 and Applica)on Server 2. Request1 Client Request2 Load Balancer Request1 Request2 Applica=on Server 1 Applica=on Server 2
ISF WebSphere Applica)on Policy Scenario: The exis)ng WebSphere VMs are running at full CPU capacity. ISF Master Host An ISF applica)on policy is configured to trigger when each WebSphere VM is running at over 80% CPU load. WebSphere VM load > 80% Each WebSphere VM is currently running at 100% CPU load. This triggers the policy. The policy ac)on is to flex up addi)onal machines un)l the CPU load is below 80%. ISF provisions an addi)onal VM for the applica)on. The CPU load of each VM is now 60%. No addi)onal VMs are needed. VMware vcenter VMware ESX Servers Virtual Machines New VM WebSphere Provisioned
Deployment Example
Applica)on Cloud App 1 App 2 App N Environment App Server App Server App Server 100s Java & Analy)c apps on 1000s proprietary UNIX SMP servers Challenge Siloed servers resul)ng in low resource u)liza)on, and expensive opera)ng costs Time- consuming, manual provisioning App 1 App 2 App N Self-Service Portal App Server Platform ISF Virtual Servers Solu=on Linux, Xen/KVM on commodity servers and storage; Self- service resource reserva)on, alloca)on & applica)on deployment, with automated placement policies across shared resources Benefits Reduced opera)ng costs by 75% Automa)cally deploy applica)on environments within 30 minutes instead of 2 weeks Applica)on teams can modify and scale infrastructure without IT involvement Improved developer produc)vity Applica)on stack and infrastructure is not reliant on one big vendor
Test/Dev Cloud: Global Banks Java Applica=on Development Teams So3ware Build.Net and C++ Teams Environment Many sovware development groups distributed globally Pla7orm ISF Challenge Siloed build and development environments within each group (30+ apps) Slow sovware build process and wasted configura)on )me to set up environments. Duplica)on of effort across teams Solu=on Consolidated Java applica)on development environment into cloud. Dynamically create environments for development and build Benefits Shared environment for Java applica)on development across global teams Increased developer produc)vity Proving ground for produc)on Java applica)on cloud.
Reference Customer Architecture Applica=on Service Monitoring Stateless Applica=ons Approval Business Logic En=tlement System Corporate Standard Java Framework Oracle (CMDB) Corporate DNS&DHCP Virtual Apache Tomcat Pla7orm ISF Pla7orm Cluster Manager Physical RHEL / CentOS Xen with plan to migrate to KVM Site Minder Applications are packaged & deployed as standard WAR files extracted from database Site Minder for Single Sign on User Authentication Multi-level Approval business logic & Entitlement System Oracle database for Application Performance and Transaction data App Service Monitoring GUI integration Integration with Corporate DNS/ DHCP for provisioning 64 bit x86 Servers 32 bit x86 Servers
Ac)ve- Ac)ve Mul)ple DataCenter Deployment End-User Cloud Admin End-User Applica)on Applica)on Backup ISF Master ISF Master Node Portal ICM CES JGROUP ISF Master Node Portal ICM CES Backup ISF Master P- VMO P- VMO VMWare PCM Nagios VMWare PCM Physical provisionin g Virtualiza)on Management Management Monitoring Physical provisionin g Virtualiza)on Management Hypervisor Hypervisor Hardware
Future Global Enterprise Deployment App Manager Applica)on ISF Master Node ISF Market Place Broker End-User Portal ICM CES P- VMO Portal ICM CES Cloud Admin xcat Tivoli Blad elogic VMware Amazon Enterprise Messaging Infrastructure / JMS Enterprise DB Infrastructure xcat Opsware P- VMO Blad elogic VMware Citrix RedHat Remote Proxy VMware Nagios xcat West Coast Data Center Remote Proxy VMware Nagios xcat East Coast Data Center Europe Data Center Leverage EGO capabili)es to distribute ISF services across mul)ple nodes and provide centralized monitoring, troubleshoo)ng, and HA