Extending TripleO for OpenStack Infrastructure Management Keith Basil Principal Product Manager, Red Hat OpenStack Summit Atlanta May 2014 ( slide 1 ) previous next
Keith Basil personal Virginia hare scrambler, plays chess.. professional Red Hat Cloudscaling, Time Warner Cable, FederalCloud.com, Cisco and a couple of startups blended skype/twitter/github/irc, life: noslzzp ( slide 2 ) previous next
Agenda Setting Context TripleO Explained (easy) TripleO Explained (detail) OpenStack in a Minute or So OOO Tuskar Deployment Flow TripleO as Management Platform OpenStack Vendor Integration Profiles TripleO Momentum Questions ( slide ) previous next 3
Setting Context ( slide 4 ) previous next
OpenStack Deployment and Management facilitates planning, deployment and ongoing operations of OpenStack clouds. ( slide 5 ) previous next
Our Goal: A Deployed and Managed Cloud Planning What will this OpenStack deployment look like? Topology? Resource capacity? Deployment Hardware and service lifecycle management. Policy driven process. Operations and Management Visualize capacity, metrics & instrumentation ( slide 6 ) previous next
bla,bla,bla, OpenStack, bla,bla,bla, Cloud, bla,... COMPLEXITY! ( slide ) previous next 7
Deployment & Management Landscape Today Open Source Deployment Options Some Commercially Supported Options PackStack Razor Crowbar DIY (do it yourself) Highly fragmented and mostly about solving the complexity of deployment! ( slide 8 ) previous next
Where s the Love? ty m muni m 00 co 0, 6 1 r Ove r s! embe Wait, how m any o 138 coun perator s? tries!!, Who cares code! just +1 my OpenStack Developers OpenStack Operators ( slide 9 ) previous next
Operator Heroes.. need love too.. http://sharpwriter.deviantart.com/art/welcome-to-the-internet-please-follow-me-322248378 http://creativecommons.org/licenses/by-nc-nd/3.0/ Operator headband, BOFH Slayer gun handle and OpenStack unicorn branding added for effect. Not for redistribution. ( slide 10 ) previous next
TripleO For Infrastructure Management Provides a complete end-to-end infrastructure management solution for OpenStack business planning, system deployment and ongoing operations. Core features: Comprehensive Operator Dashboard Cloud resource planning and modeling Deployment and provisioning Cloud metrics and instrumentation block storage (NetApp) ( slide 11 ) previous next
TripleO Explained (easy) ( slide 12 ) previous next
OpenStack on OpenStack... but let s ignore the complexity for now. ( slide 13 ) previous next
Imagine if you will.. An OpenStack Deployment and Management Application ( slide 14 ) previous next
An Application Featuring... An OpenStack Deployment and Management Application Deploying OpenStack to bare metal OpenStack community adopted Providing visual status of core services and cloud infrastructure Offering platform extensibility Providing integration via well known APIs Is cloud operator focused! Naturally resilient and scalable ( slide 15 ) previous next
Sounds cool... more please! ( slide 16 ) previous next
TripleO Explained (more detail) ( slide 17 ) previous next
OpenStack in a Minute or So ( slide 18 ) previous next
OpenStack - a quick review.. OpenStack components* manage compute, network and storage resources Nova Neutron Heat VM OS image, network, disk, instrumentation Glance Ceilometer Virtual Machine Deployment *Only a select subset of OpenStack components are shown here. ( slide 19 ) previous next
OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Nova provides command and control services for compute nodes. It orchestrates rendering of virtual machines. VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 20 ) previous next
OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Heat provides an orchestration engine to launch multiple cloud applications based on templates. Heat manages the whole lifecycle of the application by managing the underlying virtual infrastructure VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 21 ) previous next
OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Ceilometer provides acquisition of usage data across OpenStack core components. Ceilometer data is used to reconcile billing or chargeback of consumed cloud resources. VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 22 ) previous next
OOO ( slide 23 ) previous next
The Concept of TripleO Re-uses OpenStack components to deploy OpenStack on hardware. Nova Neutron Heat Bare Metal OS image, network, disk, instrumentation Glance Ceilometer Hardware Node Deployment & Management ( slide 24 ) previous next
OpenStack - Nova, Heat & Ceilometer TripleO uses Nova and Ironic to deploy to hardware Nova Neutron Heat Glance Ceilometer Nova provides command and control services for hardware nodes. Nova s scheduler matches bare metal flavors to hardware. It orchestrates the rendering of bare metal* by treating Ironic s API as a special bare metal hypervisor. Bare Metal OS image, network, disk, instrumentation Hardware Node Deployment * Today, TripleO uses Nova bare metal drivers. As Ironic matures these will be deprecated. ( slide 25 ) previous next
OpenStack - Nova, Heat & Ceilometer For hardware, Heat templates encapsulate the equivalent of a cloud resource reference architecture Nova Neutron Heat Glance Ceilometer Here, Heat provides deployment orchestration for hardware nodes. Heat templates capture hardware configuration for consistent and repeatable deployment scenarios. Bare Metal OS image, network, disk, instrumentation Bare Metal OS image, network, disk, instrumentation Bare Metal OS image, network, disk, instrumentation Hardware Node Deployment Orchestration ( slide 26 ) previous next
OpenStack - Nova, Heat & Ceilometer Ceilometer provides the framework for metrics and instrumentation data collection Nova Neutron Heat Glance Ceilometer Ceilometer is used to collect metrics on the underlying OpenStack infrastructure. Metrics and instrumentation data can be rolled up for visualization. Bare Metal OS image, network, disk, instrumentation Hardware Node Status ( slide 27 ) previous next
Tuskar ( slide 28 ) previous next
Tuskar Overview Tuskar provides deployment management services for TripleO Follows same component re-use model as TripleO Introduces the Tuskar operator UI, CLI and API Tuskar Horizon Ceilometer Horizon Ceilometer Tuskar # create an overcloud with 1 controller and 1 compute node tuskar overcloud-create overcloud \ --description "My overcloud" \ --attribute "AdminToken=${OVERCLOUD_ADMIN_TOKEN}" \ --attribute "AdminPassword=${OVERCLOUD_ADMIN_PASSWORD}" \ --attribute "CinderPassword=${OVERCLOUD_CINDER_PASSWORD}" \ --attribute "GlancePassword=${OVERCLOUD_GLANCE_PASSWORD}" \ --attribute "HeatPassword=${OVERCLOUD_HEAT_PASSWORD}" \ --attribute "NeutronPassword=${OVERCLOUD_NEUTRON_PASSWORD}" \ --attribute "NovaPassword=${OVERCLOUD_NOVA_PASSWORD}" \ --attribute "NeutronPublicInterface=$NeutronPublicInterface" \ --attribute "SwiftPassword=${OVERCLOUD_SWIFT_PASSWORD}" \ --attribute "SwiftHashSuffix=${OVERCLOUD_SWIFT_HASH}" \ --attribute "NovaComputeLibvirtType=$OVERCLOUD_LIBVIRT_TYPE" \ --attribute "GlanceLogFile=''" \ --attribute "NeutronDnsmasqOptions=dhcp-option-force=26,1400" \ --role-count $controller_role_id=1 \ --role-count $compute_role_id=$computescale \ --role-count $blockstorage_role_id=$blockstoragescale \ --role-count $swiftstorage_role_id=$swiftstoragescale tripleo wait_for_stack_ready 220 10 overcloud echo "Overcloud CREATE_COMPLETE" ( slide 29 ) previous next
TripleO is an OpenStack Program OpenStack Programs are efforts which are essential to the completion of the OpenStack mission. TripleO is the Deployment program Tuskar s focus has been on infrastructure management Tuskar has been merged into TripleO ( slide 30 ) previous next
Deployment Flow ( slide 31 ) previous next
Remember this? An OpenStack Deployment and Management Application Deploying OpenStack to bare metal OpenStack community adopted Providing visual status of core services and cloud infrastructure Offering platform extensibility Providing integration via well known APIs Is cloud operator focused! Naturally resilient and scalable ( slide 32 ) previous next
Key Concept: We Have Two Clouds Production cloud The OpenStack you know and love The Cloud that your tenants will use Also known as the Overcloud Deployment and Management Application Command and Control cloud (TripleO/OpenStack) Only for Cloud Operator use. Also known as the Undercloud OpenStack as Deployment and Management Application ( slide 33 ) previous next
Our Goal? We Want an Operational Cloud ( slide 34 ) previous next
Deployment and Management Process 1. One or more Management Nodes are installed in the control rack. ( slide 35 ) previous next
Deployment and Management Process 2. Operator logs into Operator Dashboard to configure the infrastructure ( slide 36 ) previous next
Deployment and Management Process 3. Operator defines the Controller rack. ( slide 37 ) previous next
Deployment and Management Process 4. Operator defines the Resource racks. ( slide 38 ) previous next
Deployment and Management Process 5. Controller and Resource racks get provisioned. (Tuskar -> Heat -> Nova -> Ironic -> Hardware) ( slide 39 ) previous next
TripleO as Management Platform ( slide 40 ) previous next
OpenStack Management Application Platform TripleO was initially focused on deployment. But, why stop there? Underlying OpenStack components are there for our use. Component APIs are well known and understood. Operations focused use cases are very natural here. * Community partners can build on an open, distro agnostic platform. We believe TripleO can work as a platform for on-going cloud operations We believe this will significantly increase OpenStack adoption. * http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey ( slide 41 ) previous next
OpenStack Vendor FAQs block storage object storage HPC What does this mean for compute vendors? security management network service monitoring ( slide 42 ) previous next
Platform Integration Points (logical view) Operator Dashboard Deployment Orchestration Roles, Services, Elements Instrumentation Agents Bare Metal Drivers Supporting Components Adding resources to the production cloud Special flavor support Scheduling modifications, etc. Horizon Heat Ceilometer Tuskar Nova Ironic Ironic API hardware driver hardware driver hardware node hardware node hardware node ( slide 43 ) previous next
Community Vendor Integration Matrix Integration Component Hardware Vendor Interest? Software Vendor Interest? Operator Dashboard (Horizon/Tuskar UI) Bare Metal Drivers (Ironic) Instrumentation (Ceilometer) Infrastructure Orchestration (Roles, Services, Elements) Supporting Components (scheduler, network, etc) Yes Yes Yes Yes Depends on resource Yes Probably Not Probably Maybe / As needed Maybe / As needed ( slide 44 ) previous next
OpenStack Vendor Integration Profiles ( slide 45 ) previous next
Warning! The profiles you are about to see are not promises, product roadmaps or availability announcements made by the vendors shown or Red Hat. These are sketches of what could be interesting for OpenStack and exist solely to illustrate possible TripleO integration points. Got it? Now back to our show. ( slide ) previous next 46
NetApp Conducting early work to bring NetApp product line to TripleO Storage utilization analysis Storage efficiency metrics System reserve capacity Free/unused reserve capacity Cloning, dedupe, snapshot, etc Heat, Ceilometer, Ironic, Horizon integration points block storage (NetApp) ( slide ) previous next 47
Dell Dell and Red Hat working on TripleO integration Hardware management and metrics via Ironic (DRAC driver support) Orchestration of firmware, BIOS, drivers, etc, configuration via Heat Integration: Horizon, Ironic, Ceilometer, Heat ( slide 48 ) previous next
PrivateCore Privacy of computation vision Trusted boot, attestation, node integrity services, etc. Already using Horizon today Bare metal to tenant use cases Integration points: Horizon, Ironic, Ceilometer, Tuskar, Overcloud scheduling ( slide 49 ) previous next
GroundWork OpenStack Unified Monitoring Seurat Heat maps GroundWork appliance as Glance image Horizon plugin architecture blueprint may be needed Integration points: Glance, Ceilometer, Tuskar, Horizon ( slide 50 ) previous next
Solinea OpenStack infrastructure monitoring and management Analysis, diagnostics and Ops automation Topology discovery and reports API performance, VM spawns, etc. Integration points: Horizon, Glance, Heat ( slide 51 ) previous next
Ceph and Calamari Ceph cluster visualization, monitoring, performance statistics and diagnostics Rolling, continuous upgrades Heat stacks for Ceph clusters, pre-built images in Glance Integration points: Glance, Ceilometer, Tuskar, Horizon ( slide 52 ) previous next
TripleO Momentum ( slide 53 ) previous next
Diverse and Strong Community Work Tuskar TripleO Ironic Red Hat releases InStack, a TripleO based installer for RDO Icehouse HP s Helion uses TripleO for installation Rackspace doing advanced work with Ironic (solving for multi-tenancy use case) ( slide 54 ) previous next
Gaps Auto-discovery of nodes Complex hardware configuration needs to be supported Infrastructure topology awareness ( slide 55 ) previous next
Questions? ( slide 56 ) previous next
Thank You! ( slide 57 ) previous next