Extending TripleO for OpenStack Infrastructure Management

Transcription

1 Extending TripleO for OpenStack Infrastructure Management Keith Basil Principal Product Manager, Red Hat OpenStack Summit Atlanta May 2014 ( slide 1 ) previous next

2 Keith Basil personal Virginia hare scrambler, plays chess.. professional Red Hat Cloudscaling, Time Warner Cable, FederalCloud.com, Cisco and a couple of startups blended skype/twitter/github/irc, life: noslzzp ( slide 2 ) previous next

3 Agenda Setting Context TripleO Explained (easy) TripleO Explained (detail) OpenStack in a Minute or So OOO Tuskar Deployment Flow TripleO as Management Platform OpenStack Vendor Integration Profiles TripleO Momentum Questions ( slide ) previous next 3

4 Setting Context ( slide 4 ) previous next

5 OpenStack Deployment and Management facilitates planning, deployment and ongoing operations of OpenStack clouds. ( slide 5 ) previous next

6 Our Goal: A Deployed and Managed Cloud Planning What will this OpenStack deployment look like? Topology? Resource capacity? Deployment Hardware and service lifecycle management. Policy driven process. Operations and Management Visualize capacity, metrics & instrumentation ( slide 6 ) previous next

7 bla,bla,bla, OpenStack, bla,bla,bla, Cloud, bla,... COMPLEXITY! ( slide ) previous next 7

8 Deployment & Management Landscape Today Open Source Deployment Options Some Commercially Supported Options PackStack Razor Crowbar DIY (do it yourself) Highly fragmented and mostly about solving the complexity of deployment! ( slide 8 ) previous next

9 Where s the Love? ty m muni m 00 co 0, 6 1 r Ove r s! embe Wait, how m any o 138 coun perator s? tries!!, Who cares code! just +1 my OpenStack Developers OpenStack Operators ( slide 9 ) previous next

10 Operator Heroes.. need love too Operator headband, BOFH Slayer gun handle and OpenStack unicorn branding added for effect. Not for redistribution. ( slide 10 ) previous next

11 TripleO For Infrastructure Management Provides a complete end-to-end infrastructure management solution for OpenStack business planning, system deployment and ongoing operations. Core features: Comprehensive Operator Dashboard Cloud resource planning and modeling Deployment and provisioning Cloud metrics and instrumentation block storage (NetApp) ( slide 11 ) previous next

12 TripleO Explained (easy) ( slide 12 ) previous next

13 OpenStack on OpenStack... but let s ignore the complexity for now. ( slide 13 ) previous next

14 Imagine if you will.. An OpenStack Deployment and Management Application ( slide 14 ) previous next

15 An Application Featuring... An OpenStack Deployment and Management Application Deploying OpenStack to bare metal OpenStack community adopted Providing visual status of core services and cloud infrastructure Offering platform extensibility Providing integration via well known APIs Is cloud operator focused! Naturally resilient and scalable ( slide 15 ) previous next

16 Sounds cool... more please! ( slide 16 ) previous next

17 TripleO Explained (more detail) ( slide 17 ) previous next

18 OpenStack in a Minute or So ( slide 18 ) previous next

19 OpenStack - a quick review.. OpenStack components* manage compute, network and storage resources Nova Neutron Heat VM OS image, network, disk, instrumentation Glance Ceilometer Virtual Machine Deployment *Only a select subset of OpenStack components are shown here. ( slide 19 ) previous next

20 OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Nova provides command and control services for compute nodes. It orchestrates rendering of virtual machines. VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 20 ) previous next

21 OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Heat provides an orchestration engine to launch multiple cloud applications based on templates. Heat manages the whole lifecycle of the application by managing the underlying virtual infrastructure VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 21 ) previous next

22 OpenStack - Nova, Heat & Ceilometer OpenStack components* manage compute, network and storage resources Nova Neutron Heat Glance Ceilometer Ceilometer provides acquisition of usage data across OpenStack core components. Ceilometer data is used to reconcile billing or chargeback of consumed cloud resources. VM OS image, network, disk, instrumentation Virtual Machine Deployment ( slide 22 ) previous next

23 OOO ( slide 23 ) previous next

24 The Concept of TripleO Re-uses OpenStack components to deploy OpenStack on hardware. Nova Neutron Heat Bare Metal OS image, network, disk, instrumentation Glance Ceilometer Hardware Node Deployment & Management ( slide 24 ) previous next

25 OpenStack - Nova, Heat & Ceilometer TripleO uses Nova and Ironic to deploy to hardware Nova Neutron Heat Glance Ceilometer Nova provides command and control services for hardware nodes. Nova s scheduler matches bare metal flavors to hardware. It orchestrates the rendering of bare metal* by treating Ironic s API as a special bare metal hypervisor. Bare Metal OS image, network, disk, instrumentation Hardware Node Deployment * Today, TripleO uses Nova bare metal drivers. As Ironic matures these will be deprecated. ( slide 25 ) previous next

26 OpenStack - Nova, Heat & Ceilometer For hardware, Heat templates encapsulate the equivalent of a cloud resource reference architecture Nova Neutron Heat Glance Ceilometer Here, Heat provides deployment orchestration for hardware nodes. Heat templates capture hardware configuration for consistent and repeatable deployment scenarios. Bare Metal OS image, network, disk, instrumentation Bare Metal OS image, network, disk, instrumentation Bare Metal OS image, network, disk, instrumentation Hardware Node Deployment Orchestration ( slide 26 ) previous next

27 OpenStack - Nova, Heat & Ceilometer Ceilometer provides the framework for metrics and instrumentation data collection Nova Neutron Heat Glance Ceilometer Ceilometer is used to collect metrics on the underlying OpenStack infrastructure. Metrics and instrumentation data can be rolled up for visualization. Bare Metal OS image, network, disk, instrumentation Hardware Node Status ( slide 27 ) previous next

28 Tuskar ( slide 28 ) previous next

29 Tuskar Overview Tuskar provides deployment management services for TripleO Follows same component re-use model as TripleO Introduces the Tuskar operator UI, CLI and API Tuskar Horizon Ceilometer Horizon Ceilometer Tuskar # create an overcloud with 1 controller and 1 compute node tuskar overcloud-create overcloud \ --description "My overcloud" \ --attribute "AdminToken=${OVERCLOUD_ADMIN_TOKEN}" \ --attribute "AdminPassword=${OVERCLOUD_ADMIN_PASSWORD}" \ --attribute "CinderPassword=${OVERCLOUD_CINDER_PASSWORD}" \ --attribute "GlancePassword=${OVERCLOUD_GLANCE_PASSWORD}" \ --attribute "HeatPassword=${OVERCLOUD_HEAT_PASSWORD}" \ --attribute "NeutronPassword=${OVERCLOUD_NEUTRON_PASSWORD}" \ --attribute "NovaPassword=${OVERCLOUD_NOVA_PASSWORD}" \ --attribute "NeutronPublicInterface=$NeutronPublicInterface" \ --attribute "SwiftPassword=${OVERCLOUD_SWIFT_PASSWORD}" \ --attribute "SwiftHashSuffix=${OVERCLOUD_SWIFT_HASH}" \ --attribute "NovaComputeLibvirtType=$OVERCLOUD_LIBVIRT_TYPE" \ --attribute "GlanceLogFile=''" \ --attribute "NeutronDnsmasqOptions=dhcp-option-force=26,1400" \ --role-count $controller_role_id=1 \ --role-count $compute_role_id=$computescale \ --role-count $blockstorage_role_id=$blockstoragescale \ --role-count $swiftstorage_role_id=$swiftstoragescale tripleo wait_for_stack_ready overcloud echo "Overcloud CREATE_COMPLETE" ( slide 29 ) previous next

30 TripleO is an OpenStack Program OpenStack Programs are efforts which are essential to the completion of the OpenStack mission. TripleO is the Deployment program Tuskar s focus has been on infrastructure management Tuskar has been merged into TripleO ( slide 30 ) previous next

31 Deployment Flow ( slide 31 ) previous next

32 Remember this? An OpenStack Deployment and Management Application Deploying OpenStack to bare metal OpenStack community adopted Providing visual status of core services and cloud infrastructure Offering platform extensibility Providing integration via well known APIs Is cloud operator focused! Naturally resilient and scalable ( slide 32 ) previous next

33 Key Concept: We Have Two Clouds Production cloud The OpenStack you know and love The Cloud that your tenants will use Also known as the Overcloud Deployment and Management Application Command and Control cloud (TripleO/OpenStack) Only for Cloud Operator use. Also known as the Undercloud OpenStack as Deployment and Management Application ( slide 33 ) previous next

34 Our Goal? We Want an Operational Cloud ( slide 34 ) previous next

35 Deployment and Management Process 1. One or more Management Nodes are installed in the control rack. ( slide 35 ) previous next

36 Deployment and Management Process 2. Operator logs into Operator Dashboard to configure the infrastructure ( slide 36 ) previous next

37 Deployment and Management Process 3. Operator defines the Controller rack. ( slide 37 ) previous next

38 Deployment and Management Process 4. Operator defines the Resource racks. ( slide 38 ) previous next

39 Deployment and Management Process 5. Controller and Resource racks get provisioned. (Tuskar -> Heat -> Nova -> Ironic -> Hardware) ( slide 39 ) previous next

40 TripleO as Management Platform ( slide 40 ) previous next

41 OpenStack Management Application Platform TripleO was initially focused on deployment. But, why stop there? Underlying OpenStack components are there for our use. Component APIs are well known and understood. Operations focused use cases are very natural here. * Community partners can build on an open, distro agnostic platform. We believe TripleO can work as a platform for on-going cloud operations We believe this will significantly increase OpenStack adoption. * ( slide 41 ) previous next

42 OpenStack Vendor FAQs block storage object storage HPC What does this mean for compute vendors? security management network service monitoring ( slide 42 ) previous next

43 Platform Integration Points (logical view) Operator Dashboard Deployment Orchestration Roles, Services, Elements Instrumentation Agents Bare Metal Drivers Supporting Components Adding resources to the production cloud Special flavor support Scheduling modifications, etc. Horizon Heat Ceilometer Tuskar Nova Ironic Ironic API hardware driver hardware driver hardware node hardware node hardware node ( slide 43 ) previous next

44 Community Vendor Integration Matrix Integration Component Hardware Vendor Interest? Software Vendor Interest? Operator Dashboard (Horizon/Tuskar UI) Bare Metal Drivers (Ironic) Instrumentation (Ceilometer) Infrastructure Orchestration (Roles, Services, Elements) Supporting Components (scheduler, network, etc) Yes Yes Yes Yes Depends on resource Yes Probably Not Probably Maybe / As needed Maybe / As needed ( slide 44 ) previous next

45 OpenStack Vendor Integration Profiles ( slide 45 ) previous next

46 Warning! The profiles you are about to see are not promises, product roadmaps or availability announcements made by the vendors shown or Red Hat. These are sketches of what could be interesting for OpenStack and exist solely to illustrate possible TripleO integration points. Got it? Now back to our show. ( slide ) previous next 46

47 NetApp Conducting early work to bring NetApp product line to TripleO Storage utilization analysis Storage efficiency metrics System reserve capacity Free/unused reserve capacity Cloning, dedupe, snapshot, etc Heat, Ceilometer, Ironic, Horizon integration points block storage (NetApp) ( slide ) previous next 47

48 Dell Dell and Red Hat working on TripleO integration Hardware management and metrics via Ironic (DRAC driver support) Orchestration of firmware, BIOS, drivers, etc, configuration via Heat Integration: Horizon, Ironic, Ceilometer, Heat ( slide 48 ) previous next

49 PrivateCore Privacy of computation vision Trusted boot, attestation, node integrity services, etc. Already using Horizon today Bare metal to tenant use cases Integration points: Horizon, Ironic, Ceilometer, Tuskar, Overcloud scheduling ( slide 49 ) previous next

50 GroundWork OpenStack Unified Monitoring Seurat Heat maps GroundWork appliance as Glance image Horizon plugin architecture blueprint may be needed Integration points: Glance, Ceilometer, Tuskar, Horizon ( slide 50 ) previous next

51 Solinea OpenStack infrastructure monitoring and management Analysis, diagnostics and Ops automation Topology discovery and reports API performance, VM spawns, etc. Integration points: Horizon, Glance, Heat ( slide 51 ) previous next

52 Ceph and Calamari Ceph cluster visualization, monitoring, performance statistics and diagnostics Rolling, continuous upgrades Heat stacks for Ceph clusters, pre-built images in Glance Integration points: Glance, Ceilometer, Tuskar, Horizon ( slide 52 ) previous next

53 TripleO Momentum ( slide 53 ) previous next

54 Diverse and Strong Community Work Tuskar TripleO Ironic Red Hat releases InStack, a TripleO based installer for RDO Icehouse HP s Helion uses TripleO for installation Rackspace doing advanced work with Ironic (solving for multi-tenancy use case) ( slide 54 ) previous next

55 Gaps Auto-discovery of nodes Complex hardware configuration needs to be supported Infrastructure topology awareness ( slide 55 ) previous next

56 Questions? ( slide 56 ) previous next

57 Thank You! ( slide 57 ) previous next