Puppet OpenStack <3 Fest. by Dan Bode bodepd <at > [ freenode.net, twitter, github ]

Transcription

1 Puppet OpenStack <3 Fest by Dan Bode bodepd <at > [ freenode.net, twitter, github ]

2 OpenStack?

3 What is OpenStack? Open source project Self service API for your infrastructure

4 OpenStack Components Compute (Nova) Image (Glance) Identity (Keystone) Dashboard (Horizon) Object Store (Swift)

5 Nova OpenStack Compute Schedules allocation of compute resources. Scheduler Volumes Volumes Nova API RabbitMQ Compute Compute Compute Network

6 Nova Supports management of VM instances, volumes, and networks Scheduler Volumes Volumes list instance create instance terminate instance Nova API RabbitMQ Compute Compute Compute create network create volume attach volume Network

7 Glance Storage service for Virtual machine images Swift Store FileSystem Glance API Glance Registry

8 Glance Storage service for Virtual machine images Swift AMI Store Store FileSystem Retrieve Glance API AMI Glance Registry

9 Keystone Manages authentication/authorization Tenant Authenticate Keystone API Role User Service Token Endpoint

10 Horizon Provides a dashboard for the OpenStack components.

11 Why Integrate?

12 OpenStack is hard to build reliably, repeatedly

13 OpenStack is hard

14 OpenStack makes it easier to automate the management of compute resources Puppet OpenStack Your Business Configuration Management Self Service API Hardware

15 Puppet can be used to codify best practices for OpenStack OpenStackios Now with best practices by: CERN, Enovance, Cisco Redhat, Cybera

16 Building OpenStack Modules

17 Part One: Creating a community Because you re the experts

18 The first step towards starting an open source community is to write some code

19 Create classes that wrap all of the OpenStack components Class[keystone] Package[keystone] Interface - bind_host - public_port - admin_port - admin_token - compute_port Group[keystone] User[keystone] File[/etc/keystone/keystone.conf] Service[keystone]

20 All of them: nova swift glance keystone horizon openstack rabbitmq mysql memcache apt concat ntp rsync stdlib xinetd

21 Create Higher level role classes Class [openstack::controller] mysql::server rabbit::queue keystone nova::api nova::network::flatdhcp glance::api glance::registry Class [openstack::compute] nova::compute::libvirt memcached nova::scheduler nova::volume::iscsi horizon

22 Design with community in mind

23 Base everything on small reusable components repos: repo_paths: # openstack git repos git://github.com/puppetlabs/puppetlabs-nova: nova git://github.com/puppetlabs/puppetlabs-glance: glance git://github.com/puppetlabs/puppetlabs-swift: swift git://github.com/puppetlabs/puppetlabs-keystone: keystone git://github.com/puppetlabs/puppetlabs-horizon: horizon # openstack middleware git://github.com/puppetlabs/puppetlabs-rabbitmq: rabbitmq git://github.com/puppetlabs/puppetlabs-mysql: mysql git://github.com/puppetlabs/puppetlabs-git: git git://github.com/puppetlabs/puppetlabs-vcsrepo: vcsrepo git://github.com/saz/puppet-memcached: memcached git://github.com/puppetlabs/puppetlabs-rsync: rsync # other deps git://github.com/ghoneycutt/puppet-xinetd: xinetd git://github.com/saz/puppet-ssh: ssh git://github.com/puppetlabs/puppetlabs-stdlib: stdlib git://github.com/puppetlabs/puppetlabs-apt: apt git://github.com/ripienaar/puppet-concat: concat git://github.com/duritong/puppet-sysctl.git: sysctl

24 Make them flexible class nova( $nova_cluster_id='localcluster', $sql_connection = false, $image_service = 'nova.image.glance.glanceimageservice', $glance_api_servers = 'localhost:9292', $rabbit_host = 'localhost', $rabbit_password='guest', $rabbit_port='5672', $rabbit_userid='guest', $rabbit_virtual_host='/', $auth_strategy = 'keystone', $service_down_time = 60, $logdir = '/var/log/nova', $state_path = '/var/lib/nova', $lock_path = $::nova::params::lock_path, $verbose = false, $periodic_interval = '60', $report_interval = '10', $root_helper = $::nova::params::root_helper ) {...}

25 Make it obvious where extensions go glance -- manifests -- db -- mysql.pp `--postgresql.pp -- backend -- file.pp `-- swift.pp

26 Make it obvious how to add additional platforms class nova::params { case $::osfamily { 'RedHat': { # package names $api_package_name $cert_package_name $common_package_name $compute_package_name... } 'Debian': { # package names $api_package_name $cert_package_name $common_package_name $compute_package_name... = false = false = 'openstack-nova' = false = 'nova-api' = 'nova-cert' = 'nova-common' = 'nova-compute'

27 Fear the Fork!

28 Git those forkers!

29

30 300+ merged pull requests

31 Whoa, we need tests

32 Rspec Puppet Data Puppet Facts Model

33 Emulate Facter let :facts do {:operatingsystem => RedHat } end Data Puppet Facts Model

34 Specify Data let :params do {:rabbit_host => } end Data Puppet Facts Model

35 Inspect catalog t do should contain_file ( /etc/nova.conf ).\ with_content ( rabbit_host = ) nd Data Puppet Facts Model

36 Automated unit tests

37 Integration Tests GitHub Jenkins Tempest Puppet

38 Next Steps Start connecting the community get more collaboration on the mailing list grant community members merge rights Single set of preferred community modules for monitoring HA

39 Part 2: Bare Metal

40 Gotta hit bare metal at some point

41 Razor automatically boots a machine in a micro-os with facter running Machines are automatically discovered and turned into an inventory service that can be programmatically installed.

42 Moving towards Reference Architectures You Business, Automated Puppet OpenStack Razor/Puppet/Facter Hardware

43 Resources: