Automation & Open Source. How to tame the Cloud?

Transcription

1 Automation & Open Source How to tame the Cloud?

2 Who are we? François Deppierraz Mathieu Bornoz System and Network engineer System and Software engineer Reluctant to type the same command twice Automation obsessed Provides consulting services Head of the Infrastructure Solutions Department

3 Agenda Context Why automation? Why did we build our own private cloud? Use cases Puppet Modules: continuous integration Deploy & Manage Virtual Infrastructure (demo) Conclusion 3

4 Context Geospatial & Business solutions development Need to provide standard solutions platform for development, QA, prod, CI (TDD, BDD) RedHat/Debian/Ubuntu ready Flexible hosting (Cloud, virtual, bare-metal) Scalable and evolutive platform Deployed/managed by us or by customers 4

5 Hybrid Platform

6 Why automation? Share working knowledge as code Repeatability Reuse components Decreased manual configuration DevOps Philosophy Change management Ability to record changes in a VCS 6

7 Why build a private cloud? Benefits Keep control on the full stack Data locality and sovereignty Useful for internal infrastructure/services Customer choice (privacy vs. capacity/elasticity) Leverage existing infrastructure (Data Center, Network, Hardware) -> cost effectiveness Help keep internal developments provider agnostic 7

8 Camptocamp s private cloud OpenStack Icehouse (started with Havana) Deployment automated with Foreman and Puppet 30+ physical servers Ceph for volumes and objects storage Upgrades are somewhat tricky... 8

9

10 Use Case #1: Puppet Modules Dev & QA

11 Puppet Modules: Dev & QA Improved development workflow Source code hosted on Github At each commit, Travis CI triggers Unit tests Acceptance tests (server spec) on our private cloud For each new tag commited Upload the release to the Puppet Forge 11

12

13 Puppet modules

14 14

15 Using worker: worker-linux-docker-1872a3f1.prod.travis-ci.org:travis-linux-5 $ git clone --depth=50 --branch=master git://github.com/camptocamp/puppet-openldap $ export BEAKER_set="debian-8-x86_64-openstack" Provisioning OpenStack Provisioning debian-8-x64 (...) OpenStack host debian-8-x64 (...) assigned ip: (debian-8-x64) 19:27:51$ apt-get install -y puppet... (debian-8-x64) 19:30:04$ puppet apply --strict_variables Port "389" should be listening 1178 Port "636" should be listening 1251 Finished in 4 minutes 1.1 seconds (files took 2 minutes 4.9 seconds to load) examples, 0 failures

16

17 Unit / Acceptance Tests Benefits Test / Behavior Driven Development Pluggable inside your Continuous Delivery Pipeline Non-regression secured by tests in change requests Simplifies multi-platform validation More confidence as a result 17

18 Use Case #2: Deploy & Manage Virtual Infrastructure Terraform demo

19 Terraform Infrastructure as Code One layer above typical CM tools (Puppet, Chef, ) Manages servers, networks, DNS records,... Simple file based configuration JSON-like language Idempotency Missing feature from other tools (CloudFormation, OpenStack Heat, ) 19

20

21 Provisioning from scratch 21

22

23 Live Demo

24 diff(1) your infrastructure 24

25 diff(1) your infrastructure 25

26 Apply changes to the infrastructure 26

27

28 Conclusion Taming the cloud requires... appropriate tooling (automation) embracing DevOps principles agility and willingness to learn The FOSS ecosystem provides software for Bootstrapping and managing your own private cloud Automate the deployment of all your infrastructure All that with the great support of FOSS communities! 28

29 Thank you for your attention! Any questions?