OpenStack CI: flow, tools and more

Transcription

1 Title OpenStack CI: flow, tools and more November 21, 2015 Aleksandra Fedorova, CI Team Lead

2 Outline What is Continuous Integration What is OpenStack Continuous integration of OpenStack: challenges and solutions The downstream story

3 Subtitle1 Continuous Integration

4 Feature branches feature A master/dev/trunk... feature B

5 Feature branches feature A integration master/dev/trunk...?! feature B

6 Continuous Integration feature A master/dev/trunk... feature B

7 Continuous Integration feature A???? master/dev/trunk...? feature B

8 Continuous Integration feature A???? master/dev/trunk...? feature B continuous quantum integration

9 CI Every point on this diagram is a working state It can be tested!

10 CI purpose Every point on this diagram is a working state It needs to be tested

11 Subtitle2 OpenStack

12 OpenStack

13 OpenStack Cloud, cloud, cloud...

14 OpenStack Cloud, cloud, cloud... Many components Every component is a framework Any combination is possible and it is just huge

15 OpenStack Activity

16 Gerrit Workflow (visualized by GitHub)

17 OpenStack CI "Preventing craziness: a deep dive into OpenStack testing automation" by Thierry Carrez

18 Everything is a code Puppet, Ansible, Chef...

19 Everything is a code Puppet, Ansible, Chef... list of Gerrit repositories?

20 Everything is a code Puppet, Ansible, Chef... list of Gerrit repositories? CI configuration?

21 Everything is a code Puppet, Ansible, Chef... list of Gerrit repositories? CI configuration? Meetings schedule?

22 Everything is a code Puppet, Ansible, Chef... list of Gerrit repositories? CI configuration? Meetings schedule? We have a YAML for that!

23 Everything is a code Puppet, Ansible, Chef... list of Gerrit repositories? CI configuration? Meetings schedule? We have a YAML for that! and a code review too

24 Tools Jenkins Job Builder Jeepyb aka Gerrit Project Bulder Grafyaml

25 Scalable CI Zuul: the CI scheduler nodepool: CI nodes provider Multi-master Jenkins setup via Zuul, unified dynamic nodes pool via nodepool

26 Elastic Recheck Developer dream and Infra pain

27 Subtitle3 Downstream story

28 Upstream vs. Downstream project Community Product

29 Upstream vs. Downstream project Community Product test coverage

30 Upstream vs. Downstream project Community Product test coverage deadlines

31 Upstream vs. Downstream project Community Product test coverage deadlines SLA

32 Upstream vs. Downstream CI Community Product

33 Upstream vs. Downstream CI Community Product DevStack test environments: bash + screen

34 Upstream vs. Downstream CI Community DevStack test environments: bash + screen Product 2 HA deployment test on each commit

35 Upstream vs. Downstream CI Community DevStack test environments: bash + screen Product 2 HA deployment test on each commit 68 multinode HA deployment scenarios tested nightly

36 More CI packages/* CR - build package - install - custom test - system test Merge packages Repository CentOS upstream MOS mirror local mirror openstack/* CR - unit tests - syntax tests - build package - install - custom test - system test - Tempest - components - simple Rally Merge build iso bvt smoke stable mirror test proposed openstack-build/* CR - build package - install - custom test - system test Merge ISO bvt smoke local mirror stackforge/fuel-* CR individual tests per repo syntax unit system test build package Merge stable ISO SWARM Ubuntu upstream

37 Q&A OpenStack Infra Fuel project