Workflows and Patterns. #jenkinsconf

Transcription

1 Workflows and Patterns

2 2 September 5, 2015

3

4 Leo Janine that s me San Francisco, CA Fiona

5

6 (and that s ok )

7

8 type YESIKNOWWHATIMDOING + click automatically

9

10 One size doesn t fit all!

11

12 Continuous Everything sounds better with continuous Jenkins Continuous Development Continuous Integration Continuous Delivery Continuous Deployment Continuous Monitoring

13

14 Project CMS Builds Magento Magento Magento Magento M Solr ERP Release Applications

15 Environment Staging Magento Magento 119 Magento Magento Magento 119 Magento Servers Magento Magento Magento Instances

16 transient, potentially broken Devbox Integration Deploy Staging Production

17 VirtualBox + Vagrant Jenkins Server identical setup Devbox Integration Deploy Staging Production

18

19 What is it? A simple shell script. That s it! No Ant, no Phing, no fancy PHP tool/framework Where is it used? In the build job of a Jenkins server What does it need to know? Where to get all the source code from What does it do? add metadata, composer, minify, packaging, upload to S3

20 What is it? A couple of chef cookbooks. Run by AWS OpsWorks or Vagrant, Where is it used? On the target servers What does it need to know? The role of the server (web server, devbox, Redis, ) What does it do? Installing and configuring web server, PHP, MySQL, Redis,

21 What is it? A simple shell script. Or the deploy chef cookbook Or EasyDeployWorkflows Where is it used? On the target servers What does it need to know? How to get the build and where to deploy it to What does it do? (Resetting the environment), getting the build, extracting it, managing release folders and symlinks, triggering installer, cleanup old releases

22 What is it? A simple shell script. Sometimes triggered inside deploy before_migrate.rb Where is it used? On the target servers, called from deployment step What does it need to know? What environment this is. Injected settings What does it do? Run modman, apply settings, trigger update scripts, customize cache prefix, indexing,

23 doesn t know anything about the app, except where to get it from and where to put it knows how to get the app up and running

24

25 no updating of any configuration settings! no clearing the cache no creating CMS blocks no creating product attributes no purging CDN or Reverse Proxy content!

26 (Vanilla) Magento core Modules Settings Database dump Scripts Tools media directory (sometimes minified)

27 Database Settings Payment Provider Configuration Feature Flags Urls Everything that s different between two environments

28

29

30 Vagrant Boxes

31 Pizza (Italians) Every single line potentially can break production! Bratwurst (Germans) Donut (Americans) Awesome stuff

32 GIT, SVN, Version Control PHP lint

33 Crucible, Version Control Code Reviews

34 Files DB Version Control Code Reviews Installer Build Settings

35 Files CodeSniffer php-pmd php-cpd Build Static Code Analysis php-depend er Settings

36 First system where code from all developers/teams meets each other Static Code Analysis Install on Integration unstable system, might be broken, will be rebuilt without warning

37 PHPUnit Install on Integration Unit Tests

38 AOE PMD (for Magento) broken links, HTTP headers, W3C validity, Unit Tests Integration Tests Basically this is also PHPUnit, but addressing other things Test features that rely on other parts (e.g. framework, external services, ) External components (SSL, Redis, Varnish, ERP, Data Import, )

39 Selenium Integration Tests Acceptance Tests

40 size Chrome Firefox US UK DE IT FR languages browser

41 size language touchstone job browser

42 Behat, PDIFF, Same setup as production, but different machines Acceptance Tests Install on Staging Client QA / approval

43 JMeter Install on Staging Stress Tests Spin up EC2 instances to produce traffic

44 Again: multiple servers or autoscaling setup A/B Deployments on different scales Stress Tests Zero Downtime Install on Production Plan B: rollback

45

46

47

48 Stress Tests Install on Production

49 Deployment!= Feature Release

50 Install on Production Enable Features

51 Install on Integration Install on Staging Version Control Code Reviews Build Static Code Analysis Unit Tests Integration Tests Acceptance Tests Install on Production Enable Features

52 Pipeline Visualization for team dashboards Build Static Code Analysis Install on Integration Unit Tests Integration Tests Acceptance Tests #285 #284 #283 #282 #281 #280

53

54 Tom E.

55

56

57

58

59

60

61 My blog Follow me on twitter!

62