It s Not Called Continuous Integration for Nothing!

Transcription

1 It s Not Called Continuous Integration for Nothing! Dan Boutin Vice President of Digital Strategy dboutin@soasta.com Mobile (404)

2 In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing

3 SOASTA Performance Analytics 10 Million Tests Performed 100 Billion User Experiences Tested Actual CloudTest view

4 In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing

5 CI Offers Speed of Delivery What s not to like?

6 CI Offers Speed of Delivery What s not to like? Small Batch Sizes

7 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control

8 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies

9 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation

10 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback

11 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds

12 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds Consistent environments

13 CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds Consistent environments Developer Tester Collaboration

14 In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing

15 What s Been Missing?

16 So, let s break down DevOps What is it, really? It s not what s within the silos It s about the relationships

17 A typical siloed organization lacks end-to-end integration ADLC Application Development Environment QA/Test Pre-Production QA/Test Environment Production Operational Production Environment Continuous Integration touchpoints Performance Engineering & Continuous Integration-Full Lifecycle Operational Configuration

18 CI Focus Areas The Assembly Line Hand-offs Development Test Configuration management Release management Change management Performance management Key Processes

19 Software Is Simple: It s Manufacturing & BOM Bill of Materials (BOM!) The Big 3 => Change, Configuration & Release That is your software assembly line conveyor belt

20 o Why is CI critical? So, what? Speed New features, functions, etc. need to get to the customer, ASAP! We can only test as fast as the conveyor belt allows. If the conveyor belt is moving slow, testing is delayed. The Big 3 drives testing cycle.

21 So, let s break that down CI is a key component of Performance Engineering Performance Engineering spans the silos IT Operations Application Development Life Cycle Performance Management Testing Capacity Management Performance Engineering BIG 3

22 Laying the Foundation A factory streamlines for quality and speed Assembly Line Approve materials Real Drivers Does it work as designed? What happens in actual conditions? Does it perform under extreme circumstances?

23 Laying the Foundation CI streamlines for continuous quality Build Unit-tested code Real Users Functional validation What happens in actual conditions? Performance, reliability, scalability tests

24 In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing

25 Continuous Quality SOASTA s Lifecycle

26 Continuous Quality SOASTA s LifeCycle Jenkins runs any unit tests as usual

27 Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Run iterative load tests via Jenkins

28 Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Run iterative load tests via Jenkins Mobile? Run functional automation on real devices for functional & performance validation

29 Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Embedded failure details & bottleneck data isolate issues Run iterative load tests via Jenkins Daily (or more frequent) updates keep teams quality focused Mobile? Run functional automation on real devices for functional & performance validation

30 Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Manage to a performance baseline Embedded failure details & bottleneck data isolate issues Run iterative load tests via Jenkins Daily (or more frequent) updates keep teams quality focused Mobile? Run functional automation on real devices for functional & performance validation

31 Continuous Quality SOASTA s Lifecycle Use real user data to iterate dev & test plans Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Manage to a performance baseline Embedded failure details & bottleneck data isolate issues Daily (or more frequent) updates keep teams quality focused Run iterative load tests via Jenkins Mobile? Run functional automation on real devices for functional & performance validation

32

33 SOASTA Branch Build from CloudTest

34 SOASTA Test Results

35 SOASTA Drill Down (Test Failures)

36 SOASTA UI Testing Bundle Results

37 SOASTA UI Testing Failure Drill down into SOASTA CloudTest from Jenkins

38 SOASTA Successful Regression Test Results

39 SOASTA Release Promotion

40 Continuous Quality for Continuous Delivery SOASTA - Takeaways SOASTA s Process Metrics 3 Main Products (2) Builds per day of each product (Dev + Customer branch) 8,000 tests executed per build For Mobile (TouchTest), Over 300 fully-automated tests each for ios & Android

41 The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information

42 The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information

43 The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information

44 The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information

45 The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information

46 Revenue Brand Final Takeaway Why Is CI Important? Competitive advantage

47 Questions? FREE DownLoads: Visit our Blog: Dan Boutin Vice President of Digital Strategy Mobile (404)

48 @DanBoutinSOASTA

49 Thank you for attending this session. Please don t forget to complete an evaluation form!