It s Not Called Continuous Integration for Nothing! Dan Boutin Vice President of Digital Strategy dboutin@soasta.com Mobile (404) 304-9529 @DanBoutinSOASTA
In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing
SOASTA Performance Analytics 10 Million Tests Performed 100 Billion User Experiences Tested Actual CloudTest view
In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing
CI Offers Speed of Delivery What s not to like?
CI Offers Speed of Delivery What s not to like? Small Batch Sizes
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds Consistent environments
CI Offers Speed of Delivery What s not to like? Small Batch Sizes Comprehensive Version Control Simple Branch Strategies Automation Continuous Feedback Emphasis on working builds Consistent environments Developer Tester Collaboration
In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing
What s Been Missing?
So, let s break down DevOps What is it, really? It s not what s within the silos It s about the relationships
A typical siloed organization lacks end-to-end integration ADLC Application Development Environment QA/Test Pre-Production QA/Test Environment Production Operational Production Environment Continuous Integration touchpoints Performance Engineering & Continuous Integration-Full Lifecycle Operational Configuration
CI Focus Areas The Assembly Line Hand-offs Development Test Configuration management Release management Change management Performance management Key Processes
Software Is Simple: It s Manufacturing & BOM Bill of Materials (BOM!) The Big 3 => Change, Configuration & Release That is your software assembly line conveyor belt
o Why is CI critical? So, what? Speed New features, functions, etc. need to get to the customer, ASAP! We can only test as fast as the conveyor belt allows. If the conveyor belt is moving slow, testing is delayed. The Big 3 drives testing cycle.
So, let s break that down CI is a key component of Performance Engineering Performance Engineering spans the silos IT Operations Application Development Life Cycle Performance Management Testing Capacity Management Performance Engineering BIG 3
Laying the Foundation A factory streamlines for quality and speed Assembly Line Approve materials Real Drivers Does it work as designed? What happens in actual conditions? Does it perform under extreme circumstances?
Laying the Foundation CI streamlines for continuous quality Build Unit-tested code Real Users Functional validation What happens in actual conditions? Performance, reliability, scalability tests
In This Discussion Today Agenda: SOASTA Introduction The need for Continuous The Big 3 CI with mobile and performance testing
Continuous Quality SOASTA s Lifecycle
Continuous Quality SOASTA s LifeCycle Jenkins runs any unit tests as usual
Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Run iterative load tests via Jenkins
Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Run iterative load tests via Jenkins Mobile? Run functional automation on real devices for functional & performance validation
Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Embedded failure details & bottleneck data isolate issues Run iterative load tests via Jenkins Daily (or more frequent) updates keep teams quality focused Mobile? Run functional automation on real devices for functional & performance validation
Continuous Quality SOASTA s Lifecycle Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Manage to a performance baseline Embedded failure details & bottleneck data isolate issues Run iterative load tests via Jenkins Daily (or more frequent) updates keep teams quality focused Mobile? Run functional automation on real devices for functional & performance validation
Continuous Quality SOASTA s Lifecycle Use real user data to iterate dev & test plans Jenkins runs any unit tests as usual Spin up suitable, consistent test environments in the cloud or the lab Manage to a performance baseline Embedded failure details & bottleneck data isolate issues Daily (or more frequent) updates keep teams quality focused Run iterative load tests via Jenkins Mobile? Run functional automation on real devices for functional & performance validation
SOASTA Branch Build from CloudTest
SOASTA Test Results
SOASTA Drill Down (Test Failures)
SOASTA UI Testing Bundle Results
SOASTA UI Testing Failure Drill down into SOASTA CloudTest from Jenkins
SOASTA Successful Regression Test Results
SOASTA Release Promotion
Continuous Quality for Continuous Delivery SOASTA - Takeaways SOASTA s Process Metrics 3 Main Products (2) Builds per day of each product (Dev + Customer branch) 8,000 tests executed per build For Mobile (TouchTest), Over 300 fully-automated tests each for ios & Android
The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information
The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information
The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information
The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information
The Path to Continuous Delivery SOASTA - Takeaways Understand your requirements Identify the cloud advantages for you Automate the obvious and most critical Connect to a continuous process Align teams with actionable information
Revenue Brand Final Takeaway Why Is CI Important? Competitive advantage
Questions? FREE DownLoads: http://goo.gl/6cermn Visit our Blog: http://goo.gl/ta2hkp Dan Boutin Vice President of Digital Strategy dboutin@soasta.com Mobile (404) 304-9529 @DanBoutinSOASTA
@DanBoutinSOASTA
Thank you for attending this session. Please don t forget to complete an evaluation form!