Continuous Delivery - is it from the Devil? Tamas Csako

Size: px
Start display at page:

Download "Continuous Delivery - is it from the Devil? Tamas Csako"

Transcription

1 Continuous Delivery - is it from the Devil? Tamas Csako August 25,

2 Focus on the customer Continuous Delivery 2

3 About Me Tamas Csako, Ph.D. Lead Software Testing Engineer Experience: 6+ years in Testing, 4+ years as Test Team Lead Main focus: CI/CD, test automation optimization, process improvements Expert area: Functional Testing, Agile Testing, CI, Web UI testing, Test Automation, Team Leading, Mentoring Achievements: Successfully grew up senior engineers, Membership and active participation in the company s Testing Community, accelerating CD process from QA direction, supporting successful developer to cross functional team member transition, Ph.D. in physics 3

4 Agenda What is Continuous Delivery? Project introduction Place for improvements Concept Evolution Summary & lessons learned Guidance how to implement Continuous Delivery 4

5 Sequential development model Planning Analyses Development Test Acceptance 5

6 Sequential development model problems 6

7 Solution: iterative development model AGILE Design Release Build Test 7

8 Continuous Integration 8

9 Continuous Delivery Build Release Deploy Test 9

10 Let s automate everything! 10

11 Test pyramid E2E test Integration test Unit test 11

12 Continuous Integration vs. Continuous Delivery Continuous Integration Code done Unit test Integrate Continuous Delivery Code done Unit test Integrate Acceptance test Deploy to production Manual 12

13 Key benefits of continuous delivery 13

14 Continuous Deployment Continuous Delivery Code done Unit test Integrate Auto Auto Auto Acceptance test Manual Deploy to production Continuous Deployment Code done Unit test Integrate Acceptance test Deploy to production Auto Auto Auto Auto 14

15 Key benefits of continuous deployment 15

16 16

17 Project introduction 17

18 Project introduction 18

19 Project introduction CI system Code change Build Local deploy Test job 1 Test job 2 Test job n Total execution time: 12+ hours 19

20 Place for improvements Test Pyramid UI test Unit test 20

21 Place for improvements Increase reliability of UI-level automation Well-structured and unified test code Decrease time spent on test code maintenance and result monitoring Handle test-environment instability (3rd party dependencies) Decrease the 2-weeks manual release verification process Find issues earlier THAN release verification during manual testing INCREASE CONFIDENCE IN AUTOMATION 21

22 Tools & Technologies 22

23 Concept Test Pyramid E2E test Stubbed UI test Unit test 23

24 Concept Test Environments Continuously deployed E2E test environment Stubbed test environment 24

25 Concept Process Build Smoke test Deploy Local deploy Acceptance test 25

26 Evolution Test Pyramid Define high priority scenarios Cover only the main scenarios for these features Minimize the number of E2E scripts Atomic scenarios to easily find the root cause Stubbed UI test Unit test E2E test 26

27 Evolution Test Code Structure Minimize parameters in the feature 27

28 Evolution Test Code Structure Create proper common steps Avoid complex step definitions 28

29 Evolution Test Code Structure One feature file one step definition file Simple and clean test code Use page objects and widgets Use model object 29

30 Evolution Test Code Structure Feature file Trip object Project step definitions Common step definitions Page objects Framework core Widgets 30

31 Evolution Test Code Implementation 31

32 Evolution Test Environments Code change Build E2E environment Stubbed environment E2E acceptance test Stubbed acceptance test 32

33 Evolution Process Build Smoke test Deploy Local deploy Manual testing Acceptance test ATDD TDD implementation 33

34 Evolution Process: feature gates 34

35 Evolution Release Process 35

36 Evolution Release Process Auto Auto Auto Auto Code done Unit test Smoke test Deploy to CI environment Acceptance test Manual Splunk Dashboard Canary release Production deployment Manual 36

37 Evolution Process: Summary Build Smoke test Deploy Acceptance test Local deploy Canary release Production 37

38 Summary Time to market decreased by <50% Early problem detection: weeks -> hours Number of live issues: went down to ~0 38

39 Lessons Learned You need a good cross functional team You need a well established process You need to use appropriate methodologies The business must be involved in the process You need an appropriate environment You need a well structured test code and framework You need to invest in QA 39

40 Real Lessons Learned MOTIVATION EDUCATION OWNERSHIP STABILITY Less pressure HIGHER QUALITY 40

41 Guidance to implement Continuous Delivery New project Define the business priorities Define your Test Pyramid Create your code structure Setup your Continuous Delivery pipeline Feature and test code must be submitted in one CL Full engineering team vs Engineering team with a QA 41

42 Guidance to implement Continuous Delivery Existing project Above what you need to consider in case of a new project: Usually you need to rethink the whole process It will not work with separated testing teams or testers Motivation problems, possible conflicts You need to maintain the old test set Full engineering team vs Engineering team with a QA 42

43 43

44 Tamas Csako, Ph.D. Lead Software Testing Engineer 44

ICAgile Learning Roadmap Agile Testing Track

ICAgile Learning Roadmap Agile Testing Track International Consortium for Agile ICAgile Learning Roadmap Agile Testing Track Learning Objectives Licensing Information The work in this document was facilitated by the International Consortium for Agile

More information

Web UI & Functional Test Automation for Continuous Agile Deliveries

Web UI & Functional Test Automation for Continuous Agile Deliveries Web UI & Functional Test Automation for Continuous Agile Deliveries Web Mobile API Database Date: 19 th Jan, 2016 Webinar Presentation by, Premal Dave, TestingWhiz About TestingWhiz TestingWhiz offers

More information

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 QA2010 3 Days INTRODUCTION This three-day, instructor-led course provides students with the knowledge and skills to prevent, detect, manage and avoid

More information

The Tester's Role in Continuous Integration

The Tester's Role in Continuous Integration W8 Track 10/3/2012 The Tester's Role in Continuous Integration Presented by: Roi Carmel HP Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 904-278-0524 sqeinfo@sqe.com

More information

Automated Acceptance Testing of High Capacity Network Gateway

Automated Acceptance Testing of High Capacity Network Gateway Automated Acceptance Testing of High Capacity Network Gateway Ran Nyman 1, Ismo Aro 2, Roland Wagner 3, 1,2,3 Nokia Siemens Network, PO Box 1 FI-02022 Nokia Siemens Networks 1 ran@rannicon.com, 2 ismo.aro@nsn.com,

More information

Th3 - Open Source Tools for Test Management

Th3 - Open Source Tools for Test Management Th3 - Open Source Tools for Test Management Narayanan C. V., Vice President, Sonata Software Limited www.sonata-software.com Agenda Introduction Methodology Architectural View Test Management Best Practices

More information

Modern CI/CD and Asset Serving

Modern CI/CD and Asset Serving Modern CI/CD and Asset Serving Mike North 10/20/2015 About.me Job.new = CTO Job.old = UI Architect for Yahoo Ads & Data Organizer, Modern Web UI Ember.js, Ember-cli, Ember-data contributor OSS Enthusiast

More information

Automation and Virtualization, the pillars of Continuous Testing

Automation and Virtualization, the pillars of Continuous Testing HP Software: Apps meet Ops 2015 Automation and Virtualization, the pillars of Continuous Testing Jerry Saelemakers/ April 2 nd, 2015 Today s business initiatives demand a balance between velocity and quality

More information

The Importance of Continuous Integration for Quality Assurance Teams

The Importance of Continuous Integration for Quality Assurance Teams The Importance of Continuous Integration for Quality Assurance Teams Without proper implementation, a continuous integration system will go from a competitive advantage for a software quality assurance

More information

Agile Testing Principles and Best Practices. Progress Software, Hyderabad, India

Agile Testing Principles and Best Practices. Progress Software, Hyderabad, India Agile Testing Principles and Best Practices Dr Ganesh Iyer, PhD, Sailaja Pindiproli, Kiran Kumar Angara, Principal QA Engineer Senior QA Engineer QA Engineer, Progress Software, Hyderabad, India Masters

More information

Know the Difference. Unified Functional Testing (UFT) and Lean Functional Testing (LeanFT) from HP

Know the Difference. Unified Functional Testing (UFT) and Lean Functional Testing (LeanFT) from HP Know the Difference Unified Functional Testing (UFT) and Lean Functional Testing (LeanFT) from HP 1 Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject

More information

Accelerate Software Delivery with Continuous Integration and Testing. JaSST 08 Tokyo. Jeffrey Fredrick jtf@agitar.com. Agitar Software, 2009 1

Accelerate Software Delivery with Continuous Integration and Testing. JaSST 08 Tokyo. Jeffrey Fredrick jtf@agitar.com. Agitar Software, 2009 1 Accelerate Software Delivery with Continuous Integration and Testing JaSST 08 Tokyo Jeffrey Fredrick jtf@agitar.com Agitar Software, 2009 1 Agenda What is Continuous Integration Continuous Integration

More information

CARMEN DEARDO DEVOPS TECHNOLOGY LEADER, NATIONWIDE INSURANCE

CARMEN DEARDO DEVOPS TECHNOLOGY LEADER, NATIONWIDE INSURANCE CARMEN DEARDO DEVOPS TECHNOLOGY LEADER, NATIONWIDE INSURANCE THRIVING IN A DYNAMIC, HIGHLY-REGULATED WORLD 16+ MILLION POLICIES $195.2 BILLION IN ASSETS # 1 CORPORATE LIFE WRITER # 1 WRITER OF FARMOWNERS

More information

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline Increasing Business Efficiency and Agility for ATGbased ecommerce Systems This case study follows a Tier 1 retailer migrating to an ATG-based ecommerce platform and upgrading its software development process

More information

ACCELERATE DEVOPS USING OPENSHIFT PAAS

ACCELERATE DEVOPS USING OPENSHIFT PAAS ACCELERATE DEVOPS USING OPENSHIFT PAAS September 3, 2014 AGENDA World we live in today IT organization: Charter, goals, and challenges DevOps: Problem statement, what, and why How to enable DevOps Application

More information

Lessons Learned in Test Automation

Lessons Learned in Test Automation Lessons Learned in Test Automation Peter Chau, David Cranstone SQDG - January 19th 2010 Information Technology Introduction Our experiences with functional test automation High level presentation, not

More information

Continuous Delivery. Alejandro Ruiz

Continuous Delivery. Alejandro Ruiz Continuous Delivery Alejandro Ruiz True reality How the customer explained it How the project leader understood it How the analyst designed it How the programmer wrote it What the customer really needed

More information

Continuous Integration: Improving Software Quality and Reducing Risk. Preetam Palwe Aftek Limited

Continuous Integration: Improving Software Quality and Reducing Risk. Preetam Palwe Aftek Limited Continuous Integration: Improving Software Quality and Reducing Risk Preetam Palwe Aftek Limited One more title Do you love bugs? Or Are you in love with QC members? [Courtesy: Smita N] Agenda Motivation

More information

Automated Testing of a Fully Automated Greenfield Terminal: A Case Study

Automated Testing of a Fully Automated Greenfield Terminal: A Case Study Automated Testing of a Fully Automated Greenfield Terminal: A Case Study March 2015 Stéphane Zampelli 1 Agenda How is Automated Testing useful? Automated Testing Overview at RWG Waterside Automated Tests

More information

Bridging the Gap Between Acceptance Criteria and Definition of Done

Bridging the Gap Between Acceptance Criteria and Definition of Done Bridging the Gap Between Acceptance Criteria and Definition of Done Sowmya Purushotham, Amith Pulla sowmya.sudha@gmail.com, amith.pulla@intel.com Abstract With the onset of Scrum and as many organizations

More information

INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING. Copyright 2015 CloudGen, LLC

INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING. Copyright 2015 CloudGen, LLC INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING Your Ultimate Partner for integration everywhere, ieverywhere TM CloudGen is an esteemed provider of information technology, business consulting, enterprise

More information

Developing Plugins for Cloud Scale

Developing Plugins for Cloud Scale Developing Plugins for Cloud Scale Who I am? 2 Who I am? I am? Oscar Sanjuan Engineering Director Email: oscar@elasticbox.com Twitter: twitter.com/elasticbox Blog: elasticbox.com/blog What does Elasticbox?

More information

Software Product Testing in Agile Environment

Software Product Testing in Agile Environment Software Product Testing in Agile Environment Abstract The new economic reality puts spotlight on agile software product development. Agile provides the opportunities to reduce cost of development and

More information

DevOps for. Developers. Michael Huttermann. Apress-

DevOps for. Developers. Michael Huttermann. Apress- DevOps for Developers 111 Michael Huttermann Apress- Contents About the Author About the Technical Reviewers Acknowledgments Introduction xiii xiv xv xvi Part I: Fundamentals 1 Chapter 1: Beginning DevOps

More information

Continuous Delivery / Continuous Deployment How to automate your Deliveries. Bernhard Keprt 24.02.2014

Continuous Delivery / Continuous Deployment How to automate your Deliveries. Bernhard Keprt 24.02.2014 Continuous Delivery / Continuous Deployment How to automate your Deliveries Bernhard Keprt 24.02.2014 Bernhard Keprt Software Developer Teamleader Software Development Job at willhaben.at! Likes Agile

More information

DevOps for the Mainframe

DevOps for the Mainframe DevOps for the Mainframe Rosalind Radcliffe IBM Distinguished Engineer, Enterprise Modernization Solution Architect rradclif@us.ibm.com 1 Please note IBM s statements regarding its plans, directions, and

More information

Accelerate Software Delivery

Accelerate Software Delivery Accelerate Software Delivery with Continuous Integration and Testing Kevin Lawrence kevin@agitar.com Agitar Software, 2009 1 Agenda What is Continuous Integration Continuous Integration Practices Impact

More information

How To Be Successful At An Agile Software Engineering

How To Be Successful At An Agile Software Engineering "Agile Software Engineering" Overview for external offering of ASE ABAP Juergen Heymann, CPO Software Engineering There are many ingredients for successful software projects Experienced Developers Domain

More information

Continuous Integration

Continuous Integration CODING & DEVELOPMENT BORIS GORDON FEBRUARY 7 2013 Continuous Integration Introduction About me boztek on d.o. (http://drupal.org/user/134410) @boztek boris@previousnext.com.au 2 Introduction About you

More information

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS @huibschoots & @mieldonkers INTRODUCTION Huib Schoots Tester @huibschoots Miel Donkers Developer @mieldonkers TYPICAL Experience with Continuous Delivery?

More information

Use service virtualization to remove testing bottlenecks

Use service virtualization to remove testing bottlenecks Use service virtualization to remove testing bottlenecks Discover integration faults early by pushing integration testing left in the software lifecycle Contents 1 Complex, interconnected applications

More information

AGILE SOFTWARE TESTING

AGILE SOFTWARE TESTING AGILE SOFTWARE TESTING Business environments continue to rapidly evolve, leaving many IT organizations struggling to keep up. This need for speed has led to an increased interest in the Agile software

More information

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development Introduction Today s developers are under constant pressure to launch killer apps and release enhancements as

More information

Agile Web Application Testing

Agile Web Application Testing Agile Web Application Testing Technologies and Solutions V. Narayan Raman Tyto Software Goals Rapid feedback on the quality of software Problem in Web App Testing Many Browsers Many Operating Systems Browsers

More information

IT Home 2015 DevOps 研 討 會

IT Home 2015 DevOps 研 討 會 IT Home 2015 DevOps 研 討 會 百 人 工 研 院 團 隊 如 何 落 實 CI 雙 子 星 雲 端 運 算 公 司 符 儒 嘉 執 行 長 http://www.geminiopencloud.com GOCC Internal Use Only Agenda DevOps What does it mean? From Agile to DevOps ITRI Cloud OS

More information

DELIVERING AGILE QUALITY ASSURANCE THROUGH EXTREME AUTOMATION

DELIVERING AGILE QUALITY ASSURANCE THROUGH EXTREME AUTOMATION DELIVERING AGILE QUALITY ASSURANCE THROUGH EXTREME AUTOMATION Enterprises that keep pace with rapid technology advancements are witnessing dynamic changes in their business environments. Enterprise applications

More information

Testing in an Agile Environment

Testing in an Agile Environment Testing in an Agile Environment Marie Walsh mariewalsh@anztb.org http://www.linkedin.com/in/mariewalsh In this presentation, Marie will share her experiences working in agile teams across multiple projects

More information

a new generation software test automation framework - CIVIM

a new generation software test automation framework - CIVIM a new generation software test automation framework - CIVIM Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the

More information

Continuous Delivery and Test Automation in Agile SW projects with Robot Framework 7.6.2013 Antti Pohjonen

Continuous Delivery and Test Automation in Agile SW projects with Robot Framework 7.6.2013 Antti Pohjonen Continuous Delivery and Test Automation in Agile SW projects with Robot Framework 7.6.2013 Antti Pohjonen Copyright Knowit Oy 2013 Public Version 1.0 Group revenue (MEUR) Trusted Partner in Nordics Knowit

More information

A Practical Guide to implementing Agile QA process on Scrum Projects

A Practical Guide to implementing Agile QA process on Scrum Projects Agile QA A Practical Guide to implementing Agile QA process on Scrum Projects Syed Rayhan Co-founder, Code71, Inc. Contact: srayhan@code71.com Blog: http://blog.syedrayhan.com Company: http://www.code71.com

More information

Accelerate Testing Cycles With Collaborative Performance Testing

Accelerate Testing Cycles With Collaborative Performance Testing Accelerate Testing Cycles With Collaborative Performance Testing Sachin Dhamdhere 2005 Empirix, Inc. Agenda Introduction Tools Don t Collaborate Typical vs. Collaborative Test Execution Some Collaborative

More information

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS @pascal_dufour & @hrietman INTRODUCTION Pascal Dufour Agile Tester @Pascal_Dufour Harald Rietman Developer Scrum Master @hrietman TYPICAL Experience with

More information

SAP Automated Testing Excellence Using HP Quality Center Test Tools. Linda Lehman, SAP Kjell Lillemoen, HP

SAP Automated Testing Excellence Using HP Quality Center Test Tools. Linda Lehman, SAP Kjell Lillemoen, HP SAP Automated Testing Excellence Using HP Quality Center Test Tools Linda Lehman, SAP Kjell Lillemoen, HP Content SAP End-2-End Test Management What s new in Solution Manager 7.1 Business Process Change

More information

Testhouse Training Portfolio

Testhouse Training Portfolio Testhouse Training Portfolio TABLE OF CONTENTS Table of Contents... 1 HP LoadRunner 4 Days... 2 ALM Quality Center 11-2 Days... 7 HP QTP Training Course 2 Days... 10 QTP/ALM Intensive Training Course 4

More information

Agile Testing (October 2011) Page 1. Learning Objectives for Agile Testing

Agile Testing (October 2011) Page 1. Learning Objectives for Agile Testing Agile Testing (October 2011) Page 1 Learning Objectives for Agile Testing "Certification is the by-product; Learning is the product." Agile Testing should: Compare and contrast agile testing with traditional

More information

End-to-End Integration Testing of SAP-centric Solutions. ALM Solution Management Active Global Support (AGS) SAP AG

End-to-End Integration Testing of SAP-centric Solutions. ALM Solution Management Active Global Support (AGS) SAP AG End-to-End Integration Testing of SAP-centric Solutions ALM Solution Management Active Global Support (AGS) SAP AG Disclaimer This presentation outlines our general product direction and should not be

More information

QA or the Highway 2016 Presentation Notes

QA or the Highway 2016 Presentation Notes QA or the Highway 2016 Presentation Notes Making QA Strategic Let s Get Real (Panel Discussion) Does testing belong at the strategic table? What is that strategic value that testing provides? Conquering

More information

Test Automation: A Project Management Perspective

Test Automation: A Project Management Perspective Test Automation: A Project Management Perspective Abstract Amith Pulla amith.pulla@intel.com For most QA leads or managers, it s always difficult to get the project manager (PM) to invest in test automation.

More information

Client Overview. Engagement Situation. Key Requirements

Client Overview. Engagement Situation. Key Requirements Client Overview Our client is the leading provider of health insurance related solutions for providing online and easy access to health insurance. Our client offers these services to a range of consumers

More information

What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing

What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing Today s agenda A new world order for applications impact on QA HP s response announcement

More information

Continuous Delivery of Software

Continuous Delivery of Software Continuous Delivery of Software Reducing risks with systems, feedback and flow SEPG North America 2013 Joanne Molesky October 3, 2013 2011 All rights reserved. Purpose Challenge traditional concepts for

More information

Continuous???? Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Continuous???? Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. ???? 1 Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Application Delivery is Accelerating Surge in # of releases per app

More information

Automation testing in Agile projects - Overview Shirly Ronen-Harel Mar 2014

Automation testing in Agile projects - Overview Shirly Ronen-Harel Mar 2014 Automation testing in Agile projects - Overview Shirly Ronen-Harel Mar 2014 http://www.wired.com/insights/2013/04/big-data-fast-data-smart-data/ Who am I? Linked-In: il.linkedin.com/pub/shirly-ronen-harel/0/653/249/

More information

Delivery. Continuous. Jez Humble and David Farley. AAddison-Wesley. Upper Saddle River, NJ Boston Indianapolis San Francisco

Delivery. Continuous. Jez Humble and David Farley. AAddison-Wesley. Upper Saddle River, NJ Boston Indianapolis San Francisco Continuous Delivery Jez Humble and David Farley AAddison-Wesley Upper Saddle River, NJ Boston Indianapolis San Francisco New York Toronto Montreal London Munich Paris Madrid Cape Town Sydney Tokyo Singapore

More information

DevOps Practical steps towards greater business agility AND stable IT operations.

DevOps Practical steps towards greater business agility AND stable IT operations. DevOps Practical steps towards greater business agility AND stable IT operations. White Paper BUSINESS AGILITY VS OPERATIONAL STABILITY In today s world, organisations, and the software teams that deliver

More information

Cloud Testing Testing on the Cloud

Cloud Testing Testing on the Cloud Cloud Testing Global Technology Solutions Co-Author and Domain Knowledge Noman Khan, Director Technology Solutions Co-Author and Subject Matter Expert Ravi Kumar, Manager Technology Solutions Executive

More information

Continuous Delivery Workshop

Continuous Delivery Workshop Continuous Delivery Workshop deployment pipelines Workshop materials created by Jez Humble, Martin Fowler, Tom Sulston, & Neal Ford deployment pipelines tests, synergistic practices, incremental deployment

More information

QA Engagement Models. Managed / Integrated Test Center A Case Study

QA Engagement Models. Managed / Integrated Test Center A Case Study 1 QA Engagement Models Managed / Integrated Test Center A Case Study 2 Today s Agenda» Background» Overview of QA Engagement Models MTC & ITC» The Journey to Steady State» Transition Approach» Challenges

More information

Best Practices for Performance Testing Mobile Apps

Best Practices for Performance Testing Mobile Apps Best Practices for Performance Testing Mobile Apps Lee Barnes, CTO Utopia Solutions Apology I don t believe in best practices I do believe in guidelines and better approaches for a given situation Key

More information

Lean Software Configuration Management Using 'Process Increments' Software Engineering Competence Center

Lean Software Configuration Management Using 'Process Increments' Software Engineering Competence Center Lean Software Configuration Management Using 'Process Increments' Software Engineering Competence Center Copyright Software Engineering Competence Center 2011 Agenda Process Increments Method Overview

More information

A Sumo Logic White Paper. Harnessing Continuous Intelligence to Enable the Modern DevOps Team

A Sumo Logic White Paper. Harnessing Continuous Intelligence to Enable the Modern DevOps Team A Sumo Logic White Paper Harnessing Continuous Intelligence to Enable the Modern DevOps Team As organizations embrace the DevOps approach to application development they face new challenges that can t

More information

A Hundred Days of Continuous Integration

A Hundred Days of Continuous Integration A Hundred Days of Continuous Integration Ade Miller Microsoft Corporation ade.miller@microsoft.com Abstract Many agile teams use Continuous Integration (CI). It is one of the Extreme Programming practices

More information

Scrum: A disciplined approach to product quality and project success.

Scrum: A disciplined approach to product quality and project success. Scrum: A disciplined approach to product quality and project success. CQAA February 23, 2011 Patricia Rotman Introductions Copyright 2011-2 Alternate Titles Considered Scrum: Just do it! Scrum: It only

More information

Agile Testing. What Students Learn

Agile Testing. What Students Learn Agile Testing Transition sound traditional test practices into an Agile development environment. By using a step-by-step approach, this course documents how to transition from traditional test practices

More information

Enabling Continuous Delivery by Leveraging the Deployment Pipeline

Enabling Continuous Delivery by Leveraging the Deployment Pipeline Enabling Continuous Delivery by Leveraging the Deployment Pipeline Jason Carter Principal (972) 689-6402 Jason.carter@parivedasolutions.com Pariveda Solutions, Inc. Dallas,TX Table of Contents Matching

More information

How to Maximise ROI and drive IT Governance with Visual Studio Team System

How to Maximise ROI and drive IT Governance with Visual Studio Team System How to Maximise ROI and drive IT Governance with Visual Studio Team System The Power of an Integrated ALM Solution Julio Fernández-Gayoso Sales manager for Development Tools Western European Microsoft

More information

How To Write Unit Tests In A Continuous Integration

How To Write Unit Tests In A Continuous Integration Continuous Integration bjorn.boisschot@ctg.com 1. It works on my machine. Risk 1 Lack of Deployable Software Risk 2 Lack of project visibility 2011 CTG, Inc. 9 2011 CTG, Inc. 10 Risk 3 Low quality

More information

Software Testing Lifecycle

Software Testing Lifecycle STLC-Software Testing Life Cycle SDLC Software Testing Lifecycle Software Testing Life Cycle (STLC) defines the steps/ stages/ phases in testing of software. However, there is no fixed standard STLC in

More information

Business Process Testing Accelerator for PeopleSoft Applications

Business Process Testing Accelerator for PeopleSoft Applications Business Process for PeopleSoft Applications 1 Fault Stream Analysis: Why is Critical Software Development Lifecycle Planning & Requirements Design Development User Acceptance Deploy to Production 10%

More information

Building a Continuous Integration Pipeline with Docker

Building a Continuous Integration Pipeline with Docker Building a Continuous Integration Pipeline with Docker August 2015 Table of Contents Overview 3 Architectural Overview and Required Components 3 Architectural Components 3 Workflow 4 Environment Prerequisites

More information

Agile QA Process. Anand Bagmar Anand.Bagmar@thoughtworks.com abagmar@gmail.com http://www.essenceoftesting.blogspot.com. Version 1.

Agile QA Process. Anand Bagmar Anand.Bagmar@thoughtworks.com abagmar@gmail.com http://www.essenceoftesting.blogspot.com. Version 1. Agile QA Process Anand Bagmar Anand.Bagmar@thoughtworks.com abagmar@gmail.com http://www.essenceoftesting.blogspot.com Version 1.1 Agile QA Process 1 / 12 1. Objective QA is NOT the gatekeeper of the quality

More information

Introducing SAP s Landscape and Data Center Innovation Platform. Phil Jackson SAP Solution Engineer

Introducing SAP s Landscape and Data Center Innovation Platform. Phil Jackson SAP Solution Engineer Introducing SAP s Landscape and Data Center Innovation Platform Phil Jackson SAP Solution Engineer CIO challenges Business Agility & Innovation Business Continuity Cost Containment Hybrid On-premise, Virtual

More information

Continuous Integration Processes and SCM To Support Test Automation

Continuous Integration Processes and SCM To Support Test Automation Continuous Integration Processes and SCM To Support Test Automation SIGIST Conference, July 2013 Gal Fatal Gal.fatal@ATT.com 054-342-3864 AT&T Israel Center of Excellence AT&T Worldwide One of the largest

More information

RockID: Implementation 1 demo. Team Vihannekset 17.12.2014

RockID: Implementation 1 demo. Team Vihannekset 17.12.2014 RockID: Implementation 1 demo Team Vihannekset 17.12.2014 Agenda Status of the project Achieving the goals Use of human resources Top 5 risks QA plan Work results Technical specification Demo Project introduction

More information

GETTING STARTED WITH CONTINUOUS DELIVERY. Lana Kalashnyk @lana_vk wcgp.co

GETTING STARTED WITH CONTINUOUS DELIVERY. Lana Kalashnyk @lana_vk wcgp.co GETTING STARTED WITH CONTINUOUS DELIVERY Lana Kalashnyk @lana_vk wcgp.co ABOUT ME Lana Kalashnyk BAAS Computer Science minor Business Administration AS in Computer Science emphasis on Networking Cisco

More information

Sreerupa Sen Senior Technical Staff Member, IBM December 15, 2013

Sreerupa Sen Senior Technical Staff Member, IBM December 15, 2013 Sreerupa Sen Senior Technical Staff Member, IBM December 15, 2013 Abstract In this experience report, I ll talk about how we transformed ourselves from a team that does one big bang release a year, to

More information

101-301 Guide to Mobile Testing

101-301 Guide to Mobile Testing 101-301 Guide to Mobile Testing Perfecto Mobile & Toronto Association of System and Software Eran Kinsbruner & Joe Larizza 2014 What To Do? Great News Your first Mobile Project has arrived! You have been

More information

Software Quality Analysis with Cloud Challenges and Approaches. Progress Software, Hyderabad, India

Software Quality Analysis with Cloud Challenges and Approaches. Progress Software, Hyderabad, India Software Quality Analysis with Cloud Challenges and Approaches Dr Ganesh Iyer, PhD, Santhosh Kumar Soma, Kiran Kumar Angara, Principal QA Engineer Senior QA Engineer QA Engineer, Progress Software, Hyderabad,

More information

CONTINUOUS INTEGRATION TESTING

CONTINUOUS INTEGRATION TESTING WELCOME TO CONTINUOUS INTEGRATION TESTING Mikko Palkama IBM Software Nordic mikko.palkama@fi.ibm.com THE CHALLENGE Traditional approach: Integrate everything, then try it out Complexity lies beneath the

More information

Agile Testing: The Agile Test Automation Pyramid

Agile Testing: The Agile Test Automation Pyramid Agile Testing: The Agile Test Pyramid In this post, or perhaps truly an article, I want to explore a common approach for implementing an effective strategy for your overall agile automation development.

More information

Agile Techniques and Tools. White Paper

Agile Techniques and Tools. White Paper Agile Techniques and Tools White Paper Agile Techniques and Tools Synopsis This section provides an overview of a number of techniques and tools that are commonly used by agile development teams. These

More information

Automation & Open Source. How to tame the Cloud?

Automation & Open Source. How to tame the Cloud? Automation & Open Source How to tame the Cloud? Who are we? François Deppierraz Mathieu Bornoz System and Network engineer System and Software engineer Reluctant to type the same command twice Automation

More information

Safe Harbor Statement

Safe Harbor Statement Presented with Next-Generation Testing with Oracle Application Testing Suite Mikael Fries Product Management Director - Oracle Mark Tobias Facebook Safe Harbor Statement The following is intended to outline

More information

Software Continuous Integration & Delivery

Software Continuous Integration & Delivery November 2013 Daitan White Paper Software Continuous Integration & Delivery INCREASING YOUR SOFTWARE DEVELOPMENT PROCESS AGILITY Highly Reliable Software Development Services http://www.daitangroup.com

More information

Implementing Continuous Integration Testing Prepared by:

Implementing Continuous Integration Testing Prepared by: Implementing Continuous Integration Testing Prepared by: Mr Sandeep M Table of Contents 1. ABSTRACT... 2 2. INTRODUCTION TO CONTINUOUS INTEGRATION (CI)... 3 3. CI FOR AGILE METHODOLOGY... 4 4. WORK FLOW...

More information

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info MANUAL TESTING (Complete Package) WEB APP TESTING DB TESTING MOBILE APP TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION :

More information

Best Overall Use of Technology. Jaspersoft

Best Overall Use of Technology. Jaspersoft Best Overall Use of Technology Jaspersoft Kerstin Klein Manager, Engineering Processes/ Infrastructure, Jaspersoft From requirements to release QA centric development From Requirement to Release QA-Centric

More information

Rethinking Your Finance Functions

Rethinking Your Finance Functions Rethinking Your Finance Functions Budgeting, Planning & Technology BDO Canada Daniel Caringi ( dcaringi@bdo.ca ) September 25th, 2014 A journey of a thousand miles must begin with a single step. - Lao

More information

Continuous Integration and Deployment Modern Technique's

Continuous Integration and Deployment Modern Technique's International Journal of Computer Sciences and Engineering Open Access Review Paper Volume-4, Issue-4 E-ISSN: 2347-2693 Continuous Integration and Deployment Modern Technique's Vivek Verma 1* and Vinay

More information

Payer test platform: How to ensure compliance, reduce timeto-market and maximize return on investment

Payer test platform: How to ensure compliance, reduce timeto-market and maximize return on investment Solution Overview Generating Healthcare Payer Impact Payer test platform: How to ensure compliance, reduce timeto-market and maximize return on investment Healthcare payers today face a perfect storm of

More information

Deciphering The Buzzwords. Duncan Winn @duncwinn

Deciphering The Buzzwords. Duncan Winn @duncwinn Deciphering The Buzzwords Duncan Winn @duncwinn Business Problem: Shipping with Velocity Underlying Problem: Buzzwords Buzzwords Release Engineering Cloud Computing Containers Automation Anything As A

More information

Continuous Delivery for Alfresco Solutions. Satisfied customers and happy developers with!! Continuous Delivery!

Continuous Delivery for Alfresco Solutions. Satisfied customers and happy developers with!! Continuous Delivery! Continuous Delivery for Alfresco Solutions Satisfied customers and happy developers with!! Continuous Delivery! About me Roeland Hofkens #rhofkens roeland.hofkens@westernacher.com http://opensource.westernacher.com

More information

Cost effective methods of test environment management. Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA

Cost effective methods of test environment management. Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA Cost effective methods of test environment management Prabhu Meruga Director - Solution Engineering 16 th July SCQAA Irvine, CA 2013 Agenda Basic complexity Dynamic needs for test environments Traditional

More information

Moving your development to the Cloud using Visual Studio Online

Moving your development to the Cloud using Visual Studio Online Moving your development to the Cloud using Online Jakob Ehn Active Solution @jakobehn jakob@ehn.nu #devsum15 About //Me Senior Developer @ Active Solution ALM MVP http://geekswithblogs.net/jakob @jakobehn

More information

Scrum in a Large Project Theory and Practice

Scrum in a Large Project Theory and Practice Scrum in a Large Project Theory and Practice Agile World 2012 Munich, July 12, 2012 Dr. Sebastian Stamminger Scrum in Large Projects Agenda Theory Case Study Teams Our Process Challenges Lessons Learned

More information

Live Specifications: From Requirements to Automated Tests and Back

Live Specifications: From Requirements to Automated Tests and Back Live Specifications: From Requirements to Automated Tests and Back Paul Gerrard paul@gerrardconsulting.com @paul_gerrard gerrardconsulting.com We believe there are better ways to build software Intelligent

More information

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Session 5: Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Agenda HP ALM Solution Review HP Cloud Potential Cloud Portal HP ALM Solutions in a virtual environment

More information

Next-Generation Performance Testing with Service Virtualization and Application Performance Management

Next-Generation Performance Testing with Service Virtualization and Application Performance Management Next-Generation Performance Testing with Service Virtualization and Application Performance Management By Akshay Rao, Principal Consultant, CA Technologies Summary Current approaches for predicting with

More information

The Future of Testing: How Service Virtualization Changes the Game in Testing Complex Applications

The Future of Testing: How Service Virtualization Changes the Game in Testing Complex Applications IBM Software, Rational The Future of Testing: How Service Virtualization Changes the Game in Testing Complex Applications The new frontier for quality management and testing Glyn Rhodes Chief Architect

More information

Sandesh Prasanna Kumar

Sandesh Prasanna Kumar E-Mail: sandeshp7@gmail.com Contact No: +44 7508061652 Linked in: http://www.linkedin.com/in/sandeshp7 Website: cv.sandeshp.com Skype: Sandesh_p5 Current location: London, United Kingdom Nationality: Indian

More information