Reasonability of test automation

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Reasonability of test automation"

Transcription

1 Reasonability of test automation Some thoughts on test automation. Jurijs Grigorjevs Manager of Testing Unit Tieto, Cards

2 Table of contents Reasons 3 Estimations 5 Decision 10 Practices 15 Evaluation and evolution 24 Conclusion 28 2

3 Reasons Situations, when we may need test automation.

4 Main reasons Regression testing automatically repeat same tests. Faster significantly improving time-to-market of the program. Better than humans small details can be verified. Pushed down by management. Everybody has test automation and we also need it. 4

5 Estimations Strategy for test automation to get estimations of planned costs.

6 Execution Scope Tools Users Factors End users for test scripts. What are the use cases for them? Framework availability. Test tools. Stubs. Repeatable functionality in application. Scope of tests. Parallel versions Regularity of executions. Environment for executions 6

7 Strategy Remember factors. Define scope Prioritize test cases and functionalities. Remember 20/80 principle! 80% of test cases can be automated within 20% of time. Define entry and exit criteria for test automation. Define prerequisites. Describe approach architecture for test scripts. Framework. Reusability. Parameterisation. Data-driven approach. 7

8 Prerequisites Required tools are available. Necessary HW is available. There are skilled specialists available for script development. Support from lead developers is required. Testable application. 8

9 Estimations + Strategy preparation + Script development + Documenting + Testing of scripts + Trainings (received and provided) + Test cases definition + Execution and validation + Test scripts and test data maintenance + Environment maintenance + Administration (project management, meetings, review, etc.) + Risks Total required m/d. 9 Remember factors.

10 Decision What aspects should be analysed before taking a decision?

11 External defects Is Zero defects policy in place? How crucial (reputation, financial and other loses) are the defects from production? Is the number and categorization of defects limited within some agreements between customer and developers? 11

12 Cost of defect Cost of internal defect vs Cost of external defect Registration Fixing Retesting Communication with customer Analysis of log files Retesting to prove the defect Registration Cost of external defects is about x10 more then internal. Fixing Retesting Delivery 12

13 Return Of Investments ROI = benefit investment = gain costs investment Gain is the price of manual test case execution. Gain = manual execution + env. maintenance Costs is the total price for test automation (incl. investment). Costs = investment + test development + test execution + maintenance Investment is the price to be ready for test development. Investment = licenses + HW costs (tools) + initial deployment + configuration + trainings 13

14 Return Of Investments (examples) ROI iterations

15 Practices Several practical approaches that could be recommended for others.

16 Build-deploy-test Clean-up environment Compile last version Why Clean-up is the first one not the last one?? Install last version Run Run TC TC 1 Run TC 2 Run TCs 1 16

17 Keyword-driven testing 17

18 Data-driven testing 18

19 Simplification Simple reduces errors. Simple is more effective. Simple is easy to understand, support and reuse. Examples of small independent test scripts with purpose: To compile. To install. To run Shell command. To extract data. To change business date. 19

20 Dedicated persons Different dedicated roles: - test script developers; - functional testers for test data definition; - environment manager; One can do his best within dedicated role. Goalkeeper can not be good forwarder!! 20

21 Automated test data preparation Usually requires huge resources. Sometimes can be automated. Data could be taken from: Production log files. Production database tables. Certification logs. Can be generated using special scripts. This is a bit risky! 21

22 Self documented test data 22

23 Bad examples rakes x Test data definition in test scripts. x Complicated test data definition. x Parameters definition in test scripts. x De-support of used tools. x Multiplatform support. x Each good tester can be test automation specialist. x Regular execution on several platforms requires almost xn more maintenance. x Bad communication significantly decreases efficiency. 23

24 Evaluation and evolution Scope, spend time and defect analysis.

25 3 dimensions Scope Coverage according to manual test cases Coverage according to requirements Branch, statement and other code coverage Spend time Real vs Original estimations Maintenance hours Defects Manual vs Automated Internal vs External Analysis of External defects 25

26 Automated testing similar to sappers (c) Randall Rice, Rice Consulting Services, Inc, USA 26

27 Evolution of complex test automation Standard practices and library of reusable test scripts 27

28 Conclusion Methods, tools, stuff, SUT.

29 Conclusion With test execution on multiple configurations and versions is quite easy to prove necessity of test automation (positive ROI). There are good tools, frameworks, but to get reasonable test automation we still need: Applied approaches. Additional tools and stubs. Specialists. Application itself (testability). 29

30 Jurijs Grigorjevs Manager of Testing Unit Tieto, Cards

Standard Glossary of Terms Used in Software Testing. Version 3.01

Standard Glossary of Terms Used in Software Testing. Version 3.01 Standard Glossary of Terms Used in Software Testing Version 3.01 Terms Used in the Expert Level Test Automation - Engineer Syllabus International Software Testing Qualifications Board Copyright International

More information

Sample Exam ISTQB Expert Level Test Automation - Engineering 2014

Sample Exam ISTQB Expert Level Test Automation - Engineering 2014 Sample Exam ISTQB Expert Level Test Automation - Engineering 2014 Version 1.0 Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. Table of Contents

More information

a new generation software test automation framework - CIVIM

a new generation software test automation framework - CIVIM a new generation software test automation framework - CIVIM Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the

More information

Automated Testing Best Practices

Automated Testing Best Practices Automated Testing Best Practices This document includes best practices to consider before implementing automated software testing. These best practices are strategic and are applicable regardless of the

More information

Foundation Level PRACTICE EXAM Syllabus Version 2010 Practice Exam Version 2011

Foundation Level PRACTICE EXAM Syllabus Version 2010 Practice Exam Version 2011 ISTQB Certified Tester Foundation Level PRACTICE EXAM International Software Testing Qualifications Board Name: Company address: Phone : Fax : Email: Billing address: Training company: Trainer: Foundation

More information

TESTING FRAMEWORKS. Gayatri Ghanakota

TESTING FRAMEWORKS. Gayatri Ghanakota TESTING FRAMEWORKS Gayatri Ghanakota OUTLINE Introduction to Software Test Automation. What is Test Automation. Where does Test Automation fit in the software life cycle. Why do we need test automation.

More information

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 QAI /QAAM 2011 Conference Proven Practices For Managing and Testing IT Projects Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 Format This presentation is a journey When Bill and

More information

White Paper: Creating Business Value with Business-Driven Test Automation

White Paper: Creating Business Value with Business-Driven Test Automation White Paper: Creating Business Value with Business-Driven Test Automation Table of Contents Executive Summary Understanding the Significance of Test Automation Evolution of Test Automation Major Advancements

More information

Advanced Certificate in Software Testing Test Automation Engineer Examination Questions

Advanced Certificate in Software Testing Test Automation Engineer Examination Questions Swedish Software Testing Board (SSTB) International Software Testing Qualifications Board (ISTQB) Advanced Certificate in Software Testing Test Automation Engineer Examination Questions 2016-11-18 Time

More information

Aspire's Approach to Test Automation

Aspire's Approach to Test Automation WHITE PAPER Aspire's Approach to Test Automation by Ujjawal Bagaria, Aspire Systems Automation has been seen as the long term solution for cost reduction of manual testing across the globe. A successfully

More information

Whitepaper. Progressive Approach in Test Automation

Whitepaper. Progressive Approach in Test Automation Whitepaper Progressive Approach in Test Automation Executive Summary Emerging technological innovations along with dynamic business needs of the travel industry are shaping the travel IT industry to set

More information

ALM120 Application Lifecycle Management 11.5 Essentials

ALM120 Application Lifecycle Management 11.5 Essentials ALM120 Application Lifecycle Management 11.5 Essentials Instructor-Led Workshop OVERVIEW This course provides the tools you need to implement and use Quality Center 11.50. Students learn how to manage

More information

Benefits and Pitfalls of Test Automation

Benefits and Pitfalls of Test Automation T-76.613 Software Testing and Quality Assurance 25.10.2006 Benefits and Pitfalls of Test Automation SoberIT Tools in development lifecycle Requirement Specification Acceptance test Performance, simulator

More information

Enabling Continuous Delivery by Leveraging the Deployment Pipeline

Enabling Continuous Delivery by Leveraging the Deployment Pipeline Enabling Continuous Delivery by Leveraging the Deployment Pipeline Jason Carter Principal (972) 689-6402 Jason.carter@parivedasolutions.com Pariveda Solutions, Inc. Dallas,TX Table of Contents Matching

More information

TEST AUTOMATION EFFORT ESTIMATION - Best practices

TEST AUTOMATION EFFORT ESTIMATION - Best practices TEST AUTOMATION EFFORT ESTIMATION - Best practices "The subject of software estimating is definitely a black art" says Lew Ireland, former president of the Project Management Institute. Estimation is more

More information

Introduction to Automated Testing

Introduction to Automated Testing Introduction to Automated Testing What is Software testing? Examination of a software unit, several integrated software units or an entire software package by running it. execution based on test cases

More information

What is automated software testing?

What is automated software testing? Topics 0 Automated software testing. What? Why? 0 Automated vs. Manual 0 Common types of automated testing methods 0 Automated software testing framework 0 Summary 2 What is automated software testing?

More information

Testhouse Training Portfolio

Testhouse Training Portfolio Testhouse Training Portfolio TABLE OF CONTENTS Table of Contents... 1 HP LoadRunner 4 Days... 2 ALM Quality Center 11-2 Days... 7 HP QTP Training Course 2 Days... 10 QTP/ALM Intensive Training Course 4

More information

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Table of contents Introduction.......................................................2 Step 1:

More information

Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective

Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective Iteration Advantages: bringing testing into the development life

More information

Automated Testing Frameworks: Test Automation with CodedUI

Automated Testing Frameworks: Test Automation with CodedUI Automated Testing Frameworks: Test Automation with CodedUI CodedUI Introduction CodeUI is one of the important new features in Visual Studio 2010 s Premium and Ultimate versions. It helps users to create

More information

Continuous integration End of the big bang integration era

Continuous integration End of the big bang integration era Continuous integration End of the big bang integration era Patrick Laurent Partner Technology & Enterprise Applications Deloitte Mario Deserranno Manager Technology & Enterprise Applications Deloitte The

More information

Plan-Driven Methodologies

Plan-Driven Methodologies Plan-Driven Methodologies The traditional way to develop software Based on system engineering and quality disciplines (process improvement) Standards developed from DoD & industry to make process fit a

More information

Test What You ve Built

Test What You ve Built Test What You ve Built About Your Presenter IBM i Professional for 16 Years. Primary Focus is IBM i Engineering / Programming Well Versed in 2E. Well Versed in RPG (All Flavors) Well Versed in CM Products

More information

Software Testing. Testing types. Software Testing

Software Testing. Testing types. Software Testing 1 Software Testing Testing types Software Testing 2 References Software Testing http://www.testingeducation.org/bbst/ IBM testing course available through the Academic Initiative: Principles of Software

More information

Example Software Development Process.

Example Software Development Process. Example Software Development Process. The example software development process is shown in Figure A. The boxes represent the software development process kernels. The Software Unit Testing, Software Component

More information

Building a Customized Test Automation Framework Using Open Source Tools

Building a Customized Test Automation Framework Using Open Source Tools Building a Customized Test Automation Framework Using Open Source Tools August, 2016 Contents Executive Summary...03 Need for Test Automation...04 Overcoming Limitations of Open Source Tools...04 Test

More information

Sample Exam. ISTQB Foundation Level Syllabus. International Software Testing Qualifications Board. Version 2.6

Sample Exam. ISTQB Foundation Level Syllabus. International Software Testing Qualifications Board. Version 2.6 Copyright 2016 (hereinafter called ISTQB ). All rights reserved. ISTQB Foundation Level 2011 Syllabus The authors transfer the copyright to the (hereinafter called ISTQB ). The authors (as current copyright

More information

Latest Trends in Testing. Ajay K Chhokra

Latest Trends in Testing. Ajay K Chhokra Latest Trends in Testing Ajay K Chhokra Introduction Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the customer.

More information

Higher Focus on Quality. Pressure on Testing Budgets. ? Short Release Cycles. Your key to Effortless Automation. OpKey TM

Higher Focus on Quality. Pressure on Testing Budgets. ? Short Release Cycles. Your key to Effortless Automation. OpKey TM Pressure on Testing Budgets Higher Focus on Quality Short Release Cycles Your key to Effortless Automation OpKey TM Most of the CTOs face a common challenge i.e. the need to go to Market in shortest possible

More information

INF3121 : Software Testing Lecture 5. Test management. Lecturer: Raluca Florea. INF3121/ / Raluca Florea 1

INF3121 : Software Testing Lecture 5. Test management. Lecturer: Raluca Florea. INF3121/ / Raluca Florea 1 INF3121 : Software Testing 19. 02. 2015 Lecture 5 Test management Lecturer: Raluca Florea INF3121/ 19.02.2015 / Raluca Florea 1 Overview 1. Test organization 2. Test planning and estimation 3. Test progress

More information

Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension

Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension Version 1.0 Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. Table of Contents

More information

Achieving business benefits through automated software testing. By Dr. Mike Bartley, Founder and CEO, TVS (mike@testandverification.

Achieving business benefits through automated software testing. By Dr. Mike Bartley, Founder and CEO, TVS (mike@testandverification. Achieving business benefits through automated software testing By Dr. Mike Bartley, Founder and CEO, TVS (mike@testandverification.com) 1 Introduction During my experience of test automation I have seen

More information

Develop better, Deliver Faster with DevOps: The CA LISA Product Suite. John Boebinger Senior Principal Consultant

Develop better, Deliver Faster with DevOps: The CA LISA Product Suite. John Boebinger Senior Principal Consultant Develop better, Deliver Faster with DevOps: The CA LISA Product Suite John Boebinger Senior Principal Consultant Today s reality 2 Copyright 2013 CA. All rights reserved. Does Any of This Sound Familiar?

More information

SA Tool Kit release life cycle

SA Tool Kit release life cycle Release management Release management process is a software engineering process intended to oversee the development, testing, deployment and support of software releases. A release is usually a named collection

More information

Sample Exam ISTQB Expert Level Test Automation - Engineering 2014

Sample Exam ISTQB Expert Level Test Automation - Engineering 2014 Sample Exam ISTQB Expert Level Test Automation - Engineering 2014 Version 1.0 Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. Table of Contents

More information

QTP Open Source Test Automation Framework Introduction

QTP Open Source Test Automation Framework Introduction Version 1.0 April 2009 D ISCLAIMER Verbatim copying and distribution of this entire article are permitted worldwide, without royalty, in any medium, provided this notice is preserved. Table of Contents

More information

We (http://www.newagesolution.net) have extensive experience in enterprise and system architectures, system engineering, project management, and

We (http://www.newagesolution.net) have extensive experience in enterprise and system architectures, system engineering, project management, and We (http://www.newagesolution.net) have extensive experience in enterprise and system architectures, system engineering, project management, and software design and development. We will be presenting a

More information

Quality is the responsibility of the whole team

Quality is the responsibility of the whole team Quality is the responsibility of the whole team Test do not create quality or take it away, it is only a method of assessing the quality of a product. If development schedules get tight, make sure project

More information

Basic Testing Concepts and Terminology

Basic Testing Concepts and Terminology T-76.5613 Software Testing and Quality Assurance Lecture 2, 13.9.2006 Basic Testing Concepts and Terminology Juha Itkonen SoberIT Contents Realities and principles of Testing terminology and basic concepts

More information

The Journey of Testing with Stubs and Proxies in AWS

The Journey of Testing with Stubs and Proxies in AWS The Journey of Testing with Stubs and Proxies in AWS Lucy Chang lucy_chang@intuit.com Abstract Intuit, a leader in small business and accountants software, is a strong AWS(Amazon Web Services) partner

More information

MO. 27. Feb 2006, 17:00 UHR

MO. 27. Feb 2006, 17:00 UHR 061 MO. 27. Feb 2006, 17:00 UHR AUTOMATED FUNCTIONAL TESTING QUALITÄTSSICHERUNG IN DER SOFTWARE- ENTWICKLUNG: NUR ROUTINIERTES TESTING FÜHRT ZUM ZIEL WIRD PRÄSENTIERT VON Slide 0 Automated Functional Testing

More information

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW RUN THE RIGHT RACE Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW 26032015 FUNCTIONAL TESTING With Borland everyone from business analysts

More information

AUTOMATION TESTED: an independent comparison of Selenium and Provar.

AUTOMATION TESTED: an independent comparison of Selenium and Provar. AUTOMATION TESTED: an independent comparison of Selenium and Provar www.provartesting.com info@provartesting.com Acknowledgements The following has been reproduced with permission from the authors of the

More information

Viewpoint. Choosing the right automation tool and framework is critical to project success. - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys

Viewpoint. Choosing the right automation tool and framework is critical to project success. - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys Viewpoint Choosing the right automation tool and framework is critical to project success - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys Introduction Organizations have become cognizant of the crucial

More information

CUT COSTS, NOT PROJECTS

CUT COSTS, NOT PROJECTS CUT COSTS, NOT PROJECTS Understanding and Managing Software Development Costs A WEBINAR for State of Washington Agencies Critical Logic, Inc. July 9 2009 Starting at 3pm, Pacific Daylight Time Critical

More information

Empowering Productivity through Installation Automation

Empowering Productivity through Installation Automation Authors: Empowering Productivity through Installation Automation Bhuvaneswari Radhakrishnan Santosh Ayodhya Honeywell Technology Solutions Adarsh Prime Project Pvt. Ltd, Survey No. 19/2 Devarabisanahalli

More information

Tool support for testing

Tool support for testing INF 3121 Software Testing - Lecture 06 Tool support for testing 1. Types of test (60 min) 2. Effective use of test : potential benefits and risks (15 min) 3. Introducing a test tool to an (15 min) INF3121

More information

Sample Exam Foundation Level Syllabus. Mobile Tester

Sample Exam Foundation Level Syllabus. Mobile Tester Sample Exam Foundation Level Syllabus Mobile Tester September 2015 American Software Testing Qualifications Board Sample Exam Foundation Level Syllabus Mobile Tester MOB-1.2.1 (K2) Explain the expectations

More information

Automated Software Testing Economics: A White Paper

Automated Software Testing Economics: A White Paper Automated Software Testing Economics: A White Paper Contents Automated Software Testing Economics 1 Automated Software Testing Case Study 2 Benefits of Automated Software Testing 4 About Master Key Consulting

More information

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 QA2010 3 Days INTRODUCTION This three-day, instructor-led course provides students with the knowledge and skills to prevent, detect, manage and avoid

More information

Rational Quality Manager. Quick Start Tutorial

Rational Quality Manager. Quick Start Tutorial Rational Quality Manager Quick Start Tutorial 1 Contents 1. Introduction... 2 2. Terminology... 3 3. Project Area Preparation... 4 3.1 Adding Users and specifying Roles... 4 3.2 Managing Tool Associations...

More information

The Importance of Continuous Integration for Quality Assurance Teams

The Importance of Continuous Integration for Quality Assurance Teams The Importance of Continuous Integration for Quality Assurance Teams Without proper implementation, a continuous integration system will go from a competitive advantage for a software quality assurance

More information

A LEADING SOFTWARE DRIVEN SALES & MARKETING CONSULTING COMPANY IN THE WORLD REDUCED REGRESSION CYCLE TIME BY 50%

A LEADING SOFTWARE DRIVEN SALES & MARKETING CONSULTING COMPANY IN THE WORLD REDUCED REGRESSION CYCLE TIME BY 50% A LEADING SOFTWARE DRIVEN SALES & MARKETING CONSULTING COMPANY IN THE WORLD REDUCED REGRESSION CYCLE TIME BY 50% Overview The client is a global leader in sales and marketing consulting, outsourcing, technology

More information

Software Development Basics

Software Development Basics Software Development Basics Dr. Axel Kohlmeyer Associate Dean for Scientific Computing College of Science and Technology Temple University, Philadelphia http://sites.google.com/site/akohlmey/ a.kohlmeyer@temple.edu

More information

QA or the Highway 2016 Presentation Notes

QA or the Highway 2016 Presentation Notes QA or the Highway 2016 Presentation Notes Making QA Strategic Let s Get Real (Panel Discussion) Does testing belong at the strategic table? What is that strategic value that testing provides? Conquering

More information

Virtual Platforms Addressing challenges in telecom product development

Virtual Platforms Addressing challenges in telecom product development white paper Virtual Platforms Addressing challenges in telecom product development This page is intentionally left blank. EXECUTIVE SUMMARY Telecom Equipment Manufacturers (TEMs) are currently facing numerous

More information

Keyword driven testing

Keyword driven testing Keyword driven testing in theory & practice Levente Nemeth 2015-11-19 1 19/11/2015 Nokia 2014 Agenda keyword driven testing - concept keyword driven testing robot framework how we do it? Nokia example

More information

Software Testing in Science

Software Testing in Science Software Testing in Science Dr. Axel Kohlmeyer Senior Scientific Computing Expert Information and Telecommunication Section The Abdus Salam International Centre for Theoretical Physics http://sites.google.com/site/akohlmey/

More information

Establishing your Automation Development Lifecycle

Establishing your Automation Development Lifecycle Establishing your Automation Development Lifecycle Frequently I engage clients in assessing and improving their automation efforts. The discussion normally starts from a position of frustration We ve invested

More information

Testing Tools using Visual Studio. Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation

Testing Tools using Visual Studio. Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation Plan REQUIREMENTS BACKLOG Monitor + Learn Development Collaboration Production Develop + Test Release

More information

Sample Exam. 2011 Syllabus

Sample Exam. 2011 Syllabus ISTQ Foundation Level 2011 Syllabus Version 2.3 Qualifications oard Release ate: 13 June 2015 ertified Tester Foundation Level Qualifications oard opyright 2015 Qualifications oard (hereinafter called

More information

Staffing Your Test Automation Team

Staffing Your Test Automation Team Staffing Your Test Automation Team 2002-2009, Mosaic, Inc. www.mosaicinc.com 205 N. Michigan Ave. Suite 2211 Chicago, IL 60601 312-819-2220 Automation_Staffing.PDF Page 1 2002-2009, Mosaic, Inc. INTRODUCTION

More information

Smarter Balanced Assessment Consortium. Recommendation

Smarter Balanced Assessment Consortium. Recommendation Smarter Balanced Assessment Consortium Recommendation Smarter Balanced Quality Assurance Approach Recommendation for the Smarter Balanced Assessment Consortium 20 July 2012 Summary When this document was

More information

Creating an Automated Software Testing Center of Excellence

Creating an Automated Software Testing Center of Excellence Creating an Automated Software Testing Center of Excellence Presenters: Elfriede Dustin, IDT, email: edustin@idtus.com Bio: http://amazon.com/author/elfriededustin www.idtus.com 1 AST: Practices that Yield

More information

Test Automation Framework

Test Automation Framework Test Automation Framework Rajesh Popli Manager (Quality), Nagarro Software Pvt. Ltd., Gurgaon, INDIA rajesh.popli@nagarro.com ABSTRACT A framework is a hierarchical directory that encapsulates shared resources,

More information

Functional and LoadTest Strategies

Functional and LoadTest Strategies Test Automation Functional and LoadTest Strategies Presented by: Courtney Wilmott April 29, 2013 UTD CS6367 Software Testing and Validation Definitions / Overview Software is a set of programs, procedures,

More information

Continuous Delivery Whitepaper

Continuous Delivery Whitepaper Continuous Delivery Whitepaper Releasing software is often a long, difficult and risky process. Defects and integration issues pop-up at the very last moment and cause dissatisfaction to the development

More information

Mobile Automation: Best Practices

Mobile Automation: Best Practices contents A U T H O R : M a n i s h B h a g a t Mobile Automation: Best Practices Abstract... 2 Executive Summary... 3 QA Challenges of Mobile Application Testing... 4 Mobile Application Automation Challenges...

More information

Table of contents. Successful Agile with HP Quality Center. Market leading software for Quality Assurance

Table of contents. Successful Agile with HP Quality Center. Market leading software for Quality Assurance Successful Agile with HP Quality Center Market leading software for Quality Assurance Table of contents Becoming Agile and its challenges...3 How HP Quality Center software supports Agile software development...5

More information

Data Plane Development Kit Test Suite

Data Plane Development Kit Test Suite Data Plane Development Kit Test Suite Communications & Storage Infrastructure Group Intel DPDK Team Agenda 1 What s DPDK Test Suite 2 Challenges to Validation on DPDK.ORG 3 Benefits from DPDK Test Suite

More information

Automated Acceptance Testing of High Capacity Network Gateway

Automated Acceptance Testing of High Capacity Network Gateway Automated Acceptance Testing of High Capacity Network Gateway Ran Nyman 1, Ismo Aro 2, Roland Wagner 3, 1,2,3 Nokia Siemens Network, PO Box 1 FI-02022 Nokia Siemens Networks 1 ran@rannicon.com, 2 ismo.aro@nsn.com,

More information

Continuous Delivery Workshop

Continuous Delivery Workshop Continuous Delivery Workshop deployment pipelines Workshop materials created by Jez Humble, Martin Fowler, Tom Sulston, & Neal Ford deployment pipelines tests, synergistic practices, incremental deployment

More information

System Build 2 Test Plan

System Build 2 Test Plan System Build 2 Test Plan Version 1.0 System Build 2 Test Plan Author s Signature Your signature indicates that this document has been prepared with input from content experts and is in compliance with

More information

Automated Target Testing with TTCN-3: Experiences from WiMAX Call Processing Features

Automated Target Testing with TTCN-3: Experiences from WiMAX Call Processing Features Automated Target Testing with TTCN-3: Experiences from WiMAX Call Processing Features By Bhaskar Rao G Srinath Y Sridhar Y Jitesh M Motorola India Pvt Ltd, Hyderabad bhaskarraog@motorola.com 23 November

More information

Essentials of the Quality Assurance Practice Principles of Testing Test Documentation Techniques. Target Audience: Prerequisites:

Essentials of the Quality Assurance Practice Principles of Testing Test Documentation Techniques. Target Audience: Prerequisites: Curriculum Certified Software Tester (CST) Common Body of Knowledge Control Procedures Problem Resolution Reports Requirements Test Builds Test Cases Test Execution Test Plans Test Planning Testing Concepts

More information

Continuous Integration and Delivery at NSIDC

Continuous Integration and Delivery at NSIDC National Snow and Ice Data Center Supporting Cryospheric Research Since 1976 Continuous Integration and Delivery at NSIDC Julia Collins National Snow and Ice Data Center Cooperative Institute for Research

More information

Software Test Automation Best Practices

Software Test Automation Best Practices Software Test Automation Best Practices 2 Test automation is a critical regression activity. Yet for many reasons, automation projects often fail. Follow these best practices to improve your chances of

More information

Mobile Testing Automation

Mobile Testing Automation Mobile Testing Automation HARNESS THE MAGIC OF MOBILE TESTING AUTOMATION An InfoStretch White Paper August 2014 Elevating confidence 3200 Patrick Henry Drive, Suite 250 Santa Clara, CA 95054 408.727.1100

More information

Test Data Management An introduction

Test Data Management An introduction Test Data Managed Test Data Management An introduction Dirkjan Kaper Business Line Test Automation March 5, 2015 Test data management WHY WHAT HOW TOOLS WHY Why Test data management Information Protection

More information

GUIDE SILK CENTRAL: VISIBLY BETTER THE UNIFYING VIEW FOR TEST MANAGEMENT LANDSCAPES SILK CENTRAL GUIDE. Enter

GUIDE SILK CENTRAL: VISIBLY BETTER THE UNIFYING VIEW FOR TEST MANAGEMENT LANDSCAPES SILK CENTRAL GUIDE. Enter GUIDE SILK CENTRAL: VISIBLY BETTER THE UNIFYING VIEW FOR TEST MANAGEMENT LANDSCAPES Enter SILK CENTRAL SILK CENTRAL: VISIBLY BETTER Software must perform across more platforms than ever before, so it must

More information

Test Automation: A Project Management Perspective

Test Automation: A Project Management Perspective Test Automation: A Project Management Perspective Abstract Amith Pulla amith.pulla@intel.com For most QA leads or managers, it s always difficult to get the project manager (PM) to invest in test automation.

More information

Test Data Management

Test Data Management Test Data Management The Best Practices in TDM Abhik Kar Independent Validation Solutions Infosys Technologies Limited Florida, USA Debdatta Lahiri Independent Validation Solutions Infosys Technologies

More information

TESTAUTOMATION ARCHITECTURE

TESTAUTOMATION ARCHITECTURE TESTAUTOMATION ARCHITECTURE Author : Shefali Arora, Test Automation Architect Executive Summary Test automation frameworks provide a structure to the complete process of testing and increase the overall

More information

Agile Testing. What Students Learn

Agile Testing. What Students Learn Agile Testing Transition sound traditional test practices into an Agile development environment. By using a step-by-step approach, this course documents how to transition from traditional test practices

More information

Th3 - Open Source Tools for Test Management

Th3 - Open Source Tools for Test Management Th3 - Open Source Tools for Test Management Narayanan C. V., Vice President, Sonata Software Limited www.sonata-software.com Agenda Introduction Methodology Architectural View Test Management Best Practices

More information

Why Test Automation Fails

Why Test Automation Fails Why Test Automation Fails in Theory and in Practice Jim Trentadue Enterprise Account Manager- Ranorex jtrentadue@ranorex.com Thursday, January 15, 2015 Agenda Agenda Test Automation Industry recap Test

More information

Continuous Delivery. Alejandro Ruiz

Continuous Delivery. Alejandro Ruiz Continuous Delivery Alejandro Ruiz True reality How the customer explained it How the project leader understood it How the analyst designed it How the programmer wrote it What the customer really needed

More information

Testing Automation in Agile Software Development

Testing Automation in Agile Software Development International Journal of Innovation and Applied Studies ISSN 2028-9324 Vol. 9 No. 2 Nov. 2014, pp. 541-546 2014 Innovative Space of Scientific Research Journals http://www.ijias.issr-journals.org/ Testing

More information

MOBILE APPLICATION TESTING ENGINEER

MOBILE APPLICATION TESTING ENGINEER MOBILE APPLICATION TESTING ENGINEER www.rockfortnetworks.com/mapster mapster.bng@rockfortnetworks.com TESTING? Software Testing is the process of exercising or evaluating a system or system component by

More information

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction Software Testing Rajat Kumar Bal Introduction In India itself, Software industry growth has been phenomenal. IT field has enormously grown in the past 50 years. IT industry in India is expected to touch

More information

Often Clients tend to use in-house functional resources for their testing and validation processes ending up with issues such as

Often Clients tend to use in-house functional resources for their testing and validation processes ending up with issues such as TESTING IN ERP ENVIRONMENT Organizations implement ERP applications to respond to major business challenges of reducing costs and improving revenue. ERP applications make use of a single, centralized data

More information

Metrics in Software Test Planning and Test Design Processes

Metrics in Software Test Planning and Test Design Processes Master Thesis Software Engineering Thesis no: MSE-2007:02 January 2007 Metrics in Software Test Planning and Test Design Processes Wasif Afzal School of Engineering Blekinge Institute of Technology Box

More information

DevOps330 Continuous Integration Workshop

DevOps330 Continuous Integration Workshop Course Data Sheet DevOps330 Continuous Integration Workshop Course No.: DevOps330-60400 - Continuous Integration Workshop Business Outcome Management: DevOps For software version(s): N/A Software version

More information

Codeless Test Automation for Web Apps

Codeless Test Automation for Web Apps Codeless Test Automation for Web Apps Webinar by TestingWhiz December 11, 2012 1PM EST Agenda Functional Test Automation for Agile Teams Developing and Implementing Codeless Automation Frameworks Achieving

More information

The Tester's Role in Continuous Integration

The Tester's Role in Continuous Integration W8 Track 10/3/2012 The Tester's Role in Continuous Integration Presented by: Roi Carmel HP Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 904-278-0524 sqeinfo@sqe.com

More information

An Increase in Software Testing Robustness: Enhancing the Software Development Standard for Space Systems

An Increase in Software Testing Robustness: Enhancing the Software Development Standard for Space Systems An Increase in Software Robustness: Enhancing the Software Development Standard for Space Systems Karen Owens and Suellen Eslinger Software Engineering Subdivision 15 th Ground System Architectures Workshop

More information

Agile SPL-SCM: Agile Software Product Line Configuration and Release Management

Agile SPL-SCM: Agile Software Product Line Configuration and Release Management Agile SPL-SCM: Agile Software Product Line Configuration and Release Management APLE 2006 Workshop SPLC 2006, Baltimore, MD Reto.Kurmann@phonak.com Phonak Hearing Systems Presentation Roadmap 1. Introduction

More information

Use service virtualization to remove testing bottlenecks

Use service virtualization to remove testing bottlenecks Use service virtualization to remove testing bottlenecks Discover integration faults early by pushing integration testing left in the software lifecycle Contents 1 Complex, interconnected applications

More information

FSW QA Testing Levels Definitions

FSW QA Testing Levels Definitions FSW QA Testing Levels Definitions 1. Overview This document is used to help determine the amount and quality of testing (or its scope) that is planned for or has been performed on a project. This analysis

More information