Quality Assurance. Pragmatic Programmer Tip Think about Your Work

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Quality Assurance. Pragmatic Programmer Tip Think about Your Work"

Transcription

1 Quality Assurance Pragmatic Programmer Tip Think about Your Work Turn off the autopilot and take control. Constantly critique and appraise your work.

2 Readings Required: Rapid Development, McConnell, Chapter 4, Section 4.3 QA Fundamentals Pragmatic Programmer, Hunt and Thomas, Chapter 8, p Ruthless Testing Other good stuff: If you didn t test it, it doesn t work, Coldwell (link on class Resource list)

3 Outline QA basics getting off to a good start Test o What makes a good tester? o What types of testing can we do? o Can tools help? Bugs! Test material adapted from several talks by Ian King, tester at Microsoft for many years.

4 What does QA mean to you? Your thoughts? Things we can do to ensure we produce a high quality (low defect) product Two main approaches to QA: o Process: Build in quality from the start o Test: Add quality through removing bugs

5 What are ways to foster quality from the get go? Over to you again 3 ideas Some practices: Good design and planning Coding style guides Code reviews/walkthroughs Pair programming

6 Tools can help! Configuration Management o Document changes, enforce good practices CVS Memory behavior o Detects corruption and leaks Performance o Time of routines Gnu gprof

7 Interesting fact Up to 4x the normal number of defects are reported for released products that were developed under excessive schedule pressure (Jones, 94) Why?

8 Test the most common QA practice Verify: Did we build the system right? Validate: Did we build the right system?

9 What makes a good tester? Analytical o Ask the right questions o Develop experiments to get answers Methodical o Follow experimental procedures precisely o Document observed behaviors, their precursors and environment Brutally honest o You can t argue with the data

10 How do test engineers fail? Desire to make it work o Impartial judge, not handyman Trust in opinion or expertise o Trust no one the truth (data) is in there Failure to follow defined test procedure o How did we get here? Failure to document the data Failure to believe the data

11 What types of testing can we do? Back to you to generate some ideas! Functional (include boundaries) Performance Security Stress Resource exhaustion, errors, and recovery Reliability/availability Usability (is it obvious)

12 Some testing jargon Black box testing Treats the system as atomic Best simulates the customer experience White box testing Examines the system internals Trace data flow directly (ie, in the debugger Bug report contains more detail on source of defect May obscure timing problems (race conditions)

13 It s black and white, right?! In black box, the tests are usually intended to cover the space of behavior In white box, the tests are usually intended to cover the space of parts of the program Often tester driven Often developer driven

14 How do we design good tests? Well-defined inputs and outputs o Consider environment as inputs o Consider side effects as outputs Clearly defined initial conditions Clearly described expected behavior Specific small granularity provides greater precision in analysis Test must be at least as verifiable as feature

15 and good test cases? Valid cases - What should work? Invalid cases What shouldn t? Boundary conditions Error situations ie, resource exhaustion

16 What s the trick to running tests? Manual Runs Tests that require direct human intervention with the system Necessary when: o GUI is present o Behavior is dependent on physical activity Advisable when: o Automation is more complex system being tested! o System is changing rapidly (early development)

17 Automated Testing Tests that can be executed independent of human interaction Good: replaces manual testing Better: performs tests difficult for manual testing (e.g. timing related issues) Best: enables other types of testing (regression, perf, stress, lifetime) Cost: Time investment to link tests into harness

18 Tools rock! Example Test Harness Tests are programmed as modules, then run by harness Harness provides control and reporting Example Code Coverage Freescale CodeTEST Software Analysis Tools

19 Pragmatic Programmer Tips Test early, test often, test automatically Coding ain t done til all the tests run Find bugs once

20 BUGS! Managing Bugs

21 What is a bug? Formally, a software defect System fails to perform to spec System causes something else to fail System functions, but does not satisfy usability criteria If the system works to spec and someone wants it changed, that s a feature request

22 What makes a good bug report? Include: Reproducible steps how did you cause the failure? Observed result what did it do? Expected result what should it have done? Any collateral information: return values/output, Environment o OS version, env variables, compiler flags, o Test platforms must be reproducible o It doesn t do it on my machine

23 Generally have a form to help

24 And a database to file it in Why is a bug db useful? Don t lose bugs Can pass them around easily Justify resources Justify your work Help indicate when the product ready for release Based on the number and type of bugs Based on a graph of the rate of bugs occurring Enables all sorts of cool metrics that management (and customers!) likes!

25 SPR rate 30 Open Closed Backlog TIME

26 Classifying bugs Cray links severity with priority. Some keep it separate.

27 Another classification Severity o Sev 1: crash, hang, data o o o loss Sev 2: blocks feature, no workaround Sev 3: blocks feature, workaround available Sev 4: trivial (e.g. cosmetic) Priority o o o o Pri 1: Fix immediately Pri 2: Fix before next release outside team Pri 3: Fix before ship Pri 4: Fix if nothing better to do

28 A Bug s Life (idealistic)

29 Regression Testing 1. Ensure that the bug you just fixed, doesn t reappear later though other mods o Add a test case to your suite for it! 2. Ensure that the fix you just added doesn t break things working previously o Rerun the test suite before checkin

30 When can I ship? Tune in on Monday!

Test Specifications. Test specification: example. Test Plans. Test plan: example. Test plan: goals. Quality Assurance: Test Development & Execution

Test Specifications. Test specification: example. Test Plans. Test plan: example. Test plan: goals. Quality Assurance: Test Development & Execution Quality Assurance: Test Development & Execution CSE 403 Lecture 23 Slides derived from a talk by Ian King Test Specifications What questions do I want to answer about this code? Think of this as experiment

More information

FSW QA Testing Levels Definitions

FSW QA Testing Levels Definitions FSW QA Testing Levels Definitions 1. Overview This document is used to help determine the amount and quality of testing (or its scope) that is planned for or has been performed on a project. This analysis

More information

Service Delivery Module

Service Delivery Module Service Delivery Module Software Development Methodology -India follows international industry standards and has adopted the standard methodology in our Software Development Life Cycle (SDLC). It is a

More information

<Insert Picture Here> When to Automate Your Testing (and When Not To)

<Insert Picture Here> When to Automate Your Testing (and When Not To) When to Automate Your Testing (and When Not To) Joe Fernandes (Oracle) Alex Di Fonzo (Synchronoss Technologies) Three Myths of Automated Testing 1. Automated testing always results

More information

Testing Introduction. IEEE Definitions

Testing Introduction. IEEE Definitions Testing Introduction IEEE Definitions Software testing is the process of analyzing a software item to detect the differences between existing and required conditions (that is, bugs) and to evaluate the

More information

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction Software Testing Rajat Kumar Bal Introduction In India itself, Software industry growth has been phenomenal. IT field has enormously grown in the past 50 years. IT industry in India is expected to touch

More information

Smarter Balanced Assessment Consortium. Recommendation

Smarter Balanced Assessment Consortium. Recommendation Smarter Balanced Assessment Consortium Recommendation Smarter Balanced Quality Assurance Approach Recommendation for the Smarter Balanced Assessment Consortium 20 July 2012 Summary When this document was

More information

ISTQB Certified Tester. Foundation Level. Sample Exam 1

ISTQB Certified Tester. Foundation Level. Sample Exam 1 ISTQB Certified Tester Foundation Level Version 2015 American Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. #1 When test cases are designed

More information

Testing Best Practices

Testing Best Practices ALMComplete, QAComplete, DevComplete This document is used as a guide to improving your testing and quality assurance processes. 1 Test Case Creation Once requirements have been created and approved, while

More information

Quality Assurance White Paper [By: QA Team METAOPTION]

Quality Assurance White Paper [By: QA Team METAOPTION] Quality Assurance White Paper [By: QA Team METAOPTION] Quality Assurance and Software Testing Software Quality Assurance involves the entire software development process, making sure that any agreed upon

More information

Module 10. Coding and Testing. Version 2 CSE IIT, Kharagpur

Module 10. Coding and Testing. Version 2 CSE IIT, Kharagpur Module 10 Coding and Testing Lesson 26 Debugging, Integration and System Testing Specific Instructional Objectives At the end of this lesson the student would be able to: Explain why debugging is needed.

More information

Software Testing. Testing types. Software Testing

Software Testing. Testing types. Software Testing 1 Software Testing Testing types Software Testing 2 References Software Testing http://www.testingeducation.org/bbst/ IBM testing course available through the Academic Initiative: Principles of Software

More information

Introduction to Automated Testing

Introduction to Automated Testing Introduction to Automated Testing What is Software testing? Examination of a software unit, several integrated software units or an entire software package by running it. execution based on test cases

More information

Agile Automation Testing

Agile Automation Testing Aman Arora Adobe Systems India Pvt. Ltd. I-1A, sector-25a, Noida aarora@adobe.com Agile Automation Testing Abstract: What is Agile Automation Testing? Automation of the test cases done for the Agile project

More information

Improved Software Testing Using McCabe IQ Coverage Analysis

Improved Software Testing Using McCabe IQ Coverage Analysis White Paper Table of Contents Introduction...1 What is Coverage Analysis?...2 The McCabe IQ Approach to Coverage Analysis...3 The Importance of Coverage Analysis...4 Where Coverage Analysis Fits into your

More information

Software testing. Objectives

Software testing. Objectives Software testing cmsc435-1 Objectives To discuss the distinctions between validation testing and defect testing To describe the principles of system and component testing To describe strategies for generating

More information

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010

ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 ASSURING SOFTWARE QUALITY USING VISUAL STUDIO 2010 QA2010 3 Days INTRODUCTION This three-day, instructor-led course provides students with the knowledge and skills to prevent, detect, manage and avoid

More information

Chapter 17 Software Testing Strategies Slide Set to accompany Software Engineering: A Practitioner s Approach, 7/e by Roger S. Pressman Slides copyright 1996, 2001, 2005, 2009 by Roger S. Pressman For

More information

Tool support for testing

Tool support for testing INF 3121 Software Testing - Lecture 06 Tool support for testing 1. Types of test (60 min) 2. Effective use of test : potential benefits and risks (15 min) 3. Introducing a test tool to an (15 min) INF3121

More information

Oracle Insurance Policy Administration System Quality Assurance Testing Methodology. An Oracle White Paper August 2008

Oracle Insurance Policy Administration System Quality Assurance Testing Methodology. An Oracle White Paper August 2008 Oracle Insurance Policy Administration System Quality Assurance Testing Methodology An Oracle White Paper August 2008 Oracle Insurance Policy Administration System Quality Assurance Testing Methodology

More information

ISTQB Foundation level exam Sample paper - II For more testing free downloads Visit

ISTQB Foundation level exam Sample paper - II For more testing free downloads Visit ISTQB Foundation level exam Sample paper - II For more testing free downloads Visit http://softwaretestinghelp.com Q1 A deviation from the specified or expected behavior that is visible to endusers is

More information

TESSY Automated dynamic module/unit and. CTE Classification Tree Editor. integration testing of embedded applications. for test case specifications

TESSY Automated dynamic module/unit and. CTE Classification Tree Editor. integration testing of embedded applications. for test case specifications TESSY Automated dynamic module/unit and integration testing of embedded applications CTE Classification Tree Editor for test case specifications Automated module/unit testing and debugging at its best

More information

(COMPANY LOGO) CGMP COMPUTERIZED SYSTEM VENDOR AUDIT QUESTIONNAIRE

(COMPANY LOGO) CGMP COMPUTERIZED SYSTEM VENDOR AUDIT QUESTIONNAIRE 1. GENERAL COMPANY INFORMATION (COMPANY LOGO) 1.1 Name Address Years in Business Number of Employees Services Performed or Products Manufactured Prior Experience with (Company Name) 1.2 Please provide

More information

Software Testing Interview Questions

Software Testing Interview Questions Software Testing Interview Questions 1. What s the Software Testing? A set of activities conducted with the intent of finding errors in software. 2.What is Acceptance Testing? Testing conducted to enable

More information

Automating Security Testing. Mark Fallon Senior Release Manager Oracle

Automating Security Testing. Mark Fallon Senior Release Manager Oracle Automating Security Testing Mark Fallon Senior Release Manager Oracle Some Ground Rules There are no silver bullets You can not test security into a product Testing however, can help discover a large percentage

More information

Factual Note Test Plan Document

Factual Note Test Plan Document Factual Note Test Plan Document Table of Contents 1. Introduction... 3 1.1. Test Plan Objectives... 4 1.2. Purpose... 4 1.3. Reference Documents... 4 2. Scope... 4 2.1. Factual Note In/Out of Scope...

More information

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 QAI /QAAM 2011 Conference Proven Practices For Managing and Testing IT Projects Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 Format This presentation is a journey When Bill and

More information

Quality Assurance: Early Work Items

Quality Assurance: Early Work Items Quality Assurance: Early Work Items Introduction: Ian King Software Test Lead, Microsoft Corporation Manager of Test Development for Windows CE Base OS (kernel, drivers, file systems) Previous projects

More information

Peach Fuzzer Platform

Peach Fuzzer Platform Fuzzing is a software testing technique that introduces invalid, malformed, or random data to parts of a computer system, such as files, network packets, environment variables, or memory. How the tested

More information

Acceptance Criteria. Software Engineering Group 6. 0/3/2012: Acceptance Criteria, v2.0 March 2012 - Second Deliverable

Acceptance Criteria. Software Engineering Group 6. 0/3/2012: Acceptance Criteria, v2.0 March 2012 - Second Deliverable Acceptance Criteria Software Engineering Group 6 0/3/2012: Acceptance Criteria, v2.0 March 2012 - Second Deliverable 1 Contents: Page no: Introduction...3 Test Environment...4 Acceptance Tests...5 Types

More information

What s the status of testing? What are you doing today? When will you be finished? Why is it taking so long? Have you tested, yet?

What s the status of testing? What are you doing today? When will you be finished? Why is it taking so long? Have you tested, yet? A Low-Tech Testing Dashboard James Bach, Principal Consultant james@satisfice.com http://www.satisfice.com STAR 99 East The Problem What s the status of testing? What are you doing today? When will you

More information

Week 1: Manual Testing. Types of Testing

Week 1: Manual Testing. Types of Testing Week 1: Manual Testing Software development Life cycle (SDLC) Software QA and Software testing. Capability Maturity Model. Manual and Automation testing. 1. Manual testing process (Pros and Cons) 2. Automation

More information

Quality Assurance Training Program

Quality Assurance Training Program Quality Assurance Training Program Introduction/Summary: This 5-day course focuses on understanding and developing various skills required by QA Developer, preparing to use various tools and techniques

More information

Four Schools of Software Testing. bret@pettichord.com www.pettichord.com

Four Schools of Software Testing. bret@pettichord.com www.pettichord.com Four Schools of Software Testing bret@pettichord.com www.pettichord.com Workshop on Teaching Software Testing, Florida Tech, February 2003 Why Classify Testing Doctrines into Schools? Clarify why testing

More information

Optimizing ARM Cortex-A9 support in Windows Embedded Compact

Optimizing ARM Cortex-A9 support in Windows Embedded Compact Optimizing ARM Cortex-A9 support in Windows Embedded Compact A DISCUSSION OF RANDOM HANGS AND OTHER ISSUES USING WINDOWS EMBEDDED COMPACT ON FREESCALE I.MX6 APPLICATION PROCESSOR AND HOW THEY WERE SOLVED

More information

Basic Testing Concepts and Terminology

Basic Testing Concepts and Terminology T-76.5613 Software Testing and Quality Assurance Lecture 2, 13.9.2006 Basic Testing Concepts and Terminology Juha Itkonen SoberIT Contents Realities and principles of Testing terminology and basic concepts

More information

Software Test Automation Best Practices

Software Test Automation Best Practices Software Test Automation Best Practices 2 Test automation is a critical regression activity. Yet for many reasons, automation projects often fail. Follow these best practices to improve your chances of

More information

Essential Visual Studio Team System

Essential Visual Studio Team System Essential Visual Studio Team System Introduction This course helps software development teams successfully deliver complex software solutions with Microsoft Visual Studio Team System (VSTS). Discover how

More information

Continuous Integration

Continuous Integration Continuous Integration The Sign of a Great Shop By Jared Richardson State of Software http://www.flickr.com/photos/markjsebastian/290364958/ Changing Features Illustrate Verify Update http://www.flickr.com/photos/nglynn/387898959/

More information

Key Points. Quality Assurance and Testing. Defect Process. Developer Practice

Key Points. Quality Assurance and Testing. Defect Process. Developer Practice Key Points Quality Assurance and Testing CSE 403 Lecture 22 Many different characteristics of quality Importance of having independent quality assurance from development The deliverable of QA is information

More information

Levels of Software Testing. Functional Testing

Levels of Software Testing. Functional Testing Levels of Software Testing There are different levels during the process of Testing. In this chapter a brief description is provided about these levels. Levels of testing include the different methodologies

More information

Latest Trends in Testing. Ajay K Chhokra

Latest Trends in Testing. Ajay K Chhokra Latest Trends in Testing Ajay K Chhokra Introduction Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the customer.

More information

Teaching Software Testing from two Viewpoints

Teaching Software Testing from two Viewpoints Teaching Software Testing from two Viewpoints Neil B. Harrison Department of Computer Science Utah Valley University 800 West University Parkway Orem, Utah 84058 801-863-7312 neil.harrison@uvu.edu Abstract

More information

Quality Assurance - Karthik

Quality Assurance - Karthik Prevention is better than cure Quality Assurance - Karthik This maxim perfectly explains the difference between quality assurance and quality control. Quality Assurance is a set of processes that needs

More information

Agile Test Automation. James Bach, Satisfice, Inc. James@satisfice.com www.satisfice.com

Agile Test Automation. James Bach, Satisfice, Inc. James@satisfice.com www.satisfice.com Agile Test Automation James Bach, Satisfice, Inc. James@satisfice.com www.satisfice.com Examples of Agile Automation CD test system (300% improvement in CD package testing throughput in two weeks) Auction

More information

A Guide To Evaluating a Bug Tracking System

A Guide To Evaluating a Bug Tracking System A Guide To Evaluating a Bug Tracking System White Paper By Stephen Blair, MetaQuest Software Published: October, 2004 Abstract Evaluating a bug tracking system requires that you understand how specific

More information

Module Introduction. CONTENT: 10 pages 2 questions. LEARNING TIME: 20 minutes

Module Introduction. CONTENT: 10 pages 2 questions. LEARNING TIME: 20 minutes Module Introduction PURPOSE: The intent of this module is to provide an overview of CodeWarrior Linux Tools and Solutions and the Linux product strategy. OBJECTIVES: Identify the CodeWarrior Linux Tools

More information

Application Test Management and Quality Assurance

Application Test Management and Quality Assurance SAP Brief Extensions SAP Quality Center by HP Objectives Application Test Management and Quality Assurance Deliver new software with confidence Deliver new software with confidence Testing is critical

More information

(From Glenford Myers: The Art of Software Testing)

(From Glenford Myers: The Art of Software Testing) A Testing Exercise: (From Glenford Myers: The Art of Software Testing) A program reads three integer values from a card. The three values are interpreted as representing the lengths of the sides of a triangle.

More information

Senior QA Analyst. The Role. Date produced: November Date last reviewed: March Date evaluated: November Band and Range: C2

Senior QA Analyst. The Role. Date produced: November Date last reviewed: March Date evaluated: November Band and Range: C2 Senior QA Analyst Date produced: November 2008 Produced by: Rob Norman Date last reviewed: March 2015 Reviewed by: David Jenkins Date evaluated: November 2008 Evaluated by: HR Team Band and Range: C2 Salary

More information

Test Engineering Foundation Course Outline

Test Engineering Foundation Course Outline Test Engineering Foundation Course Outline General Description This course provides test engineers and test managers with the essential ideas, processes, tools and skills they need in order to set themselves

More information

Software Engineering Support

Software Engineering Support Software Engineering Support Christopher Greenough, Alan Kyffin, Gemma Poulter Software Engineering Group Scientific Computing Department STFC Rutherford Appleton Laboratory christopher.greenough@stfc.ac.uk

More information

Final Project: Quality Assurance Plan

Final Project: Quality Assurance Plan Final Project: Quality Assurance Plan 17-654: Analysis of Software Artifacts Jonathan Aldrich (jonathan.aldrich@cs.cmu.edu) Initial QA plan due Thursday, May 4 at 5pm QA plan review documents due May 8,

More information

European Commission. <Project Name> Test Management Plan. Date: 23/10/2008 Version: 1.002 Authors: Revised by: Approved by: Public: Reference Number:

European Commission. <Project Name> Test Management Plan. Date: 23/10/2008 Version: 1.002 Authors: Revised by: Approved by: Public: Reference Number: EUROPEAN COMMISSION DIRECTORATE-GENERAL INFORMATICS Information systems Directorate European Commission Test Management Plan Date: 23/10/2008 Version: 1.002 Authors: Revised by: Approved

More information

Software Quality Assurance Plan

Software Quality Assurance Plan Company Name Software Quality Assurance Plan Copyright 2012 Template.org Version: (n) Date: (mm/dd/yyyy) adapted from the IEEE Standard for Software Test Documentation Document History and Distribution

More information

Software Reliability The Silent Danger - How to Assess It

Software Reliability The Silent Danger - How to Assess It Software Reliability The Silent Danger - How to Assess It Suzanne Flynn Cygnet Solutions Ltd 2011 Cygnet Solutions Ltd. Cygnet Solutions We are a small independent software development and consultancy

More information

CUT COSTS, NOT PROJECTS

CUT COSTS, NOT PROJECTS CUT COSTS, NOT PROJECTS Understanding and Managing Software Development Costs A WEBINAR for State of Washington Agencies Critical Logic, Inc. July 9 2009 Starting at 3pm, Pacific Daylight Time Critical

More information

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh),

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh), Content of 6 Months Software Testing Training at EH1-Infotech Module 1: Introduction to Software Testing Basics of S/W testing Module 2: SQA Basics Testing introduction and terminology Verification and

More information

Justifying the use of software of uncertain pedigree (SOUP) in safety related applications

Justifying the use of software of uncertain pedigree (SOUP) in safety related applications Justifying the use of software of uncertain pedigree (SOUP) in safety related applications Peter Bishop, Robin Bloomfield and Peter Froome Adelard Abstract This short paper is intended to serve as an introduction

More information

Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective

Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective Agile Development and Testing Practices highlighted by the case studies as being particularly valuable from a software quality perspective Iteration Advantages: bringing testing into the development life

More information

JOURNAL OF OBJECT TECHNOLOGY

JOURNAL OF OBJECT TECHNOLOGY JOURNAL OF OBJECT TECHNOLOGY Online at http://www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2006 Vol. 5, No. 6, July - August 2006 On Assuring Software Quality and Curbing Software

More information

Axe in the Agile World

Axe in the Agile World Axe in the Agile World WHITE PAPER Executive Summary This paper explains the way in which Axe (Odin s Enterprise Test Automation Platform) allows the automated testing to take place in a range of project

More information

Methods of software quality assurance. Daniel Osielczak (d.osielczak@gmail.com) Sebastian Mianowski (aeons@wp.pl)

Methods of software quality assurance. Daniel Osielczak (d.osielczak@gmail.com) Sebastian Mianowski (aeons@wp.pl) Methods of software quality assurance Daniel Osielczak (d.osielczak@gmail.com) Sebastian Mianowski (aeons@wp.pl) Table of Contents 1 Introduction 3 1.1 SQA.................................. 3 1.2 Overview

More information

Software Development Lifecycle. Steve Macbeth Group Program Manager Search Technology Center Microsoft Research Asia

Software Development Lifecycle. Steve Macbeth Group Program Manager Search Technology Center Microsoft Research Asia Software Development Lifecycle Steve Macbeth Group Program Manager Search Technology Center Microsoft Research Asia About Me Currently manage a team of 10 Program Managers at Microsoft Research Asia Over

More information

Morten Mossige, October, 2015 Application lifecycle management with Microsoft s Team Foundation Server at ABB. ABB November 5, 2015

Morten Mossige, October, 2015 Application lifecycle management with Microsoft s Team Foundation Server at ABB. ABB November 5, 2015 Morten Mossige, October, 2015 Application lifecycle management with Microsoft s Team Foundation Server at ABB Slide 1 Agenda Microsoft s ALM Platform, Team Foundation Server Focus Areas Implement process

More information

Software Configuration Management

Software Configuration Management Software Configuration Management 1 Software Configuration Management Four aspects Version control Automated build Change control Release Supported by tools Requires expertise and oversight More important

More information

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Table of contents Introduction.......................................................2 Step 1:

More information

Foundation Level PRACTICE EXAM Syllabus Version 2010 Practice Exam Version 2011

Foundation Level PRACTICE EXAM Syllabus Version 2010 Practice Exam Version 2011 ISTQB Certified Tester Foundation Level PRACTICE EXAM International Software Testing Qualifications Board Name: Company address: Phone : Fax : Email: Billing address: Training company: Trainer: Foundation

More information

Testing Services. Providing World Class Services in Implementing QA Practices

Testing Services. Providing World Class Services in Implementing QA Practices Testing Services Providing World Class Services in Implementing QA Practices This document describes the different areas of Testing Services that we can help an organization in implementing to get the

More information

Benefits and Pitfalls of Test Automation

Benefits and Pitfalls of Test Automation T-76.613 Software Testing and Quality Assurance 25.10.2006 Benefits and Pitfalls of Test Automation SoberIT Tools in development lifecycle Requirement Specification Acceptance test Performance, simulator

More information

The Dangers of Use Cases Employed as Test Cases

The Dangers of Use Cases Employed as Test Cases The Dangers of Use Cases Employed as Test Cases Bernie Berger This document is intended to provide background support and additional information to the slide presentation at STARWest 2001. I don t consider

More information

CIS 551 / TCOM 401 Computer and Network Security. Spring 2007 Lecture 6

CIS 551 / TCOM 401 Computer and Network Security. Spring 2007 Lecture 6 CIS 551 / TCOM 401 Computer and Network Security Spring 2007 Lecture 6 Announcements Reminder: Send in project groups TODAY If you don't have a group, let us know. If you haven't started on the project

More information

Software Test Plan (STP) Template

Software Test Plan (STP) Template (STP) Template Items that are intended to stay in as part of your document are in bold; explanatory comments are in italic text. Plain text is used where you might insert wording about your project. This

More information

COMMONWEALTH OF PENNSYLVANIA DEPARTMENT S OF PUBLIC WELFARE, INSURANCE, AND AGING

COMMONWEALTH OF PENNSYLVANIA DEPARTMENT S OF PUBLIC WELFARE, INSURANCE, AND AGING COMMONWEALTH OF PENNSYLVANIA DEPARTMENT S OF PUBLIC WELFARE, INSURANCE, AND AGING INFORMATION TECHNOLOGY STANDARD Name Of Standard: Defect Management and Reporting Domain: Application Domain Date Issued:

More information

Unit 14: Testing and Inspection

Unit 14: Testing and Inspection Unit 14: Testing and Inspection Objectives Ð To introduce software testing and to develop its role within the software development process. Ð To introduce the use of formal inspections of design and code

More information

3. Building Stones of Agile Testing

3. Building Stones of Agile Testing 2011 International Conference on Computer and Software Modeling IPCSIT vol.14 (2011) (2011) IACSIT Press, Singapore Agile Testing for Rapid Delivery Sendhilraj Thangaraj 1 1 Harman International (India)

More information

INF3121 : Software Testing Lecture 5. Test management. Lecturer: Raluca Florea. INF3121/ / Raluca Florea 1

INF3121 : Software Testing Lecture 5. Test management. Lecturer: Raluca Florea. INF3121/ / Raluca Florea 1 INF3121 : Software Testing 19. 02. 2015 Lecture 5 Test management Lecturer: Raluca Florea INF3121/ 19.02.2015 / Raluca Florea 1 Overview 1. Test organization 2. Test planning and estimation 3. Test progress

More information

Testing. Chapter. A Fresh Graduate s Guide to Software Development Tools and Technologies. CHAPTER AUTHORS Michael Atmadja Zhang Shuai Richard

Testing. Chapter. A Fresh Graduate s Guide to Software Development Tools and Technologies. CHAPTER AUTHORS Michael Atmadja Zhang Shuai Richard A Fresh Graduate s Guide to Software Development Tools and Technologies Chapter 3 Testing CHAPTER AUTHORS Michael Atmadja Zhang Shuai Richard PREVIOUS CONTRIBUTORS : Ang Jin Juan Gabriel; Chen Shenglong

More information

Testing Rails. by Josh Steiner. thoughtbot

Testing Rails. by Josh Steiner. thoughtbot Testing Rails by Josh Steiner thoughtbot Testing Rails Josh Steiner April 10, 2015 Contents thoughtbot Books iii Contact us................................ iii Introduction 1 Why test?.................................

More information

Fuzzing in Microsoft and FuzzGuru framework

Fuzzing in Microsoft and FuzzGuru framework Fuzzing in Microsoft and FuzzGuru framework OWASP-IL May-2007 John Neystadt jney@microsoft.com Lead Program Manager Forefront Edge, Microsoft Agenda Overview Introduction to Fuzzing FuzzGuru Architecture

More information

Software Engineering for LabVIEW Applications. Elijah Kerry LabVIEW Product Manager

Software Engineering for LabVIEW Applications. Elijah Kerry LabVIEW Product Manager Software Engineering for LabVIEW Applications Elijah Kerry LabVIEW Product Manager 1 Ensuring Software Quality and Reliability Goals 1. Deliver a working product 2. Prove it works right 3. Mitigate risk

More information

With a flexible, open architecture

With a flexible, open architecture F A C T S H E E T Change request and defect management for the application life cycle TrackRecord is an advanced change request and defect management tool that helps organizations establish a systematic

More information

What Is Specific in Load Testing?

What Is Specific in Load Testing? What Is Specific in Load Testing? Testing of multi-user applications under realistic and stress loads is really the only way to ensure appropriate performance and reliability in production. Load testing

More information

Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension

Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension Sample Exam ISTQB Agile Tester 2014 Foundation Level Extension Version 1.0 Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. Table of Contents

More information

Technology Review Test Automation and Software Development

Technology Review Test Automation and Software Development Technology Review Test Automation and Software Development Amit Srivastava Test Automation and Software Development Amit Srivastava Technology Review#2002-07 Test Automation and Software Development Amit

More information

Cem Kaner -- kaner@kaner.com James Bach -- james@satisfice.com November, 1999

Cem Kaner -- kaner@kaner.com James Bach -- james@satisfice.com November, 1999 Paradigms of Black Box Software Testing Cem Kaner -- kaner@kaner.com James Bach -- james@satisfice.com November, 1999 The Puzzle Black box testing groups vary widely in their approach to testing. Tests

More information

The ROI of Test Automation

The ROI of Test Automation The ROI of Test Automation by Michael Kelly www.michaeldkelly.com Introduction With the exception of my first project team out of college, in every project team since, I ve had to explain either what automated

More information

Procedure for Assessment of System and Software

Procedure for Assessment of System and Software Doc. No: STQC IT/ Assessment/ 01, Version 1.0 Procedure for Assessment of System and Software May, 2014 STQC - IT Services STQC Directorate, Department of Electronics and Information Technology, Ministry

More information

Best practices in scientific programming Software Carpentry, Part I. Pietro Berkes, Brandeis University

Best practices in scientific programming Software Carpentry, Part I. Pietro Berkes, Brandeis University Best practices in scientific programming Software Carpentry, Part I Pietro Berkes, Brandeis University Outline Part I Agile development for scientists Good programming practices Test driven development,

More information

A Study on Software Metrics and Phase based Defect Removal Pattern Technique for Project Management

A Study on Software Metrics and Phase based Defect Removal Pattern Technique for Project Management International Journal of Soft Computing and Engineering (IJSCE) A Study on Software Metrics and Phase based Defect Removal Pattern Technique for Project Management Jayanthi.R, M Lilly Florence Abstract:

More information

Eliminate Memory Errors and Improve Program Stability

Eliminate Memory Errors and Improve Program Stability Eliminate Memory Errors and Improve Program Stability with Intel Parallel Studio XE Can running one simple tool make a difference? Yes, in many cases. You can find errors that cause complex, intermittent

More information

Continuous Integration Optimizing Your Release Management Process

Continuous Integration Optimizing Your Release Management Process Continuous Integration Optimizing Your Release Management Process Continuous Integration? Why should I care? What s in it for me? Continuous Integration? Why should I care? What s in it for me? The cost

More information

Softjourn, Inc. s QA Testing Process

Softjourn, Inc. s QA Testing Process Softjourn, Inc. s QA Process Date of Last Update: June 05, 2007 Version: 2.0 Author: Softjourn, Inc. Headquarters 39270 Paseo Padre Pkwy #251 Fremont, CA 94536 USA p: +1.510.744.1528 f: +1. 815.301.2772

More information

Isabella 1 and Emi Retna 2. Technology, Karunya University, Coimbatore, India

Isabella 1 and Emi Retna 2. Technology, Karunya University, Coimbatore, India STUDY PAPER ON TEST CASE GENERATION FOR GUI BASED TESTING Isabella 1 and Emi Retna 2 1 PG Research Scholar, Software Engineering Group, School of Computer Science and Technology, Karunya University, Coimbatore,

More information

Continuous Quality Engineering in a Digital World. Paul Baker

Continuous Quality Engineering in a Digital World. Paul Baker Continuous Quality Engineering in a Digital World Paul Baker Visa Europe Digital Services Digital Wallets Person-to-Person Payments Card Linked Offers Mobile Payments Consumers Context Payment Service

More information

Qualities of A Superb Mobile App Tester

Qualities of A Superb Mobile App Tester 15 Qualities of A Superb Mobile App Tester introduction Getting the right expertise is the key to success in any business and that s no less relevant when it comes to mobile app testing and test automation.

More information

Getting QA and Developers to Work Together

Getting QA and Developers to Work Together Getting QA and Developers to Work Together WHITEPAPER Real-Time Test Management For many development shops choosing to implement an Agile process, one thing becomes abundantly clear: QA analysts and developers

More information

White Papers: Unit Testing. www.dcmtech.com. Unit Testing

White Papers: Unit Testing. www.dcmtech.com. Unit Testing Unit Testing Table of Contents TESTING, VERIFICATION AND VALIDATION...1 UNIT TESTING PROCEDURES...3 C1 100% COVERAGE...3 QUERY GENERATION...4 TESTING, VERIFICATION and VALIDATION Black Box Testing White

More information

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info MANUAL TESTING (Complete Package) WEB APP TESTING DB TESTING MOBILE APP TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION :

More information

Keywords: SQA,Black Box Testing( BBT), White Box testing(wbt).

Keywords: SQA,Black Box Testing( BBT), White Box testing(wbt). Volume 3, Issue 10, October 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Enhancing Software

More information