CUT COSTS, NOT PROJECTS

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "CUT COSTS, NOT PROJECTS"

Transcription

1 CUT COSTS, NOT PROJECTS Understanding and Managing Software Development Costs A WEBINAR for State of Washington Agencies Critical Logic, Inc. July Starting at 3pm, Pacific Daylight Time

2 Critical Logic Highly advanced technology for integrating requirements validation with software testing, assuring ultra-high reliability software at substantially reduced cost

3 What This Series Is About DIS Budget 2010: 10,733,000 DIS Budget 2008: 17,690,000 When the budget is cut, IT reduces its capability The enterprise loses, IT loses How can IT cut costs while retaining capability Understand the difference Make the right decisions Improve the ROI The enterprise wins, IT wins

4 How This Webinar Is Organized The source of costs in software development. Costs vs Projects Cost analysis for IT. How to measure and analyze costs Attacking the major IT cost driver: rework Cost strategies. How cost analysis drives tool, staffing and project decision making

5 Agency vs IT Agency challenges in austere budget period: Deliver more value to the state and its citizens Determine what contributes to the costs of delivery Reduce those cost drivers, improve the margin Traditional IT reaction to revenue (budget) reductions: Reduce deliveries (eliminate or scale back projects) Reduce delivery capability (staff) Ignore cost drivers

6 Meet demand while reducing cost DEMAND

7 Reduce demand and cost together INFORMATION TECHNOLOGY PROJECTS X X Perceived value to the enterprise

8 The Importance Of Cost Analysis To Business 1. Break down the cost to deliver a product or service into individual elements 2. Understanding the factors which most influence those costs: the Cost Drivers. 3. Modify business processes to optimize the cost drivers to deliver products at lowest possible cost.

9 Cost Drivers In Business Activity Cost Pool Cost Driver Annual Count of Clients Cost Screen client application 10 minutes/ application $15/hr 350 applications per week 875 Certify applicant is qualified 1 hrs per application $24/hr 350 applications. Typical rejection rate is 50 per batch of 350 8,400 Generate the license Time to Setup $250 1 hour/batch. 250 Generate the license # $15/license 300 licenses per batch 4,500 Total per Batch 14,025 Process oriented Quantitative Consistent

10 Is It Different for Government Enterprises? Mandates, revenue generation, public scrutiny are profit measures for public agencies Resource ceilings may make IT solutions the only option Delivering solutions on time and on budget remains the key management priority. It is still a business: product vs cost

11 Cost Drivers In Software Development Numerous attempts to quantify software cost drivers Boehm, COCOMO II Capers Jones Estimating Models All are project oriented Product: complexity, DB size, architecture, language Personnel: experience, skill level, allocation Project: tools, schedule, practices Useful for estimating, not helpful in reducing costs

12 Need A Different Viewpoint Every software project is unique, but Software development processes and activities are not unique Writing requirements Specifying design (interfaces, programs, databases) Constructing programs Testing Reducing the cost of a process will lower the cost of all projects using that process

13 Focus On Cost Of Process SW development process cost drivers Identify the processes Determine what drives the cost to perform the process Find ways to reduce that cost Typical processes Specify business requirement Designing screens or interfaces Coding software components Testing software

14 Cost Of Process 1. What does it cost to accomplish a typical unit of work Design a screen Code a module Test a transaction 2. Cost drivers Skills of staff Nature and complexity of applications Organizational factors 3. Focus on improving the cost of accomplishing typical processes

15 Process Cost Elements Every process has two required cost components Cost to perform the work Cost to validate that the results are correct Unfortunately, there is a third possible cost: doing the work again because it was done incorrectly the first time. Task (e.g coding) Work Effort QA Rework Essential Cost Avoidable Cost

16 What Do IT Processes Really Cost? The average programmer spends only 47 days a year coding new functionality. 80% of coding bugs are due to errors in specification of requirements. 50% or more of project costs are rework. Software development processes are much less efficient than we think. Processes are repeated because the results are incomplete or wrong.

17 Process And Project The project plan assumes processes are allocated like this: Requirements Solution Design Construction Testing Design Coding Requirement Design Coding Testing In reality software development processes are employed like this: Requirement Requirement Requirement Requirement Design Design Design Design Coding Coding Coding Testing Cost overruns, schedule overruns, quality problems

18 Why Process Costs Expand Processes get repeated because the work was incomplete the first time The process does not have clear and verifiable deliverables Wrong or inadequate tools to perform the process work Processes and their deliverables do not integrate well Understand, measure and improve each process, project costs will come down. Leverage!

19 Summary 1. The business objective is to reduce cost, not deliverables. IT tends to reduce deliverables to avoid cost. 2. Traditional IT efficiency measures are project oriented; not effective in managing for more deliverables at less cost 3. Cost is incurred in the processes used to build software, not the project per se 4. Projects go over budget because the processes have to be repeated or are performed inefficiently 5. Understand and manage SW development process cost drivers for better success

20 Quick Process Assessment Methodology We typically don t track and measure processes We do track resources in a project As a first-cut assessment of process cost drivers: 1. Determine the processes in which each team member participates 2. Track the participation of team members in project phases 3. Compare to the expected participation of team members in project phases 4. Unexpected participation indicates extended or repeated processes

21 Process And Project Requirements Solution Design Construction Testing GUI Designer 40 hrs Programmer 75 hrs Programmer 10 hrs SME 200 hrs Sys Analyst 100 hrs Programmer 125 hrs Tester 200 hrs Poor requirements processes? SME 70 hrs SME 30 hrs SME 30 hrs Design rework?? GUI Designer 20 hrs Sys Analyst 100 hrs GUI Designer 40 hrs Sys Analyst 100 hrs SME 200 hrs Sys Analyst 100 hrs Programmer 75 hrs Programmer 125 hrs Programmer 100 hrs Tester 200 hrs Cost overruns, schedule overruns, quality problems

22 Quick-analysis Template One time setup List standard processes in SW development List the actors (skills or titles) Allocate actors to processes For a project or set of projects, determine which processes take place in which project phase and the estimated hours Template allocates the hours to the actors Compare to the actual hours. Determine which actors/processes are the cost drivers

23 Process Cost Drivers Was the amount of work underestimated (scope or complexity)? Were the deliverables from the process incomplete or in error? Was there a black swan? Is the process itself poorly defined or too ad hoc?

24 Processes: Inefficient or Ineffective Inefficient processes: requires more resources but results are error-free. Process does not have to be revisited. Ineffective processes: process completes but quality of deliverable is insufficient. Process work has to be revisited. This is REWORK! Key rework indicators: Defect escapes Skill allocations Project time allocation

25 Easy Targets For Process Improvements Technologies that Help verify functional specifications Automatically design test cases Quickly automate test execution

26 DEFECT ESCAPES Other 65-70% of Defects originate in Functional Specs 85% of REWORK cost (after 1st system test) is fixing these defects Coding Design Reqmts *Capers Jones, Applied Software Measurement 2nd Ed.

27 Skills Allocation Requirements Solution Design Construction Testing GUI Designer 40 hrs Programmer 75 hrs Programmer 10 hrs SME 200 hrs Sys Analyst 100 hrs Programmer 125 hrs Tester 200 hrs Poor requirements processes? SME 70 hrs SME 30 hrs SME 30 hrs Design rework?? GUI Designer 20 hrs Sys Analyst 100 hrs GUI Designer 40 hrs Sys Analyst 100 hrs SME 200 hrs Sys Analyst 100 hrs Programmer 75 hrs Programmer 125 hrs Programmer 100 hrs Tester 200 hrs Cost overruns, schedule overruns, quality problems

28 Project Time Allocation Software Development System Test Implementation Production Fixes Rework and Re-test And support Project Start DEVELOPMENT REWORK Project End Development all effort through first run of system tests Rework all effort after first system test until project is terminated

29 Measuring Time Allocation Project Start Project Start Software Development Software Development System Test System Test Implementation Production Fixes Rework and Re-test And support Rework and Re-test Fixes & support Implementation Project End PQM Project End PQM High test coverage Project Start Software Development Early defect detection System Test Implementation Rework and Retest Fixes & support Project End PQM

30 Identifying Sources Of Rework Most rework results from incomplete or ambiguous definition of required system behavior Can test cases be derived from specifications? Root cause analysis of test defects PQM < 2.0 Rework is largest avoidable cost Hard dollars can be returned to new projects

31 Strategy For Process Improvement New tools or training are only valuable to the extent that they improve processes Primary process improvements start with reducing rework Measure the ROI in terms of rework reduction across multiple projects.

32 Where Can We Invest? Automating test execution Requirements management Business process analysis tools (including UML) Requirements based testing Remember, 80% of rework is due to poor specification of expected system behavior

33 Automated Test Execution Automated test execution tools allow existing test cases to be run using automation rather than a tester. Only impacts test execution Does not improve test case design coverage Makes testing more efficient, not necessarily more effective No impact on requirements and specifications Impact on rework ROI: Medium

34 Requirements Management Tools Technology repository to store specifications of requirements Provides a single repository for requirement descriptions Provides a framework for traceability and specifications (but you have to do the work) Does not enforce the quality of the functional specification itself ( Mary had a little lamb problem) Impact on rework ROI: Low - Medium

35 Business Process Analysis Technology and process to define business requirements Allows modeling of business requirements and decision making. Models are semi-rigorous (UML) Typically high level Generates use cases Impact on rework ROI: Medium - High

36 Requirements-Based Testing Technology models requirements and design, automatically produces all test documentation Allows modeling of business requirements and decision making during requirements/design work. Models are rigorous. Ambiguous and incorrect logic quickly identified All test cases and documentation generated from models Impact on rework ROI: High Defect escapes reduced to zero Test costs reduced 30% or more

37 Case Study: Office of Financial Management Implemented the following technologies: 1. Requirements-based testing Functional validation of specifications Automatic design of test cases 2. Keyword test automation Rapid authoring of automated scripts Full regression on each software release

38 Results TEMS (travel and expense management) Large reduction in initial defects Testing time cut significantly No defects when released to production 100% functional coverage with 1246 test cases Regression tests: All test cases executed in less than a week. Dataview Executive visibility (governor and staff) No defects on implementation Regressions run in hours, not days

39 Summary Reduced budgets do not automatically mean fewer software deliveries Assess your software development processes Identify the areas with the most rework. Typically requirements and testing Invest in technology and processes that reduce those rework costs.

40 What do our clients say? 17,000 hardware items, over 60,000 business rules. We went from hundreds and hundreds of defects logged to nearly zero. I m not sure what I would do without Critical Logic. Dr. John Will, Director Configuration Engineering, Sun Microsystems, Inc. Critical Logic has helped us deliver our software faster, allowing us to develop a wider range of products and services to our customers that are essentially defect free. Patti Rosenthal, Senior VP, Wells Fargo Bank Critical Logic reduced our requirements elicitation investment by 50%. Russ Nelson, VP of Product Development, Salesforce.com

41 Thanks Coding Business Need Requirements & Design RFTS Business Application Testing For more information on Critical Logic technologies and services

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction

Software Testing. Knowledge Base. Rajat Kumar Bal. Introduction Software Testing Rajat Kumar Bal Introduction In India itself, Software industry growth has been phenomenal. IT field has enormously grown in the past 50 years. IT industry in India is expected to touch

More information

Essentials of the Quality Assurance Practice Principles of Testing Test Documentation Techniques. Target Audience: Prerequisites:

Essentials of the Quality Assurance Practice Principles of Testing Test Documentation Techniques. Target Audience: Prerequisites: Curriculum Certified Software Tester (CST) Common Body of Knowledge Control Procedures Problem Resolution Reports Requirements Test Builds Test Cases Test Execution Test Plans Test Planning Testing Concepts

More information

Test Plan Template (IEEE 829-1998 Format)

Test Plan Template (IEEE 829-1998 Format) Test Plan Template (IEEE 829-1998 Format) Test Plan Identifier Some type of unique company generated number to identify this test plan, its level and the level of software that it is related to. Preferably

More information

Smarter Balanced Assessment Consortium. Recommendation

Smarter Balanced Assessment Consortium. Recommendation Smarter Balanced Assessment Consortium Recommendation Smarter Balanced Quality Assurance Approach Recommendation for the Smarter Balanced Assessment Consortium 20 July 2012 Summary When this document was

More information

TEST METRICS AND KPI S

TEST METRICS AND KPI S WHITE PAPER TEST METRICS AND KPI S Abstract This document serves as a guideline for understanding metrics and the Key performance indicators for a testing project. Metrics are parameters or measures of

More information

Automation can dramatically increase product quality, leading to lower field service, product support and

Automation can dramatically increase product quality, leading to lower field service, product support and QA Automation for Testing Medical Device Software Benefits, Myths and Requirements Automation can dramatically increase product quality, leading to lower field service, product support and liability cost.

More information

Testing Introduction. IEEE Definitions

Testing Introduction. IEEE Definitions Testing Introduction IEEE Definitions Software testing is the process of analyzing a software item to detect the differences between existing and required conditions (that is, bugs) and to evaluate the

More information

Requirements-Based Testing: Encourage Collaboration Through Traceability

Requirements-Based Testing: Encourage Collaboration Through Traceability White Paper Requirements-Based Testing: Encourage Collaboration Through Traceability Executive Summary It is a well-documented fact that incomplete, poorly written or poorly communicated requirements are

More information

Latest Trends in Testing. Ajay K Chhokra

Latest Trends in Testing. Ajay K Chhokra Latest Trends in Testing Ajay K Chhokra Introduction Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the customer.

More information

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability

Table of contents. Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Enterprise Resource Planning (ERP) functional testing best practices: Ten steps to ERP systems reliability Table of contents Introduction.......................................................2 Step 1:

More information

FSW QA Testing Levels Definitions

FSW QA Testing Levels Definitions FSW QA Testing Levels Definitions 1. Overview This document is used to help determine the amount and quality of testing (or its scope) that is planned for or has been performed on a project. This analysis

More information

Requirements Based Testing Process Overview

Requirements Based Testing Process Overview Requirements Based Testing Process Overview 2009 Bender RBT Inc. 17 Cardinale Lane Queensbury, NY 12804 518-743-8755 info@benderrbt.com www.benderrbt.com The requirements-based testing (RBT) process addresses

More information

Change Management Best Practices

Change Management Best Practices General Change Management Best Practices Practice Area Best Practice Criteria Organization Change management policy, procedures, and standards are integrated with and communicated to IT and business management

More information

Testing Best Practices

Testing Best Practices ALMComplete, QAComplete, DevComplete This document is used as a guide to improving your testing and quality assurance processes. 1 Test Case Creation Once requirements have been created and approved, while

More information

Application Outsourcing: The management challenge

Application Outsourcing: The management challenge White Paper Application Outsourcing: The management challenge Embedding software quality management for mutual benefit Many large organizations that rely on mainframe applications outsource the management

More information

http://www.softwaretestinghelp.com/ Test Plan Template: (Name of the Product) Prepared by: (Names of Preparers) (Date) TABLE OF CONTENTS

http://www.softwaretestinghelp.com/ Test Plan Template: (Name of the Product) Prepared by: (Names of Preparers) (Date) TABLE OF CONTENTS http://www.softwaretestinghelp.com/ Test Plan Template: (Name of the Product) Prepared by: (Names of Preparers) (Date) TABLE OF CONTENTS 1.0 INTRODUCTION 2.0 OBJECTIVES AND TASKS 2.1 Objectives 2.2 Tasks

More information

REQUIREMENTS SPECIFICATION AND MANAGEMENT. Requirements Analysis and Specification

REQUIREMENTS SPECIFICATION AND MANAGEMENT. Requirements Analysis and Specification REQUIREMENTS SPECIFICATION AND MANAGEMENT In this note we give the requirements process in a software organization, a template for the requirements document, and the process to manage changes to the requirements.

More information

Description of Services for A Quality Assurance Engineer for SQA Assignment for eservices Development Projects ICTA/CON/IC/P5/411B

Description of Services for A Quality Assurance Engineer for SQA Assignment for eservices Development Projects ICTA/CON/IC/P5/411B Description of Services for A Quality Assurance Engineer for SQA Assignment for eservices Development Projects ICTA/CON/IC/P5/411B 1. Introduction The Information and Communication Technology Agency of

More information

GENERATING VALUE WITH CONTINUOUS SECURITY TESTING

GENERATING VALUE WITH CONTINUOUS SECURITY TESTING GENERATING VALUE WITH CONTINUOUS SECURITY TESTING AND MEASUREMENT A Spire Research Report Sponsored by Core Security Technologies 2010-2011 Spire Security, LLC. All rights reserved. The Value of Continuous

More information

Picasso Recommendation

Picasso Recommendation Picasso Recommendation Mission The School of Dentistry for the University at Buffalo (UB) uses a custom application called Picasso to manage their clinic operations. Developed by two engineers in 1997,

More information

Often Clients tend to use in-house functional resources for their testing and validation processes ending up with issues such as

Often Clients tend to use in-house functional resources for their testing and validation processes ending up with issues such as TESTING IN ERP ENVIRONMENT Organizations implement ERP applications to respond to major business challenges of reducing costs and improving revenue. ERP applications make use of a single, centralized data

More information

4.13 System Testing. Section 4 Bidder's Products, Methodology, and Approach to the Project. 4.14 System Training

4.13 System Testing. Section 4 Bidder's Products, Methodology, and Approach to the Project. 4.14 System Training Section 4 Bidder's Products, Methodology, and Approach to the Project 4.1 FACTS II Requirements Summary 4.11 Interfaces 4.2 Functional Requirements 4.12 System Development 4.3 Technical Requirements 4.13

More information

PM Planning Configuration Management

PM Planning Configuration Management : a Project Support Function As stated throughout the Project Planning section, there are fundamental components that are started during the pre-performance stage of the project management life cycle in

More information

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011

Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 QAI /QAAM 2011 Conference Proven Practices For Managing and Testing IT Projects Co-Presented by Mr. Bill Rinko-Gay and Dr. Constantin Stanca 9/28/2011 Format This presentation is a journey When Bill and

More information

Aspire's Approach to Test Automation

Aspire's Approach to Test Automation WHITE PAPER Aspire's Approach to Test Automation by Ujjawal Bagaria, Aspire Systems Automation has been seen as the long term solution for cost reduction of manual testing across the globe. A successfully

More information

Customer Information System Implementation Why the New System Had Problems and What We re Doing About It

Customer Information System Implementation Why the New System Had Problems and What We re Doing About It Customer Information System Implementation Why the New System Had Problems and What We re Doing About It November 18, 2014 Purpose The implementation of LADWP s Customer Care and Billing and Mobile Workforce

More information

Software testing. Objectives

Software testing. Objectives Software testing cmsc435-1 Objectives To discuss the distinctions between validation testing and defect testing To describe the principles of system and component testing To describe strategies for generating

More information

TEST PLAN Issue Date: <dd/mm/yyyy> Revision Date: <dd/mm/yyyy>

TEST PLAN Issue Date: <dd/mm/yyyy> Revision Date: <dd/mm/yyyy> DEPARTMENT OF HEALTH AND HUMAN SERVICES ENTERPRISE PERFORMANCE LIFE CYCLE FRAMEWORK CHECKLIIST TEST PLAN Issue Date: Revision Date: Document Purpose The purpose of

More information

Enterprise Data Governance

Enterprise Data Governance DATA GOVERNANCE Enterprise Data Governance Strategies and Approaches for Implementing a Multi-Domain Data Governance Model Mark Allen Sr. Consultant, Enterprise Data Governance WellPoint, Inc. 1 Introduction:

More information

Lowering business costs: Mitigating risk in the software delivery lifecycle

Lowering business costs: Mitigating risk in the software delivery lifecycle August 2009 Lowering business costs: Mitigating risk in the software delivery Roberto Argento IBM Rational Business Development Executive Valerie Hamilton IBM Rational Solution Marketing Manager and Certified

More information

a new generation software test automation framework - CIVIM

a new generation software test automation framework - CIVIM a new generation software test automation framework - CIVIM Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the

More information

ALM: Continuous Integration. José Almeida, Microsoft

ALM: Continuous Integration. José Almeida, Microsoft ALM: Continuous Integration José Almeida, Microsoft Agenda Issues Addressed Getting Started What is CI? CI Practices About Continuous Integration What is Continuous Integration? CI is the thread that ties

More information

Minimizing code defects to improve software quality and lower development costs.

Minimizing code defects to improve software quality and lower development costs. Development solutions White paper October 2008 Minimizing code defects to improve software quality and lower development costs. IBM Rational Software Analyzer and IBM Rational PurifyPlus software Kari

More information

Higher Focus on Quality. Pressure on Testing Budgets. ? Short Release Cycles. Your key to Effortless Automation. OpKey TM

Higher Focus on Quality. Pressure on Testing Budgets. ? Short Release Cycles. Your key to Effortless Automation. OpKey TM Pressure on Testing Budgets Higher Focus on Quality Short Release Cycles Your key to Effortless Automation OpKey TM Most of the CTOs face a common challenge i.e. the need to go to Market in shortest possible

More information

SQA Labs Value Assured

SQA Labs Value Assured Q SQA Labs Value Assured QUALITY ASSURANCE TESTING TOOLS QUALITY ASSURANCE TESTING TOOLS Quality Assurance refers to the steps taken to make sure that a company s products or services are of sufficiently

More information

AUTOMATED TESTING and SPI. Brian Lynch

AUTOMATED TESTING and SPI. Brian Lynch AUTOMATED TESTING and SPI Brian Lynch 1 Introduction The following document explains the purpose and benefits for having an Automation Test Team, the strategy/approach taken by an Automation Test Team

More information

Operations Management and the Integrated Manufacturing Facility

Operations Management and the Integrated Manufacturing Facility March 2010 Page 1 and the Integrated Manufacturing Facility This white paper provides a summary of the business value for investing in software systems to automate manufacturing operations within the scope

More information

Independent Project Oversight

Independent Project Oversight RG Perspective Independent Project Oversight Helps California Projects Avoid Risk, Achieve Objectives 11 Canal Center Plaza Alexandria, VA 22314 HQ 703-548-7006 Fax 703-684-5189 www.robbinsgioia.com 2013

More information

Quality Assurance Training Program

Quality Assurance Training Program Quality Assurance Training Program Introduction/Summary: This 5-day course focuses on understanding and developing various skills required by QA Developer, preparing to use various tools and techniques

More information

MEASURING PRE-PRODUCTION APPLICATION, SYSTEM AND PERFORMANCE VOLUME STRESS TESTING WITH TEAMQUEST

MEASURING PRE-PRODUCTION APPLICATION, SYSTEM AND PERFORMANCE VOLUME STRESS TESTING WITH TEAMQUEST WHITE PAPER IT Knowledge Exchange Series MEASURING PRE-PRODUCTION APPLICATION, SYSTEM AND PERFORMANCE VOLUME STRESS TESTING WITH TEAMQUEST A white paper on how to enhance your testing discipline Contents

More information

Introduction to Software Engineering. 8. Software Quality

Introduction to Software Engineering. 8. Software Quality Introduction to Software Engineering 8. Software Quality Roadmap > What is quality? > Quality Attributes > Quality Assurance: Planning and Reviewing > Quality System and Standards 2 Sources > Software

More information

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW RUN THE RIGHT RACE Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW 26032015 FUNCTIONAL TESTING With Borland everyone from business analysts

More information

Test Data Management

Test Data Management Test Data Management The Best Practices in TDM Abhik Kar Independent Validation Solutions Infosys Technologies Limited Florida, USA Debdatta Lahiri Independent Validation Solutions Infosys Technologies

More information

Defect Tracking Best Practices

Defect Tracking Best Practices Defect Tracking Best Practices Abstract: Whether an organization is developing a new system or maintaining an existing system, implementing best practices in the defect tracking and management processes

More information

Measurement for improving accuracy of estimates: the case study of a small software organisation

Measurement for improving accuracy of estimates: the case study of a small software organisation Measurement for improving accuracy of estimates: the case study of a small software organisation Sylvie Trudel May 9th, 7 Content Introduction Company Process Product Project estimation Improving estimation

More information

How to Write a Software Process Procedures and Policy Manual for YOUR COMPANY

How to Write a Software Process Procedures and Policy Manual for YOUR COMPANY How to Write a Software Process for YOUR COMPANY 1. Introduction MicroTools is proposing to assist YOUR COMPANY in improving the existing software process. The purpose of this project is to both improve

More information

Bringing Value to the Organization with Performance Testing

Bringing Value to the Organization with Performance Testing Bringing Value to the Organization with Performance Testing Michael Lawler NueVista Group 1 Today s Agenda Explore the benefits of a properly performed performance test Understand the basic elements of

More information

Test Plan (a Real Sample) SoftwareTestingHelp.com Live Project Training - OrangeHRM

Test Plan (a Real Sample) SoftwareTestingHelp.com Live Project Training - OrangeHRM www.softwaretestinghelp.com Test Plan (a Real Sample) SoftwareTestingHelp.com Live Project Training - OrangeHRM 2/1/2014 SoftwareTestingHelp.com Name of the tester Note: This is a sample test plan created

More information

Oracle Insurance Policy Administration System Quality Assurance Testing Methodology. An Oracle White Paper August 2008

Oracle Insurance Policy Administration System Quality Assurance Testing Methodology. An Oracle White Paper August 2008 Oracle Insurance Policy Administration System Quality Assurance Testing Methodology An Oracle White Paper August 2008 Oracle Insurance Policy Administration System Quality Assurance Testing Methodology

More information

Fundamentals of Measurements

Fundamentals of Measurements Objective Software Project Measurements Slide 1 Fundamentals of Measurements Educational Objective: To review the fundamentals of software measurement, to illustrate that measurement plays a central role

More information

Analysis of Object Oriented Software by Using Software Modularization Matrix

Analysis of Object Oriented Software by Using Software Modularization Matrix Analysis of Object Oriented Software by Using Software Modularization Matrix Anup 1, Mahesh Kumar 2 1 M.Tech Student, 2 Assistant Professor, Department of Computer Science and Application, RPS College,

More information

PointZERO Enabling the right first time principle

PointZERO Enabling the right first time principle PointZERO Enabling the right first time principle Antwerpen, 16 May 2013 Geert Vanhove Rik Marselis Consumerization of IT Cloud Big data Mobility bl Social 1 Major causes of both cost and time overruns

More information

Data Quality Assessment. Approach

Data Quality Assessment. Approach Approach Prepared By: Sanjay Seth Data Quality Assessment Approach-Review.doc Page 1 of 15 Introduction Data quality is crucial to the success of Business Intelligence initiatives. Unless data in source

More information

PHASE 6: DEVELOPMENT PHASE

PHASE 6: DEVELOPMENT PHASE PHASE 6: DEVELOPMENT PHASE The Phase features a key step in the project: system construction. The previous phases lay the foundation for system development; the following phases ensure that the product

More information

Scrum: A disciplined approach to product quality and project success.

Scrum: A disciplined approach to product quality and project success. Scrum: A disciplined approach to product quality and project success. CQAA February 23, 2011 Patricia Rotman Introductions Copyright 2011-2 Alternate Titles Considered Scrum: Just do it! Scrum: It only

More information

Benefits of Test Automation for Agile Testing

Benefits of Test Automation for Agile Testing Benefits of Test Automation for Agile Testing Manu GV 1, Namratha M 2, Pradeep 3 1 Technical Lead-Testing Calsoft Labs, Bangalore, India 2 Assistant Professor, BMSCE, Bangalore, India 3 Software Engineer,

More information

The ROI of Test Automation

The ROI of Test Automation The ROI of Test Automation by Michael Kelly www.michaeldkelly.com Introduction With the exception of my first project team out of college, in every project team since, I ve had to explain either what automated

More information

IBM Rational: Sustainable automated testing for SAP Ecosystems with Worksoft Certify

IBM Rational: Sustainable automated testing for SAP Ecosystems with Worksoft Certify IBM Rational: Sustainable automated testing for SAP Ecosystems with Worksoft Certify David Myers Sales Director Worksoft, Inc. www.worksoft.com SAP Business Challenge Application Changes Service Pack New

More information

Time is Money: Justifying the Switch to Automated Time Collection

Time is Money: Justifying the Switch to Automated Time Collection Time is Money: Justifying the Switch to Automated Time Collection Can I Justify Switching to Automated Time Collection? Every employee in your organization is affected by how time and attendance data is

More information

Understand why, when and how-to to formally close a project

Understand why, when and how-to to formally close a project Project Closure Purpose: Understand why, when and how-to to formally close a project Audience: Project managers, project sponsors, team members and other key stakeholders Learning Objectives: Describe

More information

Software Project Management Matrics. Complied by Heng Sovannarith heng_sovannarith@yahoo.com

Software Project Management Matrics. Complied by Heng Sovannarith heng_sovannarith@yahoo.com Software Project Management Matrics Complied by Heng Sovannarith heng_sovannarith@yahoo.com Introduction Hardware is declining while software is increasing. Software Crisis: Schedule and cost estimates

More information

Why Test Automation Fails

Why Test Automation Fails Why Test Automation Fails in Theory and in Practice Jim Trentadue Enterprise Account Manager- Ranorex jtrentadue@ranorex.com Thursday, January 15, 2015 Agenda Agenda Test Automation Industry recap Test

More information

Change Request Process Overview

Change Request Process Overview Industry Best Practices Process Overview by Garth Wilcox This white paper outlines a process for requesting and managing changes to an application during the product development cycle. It also discusses

More information

Carnegie Mellon University Master of Science in Information Technology Software Engineering (MSIT-SE) MSIT Project (17-677) Approval Form

Carnegie Mellon University Master of Science in Information Technology Software Engineering (MSIT-SE) MSIT Project (17-677) Approval Form Carnegie Mellon University Master of Science in Information Technology Software Engineering (MSIT-SE) MSIT Project (17-677) Approval Form Student Name: Jane Doe Date: 9/19/2002 Project Title: Re-Engineer

More information

JOURNAL OF OBJECT TECHNOLOGY

JOURNAL OF OBJECT TECHNOLOGY JOURNAL OF OBJECT TECHNOLOGY Online at www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2006 Vol. 5. No. 8, November-December 2006 Requirements Engineering Tasks Donald Firesmith,

More information

ISTQB Certified Tester. Foundation Level. Sample Exam 1

ISTQB Certified Tester. Foundation Level. Sample Exam 1 ISTQB Certified Tester Foundation Level Version 2015 American Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged. #1 When test cases are designed

More information

<Insert Picture Here> When to Automate Your Testing (and When Not To)

<Insert Picture Here> When to Automate Your Testing (and When Not To) When to Automate Your Testing (and When Not To) Joe Fernandes (Oracle) Alex Di Fonzo (Synchronoss Technologies) Three Myths of Automated Testing 1. Automated testing always results

More information

Life Cycle Quality Gates

Life Cycle Quality Gates 1 Operations Release Life Cycle Quality Gates 8 Post Implement Validation 6 Implement Build Product Test Quality Assurance 2 Versions 3 4 5 Patches 7 Design 1 10 9 Requirements Requirements Sources: Executive

More information

Latest Research and Development on Software Testing Techniques and Tools

Latest Research and Development on Software Testing Techniques and Tools General Article International Journal of Current Engineering and Technology E-ISSN 2277 4106, P-ISSN 2347-5161 2014 INPRESSCO, All Rights Reserved Available at http://inpressco.com/category/ijcet Rasneet

More information

Contents. -Testing as a Services - TaaS 4. -Staffing Strategies 4. -Testing as a Managed Services - TaaMS 5. -Services 6.

Contents. -Testing as a Services - TaaS 4. -Staffing Strategies 4. -Testing as a Managed Services - TaaMS 5. -Services 6. Contents -Testing as a Services - TaaS 4 -Staffing Strategies 4 -Testing as a Managed Services - TaaMS 5 -Services 6 -Training 8 2 TestPRO is an Egyptian company founded in 2012 and headquartered in Nasr

More information

Obtaining ROI from an ALM Tool

Obtaining ROI from an ALM Tool White Paper This White Paper discusses how an Application Lifecycle Management (ALM) tool can quick obtain a return on investment (ROI) for companies that develop and maintain software. 1 Narrative Companies

More information

Continuous Integration Comes to China. www.electric-cloud.com

Continuous Integration Comes to China. www.electric-cloud.com Continuous Integration Comes to China www.electric-cloud.com Agenda Time Topic Presenter 2:00 Introduction Tracy Shi Emdoor Technology 2:15 Continuous Integration Anders Wallgren, Electric Cloud 3:00 Practical

More information

Defining Test Mission, Policy, and Metrics of Success

Defining Test Mission, Policy, and Metrics of Success Defining Test Mission, Policy, and Metrics of Success [This article is an excerpt from an upcoming book, The Expert Test Manager, to be published by Rocky Nook this fall and written by Rex Black and Debbie

More information

10 Keys to Successful Software Projects: An Executive Guide

10 Keys to Successful Software Projects: An Executive Guide 10 Keys to Successful Software Projects: An Executive Guide 2000-2006 Construx Software Builders, Inc. All Rights Reserved. www.construx.com Background State of the Art vs. State of the Practice The gap

More information

Using Earned Value, Part 2: Tracking Software Projects. Using Earned Value Part 2: Tracking Software Projects

Using Earned Value, Part 2: Tracking Software Projects. Using Earned Value Part 2: Tracking Software Projects Using Earned Value Part 2: Tracking Software Projects Abstract We ve all experienced it too often. The first 90% of the project takes 90% of the time, and the last 10% of the project takes 90% of the time

More information

Application of software product quality international standards through software development life cycle

Application of software product quality international standards through software development life cycle Central Page 284 of 296 Application of software product quality international standards through software development life cycle Mladen Hosni, Valentina Kirinić Faculty of Organization and Informatics University

More information

Automated Testing Best Practices

Automated Testing Best Practices Automated Testing Best Practices This document includes best practices to consider before implementing automated software testing. These best practices are strategic and are applicable regardless of the

More information

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Session 5: Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Agenda HP ALM Solution Review HP Cloud Potential Cloud Portal HP ALM Solutions in a virtual environment

More information

Test What You ve Built

Test What You ve Built Test What You ve Built About Your Presenter IBM i Professional for 16 Years. Primary Focus is IBM i Engineering / Programming Well Versed in 2E. Well Versed in RPG (All Flavors) Well Versed in CM Products

More information

Operationalizing Application Security & Compliance

Operationalizing Application Security & Compliance IBM Software Group Operationalizing Application Security & Compliance 2007 IBM Corporation What is the cost of a defect? 80% of development costs are spent identifying and correcting defects! During the

More information

Basic Testing Concepts and Terminology

Basic Testing Concepts and Terminology T-76.5613 Software Testing and Quality Assurance Lecture 2, 13.9.2006 Basic Testing Concepts and Terminology Juha Itkonen SoberIT Contents Realities and principles of Testing terminology and basic concepts

More information

Shorten your 11i Upgrade and Patching Cycles with Automated Testing. Rod Lehman Senior Director of Product Marketing

Shorten your 11i Upgrade and Patching Cycles with Automated Testing. Rod Lehman Senior Director of Product Marketing Shorten your 11i Upgrade and Patching Cycles with Automated Testing Rod Lehman Senior Director of Product Marketing Can You Make an Informed Go-Live Decision? Go / No-go? Go Will the application work as

More information

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh),

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh), Content of 6 Months Software Testing Training at EH1-Infotech Module 1: Introduction to Software Testing Basics of S/W testing Module 2: SQA Basics Testing introduction and terminology Verification and

More information

Increasing business values with efficient Software Configuration Management

Increasing business values with efficient Software Configuration Management Increasing business values with efficient Software Configuration Management A Softhouse White Paper Leif Trulsson February 2005 Softhouse Consulting, Stormgatan 14, SE-211 20 Malmö info@softhouse.se www.softhouse.se

More information

Practical Metrics for Managing and Improving Software Testing

Practical Metrics for Managing and Improving Software Testing Practical Metrics for Managing and Improving Software Testing Presented By: Shaun Bradshaw shaun.bradshaw@zenergytechnologies.com Slide 1 Part 1 Test Metrics Ten key metrics testers should track One bonus

More information

System Build 2 Test Plan

System Build 2 Test Plan System Build 2 Test Plan Version 1.0 System Build 2 Test Plan Author s Signature Your signature indicates that this document has been prepared with input from content experts and is in compliance with

More information

Test Data Management An introduction

Test Data Management An introduction Test Data Managed Test Data Management An introduction Dirkjan Kaper Business Line Test Automation March 5, 2015 Test data management WHY WHAT HOW TOOLS WHY Why Test data management Information Protection

More information

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline

Increasing Business Efficiency and Agility for ATGbased. Systems. the business challenge: upgrading the development pipeline Increasing Business Efficiency and Agility for ATGbased ecommerce Systems This case study follows a Tier 1 retailer migrating to an ATG-based ecommerce platform and upgrading its software development process

More information

Metrics in Software Test Planning and Test Design Processes

Metrics in Software Test Planning and Test Design Processes Master Thesis Software Engineering Thesis no: MSE-2007:02 January 2007 Metrics in Software Test Planning and Test Design Processes Wasif Afzal School of Engineering Blekinge Institute of Technology Box

More information

Requirements Management

Requirements Management REQUIREMENTS By Harold Halbleib Requirements Management Identify, Specify, Track and Control Requirements Using a Standard Process About the author... Harold Halbleib has a degree in Electrical Engineering

More information

Table of contents. HP Software customer perspective: using HP TestDirector for Quality Center software to report and resolve software defects

Table of contents. HP Software customer perspective: using HP TestDirector for Quality Center software to report and resolve software defects HP Software customer perspective: using HP TestDirector for Quality Center software to report and resolve software defects White paper Table of contents About the author................................................2

More information

Reduce QA Cost by Improving Productivity & Test Optimization

Reduce QA Cost by Improving Productivity & Test Optimization Reduce QA Cost by Improving Productivity & Test Optimization Author(s) Rajesh Kumar (rajesh_kumar_5@uhc.com) and Ajay K Chhokra (ajay_k_chhokra@uhc.com) UnitedHealth Group Information Systems, Unitech

More information

Introduction to Automated Testing

Introduction to Automated Testing Introduction to Automated Testing What is Software testing? Examination of a software unit, several integrated software units or an entire software package by running it. execution based on test cases

More information

Operational Excellence through Efficient Software Testing Metrics

Operational Excellence through Efficient Software Testing Metrics Operational Excellence through Efficient Software Testing Metrics Ramesh Pusala Abstract Metrics are gaining importance and acceptance as organizations mature and strive to improve enterprise quality.

More information

Functional Validation of SAP Implementation

Functional Validation of SAP Implementation Functional Validation of SAP Implementation Efficiently produce and maintain a SAP test repository thru modeling of business processes and business rules Geoffrey Potoczny/Smartesting Professional Services

More information

CDC UNIFIED PROCESS PRACTICES GUIDE

CDC UNIFIED PROCESS PRACTICES GUIDE Purpose The purpose of this document is to provide guidance on the practice of Release Strategy and to describe the practice overview, requirements, best practices, activities, and key terms related to

More information

Enhance visibility into and control over software projects IBM Rational change and release management software

Enhance visibility into and control over software projects IBM Rational change and release management software Enhance visibility into and control over software projects IBM Rational change and release management software Accelerating the software delivery lifecycle Faster delivery of high-quality software Software

More information

FIREWALLS & NETWORK SECURITY with Intrusion Detection and VPNs, 2 nd ed. Chapter 4 Finding Network Vulnerabilities

FIREWALLS & NETWORK SECURITY with Intrusion Detection and VPNs, 2 nd ed. Chapter 4 Finding Network Vulnerabilities FIREWALLS & NETWORK SECURITY with Intrusion Detection and VPNs, 2 nd ed. Chapter 4 Finding Network Vulnerabilities Learning Objectives Name the common categories of vulnerabilities Discuss common system

More information

Achieving Business Analysis Excellence

Achieving Business Analysis Excellence RG Perspective Achieving Business Analysis Excellence Turning Business Analysts into Key Contributors by Building a Center of Excellence Susan Martin March 5, 2013 11 Canal Center Plaza Alexandria, VA

More information

Accelerating software testing effectiveness using Agile methodologies..

Accelerating software testing effectiveness using Agile methodologies.. Accelerating software testing effectiveness using Agile methodologies.. How can testing be completed faster, and more efficiently, within short iterations? The Problem It is a painful paradox that while

More information