Metrics Program in a very Small Company. Rosa Virginia Icedo Ojeda April 2003.

Transcription

1 Metrics Program in a very Small Company Rosa Virginia Icedo Ojeda April 2003.

2 Outline Introduction Metrics data Use of Metrics data A First Metrics Program Metrics in a Software Process Improvement Tools Conclusions References

3 Introduction The main motivation for this investigation is describing a practical guideline for planning, implementing, and using a useful metrics program in a very small company. What is a Metrics Program? The basis for the metrics program as practiced today is the Quality Circle. Correction and Improvement (Act) Measurement Goals (Plan) Measurement Process (Do) Metrics data about product and process. We focus on process. Measurement Analysis (Study) What is a very small Company? * 3-30 Software Engineers * Software development ad-hoc * Don t have any certifications ( SPICE, CMM, ISO )

4 Metrics data The process database invariably captured information about project size, effort, schedule, defects, and risks. Project size Lines of code ( LOC), function points, components. Effort Person-hours, person-months, hours in a project. Schedule Actual and estimates dates. Defects Total number of defects, distribution of defects with respect to where was detected and captured, origin of defects, and removed defect. Risks Risk mitigation strategies, number of change requests, number of baseline, number of risks, number of reviews, and so on.

5 Use of Metrics data 1) Project planning 2) Monitoring and controlling a project 3) Overall process management and improvement Project Planning Effort estimation, schedule, quantitative goals for quality, control activities and defect prevention, and risk management. Project monitoring and control Current state of the project, milestone analysis, event-driven analysis. Process analysis and improvement Process capability, organization goal in terms of improvement in quality and productivity ( reducing the variance in performance, reducing the defect injection rate or improving the review effectiveness ).

6 A first metrics program ( Example 1 ) Metrics Program in a very Small Company 8 Step Metrics Program Software Productivity Center Step 1: Document the Software Development Process Step 2: State the Goals Step 3: Define Metrics Required to Reach Goals Step 4: Identify Data to Collect Step 5: Define Data Collection Procedures Step 6: Assemble a Metrics Toolset Step 7: Create a Metrics Database Step 8: Define the Feedback Mechanism

7 A first metrics program ( Example 2 ) Metrics Program in a very Small Company Coordinate Metrics Third step of a Process Model of Software Quality Assurance 1.- Project-level plan 2.- Develop QA plan 3.- Coordinate metrics 4.- Coordinate risk program 5.- Perform audits 6.- Coordinate review meetings 7.- Facilitate process improvement 8.- Monitor test program 1.- Develop metrics strategy 2.- Create metrics database schema 3.- Document metrics plan 4.- Review metrics plan 5.- Collect measurement data 6.- Compute metrics 7.- Evaluate trends 8.- Issue metrics report 9.- Update metrics process and plans

8 Metrics Program in a Software Process Improvement Quality Function Deployment (QFD). Quality System focused on delivering products and services that satisfy customers ( Mazur 1994 ). The four-phase QFD model

9 Metrics Program in a Software Process Improvement QFD for Software Process Software Process Matrix Software Process Matrix (SPM), is a process improvement strategy to produce a well-defined software process, based on house of quality of QFD. Customer requirements vs. design characteristic relationships must be established. These relationships are often stated at four levels of effect: strong, medium, weak, and none. The values given to these are 9, 3, 1, and 0, respectively.

10 Metrics Program in a SPI ( Example ) Metrics Program in a very Small Company

11 Tools. Practical Software Measurement (PSM). PSM is a guidebook designed to help software project managers: 1)identify issues and objectives that are important to their project s success; 2) implement a measurement program focused on those issues; 3) gain objective insight into those issues throughout the project s life cycle. PSM Insight Software. PSM Insight (PSMI) is a free PC-based software tool that automates the PSM. PSM Insight includes tailoring, data entry, and analysis functions to help you develop a project-specific software measurement database and analyses. While PSM Insight provides templates of commonly-used issues and measures, it is also completely flexible for you to customize analysis to project-specific needs. Tour PSM Insight

12 Conclusions Metrics Program in a very Small Company Lessons learned implementing a metrics program: 1) There is often little relationship between the measures currently collected and the issues that real projects face. 2) Making people identify their need for measurement is the best first step toward institutionalizing it. 3) The project culture will impact the implementation of measurement. Metrics Program Product Process Organization Project Phase

13 References Measurement Process Effectiveness, Software Development Magazine. Layman Beth, Rohde Sharon, Experiences implementing a software project measurement methodology, Software Quality Professional, Volumen 2, Issue 1, Diciembre Example of a Metric Program, Software Productivity Center. Rothman Johanna, Determining your Project s Quality, Software Development Magazine, Bobkowska Anna, Quantitative and Qualitative Methods in Process Improvement and Product Quality Assement, ESCOM Conference Ltd, Agosto Richardson Ita, Ryan Kevin, Software Process Improvements in a very Small Company, Software Quality Professional, Volumen 3, Issue 2, Marzo Jalote Pankaj, Use of Metrics in High Maturity Organizations, Software Quality Professional, Volumen 4, Issue 2, Marzo Weber Charles, Layman Beth, Measurement Maturity and the CMM: How Measurement Practice Evolve as Processes Mature, Software Quality Professional, Volumen 4, Issue 3, Junio Van Veenendaal Erik, Hendricks Rob, Van Vonderen Robert, Measuring Software Product Quality, Professional, Volumen 5, Issue 1, Diciembre Software Quality Drabick Roger, A Process Model of Software Quality Assurance/Software Quality Engineering, Software Quality Professional, Volumen 2, Issue 4, Septiembre Briand C. Lionel, Differding M. Christiane, Rombach2 Dieter H., Practical Guidelines for Measurement-Based Process Improvement, Software Process Improvement and Practice Journal, Volumen 2(4), 1997.