TMMi Case Study. Methodology. Scope. Use TMMi to do a gap analysis for an independent

Transcription

1 TMMi Case Study TMMi Case Study Presentation Use TMMi to do a gap analysis for an independent testing organisation Involves 2 assessors for 5 days Objectives Determine how well the organisation is meeting the goals of the specific maturity levels and specific process areas in the Test Maturity Model Integration and IEEE testing standards. Identify strengths and opportunities against each process area. Gather ideas for improvement from the practitioners Page 2 Scope The analysis is limited up to comparing the selected goals/practices with TMMi Level 2 and 3 Process Areas, viz: Level 2 Process Areas Test Policy and Strategy Test Planning Test Monitoring and Control Test Design and Execution Test Environment Level 3 Process Areas Test Organization Test Training Program Test Life Cycle and Integration Non-Functional Testing Peer Reviews Methodology 1. Prepare the gap analysis plan 2. Agree on the plan----interview schedule and documentation for reviews. 3. Review the existing test processes, templates and project artefacts such as test plans, test specification, test reports, change requests, audits, training records and etc. 4. Interview the test manager, the test leaders, the test engineers, the project managers and developers, and users 5. Identify the gaps with the standards, the opportunities for improvement, and record in a draft document. 6. Review draft findings with the test leaders 7. Presentation to the organisation Page 3 Page 4

2 Detailed Findings Test Policy and Strategy Level 2 Process Areas: Test policy and strategy Test planning 1. Establish a test policy Test monitoring and control Test design and execution Test environment 2. Establish a test strategy 3. Establish test performance indicators Page 5 Page 6 Test Planning Test Monitoring and Control 1. Perform product risk assessment 2. Establish a test approach 3. Establish test estimates 4. Develop a test plan 5. Obtain commitment to the test plan 1. Monitor test progress against plan 2. Monitor product quality against plan and estimates 3. Manage corrective actions to closure Page 7 Page 8

3 Test Design and Execution Test Environment 1. Perform test analysis and design using test design techniques 2. Perform test implementation 3. Perform a test execution 4. Manage test incidents to closure. 1. Establish test environmental requirements 2. Perform test environment implementation 3. Manage and control test environment Page 9 Page 10 Detailed Findings Test Organization Level 3 Process Areas: Test organization Test training program Test life cycle and integration Non-functional testing Peer reviews 1. Establish a test organization 2. Establish test functions for test specialists 3. Establish test career paths 4. Determine, plan and implement test process improvements 5. Deploy organisational test processes and incorporate lessons learned Page 11 Page 12

4 Test Training Program Test Life Cycle and Integration 1. Establish an organisational test training capability 2. Provide necessary test training 1. Establish organisational test process assets 2. Integrate the test life cycle with the development models 3. Establish a master test plan Page 13 Page 14 Non-functional Testing Peer Reviews 1. Perform a non-functional product risk management 2. Establish a non-functional test approach 3. Perform non-functional test analysis and design 4. Perform non-functional test implementation 5. Perform non-functional test execution 1. Establish a peer review approach 2. Perform peer reviews Page 15 Page 16

5 Experience Sharing TMMi is useful as a tool to measure the capability of a testing organisation The model is relatively easy to implement and provides good coverage of all necessary testing practices It helps to identify the improvement areas for the basic testing practices It helps to change the test engineers mindset of continuous process improvements Testing organisation should aim to achieve TMMi L3 Level 4 and 5 details were not ready CMMI formal appraisal methodology was chosen as the appraisal tool for this case study THANK YOU! Page 17 Page 18