Tester, get out of your cave! Jan Jaap Cannegieter Vice President SYSQA B.V.

Transcription

1 Tester, get out of your cave! Jan Jaap Cannegieter Vice President SYSQA B.V.

2 2

3 Why are we here? 3

4 Agenda TMMi in under 10 minutes Data from 20 TMMi workshops Conclusions How to get out of your cave 4

5

6 TMMi essentials Test maturity framework Benchmark model for assessments 5 levels Based on: TMM Evolutionary Testmodel (Gelperin / Hetzel) CMMI for Development In line with ISTQB terminology Developed by the TMMi-foundation Public domain 6

7 TMMi levels 5. Optimization Defect Prevention Test Process Optimization Quality Control 4. Management and Measurement Test Measurement Software Quality Evaluation Advanced Peer Reviews 1. Initial 2. Managed 3. Defined Test Organization Test Training Program Test Life Cycle and Integration Non-Functional Testing Peer Reviews Test Policy and Strategy Test Planning Test Monitoring and Control Test Design and Execution Test Environment 7

8 How I got my data Goals Learn Presales Assignments 20 organizations Telecommunication: 2 Government: 7 Financial services: 9 Industry: 2 Analysis 8

9 Quick scans a demo 9

10 Results Fasten your seatbelts

11 Test policy and strategy - goals Establish a test policy Establish a test strategy Establish test performance indicators 11

12 Test policy and strategy: A: 30% V: 14% Test policy and strategy Percentage of specific goals met Organizations 12

13 Test planning - goals Perform a product risk assessment Establish a test approach Establish test estimates Develop a test plan Obtain commitment to the test plan 13

14 Test planning: A: 41%, V: 13% Test planning Percentage of specific goals met Organizations 14

15 Test monitoring and control - goals Monitor test progress against plan Monitor product quality against plan and expectations Manage corrective action to closure 15

16 Test monitoring and control: A: 47%, V: 15% Test monitoring and control Percentage of specific goals met Organizations 16

17 Test design and execution - goals Perform test analysis and design using test design techniques Perform test implementation Perform test execution Manage test incidents to closure 17

18 Test design and execution: A: 60%, V: 8% Test design and execution Percentage of specific goals met Organizations 18

19 Test environment - goals Develop test environment requirements Perform test environment implementation Manage and control test environments 19

20 Test environment: A: 59%, V: 9% Test environment Percentage of specific goals met Organizations 20

21 Overview Per process area

22 My conclusion Outside 30%: Test policy and strategy 41%: Test planning 47%: Test monitoring and control Inside 59%: Test environment 60%: Test design and execution 22

23 We are in a cave! 23

24 24

25 In case you disagree 25

26 Best practices outside of your cave Perform a product risk assessment and establish a test approach with relevant stakeholders Obtain commitment for your plan from relevant stakeholders Plan stakeholder involvement in your project Monitor stakeholder involvement in your project Make release advice with people outside of testing Establish and maintain a test strategy with relevant management Define, measure and report test performance indicators to relevant stakeholders Establish and maintain a test policy with higher management (business and IT) 26

27 Stakeholder management The basics 27

28 Stakeholder A person or group of persons who will be involved in or effected by your test project or improvement project 28

29 Stakeholder management Stakeholder identification Stakeholder analysis Stakeholder involvement 29

30 Stakeholder aspects Organizational level Power Business interest Mindset Ambition Behavioral style Stakeholder type 30

31 Type of stakeholders Power Sleeping Dangerous Dominant Definitive Urgency Demanding Dependent Discretionary Legitimacy Mitchell, Agle, Wood,

32 Stakeholdercard an example 32

33 Please think this over I ll turn on some inspiring music

34 34

35 35

36 Stuart Reid s test competence model for testers Test skills Soft skills IT skills Domain knowledge 36

37 My test competence model for test consultants Test skills Political skills IT skills Soft skills Domain knowledge 37

38 38

39 More interesting graphs

40 TMMi level by percentage 84% L1 L2 L3 L4 10% 6% L5 TMMi Level 40

41 CMMI vs. Non-CMMI CMMI no CMMI TPG TP TMC TT TO 41

42 TMMi score by Industry Government Finance Industry 10 0 TPS TP TMC TDE TE Note: Telecom weg gelaten slechts 2 data punten 42

43 Formeel vs. Informeel 14% Formeel Informeel 86% 43

44 for the stakeholder card: 45

45 46