CMMI for SCAMPI SM Class A 2011 End-Year Update Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 1
Outline Introduction Current Status Community Trends Organizational Trends Summary and Terms Used in this Briefing This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes. The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a certifying authority of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only. 2
Introduction - Purpose Characterize the adoption of CMMI Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPI SM ) v1.2/v1.3 Class A appraisals using Capability Maturity Model Integration (CMMI v1.2/ v1.3)* * Organizations previously appraised against CMMI v1.0 /v1.1 and which have not reappraised against v1.2 or v1.3 are not included in this report. * SVC,ACQ appraisals are included in this report, P-CMM appraisals are not included in this report, 3
Introduction - Briefing Contents This briefing includes three primary sections: 1. Current Status Snapshot of the reporting organizations based on the most recent appraisals, since the release of SCAMPI V1.2 2. Community Trends Changes in the global distribution of appraisals Growth in the number of appraisals performed Shifts in the maturity profile over time 3. Organizational Trends Time to move up in maturity based on change in maturity level and time between appraisals 4
Process Maturity Profile by All Reporting Organizations 3600 Number of Organizations 3400 3200 3000 2800 2600 2400 2200 2000 1800 1600 1400 1200 1000 800 600 400 200 0 3.6% Not Given Initial Managed Defined Quantitatively Managed Based on most recent appraisal of 0.7% 22.9% 4731 organizations 65.8% 1.7% 5.4% Optimizing 5
Process Maturity Profile (SVC Only) by All Reporting Organizations 80 70 Number of Organizations 60 50 40 30 39.6% 55.2% 20 10 0 3.1% 1.0% 1.0% Not Given Initial Managed Defined Optimizing Based on most recent appraisal of 96 organizations 6
Reporting Organization Categories Commercial/In-house 80.4% Contractor for Military/Government 15.9% Military/Government Agency 3.7% 0 1000 2000 3000 4000 5000 Number of Organizations Based on most recent appraisal of 4657 organizations reporting an organization category 7
Process Maturity Profile by Reporting Organization Categories 100% % of Organizations Within Category 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 3.2% 3.0% 13.5% 0.6% 0.1% 2.9% 21.0% 28.2% 44.4% 67.8% 61.9% 35.1% Not Given Initial Managed Defined Quantitatively Managed Based on most recent appraisal of 4657 organizations reporting an organization category Commercial/In-house = 3746 Contractor for Military/Government = 740 Military/Government Agency = 171 1.9% 0.4% 5.4% 6.4% 1.8% 2.3% Optimizing 8
Organization Size Based on the total number of employees within the area of the organization that was appraised 501 to 1000 3.8% 1001 to 2000 1.8% 2000+ 1.6% 301 to 500 5.3% 25 or fewer 20.6% 201 to 300 5.7% 201 to 2000+ 18.2% 101 to 200 14.5% 1 to 100 67.3% 76 to 100 7.5% 26 to 50 26.5% Based on 4703 organizations reporting size data 51 to 75 12.8% 9
Organization Size (SVC Only) Based on the total number of employees within the area of the organization that was appraised 1001 to 2000 4.2% 2000+ 5.3% 501 to 1000 7.4% 301 to 500 5.3% 201 to 2000+ 29.5% 25 or fewer 38.9% 201 to 300 7.4% 1 to 100 61.1% 101 to 200 9.5% 76 to 100 4.2% 51 to 75 8.4% 26 to 50 9.5% Based on 95 organizations reporting size data 10
Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised 11 3.8% 0.8% 0.3% 0.5% 2.5% 0.6% 0.7% 1.4% 2.7% 0.5% 2.2% 2.5% 1.7% 0.3% 2.5% 5.4% 4.0% 1.2% 3.5% 6.5% 7.0% 0.4% 4.8% 0.8% 0.6% 4.4% 2.0% 1.7% 1.4% 2.7% 2.7% 5.6% 6.0% 10.7% 9.5% 20.5% 22.5% 19.5% 17.5% 14.9% 14.1% 13.5% 18.1% 20.8% 27.4% 39.3% 55.2% 59.3% 57.9% 57.1% 54.1% 63.5% 69.7% 67.4% 70.6% 74.3% 39.2% 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+ Not Given Initial Managed Defined Quantitatively Managed Optimizing Based on 4703 organizations reporting size data % of Organizations by Size
USA and Non-USA Reporting Organization Categories Commercial/Inhouse 333 3413 Contractor for Military/Government 218 522 USA: 100% = 939 Military/Government Agency 87 84 Non-USA: 100% = 3718 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% % of Organizations 12
Maturity Profile by All Reporting Organizations in the USA 100% 90% 80% % of Organizations 70% 60% 50% 40% 30% 341 496 20% 10% 0% 55 Not Given Initial Managed Defined Quantitatively Managed Based on 947 organizations in the USA 6 4 45 Optimizing 13
Maturity Profile by All Reporting Organizations based outside the USA 100% 90% 80% % of Organizations 70% 60% 50% 40% 30% 2618 20% 743 10% 0% Based on Not Given Initial Managed Defined Quantitatively Managed 3784 113 25 organizations outside the USA 75 210 Optimizing 14
Section 2 Community Trends Appraisals are conducted through December 2011 and reported to the SEI by January 2012 76 countries reporting appraisals Most of the appraisals are from Asia and North America. 5378 Appraisals posted on PARS Expired appraisals are removed from PARS and replaced with the newest reappraisal result. 15
Countries Where Appraisals Have Been Performed and Reported to the SEI Argentina Australia Austria Bahrain Bangladesh Belgium Brazil Brunei Darussalam Bulgaria Canada Chile China Colombia Costa Rica Cuba Cyprus Czech Republic Denmark Egypt Finland France Germany Greece Guatemala Hong Kong Hungary India Indonesia Ireland Israel Italy Japan Jordan Korea, Republic Of Latvia Lebanon Lithuania Luxembourg Macedonia Malaysia Mauritius Mexico Morocco Nepal Netherlands New Zealand Norway Pakistan Panama Paraguay Peru Philippines Poland Portugal Qatar Romania Russia Saudi Arabia Singapore Slovakia South Africa Spain Sri Lanka Sweden Switzerland Syrian Arab Republic Taiwan Thailand Tunisia Turkey Ukraine United Arab Emirates United Kingdom United States Uruguay Viet Nam Red country name: New additions with this reporting since September 2011 16
Number of Appraisals Reported to the SEI by Continent 5000 4500 Number of Appraisals 4000 3500 3000 2500 2000 1500 3130 1424 1000 672 500 0 326 59 17 Africa Asia Australia Europe North America South America Based on 5628 appraisals North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand 17
Number of Appraisals Reported to the SEI by Continent (SVC Only) 100 80 Number of Appraisals 60 40 28 56 20 12 0 2 Africa Asia Europe North America South America 2 Based on 100 appraisals North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand 18
Number of Appraisals and Maturity Levels Reported to the SEI by Country Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Maturity Level 5 Reported Country Number of Appraisals Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Argentina 70 40 23 3 Macedonia 10 or fewer Australia 15 3 6 1 Malaysia 48 8 38 2 Austria 10 or fewer Mauritius 10 or fewer Bahrain 10 or fewer Mexico 116 56 52 1 5 Bangladesh 10 or fewer Morocco 10 or fewer Belgium 10 or fewer Nepal 10 or fewer Brazil 143 1 76 56 8 Netherlands 12 1 4 6 Brunei Darussalam 10 or fewer New Zealand 10 or fewer Bulgaria 10 or fewer Norway 10 or fewer Canada 30 1 9 12 3 Pakistan 24 1 21 1 1 Chile 37 2 22 12 1 Panama 10 or fewer China 1866 71 1686 56 45 Paraguay 10 or fewer Colombia 43 1 16 10 3 5 Peru 18 10 7 Costa Rica 10 or fewer Philippines 12 2 4 1 4 Cuba 10 or fewer Poland 10 or fewer Cyprus 10 or fewer Portugal 20 8 10 2 Czech Republic 10 or fewer Qatar 10 or fewer Denmark 10 or fewer Romania 11 1 4 6 Egypt 44 1 25 14 1 Russia 10 or fewer Finland 10 or fewer Saudi Arabia 12 2 6 1 2 France 124 3 71 39 1 Singapore 17 5 10 1 Germany 65 6 24 19 Slovakia 10 or fewer Greece 10 or fewer South Africa 10 or fewer Guatemala 10 or fewer Spain 222 1 125 74 2 8 Hong Kong 11 3 3 4 Sri Lanka 16 2 14 Hungary 10 or fewer Sweden 10 or fewer India 518 1 15 366 4 123 Switzerland 10 or fewer Indonesia 10 or fewer Syrian Arab Republic 10 or fewer Ireland 10 or fewer Taiwan 113 1 48 58 4 1 Israel 14 8 4 Thailand 51 16 33 2 Italy 55 27 24 Tunisia 10 or fewer Japan 187 7 43 97 8 9 Turkey 24 21 3 Jordan 10 or fewer Ukraine 10 or fewer Korea, Republic Of 158 56 74 12 9 United Arab Emirates 10 or fewer Latvia 10 or fewer United Kingdom 83 2 25 29 5 Lebanon 10 or fewer United States 1278 10 470 636 5 68 Lithuania 10 or fewer Uruguay 10 or fewer Luxembourg 10 or fewer Viet Nam 22 18 1 3 Maturity Level 5 Reported 19
Most Reported Appraisals per Year by Country Country 2006 2007 2008 2009 2010 2011 Total China 1 103 273 482 499 508 1866 United States 3 149 238 311 307 270 1278 India 5 81 80 117 110 125 518 Spain 15 30 75 43 59 222 Japan 16 47 40 40 44 187 Korea, Republic Of 21 30 28 35 44 158 Brazil 16 27 38 37 25 143 France 13 29 31 28 23 124 Mexico 4 18 30 35 29 116 Taiwan 18 29 19 24 23 113 20
Number of SCAMPI A Appraisals Reported to SEI by Year 1600 1400 TOTAL POSTED ON PARs 1375 1349 1333 Number of Appraisals 1200 1000 800 600 556 1004 941 1311 1299 1307 400 509 200 0 Based on 11 2006 2007 2008 2009 2010 2011 5628 appraisals 21
Trends in the Community Maturity Profile 100% 90% 80% 2006 2007 11 564 % of Organizations 70% 60% 50% 40% 30% 31.4% 28.2% 25.1% 23.8% 22.9% 63.6% 47.9% 58.2% 62.9% 64.6% 65.9% 2008 2009 2010 2011 27.3% 1516 2770 3,845 4,731 20% 10% 0% 9.0% 6.1% 4.9% 4.4% 3.6% 1.2% 0.8% 0.5% 0.4% 0.7% 9.1% 1.1% 1.0% 1.3% 1.6% 1.7% 9.4% 5.7% 5.2% 5.1% 5.4% Not Given Initial Managed Defined Quantitatively ManagedOptimizing Based on a cumulative view of the most recent appraisals of organizations up through the year indicated 22
Time to Move Up 40 Number of months to move to next maturity level 30 25 26 75th Percentile Median 20 20 25th Percentile 10 5 Time Period of Initial Appraisal Level Orgs 2006 to Present 1to2 2to3 3to4 3to5 7 189 47 57 23
Summary -1 Since 2006, 5628 SCAMPI v1.2/1.3 appraisals have been reported to the SEI. Despite global economic conditions, demand appears to be consistent. Only 42 fewer SCAMPI appraisals were performed in 2011 vs. 2009. Appraisals reported from China, Spain, Korea, India and Japan are increasing at a rapid rate. More than 67% of appraised organizational units have 100 or fewer employees. The percentage is increasing steadily. The majority of reported appraisals are maturity level 2 and 3 organizations. The number of appraisals in the USA and China represent more than 55% of the total number of appraisals. 24
Summary -2 China is now reporting more appraisals than USA For organizations that began their CMMI-based SCAMPI effort with V1.2 or later, the median time to move from maturity level 2 to 3 is 20 months maturity level 3 to 4 is 25 months maturity level 3 to 5 is 26 months Note: Since the September 2011 report, the median time to move from maturity level 2 to 3 increased from 19 months to 20 months. The median time to move from maturity level 3 to 4 increased from 21 months to 25 months. The median time to move from maturity level 3 to 5 increased from 25.5 months to 26 months. 25
Terms Used in this Report Company - Parent of the appraised entity. A company can be a commercial or noncommercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc. Organization - a.k.a. Appraised entity. The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc. Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States. PARS - the Published webpage contains CMMI appraisals published at the request of the appraisal sponsor. The URL is: http://sas.sei.cmu.edu/pars/ 26
Contact Information SEI Customer Relations (412) 268-5800 SEI FAX number (412) 268-5758 Internet Address Mailing Address customer-relations@sei.cmu.edu Customer Relations Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213-3890 27
NO WARRANTY THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHED ON AN AS-IS" BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT. Use of any trademarks in this presentation is not intended in any way to infringe on the rights of the trademark holder. This Presentation may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at permission@sei.cmu.edu. This work was created in the performance of Federal Government Contract Number FA8721-05-C-0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center. The Government of the United States has a royalty-free government-purpose license to use, duplicate, or disclose the work, in whole or in part and in any manner, and to have or permit others to do so, for government purposes pursuant to the copyright license under the clause at 252.227-7013. 28