What you can find in the ISBSG Development & Enhancement Repository Release 13

Transcription

1 What you can find in the ISBSG Development & Enhancement Repository Release 13 This document provides details of the various project data types that are included in the ISBSG project repository Release 13. You will note that the project totals shown at the bottom of the tables rarely equal the 6,760 projects in the Repository. This is because submitters do not necessarily provide project data for all the data fields that ISBSG offers. The ISBSG Data R13 Field Descriptions document explains the contents of the various data fields that the Repository caters for. By studying the demographics that follow, you will be able to establish the areas that are of specific interest to you. You can then use the ISBSG Data Portal ( to select datasets of specific interest to you. The data in the Repository projects have come from over thirty countries, with 53% of the projects being completed in the last decade. This is what makes the ISBSG Repository unique. A broad range of project types from many industries and many business areas are available for you to use for estimating, awareness of trends, comparison of platforms and languages or benchmarking. The project totals shown at the bottom of the tables rarely equal the 6,760 projects in the Repository. This is because submitters do not necessarily provide project data for all the data fields that ISBSG offers. Major differences to be found in Release 13 A large number of the new projects added to the database come from Spain and the United States. This is reflected in the Country Tables. The Communications and Medical and Health Care sectors also are better represented. ISBSG Data Demographics Release 13 1 of 27

2 Demographic Summary The projects in the Repository cover a broad cross-section of the software industry. In general, they have a business focus. Project origin: The projects have been submitted from 26 different countries. Major contributors are the United States (32% of all projects), Australia (13%), Japan (12%), Finland (9%), France (7%), the Netherlands (6%), India (5%), Canada (5%), and Spain (4%). The projects were performed in 32 different countries. Major contributors are United States (18% of all projects where the country of effort is known), Finland (14%), France (11%), the Netherlands (10%), Australia (9%), India (8%), Japan (6%), Spain (5%), Canada (5%), Denmark (4%), and Brazil (4%). Project context: Industry sector: major sectors are communications (21% of all projects where the organisation type is known), manufacturing (15%), insurance (14%), government (11%), banking (10%), medical and health care (9%), and financial (7%). Business area: major areas are telecommunications (19% of all projects where the business area is known), insurance (9%), banking (9%), transport/logistics (9%), finance (8%), manufacturing (8%), and sales and marketing (5%). Type of project: Development type: 65% are enhancement projects, 33% are new developments, and 1% are re-developments. Intended market: 82% of projects are developed for internal use, (i.e. for the organisation that contributed the project to the Repository), and 18% for other users. 45% are developed in-house and 54% are outsourced. In total, 39% are developed in-house for internal use. Team size: 29% of projects have up to 4 people in the development team, 30% have 5 to 9 people, 18% have 10 to 19 people, and 24% have 20 or more people. Type of product: Product size: while IFPUG projects dominate the Repository, COSMIC, NESMA and FiSMA are all well represented. Among the IFPUG projects, 40% of projects have fewer than 100 UFPs, 33% have UFPs, and 20% have UFPs. The median size is 134 UFPs FPs is the most common size range for each of the other main sizing methods as well. Application group: 88% are business applications (38% transaction processing, 12% information system), 6% are real-time applications, and 5% are mathematically-intensive applications. Architecture: 47% of projects for which this information is available have a client-server architecture, and 24% have a multi-tier architecture (there is ISBSG Data Demographics Release 13 2 of 27

3 some overlap between these groups of projects). 37% are stand-alone systems. Web development: 15% of the projects in the Repository are web developments. Development environment: Platform: 36% are mainframe projects, 12% midrange, and 19% microcomputers. 36% of projects involve multiple platforms. Language: over 100 programming languages are represented. 3GLs represent 65% of projects, 4GLs 31%, and application generators 3%. Major languages are COBOL, C/C++/C#, Java/JavaScript, Visual Basic, PL/I, Oracle,.Net, SQL, Natural, Access, and ASP. Development methods: For ISBSG purposes a methodology applies to the whole project development process. This is distinct from techniques, which apply to individual activities within the development process. Methodology: 74% of projects that describe methodologies report using a waterfall model. Other methodologies include Joint Application Development (9%), Rapid Application Development (7%), Multifunctional teams (6%), Timeboxing (4%), and Agile and/or RUP (4%). Standards: ISO, CMM, and/or CMMI are used in 22% of projects that provide information about methodologies and techniques, with CMMI the most common. Techniques: the most common techniques are data modelling (43% of projects providing data about techniques), process modelling (21%), object oriented techniques (38%), prototyping (29%), and reviews/inspections/ walkthroughs (22%). ISBSG Data Demographics Release 13 3 of 27

4 Project Origin Country of origin United States Australia Japan Finland France Netherlands India Canada Spain Denmark Brazil United Kingdom China Other Country Projects Percent United States % Australia % Japan % Finland % France % Netherlands % India % Canada % Spain % Denmark % Brazil % United Kingdom % China % Other % Total 6757 Projects have been contributed from twenty-six different countries. ISBSG Data Demographics Release 13 4 of 27

5 Country of effort United States Finland France Netherlands Australia India Japan Spain Canada Denmark Brazil United Kingdom China Other Country Projects Percent United States % Finland % France % Netherlands % Australia % India % Japan % Spain % Canada % Denmark % Brazil % United Kingdom % China % Other % Total 4337 Thirty-two countries are represented in the Repository. ISBSG Data Demographics Release 13 5 of 27

6 Project Context Industry Sector The Industry Sector summarises the industry, or type of organisation, for which each project has been developed. Communication Manufacturing Insurance Government Banking Medical/health care Financial Electronics/computers Service industry Wholesale/retail Utilities Other Industry Sector Projects Percent Communication % Manufacturing % Insurance % Government % Banking % Medical & health care % Financial % Electronics / computers % Service industry % Wholesale / retail % Utilities % Professional services % Other % Total 4719 ISBSG Data Demographics Release 13 6 of 27

7 Business Area This is the business area within the organisation/industry that the project/application will be supporting. Communications Insurance Banking Transport, logistics Financial Manufacturing Sales, marketing Engineering Accounting Customer relations Personnel Government Inventory, purchasing Other Business area Projects Percent Communications, networks % Insurance % Banking % Transport, logistics % Financial % Manufacturing % Sales, marketing % Engineering % Accounting % Customer relations % Personnel % Government, public administration % Inventory, purchasing % Other % Total 1643 ISBSG Data Demographics Release 13 7 of 27

8 Type of Project Development type A detailed explanation of the development types is given in Appendices, Glossary of Terms. Enhancement New development Re-development Type of development Projects Percent Enhancement % New development % Re-development % Other % Total 6745 ISBSG Data Demographics Release 13 8 of 27

9 Intended market This defines the relationship between the customer, the project/application developer, and application user. If the customer and the developer are in the same organisation the project is assumed to be an in-house development; if the customer and user are in the same organisation the project is assumed to be developed for internal use. Most (82%) of the projects in the Repository (for which this information is available) have been developed for an internal business unit. Outsourced developments (54%) outnumber in-house developments (46%). Developed in-house, for internal business unit Outsourced for internal business unit Developed in-house, for external business unit Outsourced for external business unit Multi-supplier project Intended market Projects Percent Developed in-house for internal % business unit Outsourced for internal business unit % Developed in-house for external business unit Outsourced for external business unit % % Multi-supplier project % Total 2296 ISBSG Data Demographics Release 13 9 of 27

10 Team size This is the maximum number of people in the development team at any given time in the project Maximum team size Projects Percent 1 or % 3 or % 5 to % 10 to % 15 to % 20 to % 41 to % % Total 2337 Teams of 2 through 5 people are about equally common. 5 is most common (by a small margin). ISBSG Data Demographics Release of 27

11 Type of Product Product size Size is measured in function points. The four main function point counting approaches represented in the Repository are IFPUG CPM 4.0 or later, COSMIC, FiSMA and NESMA. Other approaches represented in the Repository include Mark II, Feature Points, and older versions of IFPUG (IFPUG 2, IFPUG 3) but there are few such projects and very few have been contributed to the Repository for many years now. IFPUG 4+ projects dominate the Repository. The numbers of COSMIC, FiSMA and NESMA projects are steadily increasing. The following tables and histograms show the range of project sizes, for each of these four function point counting approaches. (Projects sized with other approaches, or that have low data quality ratings, are not included.) IFPUG 4+ The table shows the sizes (in UFPs) of projects sized with IFPUG function points, that are known or presumed to have been sized using CPM4.0 or later. 35% 30% 25% Percent 20% of projects (UFPs) 15% 10% 5% 0% ISBSG Data Demographics Release of 27

12 Relative Size Size in IFPUG 4+ function points Projects (UFPs) Percent (UFPs) Projects (AFPs) Percent (AFPs) XXS 0 to % % XS 10 to % % S 30 to % % M1 100 to % % M2 300 to % % L 1000 to % % XL 3000 to % % XXL 9000 to % % XXXL or more % % Total Size ranges from 3 to 16,148 UFPs (3 to 20,000 AFPs). The median size is 134 UFPs (136 AFPs). For enhancement projects, the range is 3 to 7,134 UFPs with a median of 97 UFPs (3 to 20,000 AFPs with a median of 98 AFPs). For new developments, the range is 6 to 16,148 UFPs with a median of 308 UFPs (6 to 16,148 AFPs with a median of 313 AFPs). For re-developments, the range is 89 to 13,580 UFPs with a median of 410 UFPs (89 to 17,518 AFPs with a median of 408 AFPs). ISBSG Data Demographics Release of 27

13 COSMIC International Software Benchmarking Standards Group Development & Enhancement Repository Demographics 35% 30% 25% Percent 20% of projects 15% 10% 5% 0% Relative Size Size in COSMIC cfsu s Projects Percent XXS 0 to % XS 10 to % S 30 to % M1 100 to % M2 300 to % L 1000 to % XL 3000 to % XXL 9000 to % XXXL or more % Total 428 Size ranges from 2 to 2,090 cfsu s. The median size is 112 cfsu s. For enhancement projects the range is 2 to 2003 cfsu s (median 73). For new developments the range is 8 to 1958 cfsu s (median 160). For re-developments the range is 55 to 2090 cfsu s (median 466). ISBSG Data Demographics Release of 27

14 NESMA 40% 35% 30% 25% Percent of 20% projects (UFPs) 15% 10% 5% 0% Relative Size Size in NESMA function points Projects Percent XXS 0 to % XS 10 to % S 30 to % M1 100 to % M2 300 to % L 1000 to % XL 3000 to % XXL 9000 to % XXXL or more % Total 161 AFP s and UFP s are identical for most projects. Size ranges from 14 to 5,667 UFPs (14 to 5,667 AFPs). The median size is 192 UFPs (187 AFPs). For enhancement projects, the range is 28 to 1,468 UFPs with a median of 183 UFPs (same for AFPs). For new developments, the range is 14 to 5,667 UFPs with a median of 214 UFPs (same for AFPs). For re-developments, the range is 91 to 327 UFPs with a median of 139 UFPs. For AFPs the range is the same, but the median is 142. ISBSG Data Demographics Release of 27

15 FiSMA 40% 35% 30% 25% Percent of projects 20% 15% 10% 5% 0% Relative Size Size in NESMA function points Projects Percent XXS 0 to % XS 10 to % S 30 to % M1 100 to % M2 300 to % L 1000 to % XL 3000 to % XXL 9000 to % XXXL or more % Total 528 The FiSMA projects all report size in unadjusted function points only. Size ranges from 6 to 9,390 UFPs. The median size is 224 UFPs. For enhancement projects, the range is 6 to 1,843 UFPs with a median of 148 UFPs. For new developments, the range is 18 to 9,390 UFPs with a median of 316 UFPs. ISBSG Data Demographics Release of 27

16 Application group The application type identifies the type of application being addressed by the project (e.g. information system, transaction/production system, process control.) As there are hundreds of different application types recorded, they are grouped here into four groups. Business application Real-time application Mathematicallyintensive Infrastructure software Application group Projects Percent Business application % Real-time application % Mathematically-intensive application % Infrastructure software % Total 4449 ISBSG Data Demographics Release of 27

17 Application type A finer-grained breakdown of application types follows. Financial transaction process Transaction/Production System Management Information System Process control, real time Financial Database / catalogue Web, E-business Sales & Marketing OIS, EIS, DSS Billing Inventory, Ordering Analysis & Reporting Telecommunications Other ISBSG Data Demographics Release of 27

18 Application type Projects Percent Financial Transaction Process/Accounting % Transaction/Production System % Management Information System % Process control, sensor control, real time % Financial % Database, Catalogue/register of events or things % Web, E-Business % Sales & Marketing % Office information system, Executive information system, Decision support system % Billing % Inventory / Ordering % Analysis & Reporting % Network Management, Communications % Other % Total 4451 ISBSG Data Demographics Release of 27

19 Architecture Two broad types of system architecture are represented in the Repository: clientserver (of various flavours), and multi-tier (of various flavours). Stand-alone systems are also recorded as a contrast to client-server systems. Stand alone Client server Multi-tier Multi-tier client server Multi-tier with web interface Architecture Projects Percent Stand alone % Client server % Multi-tier % Multi-tier client server % Multi-tier with web interface % Total 3527 Taken together, 24% of projects in the Repository (for which this information is known) have a multi-tier architecture, and 47% of projects have a client-server architecture. ISBSG Data Demographics Release of 27

20 Development Environment Development platform Mainframe Mid-range PC Multi Development platform Projects Percent Mainframe % Mid-range % Personal computer % Multi % Total 5213 ISBSG Data Demographics Release of 27

21 Type of programming language There are a large number of languages recorded in the Repository. This can make it difficult to compare some projects. Consequently languages are classified by type as shown below. 2nd generation language 3rd generation language 4th generation language 5th generation Application generator Type of programming language Projects Percent 2nd generation language % 3rd generation language % 4th generation language % 5th generation language % Application generator % Total 5705 Over 100 programming languages are represented in the Repository. 3 rd generation languages dominate, but 4 th generation languages are also very well represented. Some languages (e.g. Visual Basic, Visual C++) were nominated sometimes as 3GLs and sometimes as 4GLs. The table above tallies the language types as originally nominated. In the following tables, each language is consolidated under a single type. ISBSG Data Demographics Release of 27

22 Primary programming languages 3GLs This is the programming language that has been nominated by the project submitter as the primary programming language. Java COBOL Visual Basic PL/I C++ C C# Scripting PL/SQL Other 3GL rd generation languages Projects Percent Java % COBOL % Visual Basic % PL/I % C % C % C# % Scripting % PL/SQL % Other % Other 3GLs in the Repository include JavaScript, Smalltalk, HTML, Ada, Pascal, Periphonics, and FORTRAN. ISBSG Data Demographics Release of 27

23 Primary Programming Languages - 4GLs Oracle.Net SQL ABAP NATURAL Delphi Access ASP Powerbuilder Lotus Notes Other 4GL th generation languages Projects Percent ORACLE %.Net % SQL % ABAP % NATURAL % Delphi % Access % ASP % PowerBuilder % Lotus Notes % Other 4GL % Other 4GLs represented in the Repository include CLIPPER, ColdFusion, Ingres, FOCUS, IDEAL, and RALLY. ISBSG Data Demographics Release of 27

24 Application generators COOL:GEN TELON HPS Other Application generators Projects Percent COOL:GEN % TELON % HPS % Other % Few projects that used application generators have been contributed to the Repository in recent years. The most recent projects that used application generators were implemented in ISBSG Data Demographics Release of 27

25 Methodologies and Techniques These describe the various methodologies and techniques that may have been used during the execution of a project. They have not been related to specific project activities, and therefore may apply to any part of the development lifecycle. For ISBSG purposes a methodology (Agile, JAD, Waterfall etc.) applies to the whole project development process. This is distinct from techniques (Data Modelling, OO Analysis etc.), which apply to individual activities within the development process. Some projects mention more than one methodology (e.g. some JAD projects also use RAD and/or timeboxing), and some mention more than one technique. Methodology Waterfall JAD RAD Multifunctional Timeboxing Agile, RUP Other ISBSG Data Demographics Release of 27

26 Methodology Projects Percent Waterfall % Joint Application Development (JAD) % Rapid Application Development (RAD) % Multi-functional teams % Timeboxing % Agile, RUP % Other % One or more of the above 2235 Of the 191 JAD projects, 37 also mention RAD, 45 also mention multi-functional teams, and 13 also mention timeboxing. Other methodologies include Spiral and Incremental. Specification Techniques, Design Techniques, Development techniques The following graph and table combine information from all three of these fields, as well as considering Specification Documents, and Design Documents. Standards (ISO, CMM, CMMI) Data modeling Process modeling Business area modeling Event modeling Object Oriented Prototyping Reviews, inspections Pair testing Regression testing Stress/load/performance testing ISBSG Data Demographics Release of 27

27 Development techniques Projects Percent Standards (ISO 9000; CMM, CMMI) % Data modeling % Process modeling % Business area modeling % Event modeling % Object Oriented Analysis/Design, UML % Prototyping % Reviews, inspections, walkthroughs % Pair testing % Regression testing % Stress / Load / Performance testing % One or more of the above 2320 Many of the projects that have been contributed recently to the Repository make use of standards (ISO 9000 series, CMM, CMMI). Of the 521 projects in the Repository now that used standards, 336 (65%) used CMMI, 168 (32%) used CMM, and 142 (27%) used ISO 9000 series standards. 113 projects (22%) used ISO 9000 and one or both of CMM/CMMI. ISBSG Data Demographics Release of 27