The Software Engineering Institute t (SEI): Today and in the Future Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 Paul D. Nielsen 1 May 2008
Software Engineering Institute Department of Defense R&D Laboratory FFRDC Created in 1984 Administered by Carnegie Mellon University Headquartered in Pittsburgh, PA; offices and support worldwide 2
Strategy Create usable technologies Apply them to real problems Amplify their impact by accelerating broad adoption Amplify Transition DoD needs Tech Trends Create Identify & Mature Tech Apply Direct Support 3
SEI Technical Programs Networked Systems Survivability Survivable Systems Engineering Survivable Enterprise Management CERT Coordination Center Network Situational Awareness Practices Development and Training Product Line Systems Software Architecture Technology Predictable Assembly from Certifiable Components Product Line Practice Dynamic Systems Integration of Software-Intensive Systems Performance-Critical Systems Mission Success in Complex Environments Software Engineering Process Management Capability Maturity Model Integration Software Engineering Measurement and Analysis Team Software Process Acquisition Support Other Research Independent R&D Ultra-Large-Scale Systems Software Assurance 4
Networked Systems Survivability Purpose Achieve routine use of practices and technology to protect against, detect, and respond to attacks Recent Impact Network Situational Awareness technology forms foundation of DoD and DHS network operations Virtual Training Environment provides information assurance (IA) training to more than 80,000 DoD IT staff Web portal provides definitive information on security engineering practices Text book published to guide engineers in writing secure code in C and C++ Technology and staff form core of malicious code analysis activity spanning 30 federal government organizations 5
Product Line Systems Purpose Achieve widespread use of effective product line and architecture t practices; enable use of predictable assembly technology for systems Recent Impact Cummins and Hewlett Packard among others on their 2 nd generation product lines, with significant bottom line results. Partnering with ABB to introduce PACC* concepts into highly configurable electric grid protection and control system (over one million lines of code) Army ATAM evaluations resulting in: reduced risk in schedule and cost, improved documentation and communication, and a higher quality product for the warfighter. *PACC: Predictable Assembly from Certifiable Components 6
Dynamic Systems Purpose Overcome interoperability, integration challenges in deployment of complex systems of systems; encourage use of model-based practices in DoD, industry systems Recent Impact Identified interoperability risks at MILSATCOM Rockwell Collins using AADL; asking tool vendors to support as standard U.S. Army CERDEC C2D implemented recommendations developed using Service Migration and Reuse Technique (SMART) to demonstrate the migration of legacy components System of Systems (SoS) approach guided alignment between technology and information support organizations in Dept. of Interior s Joint Fire Science Program * AADL: Architecture Analysis and Design Language 7
Software Engineering Process Management Purpose Advance proven process management and performance improvement practices for software and related disciplines Recent Impact NAVAIR integrated TSP & CMMI to accelerate process improvement on P3C Orion, AV-8B U.S. Navy AV-8B Harrier II CMMI improvements include cost reductions (42%, Raytheon; 20%, Lockheed Martin) productivity improvements (25%, Siemens) reductions in schedule variance (85%, NCR) Coaching WRALC on implementation of CMMI high maturity initiative Assisting ARMY PMs and PEOs with implementation of Lean Six Sigma policy 8
Acquisition Support Purpose Accelerate adoption of improved practices for acquiring, deploying, and sustaining software-intensive systems Recent Impact Support to more than 50 U.S. government program offices Increased support to global intelligence community, including U.S. National Security Agency, the UK s Government Communications Headquarters Joint Strike Fighter On-site U.S. Air Force Space and Missile Systems Center (SMC) presence in Los Angeles F-35 Joint Strike Fighter (JSF) program praises ASP evaluations of system architectures 9
Areas of Active Research and Development Software implications of Systems of Systems Function Extraction for Malicious Code (FX/MC) Predictable Assembly from Certifiable Components (PACC) Validation and Demonstration Testbed ATAM for System Architectures Model-Based Engineering g 10
Other New Research Mission success in complex environments Ultra-Large-Scale Systems Software Assurance Independent Research and Development Program The SEI s ULS Systems Study 11
Transition of Methods & Technologies Growing Partner Network: SEI Partner Licenses* (as of March 2008) Up 20% in FY07 from FY06* 450 Course Attendees for FY07 400 Partner Courses: 16,039 350 SEI Courses: 5,816 300 331 Heavily used Web site 250 272 1.8 million visits 200 219 > 550,000 downloads oads avg./quarter 150 168 100 New SEI blended learning CMMI v1.2 upgrade training: 5,810 completed Survivability in Information Assurance curriculum adopted by 1,465 faculty members Academic institutions in 105 countries 50 0 397 417 FY03 FY04 FY05 FY06 FY07 FY08 YTD * In 2007, the SEI merged CMMI and SCAMPI Partnerships into a single license. Data for all years shown here has been retroactively adjusted to represent this scheme and will vary from figures provided in past reports. 12
Benefits from SEI Process Improvement Products and Services 1 35% project cost savings with TSP; unit test defects dropped from 25 per KLOC to 7 per KLOC Used CMMI to reduce costs 42% Used TSP to cut defects in half and establish data baseline to improve future planning efforts Used CMMI to reduce schedule variance 85% Used CMMI to reduce software defects per million delivered SLOC by more than 50%; costs reduced 20% 13
Benefits from SEI Process Improvement Products and Services 2 Schedule Productivity Quality ROI Additional CMMI Impacts 50% reduction in release turn around time (Boeing, Australia) Increased the percentage of milestones met from approximately 50 percent to approximately 95 percent (General Motors) 25 percent productivity improvement in 3 years (Siemens Information Systems Ltd, India) Used Measurement & Analysis to realize an 11 percent increase in productivity, corresponding to $4.4M in additional value (reported under non-disclosure) Reduced defect rate at CMMI ML5 approximately one third compared to performance at SW-CMM ML5 (Lockheed Martin Maritime Systems & Sensors Undersea Systems) 44 percent defect reduction following causal analysis cycle at maturity level 2 (reported under non disclosure) 5:1 ROI for quality activities (Accenture) 13:1 ROI calculated as defects avoided per hour spent in training and defect prevention (Northrop Grumman Defense Enterprise Systems) 14
The People of the SEI 15
Summary Nearly 25 year history of contributions and innovation Strategic emphasis on enhanced impact Positioned for future challenges Extending current technologies Exploring new technologies www.sei.cmu.edu 16
More Information Software Engineering Institute Carnegie Mellon University 4500 Fifth Avenue Pittsburgh, PA 15213-3890 Phone: 1 (412) 268-5800 Email: customer-relations@sei.cmu.edu Email to Paul Nielsen: nielsen@sei.cmu.edu 17