Using Parametric Software Estimates During Program Support Reviews

Size: px
Start display at page:

Download "Using Parametric Software Estimates During Program Support Reviews"

Transcription

1 Using Parametric Software Estimates During Program Support Reviews Version 1.0 Chris Miller Office of the Deputy Director, Software Engineering and System Assurance SYSTEMS & SOFTWARE ENGINEERING Office of the Deputy Under Secretary of Defense for Acquisition and Technology US Department of Defense July 2008 OUSD (AT&L) Organization May 2006 USD, Acquisition Technology & Logistics DUSD, Acquisition & Technology Dir, Joint Advanced Concepts Dir, Systems and Software Engineering Dir, Portfolio Systems Acquisition Defense Acquisition University Defense Procurement and Acquisition Policy Industrial Programs Small Business Programs Defense Contract Management Agency Systems & Software Engineering Chris Miller, June 2008 Slide 2

2 Systems and Software Engineering Director, Systems & Software Engineering Deputy Director Enterprise Development Deputy Director Developmental Test & Evaluation Deputy Director Software Engineering & System Assurance Deputy Director Assessments & Support Systems & Software Engineering Chris Miller, June 2008 Slide 3 Analysis of Program Failure Acquisition cost growth over 11 years (SAR data FY ): Estimation changes: $201B Engineering changes: $147B Schedule changes: $70B Over the past 10 years, DoD systems have experienced a 33% cost growth due to RDT&E mistakes DoD IOT&E results, FY systems; mix of ACAT II, 1C, 1D across 3 Services Approx. 50% were deemed Not Suitable, or partially NS Approx. 33% were deemed Not Effective, or partially NE Specific Causes of Program Failure (Systemic Root Cause Analysis findings) We do not Start Programs Right -Insufficient requirements analysis and definition at program initiation -Lack of rigorous SE approach -Optimistic/realistic reliability growth not a priority during development -Inadequate software architectures, design/development discipline, and organizational competencies We do not Manage Programs Right -Insufficient trade space -Insufficient risk management -Inadequate IMP, IMS, EVMS -Most programs lack quantifiable entrance/exit criteria -Maturing suitability (e.g., RAM) is not always a priority 4 Systems & Software Engineering Chris Miller, June 2008

3 Establishing a DoD Engineering Center of Excellence DoD Center of Excellence DoD Engineering Center of Excellence Support Acquisition Success Improve State-of-the- Practice of Engineering Leadership, Outreach and Advocacy Foster Resources to Meet DoD Needs Systems & Software Engineering Chris Miller, June 2008 Slide 5 Elements of a DoD Strategy for Software Support Acquisition Success Ensure effective and efficient software solutions across the acquisition spectrum of systems, SoS and capability portfolios Improve the State-of-the-Practice of Software Engineering Advocate and lead software initiatives to improve the state-of-thepractices through transition of tools, techniques, etc. Leadership, Outreach and Advocacy Implement at Department and National levels, a strategic plan for meeting Defense software requirements Foster Software Resources to meet DoD needs Enable the US and global capability to meet Department software needs, in an assured and responsive manner Promote World-Class Leadership for Defense Software Engineering Systems & Software Engineering Chris Miller, June 2008 Slide 6

4 Getting Started What are we Doing? Identifying software issues, needs Software Industrial Base Study NDIA Top Software Issues Workshop Defense Software Strategy Summit Creating opportunities, partnerships Established network of Government software POCs Chartered the NDIA Software Committee and Expert Panel Information exchanges with Government, Academia, and Industry Executing focused initiatives Providing software support to acquisition programs Foundational assessment of software policy/guidance Study of Software/SE integration Software Engineering reference curriculum Engineering for System Assurance SoS Systems Engineering Guide CMMI Integrity, CMMI-ACQ, CMMI Guidebook Early Systems/Software Engineering Systems & Software Engineering Chris Miller, June 2008 Slide 7 Top Software Issues* 1. The impact of requirements upon software is not consistently quantified and managed in development or sustainment. Requirements 2. Fundamental system engineering decisions are made without full participation of software engineering. SE/SW Integration 3. Software life-cycle planning and management by acquirers and suppliers is ineffective. Sustainment 4. The quantity and quality of software engineering expertise is insufficient to meet the demands of government and defense industry. Human Captial 5. Traditional software verification techniques are costly and ineffective for dealing with the scale and complexity of modern systems. Testing 6. There is a failure to assure correct, predictable, safe, secure execution of complex software in distributed environments. Assurance 7. Inadequate attention is given to total lifecycle issues for COTS/NDI impacts on lifecycle cost and risk. COTS * NDIA Top Software Issues Workshop August 2006 Systems & Software Engineering Chris Miller, June 2008 Slide 8

5 Driving Technical Rigor Back Into Programs Program Support Reviews Program Support Reviews provide insight into a program s technical execution focusing on: SE as envisioned in program s technical planning T&E as captured in verification and validation strategy Risk management - integrated, effective and resourced Milestone exit criteria as captured in Acquisition Decision Memo Acquisition strategy as captured in Acquisition Strategy Report Independent, cross-functional view aimed at providing risk-reduction recommendations The PSR reduces risk in the technical and programmatic execution of a program Systems & Software Engineering Chris Miller, June Program Support Review Activity (since March 2004) PSRs/NARs completed: 48 AOTRs completed: 11 Nunn-McCurdy Certification: 10 Participation on Service-led IRTs: 2 Technical Reviews: 12 Reviews planned for FY08: PSRs/NARs: 21 AOTRs: 2 Nunn-McCurdy: 2 Service-Managed Acquisitions Pre-MS C 21% Pre-MS B 30% Decision Support Reviews OTRR 6% Nunn- McCurdy 12% DAE Review 7% Pre-MS A 4% Programs by Domain Area Other 20% Air Force 34% Agencies 9% Business 2% Missiles 9% Fixed Wing 18% Other 7% Space 5% Land 16% Rotary Wing 18% Marine Corps 9% Army C2-ISR 9% Unmanned 5% 28% Munitions 4% Ships 7% Navy 20% Systems & Software Engineering Chris Miller, June

6 DoD Software Performance: What We re Seeing* Software issues are significant contributors to poor program execution Schedule realism (compressed, overlapping) Software requirements not well defined, traceable, testable Immature architectures, COTS integration, interoperability, obsolescence (electronics/hardware refresh) Software development processes not institutionalized, planning documents missing or incomplete, reuse strategies inconsistent Software test/evaluation lacking rigor and breadth Lessons learned not incorporated into successive builds Software risks/metrics not well defined, managed *Based on over 60 program reviews over the past 3 ½ years Systems & Software Engineering Chris Miller, June Software Engineering and System Assurance (SSA) Role SSA produced software estimates to support several PSR teams in 2007 Program A: SSA was asked to assess software schedule feasibility prior to MS B Program B: Significant software issues Opportunity for SSA to support program decision making by providing software estimates Estimation activities aimed at gauging overall program feasibility and quantifying magnitude of top program risks Focus on support for engineering vs. budgeting decisions Systems & Software Engineering Chris Miller, June

7 Program A PSR of aircraft program with ambitious schedule Three years (36 months) from Milestone B to LRIP Modifications needed to meet U.S. requirements Developed three software estimates Software size (SLOC) estimates provided by program office Re-estimated both new and reused code» Based on reuse and code growth» Estimates for optimistic, typical, and pessimistic were identified as Min, Mid, and Max Used three parametric models» COCOMO II, SLIM, and SEER-SEM Most input parameters set at nominal Systems & Software Engineering Chris Miller, June Program A Estimation & Feasibility Analysis Given an adjusted code size (ASIZE) of 918K to 1590K SLOCs A range of 5375 to 9571 person months should be expected over a 62 to 74 calendar month schedule COCOMO II Min Mid Max ASize (KSLOC) 918 1, Effort (PM) Duration (CM) All three models forecasted 65 to 68 months (assuming a 50% confidence-level) Result: Analysis revealed existing acquisition strategy was not feasible Service added more schedule to acquisition strategy DUSD(A&T) estimates change in acquisition strategy saved $5 billion Systems & Software Engineering Chris Miller, June

8 Program B Major subcontractor with significant software content did not use any parametric estimating tool Firm Fixed Price subcontract At one point there was a substantial conflict on estimates between major subcontractor and prime, related to requirements One portion of software grew from ~250KSLOC to 863KSLOC (3.5x), reflecting shall not degrade current capability requirement Increase in software engineering staff by 57 percent (40 people) over 9 month period Based on schedule, contractor should be drawing down software staff Significant variation in code estimates during review Systems & Software Engineering Chris Miller, June Program B Changes in SLOC estimates CSCI Supplier Original NM Review 2 wks. later New Reuse Complete % Test coverage to-date DR's/Problem reports 1 A 40, , , ,144 49,700 75% 68% 47 2 B 27,000 50,363 50,363 40,363 10,000 90% 85% 0 3 A 20,000 38,962 38,962 38, % 60% C 325, , , , ,811 98% 98% D 65, ,255 25,467 18,367 7,100 82% 60% 0 8 C 33, , ,129 68,129 32,000 99% 99% 0 9 E 15,000 7,879 7,879 2,000 5, % 100% 1 10 F 114, , ,609 16, ,200 99% 95% 0 11 G 26,000 25,622 34,544 8,922 25, % 100% 2 12 H 6,000 16,580 16,580 15,580 1, % 100% 2 13 H 2,000 34,806 34,806 17,206 17, % 100% 0 14 I 33,000 42,355 42,355 31,655 10,700 99% 97% 1 15 G 15, , ,626 6, , % 100% 0 16 K 23,000 26,404 26,404 2,604 23,800 91% 91% 1 17 L 7,000 12,500 12,500 1,000 11, % 100% 1 18 C 1,000 29,121 29,121 25,621 3, % 100% 7 19 M NA 100 1,000 1,000 Unavail 100% 100% 0 20 C NA 2,600 2, ,200 81% 43% 0 752,000 2,078,969 1,413,521 Systems & Software Engineering Chris Miller, June

9 Program B Schedule Estimates KSLOC remaining based on last estimate KSLOC (Optimal Schedule) Staff Months KSLOC (Optimal Schedule) 50 KSLOC (Optimal Schedule) 100 KSLOC (Nominal) 150 KSLOC (Nominal) 0 50 KSLOC (Nominal) Months Time from Detailed Requirements Complete Through End of Developmental Testing Systems & Software Engineering Chris Miller, June Program B Estimation and Feasibility Analysis Contractor appears to be driven to meet schedules versus costs» Significant increase in effort for minimal schedule savings Uncertainty in scope of remaining software development» Need to develop firmer size estimates Recommendations PMO reach a decision on unstable requirements to prevent further code growth in or out Program office bring in parametric estimating consultant to review contractor s estimates for most volatile software components Result Acquisition Decision Memorandum requires Service to conduct software review Systems & Software Engineering Chris Miller, June

10 Integrating Management Indicators Estimation & Planning Prioritized Risks Program Context Data & Insight Risk Management Insight Needed Risk Mitigation Status SDP: WBS, IMP, IMS, Metric Definitions Measurement & Analysis Systems & Software Engineering Chris Miller, June SSA Software Initiatives Measurement, Analysis, and (Size, Effort/Cost, Schedule Risk) Estimation Work Breakdown Structure Study» Focus: Recommendations for update of MIL-HDBK-881A» Execution: Partnering with DCMA, ARA, NII, PA&E/CAIG and using NDIA expert panel Earned Value Management Study» Focus: Recommendations for update of EVM Guidebook» Execution: Partnering with AS, DCMA, ARA, NII, PA&E Pilot of EVM/SW Metric» Focus: Development of cost controls for software component of program» Execution: Partnering with DCMA, ARA, NII, PA&E/CAIG, Contractors Cost Estimation» Focus: Software considerations for cost estimation Software Quality Attributes Possible studies» Focus: SW Quality attributes issues, data» Execution: NDIA Panel Systems & Software Engineering Chris Miller, June

11 Questions/Discussion Contact Information: Scott Lucero Assistant Deputy Director, Software Engineering & Systems Assurance ODUSD(A&T) Systems & Software Engineering Deputy Director, Assessments and Support Chris Miller SSE/SSA Support Software Estimation Lead Systems & Software Engineering Chris Miller, June

Software Engineering Framing DoD s Issues

Software Engineering Framing DoD s Issues Software Engineering Framing DoD s Issues Ms. Kristen Baldwin Director, Systems Analysis 15 September 2009 09/15/09 Page-1 DDR&E Organization WSARA 2009 - D,DT&E - D,SE - Dev Planning Director, Defense

More information

National Defense Industrial Association Systems Engineering Division Task Group Report Top Five Systems Engineering Issues

National Defense Industrial Association Systems Engineering Division Task Group Report Top Five Systems Engineering Issues National Defense Industrial Association Systems Engineering Division Task Group Report Top Five Systems Engineering Issues In Defense Industry January, 2003 Vers 9, 1/23/03 Background The Director, Systems

More information

Update: OSD Systems Engineering Revitalization Efforts

Update: OSD Systems Engineering Revitalization Efforts Update: OSD Systems Engineering Revitalization Efforts 23 October 2007 Col Rich Hoeferkamp Ms. Sharon Vannucci Systems and Software Engineering (Enterprise Development) Office of the Deputy Under Secretary

More information

Achieving True Risk Reduction through Effective Risk Management

Achieving True Risk Reduction through Effective Risk Management Achieving True Risk Reduction through Effective Pete Nolte Deputy Director, Major Program Support Office of the Deputy Assistant Secretary of Defense for Systems Engineering 16th Annual NDIA Systems Engineering

More information

Introduction to the CMMI Acquisition Module (CMMI-AM)

Introduction to the CMMI Acquisition Module (CMMI-AM) Pittsburgh, PA 15213-3890 Introduction to the CMMI Acquisition Module (CMMI-AM) Module 2: CMMI-AM and Project Management SM CMM Integration, IDEAL, and SCAMPI are service marks of Carnegie Mellon University.

More information

Scheduling Process Maturity Level Self Assessment Questionnaire

Scheduling Process Maturity Level Self Assessment Questionnaire Scheduling Process Maturity Level Self Assessment Questionnaire Process improvement usually begins with an analysis of the current state. The purpose of this document is to provide a means to undertake

More information

Best Practices for the Acquisition of COTS-Based Software Systems (CBSS): Experiences from the Space Systems Domain

Best Practices for the Acquisition of COTS-Based Software Systems (CBSS): Experiences from the Space Systems Domain GSAW 2004 Best Practices for the Acquisition of COTS-Based Software Systems (CBSS): Experiences from the Space Systems Domain Richard J. Adams and Suellen Eslinger Software Acquisition and Process Office

More information

The Program Managers Guide to the Integrated Baseline Review Process

The Program Managers Guide to the Integrated Baseline Review Process The Program Managers Guide to the Integrated Baseline Review Process April 2003 Table of Contents Foreword... 1 Executive Summary... 2 Benefits... 2 Key Elements... 3 Introduction... 4 IBR Process Overview...

More information

WORKFORCE COMPOSITION CPR. Verification and Validation Summit 2010

WORKFORCE COMPOSITION CPR. Verification and Validation Summit 2010 WORKFORCE COMPOSITION CPR PEO IEW&S Organizational Assessment VCSA Brief Date 2010 October 13, 2010 This briefing is UNCLASSIFIED/FOUO PREDECISIONAL LIMITED DISTRIBUTION AS OF: 11 Sep 2010 Verification

More information

UNCLASSIFIED. UNCLASSIFIED Office of Secretary Of Defense Page 1 of 16 R-1 Line #145

UNCLASSIFIED. UNCLASSIFIED Office of Secretary Of Defense Page 1 of 16 R-1 Line #145 Exhibit R-2, RDT&E Budget Item Justification: PB 2015 Office of Secretary Of Defense Date: March 2014 0400: Research, Development, Test & Evaluation, Defense-Wide / BA 6: RDT&E Management Support COST

More information

DEFENSE ACQUISITION PROGRAM SUPPORT METHODOLOGY

DEFENSE ACQUISITION PROGRAM SUPPORT METHODOLOGY Systems and Software Engineering DEFENSE ACQUISITION PROGRAM SUPPORT METHODOLOGY Version 2.0 Office of the Deputy Under Secretary of Defense for Acquisition and Technology Systems and Software Engineering

More information

Top Systems Engineering Issues In US Defense Industry

Top Systems Engineering Issues In US Defense Industry National Defense Industrial Association Systems Engineering Division Task Group Report Top Systems Engineering Issues In US Defense Industry September 2010 Final-v11-9/21/2010 Background The NDIA Systems

More information

MKS Integrity & CMMI. July, 2007

MKS Integrity & CMMI. July, 2007 & CMMI July, 2007 Why the drive for CMMI? Missed commitments Spiralling costs Late delivery to the market Last minute crunches Inadequate management visibility Too many surprises Quality problems Customer

More information

Recognizing and Mitigating Risk in Acquisition Programs

Recognizing and Mitigating Risk in Acquisition Programs Professional Development Institute May 27 th to May 29 th 2015 Recognizing and Mitigating Risk in Acquisition Programs D e b r a E. H a h n D e b b i e. h a h n @ d a u. m i l 703-805- 2830 1 DoD Risk

More information

System Security Engineering

System Security Engineering A Critical Discipline of SE Ms. Kristen Baldwin Director, Systems Analysis DDR&E/Systems Engineering 12th Annual NDIA Systems Engineering Conference 28 October 2009 10/28/09 Page-1 Defense Research & Engineering

More information

THE UNDER SECRETARY OF DEFENSE 3010 DEFENSE PENTAGON WASHINGTON, DC 20301 3010

THE UNDER SECRETARY OF DEFENSE 3010 DEFENSE PENTAGON WASHINGTON, DC 20301 3010 THE UNDER SECRETARY OF DEFENSE 3010 DEFENSE PENTAGON WASHINGTON, DC 20301 3010 ACQUlsmON, TECHNOLOGY AND LOG ISTICS AUG 1 0 2011 MEMORANDUM FOR SECRETARIES OF THE MILITARY DEPARTMENTS CHAIRMAN OF THE JOINT

More information

WEAPONS ACQUISITION REFORM

WEAPONS ACQUISITION REFORM GAO United States Government Accountability Office Report to the Committee on Armed Services, U.S. Senate December 2012 WEAPONS ACQUISITION REFORM Reform Act Is Helping DOD Acquisition Programs Reduce

More information

SED / Rassa Open Issue: Rapid acquisition and deployment Sep-10 2010 Top SE Issues

SED / Rassa Open Issue: Rapid acquisition and deployment Sep-10 2010 Top SE Issues NDIA Systems Engineering Division Last updated: 12/8/10 4 1 0 0 1 0 0 # Candidate NDIA SE Division Tasks - 2011 Assigned Status Disposition/Comments Date Opened Source 1 SED to convene a joint government/industry

More information

DEPARTMENT OF DEFENSE Defense Contract Management Agency INSTRUCTION. Defense Acquisition Executive Summary (DAES)

DEPARTMENT OF DEFENSE Defense Contract Management Agency INSTRUCTION. Defense Acquisition Executive Summary (DAES) DEPARTMENT OF DEFENSE Defense Contract Management Agency INSTRUCTION Defense Acquisition Executive Summary (DAES) Portfolio Management and Integration Directorate DCMA-INST 406 DCMA-PII Validated current,

More information

Internal Surveillance

Internal Surveillance Page 1 of 18 Internal Surveillance A contract having Earned Value Management System (EVMS) requires the contractor to maintain an effective management control system consistent with EVM industry standards

More information

Risk Management in DoD Programs

Risk Management in DoD Programs in DoD Programs James Thompson Director, Major Program Support Office of the Deputy Assistant Secretary of Defense for Systems Engineering National Defense Industrial Association (NDIA) Industrial Committee

More information

ODIG-AUD (ATTN: Audit Suggestions) Department of Defense Inspector General 400 Army Navy Drive (Room 801) Arlington, VA 22202-4704

ODIG-AUD (ATTN: Audit Suggestions) Department of Defense Inspector General 400 Army Navy Drive (Room 801) Arlington, VA 22202-4704 Additional Copies To obtain additional copies of this report, visit the Web site of the Department of Defense Inspector General at http://www.dodig.mil/audit/reports or contact the Secondary Reports Distribution

More information

Project Management Certificate (IT Professionals)

Project Management Certificate (IT Professionals) Project Management Certificate (IT Professionals) Whether your field is architecture or information technology, successful planning involves a carefully crafted set of steps to planned and measurable goals.

More information

Software Cost Estimation Metrics Manual for Defense Systems

Software Cost Estimation Metrics Manual for Defense Systems Software Cost Estimation Metrics Manual for Defense Systems Brad Clark USC Ray Madachy Naval Postgraduate School 29 th International Forum on COCOMO and Systems/Software Cost Modeling October 22, 2014

More information

WEAPONS ACQUISITION REFORM

WEAPONS ACQUISITION REFORM GAO United States Government Accountability Office Report to the Committee on Armed Services, U.S. Senate September 2011 WEAPONS ACQUISITION REFORM Actions Needed to Address Systems Engineering and Developmental

More information

Earned Value Management Systems Application Guide

Earned Value Management Systems Application Guide National Defense Industrial Association Integrated Program Management Division Earned Value Management Systems Application Guide May 4, 2011 Revision 1* National Defense Industrial Association (NDIA) 2111

More information

U.S. DEPARTMENT OF ENERGY CONTRACT AND PROJECT MANAGEMENT IMPROVEMENT. Closure Report

U.S. DEPARTMENT OF ENERGY CONTRACT AND PROJECT MANAGEMENT IMPROVEMENT. Closure Report U.S. DEPARTMENT OF ENERGY CONTRACT AND PROJECT MANAGEMENT IMPROVEMENT Closure Report April 2012 Executive Summary The Department of Energy (DOE) is committed to making continuous improvements in contract

More information

UNCLASSIFIED. UNCLASSIFIED Office of Secretary Of Defense Page 1 of 5 R-1 Line #159

UNCLASSIFIED. UNCLASSIFIED Office of Secretary Of Defense Page 1 of 5 R-1 Line #159 Exhibit R-2, RDT&E Budget Item Justification: PB 2015 Office of Secretary Of Defense Date: March 2014 0400: Research, Development, Test & Evaluation, Defense-Wide / BA 6: RDT&E Management Support COST

More information

PSM. Using CMMI To Improve Contract Management Within DCMA. Guy Mercurio, DCMA Boston, MA

PSM. Using CMMI To Improve Contract Management Within DCMA. Guy Mercurio, DCMA Boston, MA Using CMMI To Improve Contract Management Within DCMA Presented By: Guy Mercurio, DCMA Boston, MA Practical Software and Systems Measurement 2003 Users Group Conference Keystone, Co July 18, 2003 CMMI

More information

BETTER BUYING POWER 2.0 INITIATIVES DESCRIPTIONS

BETTER BUYING POWER 2.0 INITIATIVES DESCRIPTIONS BETTER BUYING POWER 2.0 INITIATIVES DESCRIPTIONS Achieve Affordable Programs Mandate affordability as a requirement: The initiative to provide affordability caps for unit production cost and sustainment

More information

Military Handbook 881 Work Breakdown Structure Update

Military Handbook 881 Work Breakdown Structure Update Military Handbook 881 Work Breakdown Structure Update Presented By: Neil Albert 25 August 2004 MCR, LLC 2000 Corporate Ridge, Suite 400 McLean, VA 22102 Update to incorporate DoD changes in Acquisition

More information

Program and Project Management Practices in the Federal Civilian Agencies

Program and Project Management Practices in the Federal Civilian Agencies Progress through partnership National Defense Industry Association, Civilian Agencies Industry Working Group Program and Project Management Practices in the Federal Civilian Agencies White Paper Lawrence

More information

Earned Value Management Systems Application Guide

Earned Value Management Systems Application Guide National Defense Industrial Association Integrated Program Management Division Earned Value Management Systems Application Guide January 27, 2015 Revision 2 National Defense Industrial Association (NDIA)

More information

F-35 JOINT STRIKE FIGHTER. Problems Completing Software Testing May Hinder Delivery of Expected Warfighting Capabilities

F-35 JOINT STRIKE FIGHTER. Problems Completing Software Testing May Hinder Delivery of Expected Warfighting Capabilities United States Government Accountability Office Report to Congressional Committees March 2014 F-35 JOINT STRIKE FIGHTER Problems Completing Software Testing May Hinder Delivery of Expected Warfighting Capabilities

More information

Process In Execution Review (PIER) and the SCAMPI B Method

Process In Execution Review (PIER) and the SCAMPI B Method Process In Execution Review (PIER) and the SCAMPI B Method Lorraine Adams, SEI Lynda Rosa, MITRE Fred Schenker, SEI Dale Swanson, MITRE November 17, 2005 Sponsored by the U.S. Department of Defense SM

More information

Extending CMMI Level 4/5 Organizational Metrics Beyond Software Development

Extending CMMI Level 4/5 Organizational Metrics Beyond Software Development Extending CMMI Level 4/5 Organizational Metrics Beyond Software Development CMMI Technology Conference and User Group Denver, Colorado 14-17 November 2005 Linda Brooks Northrop Grumman Corporation Topics

More information

Report No. DoDIG-2012-081 April 27, 2012. Navy Organic Airborne and Surface Influence Sweep Program Needs Defense Contract Management Agency Support

Report No. DoDIG-2012-081 April 27, 2012. Navy Organic Airborne and Surface Influence Sweep Program Needs Defense Contract Management Agency Support Report No. DoDIG-2012-081 April 27, 2012 Navy Organic Airborne and Surface Influence Sweep Program Needs Defense Contract Management Agency Support Additional Copies To obtain additional copies of this

More information

Thinking About Agile in DoD

Thinking About Agile in DoD Thinking About Agile in DoD Stephen Welby Deputy Assistant Secretary of Defense for Systems Engineering AFEI Agile for Government Summit November 21, 2013 11/21/2013 Page-1 US Department of Defense (DoD)

More information

Government Contracting and Earned Value Management (EVM)

Government Contracting and Earned Value Management (EVM) Government Contracting and Earned Value Management (EVM) Ida Davis, EVP, PMP, MBA Earned Value Manager DynPort Vaccine Company LLC, A CSC Company Note: This presentation is the property of DynPort Vaccine

More information

Information Technology Project Oversight Framework

Information Technology Project Oversight Framework i This Page Intentionally Left Blank i Table of Contents SECTION 1: INTRODUCTION AND OVERVIEW...1 SECTION 2: PROJECT CLASSIFICATION FOR OVERSIGHT...7 SECTION 3: DEPARTMENT PROJECT MANAGEMENT REQUIREMENTS...11

More information

Improving ERP Estimating

Improving ERP Estimating Headquarters U.S. Air Force I n t e g r i t y - S e r v i c e - E x c e l l e n c e Improving ERP Estimating in the Department of Defense Dr. Wilson Rosa Max Hodal (Wyle) Brian Kolstad (MCR) Travis Packard

More information

A DIFFERENT KIND OF PROJECT MANAGEMENT: AVOID SURPRISES

A DIFFERENT KIND OF PROJECT MANAGEMENT: AVOID SURPRISES SEER for Software: Cost, Schedule, Risk, Reliability SEER project estimation and management solutions improve success rates on complex software projects. Based on sophisticated modeling technology and

More information

A Guide to Conducting Independent Technical Assessments

A Guide to Conducting Independent Technical Assessments A Guide to Conducting Independent Technical Assessments 5 March 2003 J. A. Clapp P. G. Funch Center for Air Force C2 Systems Bedford, Massachusetts Table of Contents Section Page 1. Introduction 1.1 Purposes

More information

ReMilNet Service Experience Overview

ReMilNet Service Experience Overview ReMilNet Service Experience Overview ReMilNet s knowledge across all functional service areas enables us to provide qualified personnel with knowledge across the spectrum of support services. This well

More information

Partnering for Project Success: Project Manager and Business Analyst Collaboration

Partnering for Project Success: Project Manager and Business Analyst Collaboration Partnering for Project Success: Project Manager and Business Analyst Collaboration By Barbara Carkenord, CBAP, Chris Cartwright, PMP, Robin Grace, CBAP, Larry Goldsmith, PMP, Elizabeth Larson, PMP, CBAP,

More information

COCOMO III Project Status

COCOMO III Project Status COCOMO III Project Status Brad Clark USC April 14, 2015 Working Group Relatively small group of people meeting via teleconference once a week since the October 2014 Forum Work on and discuss various aspects

More information

A DIFFERENT KIND OF PROJECT MANAGEMENT

A DIFFERENT KIND OF PROJECT MANAGEMENT SEER for Software SEER project estimation and management solutions improve success rates on complex software projects. Based on sophisticated modeling technology and extensive knowledge bases, SEER solutions

More information

Fundamentals of Measurements

Fundamentals of Measurements Objective Software Project Measurements Slide 1 Fundamentals of Measurements Educational Objective: To review the fundamentals of software measurement, to illustrate that measurement plays a central role

More information

A Cure for Unanticipated Cost and Schedule Growth

A Cure for Unanticipated Cost and Schedule Growth + Thomas J. Coonce Glen B. Alleman A Cure for Unanticipated Cost and Schedule Growth We have lots data. Let s use it create more credible estimates to help tame the growth beast + Why Are We Here? 2 In

More information

Making the Business Case for Industrial Base and Supply Chain Management for the Aerospace and Defense Industry

Making the Business Case for Industrial Base and Supply Chain Management for the Aerospace and Defense Industry National Aeronautics and Space Administration Making the Business Case for Industrial Base and Supply Chain Management for the Aerospace and Defense Industry A 10 Step Guide to adopting SCM* and review

More information

FY09 Department of Defense Human Systems Integration Management Plan Version 1.0

FY09 Department of Defense Human Systems Integration Management Plan Version 1.0 FY09 Department of Defense Human Systems Integration Management Plan Version 1.0 Office of the Deputy Under Secretary of Defense (Acquisition and Technology) and Office of the Deputy Under Secretary of

More information

Is the Cost of Reliability, Maintainability, and Availability Affordable for Software Intensive Systems?

Is the Cost of Reliability, Maintainability, and Availability Affordable for Software Intensive Systems? Is the Cost of Reliability, Maintainability, and Availability Affordable for Software Intensive Systems? Presented to IEEE Software Technology Conference Long Beach, CA Myron Hecht April, 2014 1 The Aerospace

More information

Software Metrics Reporting Proposal

Software Metrics Reporting Proposal Software Metrics Reporting Proposal Tom Coonce Office of the Secretary of Defense Program Analysis and Evaluation Contractor Cost Data Report Project Office Goal Document both the anticipated and actual

More information

Measurement Strategies in the CMMI

Measurement Strategies in the CMMI Measurement Strategies in the CMMI International Software Measurement & Analysis Conference 9-14 September 2007 Rick Hefner, Ph.D. Director, Process Management Northrop Grumman Corporation One Space Park,

More information

Test and Evaluation in Support of Systems Acquisition

Test and Evaluation in Support of Systems Acquisition Department of the Army Pamphlet 73 1 Test and Evaluation Test and Evaluation in Support of Systems Acquisition Headquarters Department of the Army Washington, DC 30 May 2003 UNCLASSIFIED SUMMARY of CHANGE

More information

Developing Work Breakdown Structures

Developing Work Breakdown Structures Developing Work Breakdown Structures International Cost Estimating & Analysis Association June 2014 Neil F. Albert MCR, LLC nalbert@mcri.com 703-506-4600 2014 MCR, LLC Distribution prohibited without express

More information

DoD Software Assurance (SwA) Overview

DoD Software Assurance (SwA) Overview DoD Software Assurance (SwA) Overview Tom Hurt Office of the Deputy Assistant Secretary of Defense for Systems Engineering NDIA Program Protection Summit / Workshop McLean, VA May 19, 2014 May 19, 2014

More information

Technology Readiness Assessment (TRA)

Technology Readiness Assessment (TRA) DEPARTMENT OF DEFENSE Technology Readiness Assessment (TRA) Guidance April 2011 Prepared by the Assistant Secretary of Defense for Research and Engineering (ASD(R&E)) revision posted 13 May 2011 Contents

More information

UNCLASSIFIED. R-1 Program Element (Number/Name) PE 0603461A / High Performance Computing Modernization Program. Prior Years FY 2013 FY 2014 FY 2015

UNCLASSIFIED. R-1 Program Element (Number/Name) PE 0603461A / High Performance Computing Modernization Program. Prior Years FY 2013 FY 2014 FY 2015 Exhibit R-2, RDT&E Budget Item Justification: PB 2015 Army Date: March 2014 2040: Research, Development, Test & Evaluation, Army / BA 3: Advanced Technology Development (ATD) COST ($ in Millions) Prior

More information

Software Project Management

Software Project Management Software Project Management Objectives Introduce students to a variety of approaches and techniques in SPM Use current SPM tools Develop new SPM ideas Document reading, experiences and ideas Improve writing

More information

GAO MAJOR AUTOMATED INFORMATION SYSTEMS. Selected Defense Programs Need to Implement Key Acquisition Practices

GAO MAJOR AUTOMATED INFORMATION SYSTEMS. Selected Defense Programs Need to Implement Key Acquisition Practices GAO United States Government Accountability Office Report to Congressional Addressees March 2013 MAJOR AUTOMATED INFORMATION SYSTEMS Selected Defense Programs Need to Implement Key Acquisition Practices

More information

PROJECT MANAGEMENT PLAN TEMPLATE < PROJECT NAME >

PROJECT MANAGEMENT PLAN TEMPLATE < PROJECT NAME > PROJECT MANAGEMENT PLAN TEMPLATE < PROJECT NAME > Date of Issue: < date > Document Revision #: < version # > Project Manager: < name > Project Management Plan < Insert Project Name > Revision History Name

More information

MAJOR AUTOMATED INFORMATION SYSTEMS. Selected Defense Programs Need to Implement Key Acquisition Practices

MAJOR AUTOMATED INFORMATION SYSTEMS. Selected Defense Programs Need to Implement Key Acquisition Practices United States Government Accountability Office Report to Congressional Committees March 2014 MAJOR AUTOMATED INFORMATION SYSTEMS Selected Defense Programs Need to Implement Key Acquisition Practices GAO-14-309

More information

Program Management Office Provided Adequate Oversight of Two Contracts Supporting the Defense Enterprise Accounting and Management System

Program Management Office Provided Adequate Oversight of Two Contracts Supporting the Defense Enterprise Accounting and Management System Report No. DODIG-2014-006 I nspec tor Ge ne ral U.S. Department of Defense OCTOBER 25, 2013 Program Management Office Provided Adequate Oversight of Two Contracts Supporting the Defense Enterprise Accounting

More information

Developing CMMI in IT Projects with Considering other Development Models

Developing CMMI in IT Projects with Considering other Development Models Developing CMMI in IT Projects with Considering other Development Models Anahita Ahmadi* MSc in Socio Economic Systems Engineering Organizational Process Development Engineer, International Systems Engineering

More information

In today s acquisition environment,

In today s acquisition environment, 4 The Challenges of Being Agile in DoD William Broadus In today s acquisition environment, it no longer is unusual for your program to award a product or service development contract in which the vendor

More information

BETTER RECORDS MANAGEMENT

BETTER RECORDS MANAGEMENT BETTER RECORDS MANAGEMENT THROUGH PROJECT MANAGEMENT Maura L. Dunn, CRM President April 8, 2015 What is the difference between program management and project management? Why does it matter? Programs Are

More information

PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING

PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING PMI PMBOK & ESTIMATING 03-23-05 Christine Green, PMI PMBOK and Estimating EDS, Delivery

More information

Auditing Capital Projects and Project Controls. March 2013

Auditing Capital Projects and Project Controls. March 2013 Auditing Capital Projects and Project Controls March 2013 Internal Audit Perspective Oversight Insight Foresight Is the process operating as planned? Are controls, resources, and performance measures adequate

More information

Headquarters U.S. Air Force. Building CERs & SERs for Enterprise Resource Planning (ERP)

Headquarters U.S. Air Force. Building CERs & SERs for Enterprise Resource Planning (ERP) Headquarters U.S. Air Force I n t e g r i t y - S e r v i c e - E x c e l l e n c e Building CERs & SERs for Enterprise Resource Planning (ERP) Programs Dr. Wilson Rosa, Travis Packard, Abishek Krupanand,

More information

Capability Maturity Model Integration (CMMI SM ) Fundamentals

Capability Maturity Model Integration (CMMI SM ) Fundamentals Capability Maturity Model Integration (CMMI SM ) Fundamentals Capability Maturity Model Integration and CMMI are are service marks of Carnegie Mellon University 2008, GRafP Technologies inc. 1 What is

More information

Writing a Systems Engineering Plan, or a Systems Engineering Management Plan? Think About Models and Simulations

Writing a Systems Engineering Plan, or a Systems Engineering Management Plan? Think About Models and Simulations Writing a Systems Engineering Plan, or a Systems Engineering Management Plan? Think About Models and Simulations Philomena Zimmerman Office of the Deputy Assistant Secretary of Defense for Systems Engineering

More information

DoD Software Assurance Initiative. Mitchell Komaroff, OASD (NII)/DCIO

DoD Software Assurance Initiative. Mitchell Komaroff, OASD (NII)/DCIO DoD Software Assurance Initiative Mitchell Komaroff, OASD (NII)/DCIO Agenda Background Software Assurance Definition and Strategy Guiding Principles for SwA DoD SwA Strategy Elements Industry Outreach

More information

SUCCESSFULLY INTEGRATING AGILE WITH EARNED VALUE MANAGEMENT

SUCCESSFULLY INTEGRATING AGILE WITH EARNED VALUE MANAGEMENT 1 PMSC Quarterly Meeting, February 1 2, 2011, Fort Worth, Texas SUCCESSFULLY INTEGRATING AGILE WITH EARNED VALUE MANAGEMENT Increasing the Probability Program of Success (PoPS)by Connect the dots between

More information

Dr. Barry W. Boehm USC Center for Software Engineering

Dr. Barry W. Boehm USC Center for Software Engineering 7th Annual Practical Software and Systems Measurement Users Group Conference Keystone, CO July 16, 2003 Dr. Barry W. Boehm USC 1 Workshop Agenda Day 1 (1:30 AM 5:00 PM 7/16) Next-level tutorial Review

More information

Using CMMI Effectively for Small Business Panel

Using CMMI Effectively for Small Business Panel Using CMMI Effectively for Small Business Panel (With interactive discussion from panel and audience recorded in slides) NDIA CMMI Working Group NDIA Systems Engineering Division 2010 CMMI Technology Conference

More information

Early Development Planning Leads to Affordable Systems. NDIA 14 th Annual Systems Engineering Conference Track 4 Early Systems Engineering

Early Development Planning Leads to Affordable Systems. NDIA 14 th Annual Systems Engineering Conference Track 4 Early Systems Engineering Early Development Planning Leads to Affordable Systems presented at NDIA 14 th Annual Systems Engineering Conference Track 4 Early Systems Engineering October 25-28, 2010 Chuck Kondrack David Peterson

More information

UNITED STATES AIR FORCE. Air Force Product Support Enterprise Vision

UNITED STATES AIR FORCE. Air Force Product Support Enterprise Vision UNITED STATES AIR FORCE Air Force Product Support Enterprise Vision July 2013 Foreword Product Support is a set of functions and products that enables operational capability and readiness of systems, subsystems,

More information

Your Software Quality is Our Business. INDEPENDENT VERIFICATION AND VALIDATION (IV&V) WHITE PAPER Prepared by Adnet, Inc.

Your Software Quality is Our Business. INDEPENDENT VERIFICATION AND VALIDATION (IV&V) WHITE PAPER Prepared by Adnet, Inc. INDEPENDENT VERIFICATION AND VALIDATION (IV&V) WHITE PAPER Prepared by Adnet, Inc. February 2013 1 Executive Summary Adnet is pleased to provide this white paper, describing our approach to performing

More information

Click to edit Master title style

Click to edit Master title style Click to edit Master title style Click The to Business edit Master title style Operations Center and CPSRs Breakout Third Session level # D08 Andrew C. Obermeyer, Director, DCMA Business Operations Center

More information

Property and Equipment Accountability and Management Best Practice Discussion

Property and Equipment Accountability and Management Best Practice Discussion Property and Equipment Accountability and Management Best Practice Discussion Name: Office: Date: OUSD, (AT&L) P&E Policy Version 3.0 Why We Are Here The Department of Defense (DoD) is looking at departmental

More information

Case Studies in Systems Engineering Central to the Success of Applied Systems Engineering Education Programs

Case Studies in Systems Engineering Central to the Success of Applied Systems Engineering Education Programs Complexity Case Studies in Systems Engineering Central to the Success of Applied Systems Engineering Education Programs Carlee A. Bishop Principal Research Engineer, Georgia Tech Research Institute Georgia

More information

ATTACHMENT 3 SPS PROJECT SENIOR PROGRAM MANAGER (SPM) DUTIES & RESPONSIBILITIES

ATTACHMENT 3 SPS PROJECT SENIOR PROGRAM MANAGER (SPM) DUTIES & RESPONSIBILITIES 1. ROLE DEFINITIONS ATTACHMENT 3 SPS PROJECT SENIOR PROGRAM MANAGER (SPM) DUTIES & RESPONSIBILITIES The purpose of this section is to distinguish among the roles interacting with the SPM obtained through

More information

NODIS Library Program Formulation(7000s) Search

NODIS Library Program Formulation(7000s) Search NODIS Library Program Formulation(7000s) Search NASA Procedural Requirements This Document Is Uncontrolled When Printed. Check the NASA Online Directives Information System (NODIS) Library to verify that

More information

Report No. D-2009-048 January 30, 2009. DoD Small Business Innovation Research Program

Report No. D-2009-048 January 30, 2009. DoD Small Business Innovation Research Program Report No. D-2009-048 January 30, 2009 DoD Small Business Innovation Research Program Additional Information and Copies To obtain additional copies of this report, visit the Web site of the Department

More information

Every so often, people need to review past efforts, examine

Every so often, people need to review past efforts, examine Every so often, people need to review past efforts, examine progress, and reassess future activities. After more than 40 years of practicing systems engineering within the Department of Defense, it is

More information

IS EARNED VALUE + AGILE A MATCH MADE IN HEAVEN?

IS EARNED VALUE + AGILE A MATCH MADE IN HEAVEN? 1 IS EARNED VALUE + AGILE A MATCH MADE IN HEAVEN? Presented at The Nexus of Agile Software Development and Earned Value Management, OSD-PARCA, February 19 20, 2015 Institute for Defense Analysis, Alexandria,

More information

Using Earned Value Management Concepts to Improve Commercial Project Performance

Using Earned Value Management Concepts to Improve Commercial Project Performance Using Earned Value Management Concepts to Improve Commercial Project Performance R. Scott Brunton, PMP, PMI-RMP/SP, EVP Principal Solutions Consultant Lewis Fowler, LLC www.lewisfowler.com Welcome to the

More information

Some Critical Success Factors for Industrial/Academic Collaboration in Empirical Software Engineering

Some Critical Success Factors for Industrial/Academic Collaboration in Empirical Software Engineering Some Critical Success Factors for Industrial/Academic Collaboration in Empirical Software Engineering Barry Boehm, USC (in collaboration with Vic Basili) EASE Project Workshop November 7, 2003 11/7/03

More information

NASCIO Recognition Award Nomination - 2009. IT Project and Portfolio Management

NASCIO Recognition Award Nomination - 2009. IT Project and Portfolio Management NASCIO Recognition Award Nomination - 2009 IT State of North Carolina Enterprise Project Management Office June 3, 2009 Executive Summary The Enterprise Project Management Office () was established in

More information

DEFENSE ACQUISITIONS. DOD Efforts to Adopt Open Systems for Its Unmanned Aircraft Systems Have Progressed Slowly

DEFENSE ACQUISITIONS. DOD Efforts to Adopt Open Systems for Its Unmanned Aircraft Systems Have Progressed Slowly United States Government Accountability Office Report to the Subcommittee on Tactical Air and Land Forces, Committee on Armed Services, House of Representatives July 2013 DEFENSE ACQUISITIONS DOD Efforts

More information

Develop Project Charter. Develop Project Management Plan

Develop Project Charter. Develop Project Management Plan Develop Charter Develop Charter is the process of developing documentation that formally authorizes a project or a phase. The documentation includes initial requirements that satisfy stakeholder needs

More information

Panel: Transitioning Systems Engineering Research into Programs and Practice

Panel: Transitioning Systems Engineering Research into Programs and Practice Panel: Transitioning Systems Engineering Research into Programs and Practice D. Scott Lucero Office of the Deputy Assistant Secretary of Defense for Systems Engineering 17th Annual NDIA Systems Engineering

More information

Request for Resume (RFR) for Project Manager (Senior) CATS+ Master Contract All Master Contract Provisions Apply. Section 1 General Information

Request for Resume (RFR) for Project Manager (Senior) CATS+ Master Contract All Master Contract Provisions Apply. Section 1 General Information Request for Resume (RFR) for Project (Senior) Section General Information RFR Number: (Reference BPO Number) Functional Area (Enter One Only) Q00R00 BPO # 060B900 in ADPICS Functional Area 0 IT Management

More information

Report No. D2008-041 January 14, 2008. Management of the General Fund Enterprise Business System

Report No. D2008-041 January 14, 2008. Management of the General Fund Enterprise Business System Report No. D2008-041 January 14, 2008 Management of the General Fund Enterprise Business System Additional Copies To obtain additional copies of this report, visit the Web site of the Department of Defense

More information

Systems Engineering Beyond Aerospace and Defense

Systems Engineering Beyond Aerospace and Defense Systems Engineering Beyond Aerospace and Defense Don S. Gelosh Ph.D., CSEP-Acq. White Paper Systems Engineering Beyond Aerospace and Defense By Don S. Gelosh, Ph.D., CSEP-Acq. Director, Systems Engineering

More information

DoD Cloud Computing Strategy Needs Implementation Plan and Detailed Waiver Process

DoD Cloud Computing Strategy Needs Implementation Plan and Detailed Waiver Process Inspector General U.S. Department of Defense Report No. DODIG-2015-045 DECEMBER 4, 2014 DoD Cloud Computing Strategy Needs Implementation Plan and Detailed Waiver Process INTEGRITY EFFICIENCY ACCOUNTABILITY

More information

Assessment of NCTD Program Management Framework for Positive Train Control Program

Assessment of NCTD Program Management Framework for Positive Train Control Program Assessment of NCTD Program Management Framework for Positive Train Control Program Subtask 2: Analysis Gap Analysis Prepared for: Brad Hansen, M.S., PMP Director, PMO Capital Projects May 2013 0 icfi.com/transportation

More information

ROOT CAUSE ANALYSIS OF VTUAV FIRE SCOUT S NUNN-MCCURDY BREACH Patricia Fazio Bronson and Christopher Martin

ROOT CAUSE ANALYSIS OF VTUAV FIRE SCOUT S NUNN-MCCURDY BREACH Patricia Fazio Bronson and Christopher Martin ROOT CAUSE ANALYSIS OF VTUAV FIRE SCOUT S NUNN-MCCURDY BREACH Patricia Fazio Bronson and Christopher Martin The Problem The root cause of the VTUAV Fire Scout Program s Nunn-McCurdy breach needs to be

More information

Defense Travel Management Office. Change Management Plan

Defense Travel Management Office. Change Management Plan Defense Travel Management Office Change Management Plan January 2007 Version 2.0 Table of Contents Table of Contents...2 List of Figures...2 List of Appendices...2 Record of Changes...3 Executive Summary...4

More information