IBM Software Group Performance with MCIF and IBM Rational Insight Dr. Einar Karlsen Certified IT Specialist Solution Architect einar.karlsen@de.ibm.com 2009 IBM Corporation
Agenda Background IBM Rational Insight Overview Measured Capability Improvement Framework (MCIF) Overview Executive Dashboard Conclusion Demo 2
You can t manage, what you can t measure! Control Settings Better Results Quantity of Data Quality of Data Time Delay Non-Intrusive Stable You cannot IMPROVE what you cannot MANAGE! 3
Problems and Implications 2/3 of executives make more than half of their decisions based on gut feel rather than verifiable information 77% of managers are aware of bad decisions made due to lack of access to accurate information Poor decisions have generated revenue 75% or more below expectations Lack of timely information and in-context insight Disparate data sources, formats, and definitions Lack of relevant, timely actionable information Inability to baseline and benchmark status and progress Inability to measure and assess unobtrusively 4
IBM Rational Insight Automatic collection, measurement and analysis of real-time data across projects for informed decision making Built-in library of metrics and dashboards based on best practices and optimized for software and systems development and delivery Customizable performance management framework guides customers with best practices to continuously improve process Built upon an open Jazz architecture, leveraging legacy Rational and 3rd-party data Built on a best-in-class business intelligence platform from IBM Cognos, clear leader in the 2008 Gartner Magic Quadrant for BI 5
Application Lifecycle Reports 6
Collaborate across disparate development artifacts In the context of business objectives Portfolio Project Requirements Rational Insight CxO Architecture Change Process Lead Configuration Build Quality Project Manager 7
Performance Across the Lifecycle Powered by Insight DOORS XML ClearQuest RequisitePro Measured Capability Improvement Framework (MCIF) Best Practice Guidance Open Lifecycle Service Integrations Single View into Your Organizational Performance ClearCase Team Concert HP Quality Center Quality Manager MS Project Partners Requirement s Composer 3 rd Party Powered By Cognos 8
Rational Insight High-Level Domains Architecture Change Requirements Configuration Project Build Portfolio REST API - native REST API adapter Quality XML DB Web architecture to retrieve product data in XML (REST get) Open Data Architecture XML ODBC Mapping DB Access Reporting Server Enterprise Data Warehouse DataStream DataStream Industry Proven BI Platform Extract, Transform, Load Data Warehouse M e t a d a t a CxO Process Lead Project Manager Self Service Report Authoring 9
Measured Capability Improvement Framework (MCIF) Ongoing Adoption Assessment Adopt Practices Best Practice Adoption a systematic approach to best practice adoption Rational Health Assessment to benchmark against proven improvement roadmaps Rational Self Checks to provide ongoing self assessment
Performance Measurement Practices shipped with Rational Insight This practice (included with Insight) gives detailed process guidance on how to to implement performance measurement. Rational Insight provides the tooling to to implement the performance measurement practice. 11
Available Reports in IBM Rational Insight Change control Reports Change management reports Iterative development sample reports Requirement practices sample reports Test management sample reports Code Churn Code Contributions Defect Arrival Rate Activities per Person Defect Glide Path Blocking Defects Build Health Defect Aging Defect Status and Distribution Iteration Velocity Project Burndown Project Performance Defect per Requirement Release Readiness (Requirement) Requirement Delivery Requirement List Test Case Execution Status Test Coverage by Requirement Defect Distribution Defect Verification Failure Rate SLOC by component SLOC per Defect Release Readiness (Defect) Request Trends Run Rate Tasks per Project Tasks per State Type Owner Workload Requirement Volatility Churn Requirements Distribution Requirements Traceability Matrix Requirement and related UCM Activities Test Lab Utilization Tested Use Cases to Implemented Use Cases 12
An Executive Dashboard One Possibility Executive Dashboard Project Health Defect Backlog Defect Density Defect Repair Latency Build Health Project Velocity Staffing Actuals Process Timeliness Milestone Status Severity Analysis Security Vulnerabilities Static Code Analysis Requirements Met IPD Timeliness Customer Quality Transactional Survey PMR / Call Rates Critical Situations Cost of Support Installability Enhancement SLA Useability Consumability Perceived Performance Scalability Integrations with other products User Experience / Doc Time to Resolution Development Quality Defect Backlog Test Escapes Functional Test Trends Critical Situations System Test Trends S-Curve Progress Automation Percentage Customer Testcases Consumability Scorecard Defect Latency Quality Plan Commitments Test Coverage Strategic Health Sales Plays Partner Enablement Support Enablement Technical Enablement Sales Enablement Localization MCIF Index Competition Integrated into Story Green Threads LCM Pipeline / Multiplier Revenue Evolutionary Architecture Vulnerability Assessment Concurrent Testing Practices Test Driven Development Whole Team Requirements Team Change 13
Rational Executive Dashboard DB2 Rational Insight Oracle SQL Server Where You Are Productivity Rates Quality Levels Why You Are Process Assess Product Health REST Open Services / ODBC / XML Quantitative and Qualitative Data Rational Rational ClearQuest Requirements Composer Rational Team Concert Rational Quality Manager Rational Test Manager Rational Data Sources Rational Requisite Pro Rational ClearCase ProjectHeadcount Sales CustomerManual Data & & Support Data FinancialsPipeline 3 rd Party Data Sources 14
This top-level dashboard showcases schedule variance, project health, size, and % complete for each project. Drill down on project for more info. Dashboards are organized around business objectives to ensure focus on potential problem areas preventing us to reach stated business objectives. Project health by region. Drill down for regional information, including headcount and cost-related information. 15
Guidance on how to set up a performance measurement system and how to effectively leverage metrics to manage your business is provided (from RMC) Online Auction is a fictive project. Project health dashboard provides a scorecard of 12 different quality related metrics. Drill down enables further analysis. Control metrics for practices including Test, Iterative Development, Continuous Integration, and 2- Level Planning are provided. Plugging in acquired products into our dashboard allows us to rapidly identify strengths and weaknesses. 16
Build health is an example of a control metric for practices such as iterative development and continuous integration. Seems like most teams have daily builds that pass our automated build tests. Individual reports are among others organized around practices. For each practice, you can run a set of reports for a project, or a set of projects, to understand how well they follow discriminating practices. Poor metrics indicating need for process improvement. 17
360-degree view protects top-line, bottom line and manages risk Integrating and balancing for Real Return on IT Assets Reallocate from troubled projects to get winners to market faster for higher ROI Prevent issues that create rework that drives projects over budget 30% ( )( Risk ) Benefits Total Asset Cost Reduce Analysisparalysis that puts delays projects up to 10% of the time Automate project and process measurement to improve team productively 10% 18
IBM Rational Insight Added Value You cannot IMPROVE what you cannot MEASURE! Raise enterprise transparency to reduce costs and risks by mapping operational activities to strategic objectives Drive business innovation and reduce costs through measured and continuous process improvement Gain insight into development projects which span organizational and geographic boundaries 19
Demo: IBM Rational Insight Overview Executive Dashboard KPIs Staffing Project Size Project Status Quality Project View Build Health Defects Enhancement Requests Test Coverage Uncovered Test Cases Requirement Volatility Out-of-the-Box (OOTB) Reports Functional Hierarchy>Defect >Defect Distribution Practice Oriented Hierarchy>Change Control>Code Contributions 20
Copyright IBM Corporation 2009. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 21