An Feb 23 2012 Webinar David White Senior Product Manager David.white@assure.net Tel: +972-54-6750323 Shir Goldberg Co-Founder & VP Biz Dev shir.goldberg@assure.net Tel: +1 919 827 1194
This presentation Overview of HP ALM & QC reporting features Key ALM metrics Hear about customers experiences and customized solutions for reporting Learn about Assure TotalView the ultimate BI solution for HP ALM & QC Practicalities http://assure.net/almplus Webinar recording will be available Materials will be available Please ask questions as we go
Assure The QC Guys We know HP ALM & Quality Center Since 2006, offices in USA, Finland and Israel Innovative products, solutions and services for HP ALM & Quality Center customers Our customers are able to streamline processes, boost efficiency and decrease overall QA and administration costs Assure works with some of the world s largest and most demanding HP ALM & Quality Center customers HP AllianceOne Technology Partner of the year 2011
Reporting Methods in ALM 11
ALM Reporting Features 1/2 Dashboard module For creating tabular reports or graphs based on field values Excel Reports (SQL queries to QC database) Dashboard: Combine multiple reports into a single view Report export to Wiki, Intranet etc Cross-Project graphs (in HP ALM) Document Generator for generating project level Word documents All project data into a single document Can contain pre-defined Graphs and Attachments Snapshot of the current situation Analysis menu in each module Standard Reports and Graphs that can be customized and saved to Dashboard module for future use Live Analysis in Test Plan and Test Lab Two configurable graphs showing analysis data from selected folders
ALM Reporting Features 2/2 Project Planning & Tracking - Release Analysis Milestones are placed on the release timeline to define a lifecycle of a product Scopes define assets involved in test effort Key Performance Indicator (KPI) Measure your release objectives Set on Milestones to track performance vs. plan Graphs can be published on web pages (SharePoint, Wiki, etc.) Project Reports Easy design of fully customable report templates Rich style and layout options using MS Word templates Create a centralized report template repository Multiple output file types (doc, docx, html) HP Executive Scorecard
Project Planning & Tracking: Release Milestones and KPIs Define releases Define Scope Define milestones Define KPI s for milestone Define & Preview Thresholds
Project Planning &Tracking : Release Scorecard In a Release Scorecard you can easily follow the performance of a release based on KPI`s KPI Analysis Graphs provide the ability to drill down to find the root cause of a problem How KPI Thresholds are met is indicated by different colors: green (OK), yellow (warning) or red (critical)
Project Planning &Tracking : Release Analysis Graphs Used to provide extended analysis of a KPI Click the KPI cell in the scorecard KPI Type = Analysis
Project Reports : Create Templates Easily create an MS Word report template with a custom layout
Project Reports : Customize Templates Edit MS Word report templates by selecting fields from ALM
Project Reports : Generate Reports Populate template reports with ALM data Save the reports as public or private
Key ALM Metrics
Valuable data in your ALM & QC databases Quality and maturity of releases / products / apps / features Which areas have the best/worst test coverage Where are most defects detected Where are my critical defects When can we release the product?
Valuable data in your ALM & QC databases Effort and efficiency How much time and effort was put into testing How well testing has been executed How effective was testing Effectiveness of the QA team Team performance Individual performance
Valuable data in your ALM & QC databases Quality of your test assets Are they managed effectively linking, coverage Do test cases find defects Are test cases reused
Valuable data in your ALM & QC databases Multi-Project Comparison of metrics across projects Trends of metrics over time Slice the metrics by any user defined field(s) And much more.
What Are Customers Doing?
Customized reporting with HP ALM & QC data Majority of customers access their HP ALM & QC database directly to create reports. Why do they do that? What are the challenges? Not enough visibility with out of the box HP ALM Solutions of operative system not flexible enough Multi project reports are a challenge Trend reports are limited What is in HP ALM? Customizable reports Excel reports Project Planning & Tracking Future - DB views possibly coming IT Executive Scorecard Past QC solutions - (advanced reports - Actuate, 9.0 dashboard)
Business Insight The levels of reporting - Maturity Strategic BI Solution One Version of the Truth Centralized dedicated Reporting Team & Environment Business Driven Reports Centralized Effort Business Awareness Customized Operational Reports Islands of Information Out of the Box Operational Reports Maturity of Reporting Culture and Tools
Why is the operational level not enough? Limitations Operational systems are not reporting platforms Complex Data structure not reporting friendly Performance Impact Access to underlying databases is limited by security In the Industry it is common practice to separate the reporting platform from the operational system SAP with Business Objects separate BW IBM Rational Common Reporting with Cognos Microsoft TFS with Reporting Services and DWH
Customized solutions we have seen at customers External Excel reports using e.g. OTA API Offer more flexibility than QC/ALM excel reports Can capture data from multiple projects Used to capture data over time manually create trends Combine with other data DB views Create DB views over the QC/ALM database to ease reports creation Mirror the DB Enable reporting on QC/ALM database without a performance impact External DB Copy subset of data from QC/ALM DB to an external DB Data Warehouse A real BI solution ETL processes, staging DB and a DWH
Challenges with customized solutions External excel reports Difficult to maintain Not accessible for everyone No scheduling DB views Not supported by HP Requires DB knowledge Performance penalty Mirror DB Performance and manageability challenges Does not solve the database complexity External DB Need to set up DB jobs Complex to extract a subset of data Data warehouse Very costly to create and requires technical competence Costly to maintain over ALM/QC version changes
INNOVATIVE PRODUCTS FOR HP ALM & QUALITY CENTER ASSURE PROJECT HARMONIZER ASSURE TOTALVIEW ASSURE ADMIN CONSOLE ASSURE TRASHBIN ASSURE DATA STANDRDIZER ASSURE BUGZILLA ADAPTER ASSURE TEST DATA INTEGRITY
Assure TotalView BI for HP ALM/QC What is Assure TotalView A revolutionary Data Mart solution specifically designed for HP ALM & QC, which incorporates BI best practices and has all the benefits of a BI solution Why we created it A clear market need for a best in class, business focused, BI solution for HP ALM & QC Who is it for Mature organizations who look for complete flexibility and visibility, decision making power and one version of the truth.
Why BI You can't beat a BI solution for reporting. The source system will never be able to compete. It is a proven fact by leading companies all over the world. If a company wants to beat competition it must be one step ahead - BI is the key Most leading software providers supply a separate platform for BI that is not part of any legacy system The source system will never be able to incorporate BI best practices as it is always limited in its resources and capabilities
Business Insight Positioning Assure TotalView ASSURE TOTAL VIEW One Version of the Truth Business Driven Reports Centralized Effort Centralized dedicated Reporting Team & Environment Business Awareness Customized Operational Reports Islands of Information Out of the Box Operational Reports Maturity of Reporting Culture and Tools
Why Assure TotalView TotalView is a BI solution for HP Quality Center & HP ALM A fully extendable and customizable BI platform for HP ALM For mature HP ALM customers that want complete control and flexibility Based on Business Intelligence methodology, technology and best practices Seamlessly integrates with any Enterprise BI solution or BI presentation layer Data Mart Dedicated data analysis database Provides data analysis from summarized to single row data Fully self-governed Control, Monitor, Customize Supports and evolves with customer business culture Rapid ROI Vs. creating your own QC BI solution Low TOC Self-governed HP QC/ALM upgrades delta provided by Assure
Product Components Data Mart Management Console ETL (Extract-Transform-Load) processes Ready to use dashboard (using QlikView) Report library
Product Architecture
Star Schema Data Model - a BI Best Practice Exec Status Time Priority Bug Status Test Set Execution Progress TEST Test Readiness Severity Defect Detection Person Release Cycle Release Plan Status Test Instance REQ
Summary of Key Features Without TotalView Complex table structure Limited Depth No QC/ALM version support Complex maintenance Short-term solution Analysis on Prod. DB Complex data management Complex report build Limited Multi-QC Project With TotalView Intuitive table structure Strategic - Trend and Progress QC/ALM version support Minimal maintenance Long-term solution Dedicated analysis DB Management console Simple report build Unlimited Multi QC Projects
Demo of TotalView
Multi-Project Analytics Key Considerations Multi-Project Analytics requires an uniform data structure QC10 Premier / ALM11 Strict Policies for project creation and changes Assure Project Harmonizer Quality Analytics requires quality data - uniform data values QC10 Premier / ALM11 Strict Policies for project creation and changes Assure Admin Console Assure Data Standardizer
Q&A and Next Steps ALM+ Current State Analysis Gain visibility into how well you are running ALM/QC Get a clear plan for the next steps to better reporting 10 days (7 on-site), $9500 (plus travel cost) Assure TotalView Contact us for details, demo, POC or questions Web: www.assure.net Email: sales@assure.net Twitter: http://twitter.com/assureqc Presenters shir.goldberg@assure.net david.white@assure.net