Comparison Test Management Tools HP ALM11 & MS VS/TFS2010 22 mei 2012 voordracht georganiseerd door Discussiegroep Software Testing met de steun van Ingenieurshuis, Antwerpen
24/05/2012 HP ALM 11 Microsoft TFS 2010 Moderator: Rik Kochuyt Comparison Test Management Tools May 22 nd, 2012 What? First time life demo comparison between HP ALM 11 Jerry Saelemakers (jsaelemakers@hp.com) Microsoft TFS 2010 Pieter Ostyn Jan Willem van Buuren Gerard van der Pol 2 similar tools with a different background, May 22nd, 2012 Comparison Test Management Tools 2 1
24/05/2012 Agenda Short positioning of each tool Hands on demo on a standard test practice Q&A Networking May 22 nd, 2012 Comparison Test Management Tools 3 Agenda Short positioning of each tool Hands on demo on a standard test practice Q&A Networking May 22 nd, 2012 Comparison Test Management Tools 4 2
24/05/2012 Agenda Short positioning of each tool Hands on demo on a d d standard test practice Q&A Networking May 22nd, 2012 Comparison Test Management Tools 5 Scenario We ve some Requirements From there, Test Cases get created The Test Cases get executed During execution, Defects get found Defects get handled (repaired, ) To keep overview and to follow up the process some reporting is needed May 22nd, 2012 Comparison Test Management Tools 6 3
24/05/2012 Agenda Short positioning of each tool Hands on demo on a d d standard test practice Q&A Networking May 22nd, 2012 Comparison Test Management Tools 7 Software Testing Discussie groep Thanks! May 22nd, 2012 Comparison Test Management Tools 8 4
HP Application Lifecycle Management K.V.I.V., May 22th 2012 Jerry Saelemakers HP Software 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice The goal of ALM? How to connect business & IT shorten release cycles adopt to change HP Confidential 1 22 May 2012
Some History 1995 TD 1.52 Windows like interface (and 1.52 for OS/2!) 1997 TD 4.0, 1999, TD 6.01 2000 TD 7.0i Fully web enabled, new requirements module 2001 - TD 7.2, 2002 - TD 7.5, 2002 - TD 7.6, 2003 -TD 8.0 2004 QC 8.0 New Java Server, High Availability, BPT module 2004 QC 8.2 Advanced reporting, requirement traceability rules 2006 QC 9.0 Dashboard server, STM module, defects traceability, repository over database November 2006 - Mercury acquired by HP 2007 QC 9.2 Risk based testing, releases module, Excel reporting 2009 QC 10.0 Versioning, sharing, baselining, New Premier version TODAY QC/ALM 11 TestDirector 1.51 Defects Tracking HP Confidential 2 22 May 2012
TestDirector 1.51 Test Planning TestDirector 6.01 Test Planning HP Confidential 3 22 May 2012
TestDirector 7.0i Requirements TestDirector 7.0i Test Planning HP Confidential 4 22 May 2012
Quality Center 8.0 Requirements Today: ALM 11 10 HP Confidential HP Confidential 5 22 May 2012
THE COMPLETE AND CORE APPLICATION LIFECYCLE COMPLETE LIFECYCLE COVERAGE Project & Portfolio Management Application Governance Business Availability Service Management Archiving CORE LIFECYCLE EXCELLENCE Lifecycle Management & Automation Requirements Development Integration Quality & Performance Security BEST-IN-CLASS MODULAR HETEROGENEOU S TRACEABILITY & INSIGHT UNIFIED PLATFORM TECHNOLOGY AGNOSTIC LEADERSHIP IN QUALITY HP Application Lifecycle Management Application Lifecycle Management Project Planning & Tracking Enterprise Release Management Requirements Management Development Management Quality Management Requirements Definition * Requirements Management Developme nt Integrations Defect Managemen t Secure Developmen t Functional Performanc e Security Foundation Traceability Process Standardization (i.e. Waterfall, Agile) Reporting Extensibility (Open APIs) HP Confidential 6 22 May 2012
HP ALM core Deliver optimal business results through high-quality applications Single, scalable platform that enables a consistent, repeatable process for: Requirement management Test planning, scheduling & execution Release & cycle management Defect management Real time reporting of progress and status Integration with Developer Environments Facilitates distributed collaboration and communication between QA teams, developers and business analysts on a single platform Allows organizations to lower costs by capturing critical defects before they reach production Enables organizations to manage release process and make informed go/no go decisions through real time reports Supporting key stakeholders from across IT & the business Business Analysts QA Teams Development Teams Development Tools Integration BA QA Manager Project\Program Mangers HP ALM Developer s Development eeop e Manager IDEs - Eclipse or VSTS Task or Work Item Management Build & Continuous Integration Source Code Management Project Management Testers PCOE Manager Performanc e Eng HP Confidential 7 22 May 2012
The application lifecycle with HP ALM Microsoft TFS Requirements Subversion VersionOne Mingle Perforce Tasks HP ALM Tests Hudson Bugzilla Mantis JIRA HP Change sets Defects Trac Git Build HP ALI 2.0 how it works Waterfall Surfacing actionable information across various development tools Bringing intelligence to HP ALM and developers IDE Scrum TFS TFS Perforce Hudson Lea n Hybrid HP ALM Jenkins SVN Req Build Test ClearCase Electric Cloud Single Platform HP Confidential 8 22 May 2012
HP AGILE ACCELERATOR V 5.0 Agile Project Planning Define and automate Agile processes Enforce and accelerate process Release / sprint / backlog management User story and task definition Taskboard Agile Dev Mgmt Task Mgmt Effort estimation IDE plug-ins SCM integration HP Agile Accelerator 5.0 Agile Quality Mgmt Task Mgmt Test Execution mgmt Defect\Issue Mgmt Quality progress Continuous Integration Automatic Integration with CI tools Schedule Build Deploy Agile Dashboard and Reporting Burn up/burn down charts Cross-sprint velocity charts Agile development progress dashboard Agile testing progress dashboard On Demand Reporting Generate from Requirements Module Unit Testing Integrate with: Nunit Junit FitNesse HP ALM applications empowered by connectivity QUALITY ENGINEERS ENTERPRISE ARCHITECT Requirement s VP APPS SCRUM MASTER VISIBILITY Task s ALM Tests CONTROL SCCM Build Defect s BIZ ANALYST PRODUCT MANAGER DEVELOPERS (.NET, JAVA, etc.) QA MANAGER HP Confidential 9 22 May 2012
HP ALM - Conclusion Requirements Tasks Tests ALM SCCM Defects PREDICTABILITY PREDICTABILITY Predictable e outcome? Real-time collaboration Measurements and intelligence Build COLLABORATION Heterogeneous environments Unobtrusive usability CHANGE-READINESS Traceability change impact Risk assessment www.hp.com/go/almdev Twitter: @HPSoftwareALM; LEARN MORE Read our blog: Application lifecycle management and application transformation blog Footer 20 goes here HP Confidential 10 22 May 2012
24/05/2012 Microsoft Platform Software Quality with Visual Studio/Team Foundation Server (TFS) Jan Willem van Buuren janwvb@microsoft.com Gerard van der Pol Gevdpol@microsoft.com Goal of this overview Quickly update you on Microsoft Test Quickly update you on Microsoft Test and Platform Solution 1
24/05/2012 Challenges to Software Quality Challenges to Development 2
24/05/2012 Evolution of people and contexts Trustworthy Transparency bridges the team PM Devs DB Test Arch PM Devs DB Test Arch 6 3
24/05/2012 Testing Across the Lifecycle An integrated offering optimized to discover issues early and streamline the flow actionable information Manual Testing Virtualized Labs. The majority of testing is done here no more, no repro - Actionable feedback - Fast forward for manual testing 70% Testing Here Test Management A 360 degree view of relationships and progress ensures you are ready to ship. - Transparency across all roles - Streamlined flow of feedback Dramatically improving the build, deploy test workflow - Test from an on-demand, known state - Snapshot complex environments Developer Test Performance & Load. As code is developed automate critical tests - Unit testing, Code Coverage, Coded UI Testing - Test impact analysis, Gated Check-ins Find problems early lowering the impact of design flaws - Validate design decisions - Simulate production load 7 4
24/05/2012 Demo Workflow 1. Requirements and Test Case creation 2. Test Execution, Defect Registration 3. Defect Management and Reporting Scenarios & Information 1. Eliminate bugs: http://www.microsoft.com/visualstudio/enus/scenarios/eliminate-bugs 2. Manual Testing: http://www.microsoft.com/visualstudio/enus/scenarios/manual-testing 3 Virtual Labmanagement: 3. Virtual Labmanagement: http://www.microsoft.com/visualstudio/enus/scenarios/virtual-lab-management 5
24/05/2012 Scenarios & Information cont d 1. Building the Business Case http://go.microsoft.com/?linkid=9776094 2. Test Release Management http://vsartestreleaseguide.codeplex.com/ 3. Planning, set up and configuring Test Labs http://vsarlabman.codeplex.com/ 6