Test Automation with SAP Solution Manager 7.1 and HP QTP ALM Solution Management, AGS, SAP AG September 2012
Motivation and disadvantages of manual testing
Change is critical to Business Innovation and impacts your SAP-centric Solution Business Drivers Compliance Drivers Technology Drivers Changed business processes M & A and reorganizations New products, vendors Governance Risk management Compliance Examples: SOX, SEC, FDA, Basel 2 Maintenance New functionality Upgrades Global rollouts these change events impact the life cycle of enterprise solutions Effort Discrete Change Events Ongoing Change Events New Implemention New Processes Consolidation Upgrades Custom Development Support Pack Time 2012 SAP AG. All rights reserved. 3
Customer Pain Points Type of Software Change Maintenance Stream DEV TST PRD Innovation / Release Stream DEV TST PRD Customer pain points related to regression tests after software changes 1 2 3 4 Identification of Test Scope after software changes Business Process Experts not available for recurring manual tests Time window not sufficient to test all mission-critical business processes manually Test Automation Tools difficult to use and not integrated with business processes 2012 SAP AG. All rights reserved. 4
Manual Testing Disadvantages of manual testing compared to automated testing Test coverage within tight timelines Lack of time to execute regression tests may potentially compromise Performance & Reliability Overcompensating scope of testing may result in more testing than may be really required and project delays Defects in Production Systems Insufficient test coverage leads to a higher amount of defects not found before cut-over of changes from test to production landscape Testing accuracy due to not being able to test all variants Costs High costs for manual testers involved in recurring regression tests High costs to fix errors in production landscape Finding errors late in the development process could delay delivery Complexity Complexity increasing with added business processes and modules implemented Manual testing cannot keep pace with expansion of applications 2012 SAP AG. All rights reserved. 5
The SAP Offering
New SAP Offering for Test Automation Offering SAP Solution Manager 7.1 HP Quick Test Professional 11 What s new? Test Automation Framework to manage and integrate automated test scripts like HP QTP, test data, system under test, etc. HP QTP with extended functionality for test data and test system handling for automated tests of SAP and non-sap applications 2 Licenses of HP QTP 2 licenses of HP QTP for all SAP customers with SAP Enterprise Support, PSLE or Max Attention contract Access: https:/service.sap.com/testing New license check starting September 2012 see SAP Note 1745282 Support SAP customers to move from manual to automated regression tests in a convinient, reliable and cost efficient fashion for SAP and non-sap applications. 2012 SAP AG. All rights reserved. 7
UI Technologies used in SAP-centric Business Processes Goal Provide test automation for all typical business processes used by SAP customers including SAP and non-sap applications. HP QTP supports the following Business Scenarios / UI technologies*: SAP vs. non-sap Business Process Example UI Technologies 100 % SAP SAP CRM, SAP ERP, SAP Portal SAPGui, Web-Dynpro ABAP, BSP,... SAP-centric SAP CRM, SAP ERP + partner product for price determination SAPGui, Web-Dynpro ABAP, BSP, html,.net, JavaScript,... Non-SAP Partner application or non-sap application for HR processes Html,.Net, JavaScript,... (*) see HP website for a comlete list of supported UI technologies 2012 SAP AG. All rights reserved. 8
Integrated solution from SAP Solution Manager 7.1 and HP QTP 11 for test automation
Test Management Capabilities of test option 1 with SAP Solution Manager 7.1 SP07 Business Blueprint Change Impact Analysis Test Planning Test System Setup Test Execution and Reporting Change Deployment SAP Solution Manager 7.1 Test Case Assignment Business Blueprint Test Scope Optimization Test Planning WoC Test Management Test Plan generation Tester assignment Test Execution WoC Test Management Manual Tests Automated Tests Test Status Reporting WoC Test Managment Test Workbench BW Reporting Partner Logs and Reports Business Process Change Analyzer Test Data Provisioning SAP TDMS (BPCA) Test Automation Framework Test script creation Test system assignment Test data assignment CBTA ( Component based Test Automation ) ecatt START* HP QTP other 3rd party test automation tools * planned capability START (SAP Standard Regression Tests) 2012 SAP AG. All rights reserved. This is the current state of planning and may be changed by SAP at any time. 10
Test Automation Framework in SAP Solution Manager 7.1 Test Automation Framework Non-SAP Test Design Test Execution Test Result Analysis Accelerated Repair Seamless integration between SAP Solution Manager and test tools from SAP and Partners Start of automated tests from Workcenter Test Management Test Manager can view test results from manual and automated tests in Workflow between Tester and Test Engineer to trigger test case repair Test Data Container (TDC) provide test data for test script parameters Central management of System under Tests Ad-hoc start or scheduler for unattended execution Integrated test execution logs from partner tools one environment Status and progress resports Integrated partner reports Rich environment for Test Engineer to analyze problems and perform repair activities 2012 SAP AG. All rights reserved. 11
Test Automation Framework in SAP Solution Manager 7.1 Automated tests assigned to process steps in Business Blueprint Test Configuration Business Process Test Script Test Data System under Test CBTA, ecatt Order Type Customer Product OR C1000 P-100 HP QTP OR C2000 P-200 other ISV test automation tools Test Data Container Component Based Test Automation (CBTA) is shipped with SAP Solution Manager 7.1 SP07 Customers with SAP Enterprise Support contract can download 2 HP QTP licenses from SMP (https:/service.sap.com/testing) Test Automation Framework provides 2 interfaces to integrate ISV test automation tools. SAP ICC offers certification services SAP customers have a choice of test automation tools integrated with SAP Solution Manager 7.1 through the Test Automation Framework 2012 SAP AG. All rights reserved. 12
Test Automation Framework in SAP Solution Manager 7.1 Steps to create automated test script using HP QTP SAP Solution Manager HP QTP Test Configuration Test Script Test Data System Data Test System 1 Start of HP QTP recorder 4 Test Script with Parameters stored in SAP Solution Manager Non SAP 3 Automatic parameter creation for input fields of the business transaction 2 Test script recording during business process execution Convenient test script creation through seamless integration between SAP Solution Manager and partner test automation tools 2012 SAP AG. All rights reserved. 13
Test Automation Framework in SAP Solution Manager 7.1 Test execution Tester Worklist in Workcenter Test Management 5 Test results and logs Test Script HP QTP 1 User starts test execution Test Configuration Test Script Test Data System Data 3 Test execution: handover of Test Script + Test Data + SUT info 4 Logon and automated business process execuction System under Test 2 Test data selection Non SAP TDC Test Data Container (TDC) 2012 SAP AG. All rights reserved. 14
Test Automation Framework in SAP Solution Manager 7.1 Test data planning 1 Test Data Container (TDC): Data Structure 2 TDC: test data planning test data entry test data upload How: create TDC parameter for all input fields of your business process used in test script Who: Test Engineer Who: Business Analysts Use: Test data stored in a TDC can be consumed by multiple Test Configurations. Test Data Container(s) act as central repository for your test data. Customer benefit: test data changes can be done in one central location leading to a significant lower maintenance effort and faster availability of test data 2012 SAP AG. All rights reserved. 15
Test Automation Framework in SAP Solution Manager 7.1 Test data assignment to automated tests Test Data Assignment Wizard Step-by-step guidance to find and assign test data for automated regression tests Features Comprehensive search functions to find suitable Test Data Container by multiple dimensions System-supported parameter mapping between TDC and Test Configuration Test data selection from TDC for use in Test Configuration Availability: SAP Solution Manager 7.1 SP07 Business Analysts and Test Engineers have got a convenient way to assign test data to automated regression tests 2012 SAP AG. All rights reserved. 16
Test Automation Framework Customer Benefits Test Coverage More business processes can be tested in a testing cycle Defects are caught earlier in test system before they move to production system Flexibility Customers can jump-start their test automation project with 2 licenses of HP QTP All major vendors providing test automation tools are integrated via certifiable SAP interfaces Costs Save cost by engaging less manual testers Fast Return on Investments Accelerated Approach Workflow and analysis functions speed of the identification and repair of damaged test case Central repair environment for Test Engineer 2012 SAP AG. All rights reserved. 17
Information on how to download HP QTP
SAP Service Marketplace Place to find Information about Test Management and the HP QTP offering Access: https:/service.sap.com/testing (page 1) Please follow the link to find out more about the HP QTP offering 2012 SAP AG. All rights reserved. 19
SAP Service Marketplace Place to find Information about Test Management and the HP QTP offering Access: https:/service.sap.com/testing Page 2 Please follow the link to find out whether your company is entitled 2012 SAP AG. All rights reserved. 20
SAP Service Marketplace Place to find Information about Test Management and the HP QTP offering Access: https:/service.sap.com/testing Page 3 top part Please select your country, download and sign the contract and send back to your local SAP office (at no additional fee) 2012 SAP AG. All rights reserved. 21
SAP Service Marketplace Place to find Information about Test Management and the HP QTP offering Access: https:/service.sap.com/testing Page 3 bottom part HP QTP is available for download after your contract was processed by SAP Please setup the license check for your 2 users which is valid from September 2012 as described in SAP Note 1745282 2012 SAP AG. All rights reserved. 22
License Check for HP QTP starting September 2012
License Check one-time Preparation HP QTP 11 Client-PC User 1+2 install HP QTP 11 plus 4 patches on their client PC plus new patch SAPQTP_00049 for the new license check Alternatively the customer can install HP QTP 11 in a virtualization environment such as Citrix SAP SolMan 7.1 One-time Preparation SAP Solution Manager 7.1 SP06: no SAP Note required, but IMG activities (description see SAP Note 1745282) SAP Solution Manager 7.1 SP01-SP05: install SAP Note 1751112 Customizing (SPRO): register 1-2 Client (Windows) user ID as described in the IMG activity and update the required authorizations 2012 SAP AG. All rights reserved. 24
More Information
Test Management Overview and Detail Presentations and Offline Demos SAP Service Marketplace: http://service.sap.com/testing Information Overview Presentations Detail Presentations Offline Demos More Information: http://service.sap.com/testing --> Additional Information 2012 SAP AG. All rights reserved. 26
More Information for SAP Customers and Partners 1. How To Guide Test Automation Framework 2. How To Guide HP QTP 3. Best Practice Regression Testing of SAPcentric Business Processes 4. Detailled Presentation 5. Offline Demos 6. Download and Activation Key for HP QTP Available via SAP Service Marketplace http://service.sap.com/testing Additional Information Test Management 2012 SAP AG. All rights reserved. 27
Best Practices / Next Practice: Regression Testing of SAP-centric Business Processes Leverage the experience of other SAP customers and find out what works best for them. Content Regresstion tests as integral part of the software change process 9 Recommendations for regression testing Customer use cases from Colgate-Palmolive, Ferrero, Sara Lee, ConAgra Foods, Soka-Bau Best Practice available at SDN: http://www.sdn.sap.com/irj/sdn/alm-test-management SMP: http://service.sap.com/testing More Information Test Management 2012 SAP AG. All rights reserved. 28
Best Practices: Regression testing of SAP-centric Business Processes 9 Recommendations Business Blueprint Test System 1 Lean documentation of important business processes 2 Setup of lean test systems Creation of Regression Tests Change Impact Analysis 3 Test automation for critical business processes 4 Comprehensive test data for automated regression tests 5 Provisioning of easy to use manual tests 6 Change Impact Analysis: Risk-based test scope identification Test Execution 7 8 Unattended ( lights out ) execution of automated regression tests Manual test execution with guidance for business users Governance 9 Management of the change process 2012 SAP AG. All rights reserved. 29
Test Management Information Sources Infos, Presentations, Demos http://service.sap.com/testing «CLOSED LOOP» SAP AGS Whitepaper Test Management http://service.sap.com/supportstandards SAP Enterprise Support Testing SAP Solutions ALM Infos, Presentations, Demos http://service.sap.com/alm Classroom Training E2E220 Professional Services www.sap.com/services/testing Remote Service Expert Guided Implementation http://service.sap.com/alm-services 2012 SAP AG. All rights reserved. 30
2012 SAP AG. All rights reserved. No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iseries, pseries, xseries, zseries, eserver, z/vm, z/os, i5/os, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle and Java are registered trademarks of Oracle and/or its affiliates. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C, World Wide Web Consortium, Massachusetts Institute of Technology. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company. Sybase and Adaptive Server, ianywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG. This presentation and SAP s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is 2012 SAP AG. All rights reserved. provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement 31