E2E Test Management Test Management Overview

E2E Test Management Test Management Overview ALM Solution Management, Active Global Support (AGS), SAP AG

Agenda SAP Approach for Functional and Load Testing Lean Documentation of Business Processes Change Impact Analysis Capabilities of Test Option 1 Capabilities of Test Option 2 Capabilities of Test Option 3 Setup of lean Test Systems Load Testing Links and Contacts 2011 SAP AG. All rights reserved. 2

Test Management SAP Approach for Functional and Load Testing

E2E Test Management End-to-End Testing of SAP-centric Solutions Test Process Type of Change Test Scope Identification New SAP Solution Business Blueprint Test Planning Test System Setup Test Execution Change Deployment SAP Solution Update Change Impact Analysis Customer Pain Points 1. 1 Tests in heterogeneous system landscapes 2. 2 SAP Solution updates affecting missioncritical business processes 3. 3 Test system setup and test data management 4. 4 Effort for creation and maintenance of automated tests SAP Strategy for E2E Integration Testing SAP Solution Manager acts as central hub to manage SAP change events and E2E Integration Testing Superior functionality from risk-based test planning, functional and regression testing to integration validation Interfaces to Partner Test Suites 2011 SAP AG. All rights reserved. 4

Q-Gate: Requirements to Design Q-Gate: Design to Build Q-Gate: Build to Test Q-Gate: Test to Deploy E2E Test Management Phases from Requirements to Deploy Q Q Q Q Requirements Design Build Test Deploy Collaboration and Project Controlling Extend Solution Functional and technical blueprint Custom Development Partner solutions Unit Tests Functional Tests Scenario Tests Regression Tests Support Going- Live Session Requirements from business departments Functional and technical feasibility Initial Integration Tests User Acceptance Tests Verification of production system Set-up of technical infrastructure Test Planning Test Scope Identification Test Requirements Test System Setup Consistency Checks Performance Tests Sign-off by business process owners Handover to business Transports in Cycles Final Transport 2011 SAP AG. All rights reserved. 5

E2E Test Management Test Process embedded in the SAP Application Lifecycle Type of Change Test Scope Identification New SAP Solution Business Blueprint Implementation of new SAP Solution Business Blueprint Design Solution Configuration Test Planning System Setup Test Execution Deploy changes to Production SAP Solution Update Change Impact Analysis SAP Support Packages SAP Legal Change Packages SAP Enhancement Packages Customizing changes Custom Code Interface changes Business Blueprint Update Identification of Business Processes affected by SAP Solution Updates Recommendation of business processes for regression tests Development of Test Cases Test Plan setup Compilation of Test Packages Assigment of Testers Setup of Test System Creation of Test Data Manual tests Automated tests Integration Validation Incident Management Performance tests Test status and progress reporting Test sign-off Deployment of changes through transports from Test to Production system SAP Support packages, Legal Change Packages, Enhancement Packages 2011 SAP AG. All rights reserved. 6

E2E Test Management Options for SAP Customers based on SAP Solution Manager 7.0 New SAP Solution Business Blueprint Test Planning Test System Setup Test Execution Change Deployment SAP Solution Update Change Impact Analysis Test Option 1 Test Scope Identification Test Planning Manual Tests Automated Tests UI + Backend Tests SAP Solution Manager Business Blueprint SAP Solution Manager Business Process Change Analyzer SAP Solution Manager Test Workbench SAP TDMS SAP Solution Manager Test Workbench SAP Solution Manager ecatt ecatt UI based Tests HP QTP other 3rd party Test Option 2 SAP Solution Manager Business Blueprint SAP Solution Manager Business Process Change Analyzer SAP TDMS SAP Quality Center by HP SAP Quality Center by HP + QTP SAP TAO 2011 SAP AG. All rights reserved. 7

E2E Test Management Options for SAP Customers based on SAP Solution Manager 7.1 New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Option 1 Test Planning Test System Setup Test Execution Change Deployment Business Blueprint SAP Solution Manager Test Workbench Work Center TM SAP Solution Manager Test Automation Framework HP QTP and other 3rd party tools Test Option 2 BPCA SAP Quality Center by HP SAP TAO Test Option 3 Quality Manager, ReqPro, RFT,... 2011 SAP AG. All rights reserved. 8

Test Management Lean Documentation of Business Processes

Lean Solution Documentation as prerequisite for Test Management System Landscape Documentation Business Process Documentation SAP ERP DEV SAP CRM DEV TST PRD TST Connectivity PRD Connectivity Single source of truth non-sap Lean documentation of process steps Business Requirements Interface and Custom Code documentation ARIS integration Test Case assignment (Test Option 1) Trace results (TBOM) assignment for BPCA Setup SAP Solution Manager Setup Wizard - guided procedure with help sections and log files for semi-automatic and fast setup Setup SAP Business Suite content: BPR Re-documentation with SoDocA Manual documentation Utility to upload existing documentation 2011 SAP AG. All rights reserved. 10

Proof of Concept results from SAP Customer in EMEA Project steps and required effort SAP Solution Manager Upgrade Update SAP Solution Manager 7.0 SP19 to SP20 SAP Solman agent update in managed system SAP SolMan Setup Wizard used 5.5 hours No additional effort SAP Solution Documentation Business process definition in MS Excel Adjustment of existing process structure to 3 level hierarchy in SAP Solution Manager Business process modeling of MM-Procurement processes in ARIS and upload into SAP Solution Manager (for 5 business processes incl.steps) Already available 30 minutes 2 hours for 5 business processes SAP Business Process Change Analyzer (BPCA) BPCA preparation: trace (TBOM) for each business process via manual process execution BPCA analysis for 5 software changes including customizing and program changes 5h for 14 processes* 15 min for each analysis * 14 variants of the 5 procurement processes 2011 SAP AG. All rights reserved. 11

Test Management Change Impact Analysis using BPCA of SAP Solution Manager

Business Process Change Analyzer Approach SAP Solution updates occur frequently SAP triggered: Support Packages, Enhancement Packages Customer triggered: Customizing changes, Custom code development Approach Customer Pain Point Which business processes are affected by planned changes? SAP Solution Update Change Impact Analysis Test Planning Test Execution Identification of business processes affected by change Risk-based Test Recommendation Test Case review and creation of missing test cases Test Plan generation Regression Tests Manual Tests Automated Tests 2011 SAP AG. All rights reserved. 14

Business Process Change Analyzer Preparation Order to Cash Sales Order Delivery Goods Issue Billing Execution of mission-critical business processes by Business User Trace Result: Technical Bill of Material (TBOM) Code: Function modules, UI: Dynpro 1000, Tables: Customizing, Master Data Change Impact Analysis Which critical Business Processes will be affected by planned changes? Risk-based Test Scope Can I get a recommendation for regression tests? Planned Changes Customizing changes Custom code Business Function activation SP and EhP deployment Business Process Change Analyzer Business Process Change Analyzer Order to Cash Sales Order code change Delivery Goods Issue UI change Billing Procure to Pay Create PO customizing change Identification of business processes impacted by software changes Support decision making whether planned change shall be executed Automatic test plan generation (Test Option 1) 2011 SAP AG. All rights reserved. 15

Business Process Change Analyzer SAP Solution Manager 7.0 SP18 BPCA Use Case 1: Customizing Changes* Example: Create Sales Order input field Purchase Order: optional mandatory Customizing Changes Transport DEV TST PRD Change Impact Analysis Identification of impacted business processes Test Recommendation Generation of Test Plan (*) Note: BPCA of SAP SolMan 7.1 SP01: additional precision through tracing of key fields of SAP customizing tables Example 2011 SAP AG. All rights reserved. 16

Business Process Change Analyzer SAP Solution Manager 7.0 SP18 BPCA Use Case 2: Custom Code Developments Example: Extention of existing SAP screen with custom required field Custom Code Developments Transport DEV TST PRD Change Impact Analysis Identification of impacted business processes Test Recommendation Generation of Test Plan Example 2011 SAP AG. All rights reserved. 17

Business Process Change Analyzer SAP Solution Manager 7.0 SP23 BPCA Use Case 3: Planned activation of inactive Business Functions Example: inactive Enterprise Business Function Advanced Order Processing and Billing deployed EhP DEV TST PRD planned Bus.Function activation Change Impact Analysis Identification of impacted business processes before BF activation Test Recommendation Generation of Test Plan End-user training plan Example 2011 SAP AG. All rights reserved. 18

Business Process Change Analyzer SAP Solution Manager 7.1 SP01 BPCA Use Case 4: SP / EhP Deployment and Test Scope Optimization Example: Deployment of EhP 4 for SAP ERP SAP Support Package / Enhancement Package Deployment SP / EhP DEV TST PRD Change Impact Analysis Identification of impacted business processes Test Recommendation Generation of Test Plan with risk-based test scope Example 2011 SAP AG. All rights reserved. 19

Business Process Change Analyzer Test Scope Optimization for SAP Support Packages and EhPs Key Message Optimization, i.e. identification of test cases based on # changed SAP objects and test effort Approach: changed SAP objects should be tested at least once Not all affected process steps have to be included in the regression test 100% Test coverage reached 96% Test coverage selected by Change Manager Ranking of impacted Process Steps 2011 SAP AG. All rights reserved. 20

SOKA-BAU & SOKA IT Gains Significant Time and Test Effort Reduction with SAP Solution Manager QUICK FACTS SOKA BAU & SOKA IT Headquarters: Wiesbaden, Germany Industry: Insurance Revenue: 4.8 billion Employees: 1,200 Web site: www.soka-bau.de www.soka-it.de SAP solution and services: SAP ERP, SAP BW, SAP Solution Manager, SAP Consulting We can significantly reduce our test efforts which affect our SAP solution operations by using a risk based test scope identification provided by the Business Process Change Analyzer of SAP Solution Manager. Roland Krüger Manager SAP Customer CoE SOKA-IT Challenges and Opportunities Implement extension of proven test management capabilities of SAP Solution Managers by using functional enhancements of Enhancement Package 1 Objectives Optimize test planning through Business Process Change Analyzer (BPCA) Improve test execution via deployment of test sequence functionality Increase user and process efficiency though html-based work center for test and incident management Raise quality of SAP solution documentation though deployment of Solution Documentation Assistant (SoDocA) Implementation Highlights Email notifications for all status changes of test cases & central access and administration for all test relevant information Set-up of new wizard for SAP Solution Manager configuration within three hours Why SAP Services End-to-end functionality and excellent integration into existing SAP solution landscape Possibility to leverage and re-use of already achieved results Key Benefits Risk-based test scope identification leading to considerable reduction of test efforts Significant time savings within test preparation Streamlined communication during test execution Role-based approach for all test activities supported by new customer work-center 2011 SAP AG. All rights reserved. 21

Business Process Change Analyzer Customer Benefits Precise insight Identification of critical business processes affected by planned change events Improved handling of change events Support for customer s change committee to decide on SPs, EhPs or Custom triggered changes for SAP production systems Risk-based Test Planning Recommendation for subsequent regression tests 2011 SAP AG. All rights reserved. 22

Test Option 1 SAP Solution Manager test management and integrated partner and 3rd party products

E2E Test Management Capabilities of Test Option 1 with SAP Solution Manager 7.1 New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning Test System Setup Test Execution Change Deployment SAP Solution Manager 7.1 Test Case Setup Business Blueprint Test Scope Identification Business Process Change Analyzer (BPCA) Test Planning Test Workbench Test Data Provisioning SAP TDMS Test Execution Test Workbench - manual Tests - automated Tests Test Status Reporting Test Workbench Work Center BW Reporting Integrated Partner Reporting Test Automation Framework Test case design Test system assignment Test data assignment ecatt HP QTP Certified Interface other 3rd party test automation tools GOAL with SAP Solution Manager 7.1: Extended functionality of BPCA for risk-based test scope identification Improved usability for manual testers Smooth integration of 3rd party test automation tools with SAP Solution Manager 2011 SAP AG. All rights reserved. 24

Manual Test Execution with SAP Solution Manager 7.0 and 7.1 Tester Worklist Test Script Start of Business Transaction Test Status and Test result documentation Incident 2011 SAP AG. All rights reserved. 25

Manual Test Execution with SAP Solution Manager 7.1 Tester Worklist: end-user environment to view and start test execution Test Packages assigned to Tester Test Cases ready for execution 2011 SAP AG. All rights reserved. 26

Manual Test Execution with SAP Solution Manager 7.1 Start of business transaction in assigned test system Copy of test script to record test results Test Status Actual test effort recorded from execution Space to upload results, e.g. screenshots Change history Additional documents for entire Test Package to inform users about environment and test data Integrated incident management (Service Desk, SAP CRM 7.0) 2011 SAP AG. All rights reserved. 27

SAP Customer: Ferrero Project Setup using SAP Solution Manager capabilities (1) Project Setup Project setup Setup of implementation project and assignment of systems with their roles like DEV, TST, PRD Business Blueprint Business Blueprint The structure of the project is mapped in the Solution Manger on detailed level including transactions Solution Configuration Solution Documentation Customizing All relevant customizing object are tracked in the Solution Manager on the specific level of the project and can be directly accessed from it by the link to the IMG (Customizing). Documentation SAP Solution Manager is used as the repository for all the project documentation (business blue print, technical specifications, test cases). The documentation is uploaded on the specific process level. An approval process for the documentation was implemented within the Solution Manager. 2011 SAP AG. All rights reserved. 28

SAP Customer: Ferrero Test Planning using SAP Solution Manager capabilities (2) Test Case definition Test Case setup Starting from the business process the user defines test cases and assigns them to the business process Test Plan & Test Package generation Test plan and test package creation Starting from the defined structure it is possible to generate a test plan Multiple test packages can be derived from the test plan Tester assignment Test assignment to user It is possible to assign tests to the users and track the results 2011 SAP AG. All rights reserved. 29

SAP Customer: Ferrero Test Execution using SAP Solution Manager capabilities (3) Manual Test Case execution Automated Test Case execution Incident Management Manual test case execution It is possible to manage the collaboration between users and development team during the test (create internal messages, log tests, review the testing status) Automated test case execution ecatt has been used as tool to automate the testing process and to create test data for user acceptance test Test Status Reporting Status Info System enables Test Coordinator to view the progress of all test packages and test plan Drilldown to tester notes and incidents allows tracking of critical tests Test cases, test packages and test plan can locked 2011 SAP AG. All rights reserved. 30

Ferrero Using the SAP Solution Manager is an excellent way of covering the life-cycle of a solution. It enables us to control every step from the design to the realization to the IT operation of the system, and guaranteeing a full tracking and a very effective introduction of the system. Were obtained substantial benefits with this adoption, reducing TCO and above all we were successful to manage complex projects and leading edge operations" Martin Flegenheimer IT Director Ferrero Germany 2011 SAP AG. All rights reserved. 31

Test Automation Framework provided with SAP Solution Manager 7.1 SAP Solution Manager 7.1 Test Case Setup Test Planning Test Execution Test Status Reporting Business Blueprint Test Scope Identification Business Process Change Analyzer (BPCA) Test Workbench Test Data Provisioning SAP TDMS Test Workbench - manual Tests - automated Tests Test Workbench Work Center BW Reporting Integrated Partner Reporting Test Automation Framework Test case design Test system assignment Test data assignment ecatt HP QTP Certified Interface other 3rd party test automation tools FUNCTIONALITY 1. Integration of design time of 3rd party test tool through certified interfaces, test data planning and assignment of System under Test 2. Scheduling of execution of unattended automated tests also for remote locations 3. Integration of status and progress reporting between SAP Solution Manager and 3rd party tools 4. Change Impact Analysis and Workflow to trigger repair activities for damaged test cases 2011 SAP AG. All rights reserved. 32

Test Automation Framework (1) Definition of automated Tests and assignment to Processes Seamless creation of automated test cases from SAP Solution Manager business process hierarchy with 3rd party test automation application. SAP Solution Manager provides Test Data and System Landscape to auto Test Case SAP provides 2 interfaces to link SAP Solution Manager (Test Management) and 3rd Party Test Automation applications. 3rd party vendors can receive an SAP certification. Test Configuration Business Processes Test Script Test Data System Data ecatt QTP other 3rd party test automation tools 2011 SAP AG. All rights reserved. 33

Test Automation Framework System Data Container - Assignment of Systems under Test SAP Solution Manager Test Configuration Test Script Test Data System Data System Landscape Documentation Solution System Role Test execuction SAP ERP DEV yes TST yes PRD not allowed SAP CRM DEV yes TST yes PRD not allowed......... Handover of system access information (RFC,...) Client (Laptop / Desktop) Execution of Test Scripts No hard coded system information Customer Test System Landscape (SAP ERP, ) 2011 SAP AG. All rights reserved. 34

Test Automation Framework Parameterization of test scripts and SAP Test Data Container SAP Test Configuration Test Script 1 New test script 3rd party test script 3 Test Data Test Data variant generated by script parameters Test Data Container (TDC) Test Data Container 4 Wizard to map test data from TDC to Test Configuration Order Type Customer Product OR C1000 P-100 OR C2000 P-200 2 Replacement of static value (customer C1000 ) with parameter (I_SOLD_TO_PARTY) 2011 SAP AG. All rights reserved. 35

Test Automation Framework (2) Scheduling of unattended automated tests Scheduling Unattended Test Execution Analysis Scheduling of unattended automated tests in local or remote locations Test Engineer - Location 1 Unattended execution of automated test on Test PCs Notification about test execution status and subsequent failure analysis Business Analysist Test PCs - Location 2 Test result analysis Test System Landscape (SAP ERP, SAP CRM, ) 2011 SAP AG. All rights reserved. 36

Test Automation Framework (3) Integrated Test Status and Progress Reporting Multiple reporting options for Test Coordinators, Test Engineers, Testers and Project Manager Management of Test Plans: Completeness and gap reports for included test cases Test status and trend reports to monitor progress of test activities and problem solving Drilldown from test status reports to 3rd party test tool logs and dashboards 2011 SAP AG. All rights reserved. 37

Test Automation Framework (4) Accelerated repair of damaged tests Software changes of SAP Solutions can damage automated test cases fast repair required Workflow to request repair activities (from test executor to Test Engineer) Environment for test engineer to access the log, re-run the test and display/edit the test script Change Impact Analysis (SAP Solution Manager BPCA) integrated into test case maintenance 2011 SAP AG. All rights reserved. 38

Test Automation Framework Workflow & Analysis for accelerated repair of damaged tests Tester 1. Requests repair activity after failed test case execution Test Case Error Message Test Engineer 2. Receives message in Damaged Test Case Worklist 3. Analyses and repairs the test case Central environment for analysis and repair 5. Performs Re-Test 6. Confirms successful repair Notification for Re-Test Complete information on execution context View logs 4. Requests Re-Testing Run test case Edit test script Run change analysis 2011 SAP AG. All rights reserved. 39

Test Automation Framework with SAP Solution Manager 7.1 using Test Option 1 Customer Benefits Test Coverage More business processes can be tested in a testing cycle Defects are caught earlier in test system before they move to production system Flexibility Customers can choose their test automation tool of choice All major vendors support the certified interfaces with SAP Solution Manager Costs Save cost by engaging less manual testers Fast Return on Investments Accelerated Approach Workflow and analysis functions speed of the identification and repair of damaged test case 2011 SAP AG. All rights reserved. 40

Test Option 2 SAP Solution Manager, Adapter, SAP Quality Center by HP, SAP TAO

E2E Test Management Capabilities of Test Option 2 with SAP Solution Manager 7.0 and 7.1 New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning Test System Setup Test Execution Change Deployment Test Option 2 Solution Manager Business Blueprint Setup of business process hierarchy Business requirements Solution Manager Business Process Change Analyzer Identification of business processes affected by code / customizing changes Quality Center Test requirements Test planning SAP TDMS Setup of lean test systems Quality Center Test Lab Defect management SAP TAO Accelerated test case generation and maintenance Quality Center Business Process Tests Quick Test Pro LoadRunner Performance Tests 2011 SAP AG. All rights reserved. 42

SAP Solution Manager SAP Solution Manager Adapter for SAP Quality Center by HP Goal Exchange of business processes, business requirements, test assets, incidents and test results between SAP Solution Manager and Quality Center SAP Solution Manager Adapter* SAP Quality Center by HP Outbound Business Blueprint Bus. Requirements Test Objects Documents Incidents / Defects Inbound Test Results Incidents / Defects * additional license required 2011 SAP AG. All rights reserved. 43

Test Management SAP Quality Center by HP Test Plan Module Goal Test Planning and definition of manual Test Cases Scope Enables central planning, development and management of manual and automated test cases Bidirectional traceability allows tracking requirement and defect coverage Benefits Centralized management of manual and automated test assets Ensure all business critical requirements are planned for testing * additional license required 2011 SAP AG. All rights reserved. 44

Test Management SAP Quality Center by HP Quick Test Professional Goal Test Automation for SAP and non-sap Applications Scope Definition of automated test cases Support for SAP Applications covering SAPGUI and html-based user-interfaces Support of non-sap applications, thus allowing to create automated test cases for heterogeneous business processes Record and playback, scripting and key-word approach to create test cases Benefits Very mature functionality for test automation of SAP and non-sap applications * additional license required 2011 SAP AG. All rights reserved. 45

Test Management SAP Quality Center by HP Test Lab Module Goal Test Execution of manual and automated tests Scope Definition and scheduling of test cycles and test sets Guidance for manual testers to execute manual test steps Scheduling of automated tests Integration with defect module Benefits High usability for non-technical users Guidance for endusers on how to perform manual test Comprehensive functionality to document test results and defects * additional license required 2011 SAP AG. All rights reserved. 46

Test Management SAP Quality Center by HP Defect Management Module Goal Defect creation after manual or automated test execution Scope Track defects from requirements through all stages of test management and execution Alert key stakeholders through automated emails Benefits Mitigate risks by finding and resolving defects earlier in the application lifecycle Prioritize defects based on impact to the business * additional license required 2011 SAP AG. All rights reserved. 47

Test Management SAP Quality Center by HP Dashboards and Reporting Goal Reporting of test status and progress suitable for different types of users Scope Custom and role-based reports Coverage graphs with drilldown Benefits Comprehensive and holistic overview about test progress Out of the box reports Various reporting types usable for a wide range of users from manual testers to senior management * additional license required 2011 SAP AG. All rights reserved. 48

Manual Testing Disadvantages of Manual Testing compared to Test Automation Test coverage within tight Test timeline Engineer Lack of time to execute regression tests for critical business processes leads to insufficient test coverage Acceptance tests require more time and manual testers due to number of errors not fixed beforehand Defects in Production Test Systems Engineer Insufficient test coverage leads to a higher amount of defects not found before cut-over of changes from test to production landscape Costs Test Engineer High costs for manual testers involved in recurring regression tests High costs to fix errors in production landscape SAP TAO along with SAP Quality Center by HP helps customers to create automated test cases fast ROI within 2-3 test cycles 2011 SAP AG. All rights reserved. 49

Approaches for Test Automation 3 generations of test tools 1. Allows parameterization 2. Can run unattended 3. Lot of effort to record a script 4. Many redundancies 5. Maintenance Overhead 6. Skilled Quality Engineers required 1. Modularization of test cases leading to lesser maintenance 2. Reduced development time of test cases 3. It is still necessary to record test cases 4. Maintenance at script level still required 5. Skilled Quality Engineers required 1. Library or test components for SAP applications 2. Automatically creates test components 3. Eliminates record/replay activities 4. Fast and convenient way to create test cases 5. Greatly reduces test case maintenance cost 6. Quick ROI, within 2-3 test cycles 2011 SAP AG. All rights reserved. 50

Test Automation with SAP TAO Mission Approach Execution Changing the testing paradigm from manual testing to Testing by Composition Reducing costs and risks for testing after SAP solution updates Automatic generation of test components for SAP business processes via SAP TAO Semi-automatic composition of automated test cases via SAP TAO and SAP Quality Center Streamlined repair of damaged test cases Initial setup Generate test components Compose automated tests Change event Change Impact Analysis Repair of damaged test cases Test Case Management, Test Planning, Test Execution and Reporting Customer SAP Landscape (SAP ERP, ) Customer Benefits 1. Reduced effort for maintaining automated business process tests 2. Reduced risk due to better testing coverage 3. Increased capacity to absorb /manage change 4. High process efficiency through tight integration with SAP Quality Center and SAP Solution Manager 2011 SAP AG. All rights reserved. 51

Test Automation with SAP TAO Test Case Composition SAP TAO Process Flow Analyzer SAP Quality Center by HP Business Analyst Easy creation of new automated Test Case by Business Analyst via execution of business transaction upload Test Components for each SAPGUI subscreen with parameters for all fields Draft Test Case composed out of Test Components with parameters for all input fields Test Case refinement File with Test Data for each input parameter Flexibilization of automated test case to finalize test case, e.g. additional validation checks Test Engineer Consolidation of automated tests for better performance 2011 SAP AG. All rights reserved. 52

Test Automation with SAP TAO Execution of automated Test Script using Test Data SAP Quality Center Test Script execution Test data file During test execution test data is entered into input fields of the SAP business process SAP Test System Test results Iteration Result # 1 Passed # 2 Passed # 3 Failed 2011 SAP AG. All rights reserved. 53

SAP TAO Change Management Update of damaged Test Cases after SW Change of SAP Solution SAP Business Process SAPGUI based SAP transaction SAP QC Business Components Test components generated by SAP TAO for each screen Test components stored in QC - BPT SAP QC Test Plan Automated test cases composed via SAP TAO-generated test components BC1 BC2 BC3 SAP TAO generated test components SAP TAO composed test cases Test Cases Test Case 1 Test Case 2 Test Case 3 Test Case 4 2011 SAP AG. All rights reserved. 54

SAP TAO Change Management Update of damaged Test Cases after SW Change of SAP Solution SAP Business Process Software Change changed SAP QC Business Components Test components generated by SAP TAO for each screen Test components stored in QC - BPT BC1 BC2 BC3 1 2 Identification of impacted Test Cases Test Engineer or BPCA Regeneration of Business Components SAP QC Test Plan Automated test cases composed via SAP TAO-generated test components Test Case 1 Test Case 2 Test Case 3 Test Case 4 3 Consolidation of Test Cases 4 Execution of updated Test Cases 2011 SAP AG. All rights reserved. 55

Manual vs. Automated Testing by SAP TAO Customer specific ROI calculation Questions to calculate customer-specific ROI for manual vs. SAP TAO based tests # of business processes for regression tests? Expected percentage of test automation? # of regression test cycles per year? Day rates for internal and external manual tester? # of manual testers internal and external? Costs for disruption and problem fix in PRD Landscape ROI calculation Please contact SAP Professional Services for a customized ROI calculation! 2011 SAP AG. All rights reserved. 57

Test Option 3 SAP Solution Manager, Connector, IBM Rational

Test Option 3 New Quality Management option for SAP and IBM customers Business Blueprint Change Impact Analysis Project Reporting Incident Management SAP Solution Manager Connector for IBM Rational Requirements Management Quality Management Change/Defect Management Functional View Import SAP Solution Manager Business Blueprint into Rational Quality Manager & RequisitePro Update test results into SAP Solution Manager Integrate with SAP Service Desk Customer Benefits Allows customers to combine SAP & IBM best practices & standards Combine SAP Solution Manager life-cycle management capabilities with IBM Rational s integrated governance and quality management capabilities Enables End to end business process testing Aligns enterprise architecture and requirements with SAP-centric Solutions 2011 SAP AG. All rights reserved. 59

Test Management Setup of lean test systems with SAP TDMS

Setup of lean Test Systems SAP Test Data Migration Server (SAP TDMS) Goal Fast creation of lean Test Systems and efficient refreshs of Test Data Capabilities Fast setup of lean test system with reduced set of transactional data Selective setup and refresh of separate clients for development, test and training environments Data extraction based on business objects, organizational units or time slices Scrambling of sensitive data SAP TDMS workbench and Business Process Library for custom specific extraction methods SAP TDMS * additional license required 2011 SAP AG. All rights reserved. 61

Test Management Load Testing with SAP Loadrunner by HP

Load Testing SAP Loadrunner by HP* Goal Load testing for identification of performance bottlenecks Scope Emulates production workload on SAP landscapes Replaces real users with thousands of virtual users Generates accurate, measurable and repeatable load on the system from a single point of control Pinpoints bottlenecks in the system Benefits Avoids performance problems in PRD after go-live * additional license required 2011 SAP AG. All rights reserved. 63

Further Information Links and Contacts

Application Lifecycle Management Information Sources for Test Management Test Management: Infos, Presentations, Demos http://service.sap.com/testing «CLOSED LOOP» SAP AGS Whitepaper Test Management http://service.sap.com/supportstandards SAP Enterprise Support Testing SAP Solutions Professional Services www.sap.com/services/testing ALM Infos, Presentations, Demos http://service.sap.com/alm Classroom Training E2E220 Remote Service Expert Guided Implementation http://service.sap.com/alm-services 2011 SAP AG. All rights reserved. 65

Additional Information Overview and Detail Presentations and Offline Demos SAP Service Marketplace: http://service.sap.com/testing Information Overview Presentations Detail Presentations Offline Demos More Information: http://service.sap.com/testing -> Additional Information 2011 SAP AG. All rights reserved. 66

E2E Integration Testing of SAP Solutions Information and SAP Contacts Information E2E Integration Testing: http://service.sap.com/testing SAP TAO: http://service.sap.com/saptao Application Lifecycle Management: http://service.sap.com/alm SAP Standard for Test Management: http://service.sap.com/supportstandards SAP Solution Manager e-learning material: http://service.sap.com/rkt-solman Regional SAP Contacts Region Product Sales Professional Services North America jonathan.lerner@sap.com jim.bisordi@sap.com Latin America go.nunez@sap.com steve.mann@sap.com EMEA martin.hasselbalch@sap.co m fabio.farhi@sap.com eric.siegeris@sap.com APJ steven.medeiros@sap.com sebastien.aubrey@sap.com 2011 SAP AG. All rights reserved. 67

Thank you Marcus Wefers ALM Solution Management Active Global Support SAP AG Email: marcus.wefers@sap.com

Copyright Copyright 2011 SAP AG. All rights reserved. No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iseries, pseries, xseries, zseries, eserver, z/vm, z/os, i5/os, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C, World Wide Web Consortium, Massachusetts Institute of Technology. Java is a registered trademark of Sun Microsystems, Inc. JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP Business ByDesign, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects S.A. in the United States and in other countries. Business Objects is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. These materials are subject to change without notice. These materials are provided by SAP AG and its affiliated companies ("SAP Group") for informational purposes only, without representation or warranty of any kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP Group products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.