End-to-End Integration Testing of SAP-centric Solutions. ALM Solution Management Active Global Support (AGS) SAP AG

End-to-End Integration Testing of SAP-centric Solutions ALM Solution Management Active Global Support (AGS) SAP AG

Disclaimer This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent. SAP 2009 / Page 2

Agenda 1. Customer Pain Points and SAP Approach 2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples 3.1. Test Option 1 3.2. Test Option 2 4. Additional Test Management Capabilties 5. Summary and further Information SAP 2009 2008 / Page 3

SAP Solution Manager From Awareness to Action SAP has compiled best practices for E2E Solution Operations based on the experience from customer engagements over three decades. SAP is aware of customer pain points. Solution Updates Problem analysis Incident Management Change Management Monitoring Optimize Operate Requirements Application Management Deploy Transparency on Processes & Apps Design Build & Test Software logistics Innovation Management Integration Testing Integration Validation Implementation methodology for E2E Solution Operations: Run SAP. Pain points are addressed by best practices: SAP Standards* for E2E Solution Operations. * SAP Standards for Solution Operations http://service.sap.com/supportstandards SAP Solution Manager provides all capabilities for E2E Solution Operations. Improvements of processes, components and solutions Maintenance of SAP Solutions Root Cause Analysis Incident Management Monitoring of missioncritical processes Requirements Optimize Application Management Operate Deploy Identification of critical business processes Innovation Management Design Build & Test Integration Validation Deployment of solution updates Integration Testing SAP 2009 / Page 4

Changing SAP Solutions Customer pain points* 1 Tests in heterogeneous system landscapes E2E Integration Tests of business processes in system environments interfacing SAP with non-sap solutions 2 Change Impact Analysis Indentification of critical business processes affected by change events such as SAP Support Packages No risk-based test recommendations 3 Test Data Management Test Systems with outdated test data Productive System copy is too expensive and rework intensive Creation of appropriate test data for manual / auto test cases 4 Test Automation Creation of automated test cases is time consuming and expensive to maintain via skilled QA specialists Automated test cases get damaged by change events and need time consuming repair by QA Specialist SAP 2009 / Page 5 (*) Pain point have been collected via customer survey conducted in the US and Europe

Managing Changes is Critical for Business Agility Methodology, Test Process and Test Capabilities Methodology E2E Solution Operations methodology for the ongoing management of end-to-end solutions Run SAP methodology to implement end-to-end solution operations including SAP standards, best practices, roadmap, training, certification, services and tools for E2E solution operations New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning Test Execution Apply Changes to Production Test Process From change events and change impact analysis via test planning and test execution to deployment of changes in production system Test Capabilities SAP Solution Manager SAP Solution Manager acts as central point of access to SAP and 3rd Party test capabilities as well as additional capabilities like E2E Integration Validation SAP 2009 / Page 6

Test Management Test Process embedded in Application Life-cycle Management Type of Change Test Scope Identification New SAP Solution Business Blueprint Implementation of new SAP Solution Business Blueprint Design Solution Configuration Test Planning System Setup Test Execution Deploy Changes to Production SAP Solution Update Change Impact Analysis SAP Support Packages SAP Legal Change Packages SAP Enhancement Packages Customizing changes Custom Code Interface changes Business Blueprint Update Identification of Business Processes affected by SAP Solution Updates Recommendation of business processes for regression tests Development of Test Cases Test Plan setup Compilation of Test Packages Assigment of Testers Setup of Test System Creation of Test Data Manual tests Automated tests Integration Validation Incident Management Performance tests Test status and progress reporting Test sign-off Deployment of changes through transports from Test to Production system SAP Support packages, Legal Change Packages, Enhancement Packages Note: Test Project Preparation as first step including: test strategy review, definition of test objectives, test tools, test budget, timeline, roles & responsibilities SAP 2009 / Page 7

Test Management Guiding Principles SAP Solution Manager All SAP test capabilities are provided and tightly integrated with SAP Solution Manager Risk-based Test Planning Identification of business processes affected by SAP Solution changes Provide choices to SAP customers Customers can use SAP capabilities and 3rd Party Test Suites in combination All required Interfaces will be provided over time SAP 2009 / Page 8

Test Management Capability Options for SAP Customers Type of Change Test Scope Identification New SAP Solution Business Blueprint Test Planning System Setup Test Execution Manual and automated tests Apply Changes to Production SAP Solution Update Change Impact Analysis Option 1 Test Scope Identification Test Planning Manual Tests Automated Tests UI based Tests SAP Solution Manager Business Blueprint SAP Solution Manager Business Process Change Analyzer* SAP Solution Manager Test Workbench SAP TDMS SAP Solution Manager Test Workbench SAP Solution Manager ecatt HP: QTP CPWR:TestPartner Backend Tests ecatt: Application Logic Tests Option 2 SAP Solution Manager Business Blueprint SAP Solution Manager Business Process Change Analyzer* HP Quality Center HP Quality Center HP QTP SAP TDMS SAP TAO * Availability with SAP Solution Manager 7.0 EhP1 SAP 2009 / Page 9

SAP Solution Manager Business Process Change Analyzer SAP Solution updates occur frequently SAP triggered: Support Packages, Enhancement Packages Customer triggered: Customizing changes, Custom code development Customer Pain Point Which business processes are affected by planned change? Approach SAP Solution Update Change Impact Analysis Test Planning Test Execution Identification of business processes affected by change Risk-based Test Recommendation Test Case review and creation of missing test cases Test Plan generation Regression Tests Manual Tests Automated Tests SAP 2009 / Page 11

SAP Solution Manager Business Process Change Analyzer Preparation Order to Cash Execution of mission-critical business processes by Business User Trace Result: Technical Bill of Material (T-BOM) Sales Order Code: Function modules, Delivery UI: Dynpro 1000, Goods Issue Tables: Customizing, Master Data Billing Change Impact Analysis Which critical Business Processes will be affected by planned changes? Planned Change SAP Support Packs SAP EhPs Custom Code Customizing changes Business Process Change Analyzer Order to Cash Sales Order code change Delivery Goods Issue UI change Billing Procure to Pay Create PO customizing change Risk-based Test Scope Can I get a recommendation for regression tests? Business Process Change Analyzer Identification of business processes impacted by software changes Support decision making whether planned change shall be executed Automatic test plan generation for SAP Test Workbench SAP 2009 / Page 12

SAP Solution Manager Business Process Change Analyzer SAP Solution Manager 7.0 EhP1 Business Process Change Analyzer Precise insight Identification of critical business processes affected by planned change events Improved handling of change events Support for customer s change committee to decide on SPs, EhPs or Custom triggered changes for SAP production system Risk-based Test Planning Recommendation for subsequent regression tests SAP 2009 / Page 13

SOKA-BAU and SOKA-IT SAP Solution Manager including BPCA and Test Workbench Quick Facts Location: Wiesbaden, Germany Industry: Insurance Total assets: 4.8 bn (2008) Total employees: 1.200 (2009) Website 1: soka-bau.de Website 2: soka-it.de SAP Solutions: SAP ERP, SAP BW, SAP EP, SAP Solution Manager Partner: SAP Consulting Test efforts resulting from software changes affecting our SAP solution operations can be significantly reduced by using a risk-based test scope identification provided by the Business Process Change Analyzer of SAP Solution Manager. Roland Krüger Manager SAP Customer CoE SOKA-IT SAP 2009 / Page 14 Challenges and Opportunities Extention of the proven test management capabilities of SAP Solution Managers via utilization of functional enhancements of EHP1 Objectives Optimization of test planning through Business Process Change Analyzers (BPCA) of SAP Solution Manager Optimization of test execution via deployment of test sequence functionality of Test Workbench Increased user and process efficiciency through html-based Workcenter for Testand incident management Increased quality of SAP solution documentation through deployment of Solution Documentation Assistent (SoDocA) Implementation Highlights New Wizard for setup of basic configuration of SAP Solution Manager within 3 hours Tool-based test scope identification and automated test plan generation Email notification for all status chnages of test cases Central access and administration for all test relevant information. Why SAP End-to-End functionality and excellent integration into existing SAP solution landscape Reuse of already achieved results Benefits Significant time savings within test preparation Risk-based test scope identification leading to significant reduction of test effort Streamlined communication during test execution Role-based approach for all test activities supported by new Work- Center

E2E Integration Testing of SAP Solutions Options for SAP Customers Type of Change Test Scope Identification New SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning Test System Setup Test Execution Apply Changes to Production Option 1 Solution Manager Business Blueprint Setup of business process catalog Business requirements Solution Manager Business Process Change Analyzer * Identification of processes affected by code / customizing changes Solution Manager Test Workbench Test planning SAP TDMS Setup of lean test systems Solution Manager Test Workbench Manual testing Automated Tests Solution Manager ecatt Admin of automated tests LoadRunner Performance Tests UI based Tests QTP Test Partner QTP Application-logic Tests ecatt SAP 2009 / Page 16 * Availability with SAP Solution Manager 7.0 EhP1

Test Management SAP Solution Manager Business Blueprint / Configuration Goal Documentation of Business Processes and assignment of manual and automated test cases Scope Business Blueprint: hierarchical definition of business processes Single source of thruth 1 repository for business process information from various perspectives: assigned systems by role (DEV, TST, PRD), interfaces, integrated partner / non-sap products, transaction codes, training material, business process details, business requirements Assignment of manual and automated tests to business processes Benefits Central business processes repository from a business -, system landscape - and technical perspective Business Blueprint as central location for test cases SAP 2009 / Page 17

Test Management SAP Solution Manager Business Process Change Analyzer Goal Change Impact Analysis of software changes on mission-critical business processes Scope Precise identification of business processes impacted by change events including SAP Support Packages SAP Enhancement Packages (limited functionality) Customizing changes Custom code developments Risk-based test scope identification Semi-automatic test plan generation for Test Workbench Benefits Precise change impact analysis for mission-critical processes resulting from SAP Solution changes Reduction of test effort via risk-based test scope identification SAP 2009 / Page 18

Test Management SAP Solution Manager Test Workbench Goal Management of functional tests from test planning via test execution to test status reporting and test sign-off Scope Planning of manual and automated test cases Link between business processes and test cases Suitable environment for endusers to execute manual tests via individual test packages Test status reporting for test coordinators including % of completion, incidents, drilldown to tester notes, incidents, Trend reports through integrated SAP BI reports Benefits Very comprehensive and mature test management capability used by thousands of SAP customers 1-click access from test management to test systems Test sign-off including digital signatures SAP 2009 / Page 19

Test Management SAP Solution Manager ecatt Goal Test automation for functional tests and backend logic tests Scope Test automation for SAP business processes such as Order-to-Cash Test automation for backend logic tests (SOA, ) Test Management via Test Workbench Central test data repository Test execution in distributed system landscapes Integration with partner test automation tools like HP QTP for html-based business processes Benefits Mature capability for test automation of business processes as well as backend logic tests Seemless integration into Test Workbench for test planning, execution and status reporting SAP 2009 / Page 20

E2E Integration Testing of SAP Solutions Test capabilities for functional testing Type of Change Test Scope Identification New SAP Solution Business Blueprint Test Requirements Test Planning Test Execution Deploy Changes to Production SAP Solution Update Change Impact Analysis Option 2 Solution Manager Business Blueprint Quality Center Test Lab Setup of business process hierarchy Defect management Business requirements Solution Manager Quality Center Test requirements Test planning SAP TAO Accelerated test component generation Business Process Change Analyzer * Identification of business processes affected by code / customizing changes SAP TDMS Setup of lean test systems Quality Center Business Process Tests Quick Test Pro LoadRunner Performance Tests SAP 2009 / Page 22 * Availability with SAP Solution Manager 7.0 EhP1

Test Management SAP Solution Manager Business Blueprint / Configuration Goal Documentation of Business Processes and assignment of manual and automated test cases Scope Business Blueprint: hierarchical definition of business processes Single source of thruth 1 repository for business process information from various perspectives: assigned systems by role (DEV, TST, PRD), interfaces, integrated partner / non-sap products, transaction codes, training material, business process details, business requirements Assignment of manual and automated tests to business processes Benefits Central business processes repository from a business -, system landscape - and technical perspective Business Blueprint as central location for test cases SAP 2009 / Page 23

Test Management SAP Solution Manager Business Process Change Analyzer Goal Change Impact Analysis of software changes on mission-critical business processes Scope Precise identification of business processes impacted by change events including SAP Support Packages SAP Enhancement Packages (limited functionality) Customizing changes Custom code developments Risk-based test scope identification Semi-automatic test plan generation for Test Workbench Benefits Precise change impact analysis for mission-critical processes resulting from SAP Solution changes Reduction of test effort via risk-based test scope identification SAP 2009 / Page 24

Test Management SAP Solution Manager Adapter for SAP Quality Center by HP* Goal Exchange of business processes, business requirements, test assets, incidents and test results between SAP Solution Manager and Quality Center Scope Outbound interface: transfer of business processes, business requirements, test objects and incidents to Quality Center Inbound interface: transfer of defects and test results from Quality Center to SAP Solution Manager Quality Center Benefits Enablement of end-to-end integration testing based on business processes and business requirements Efficient collaboration between solution implementation and change management supported by SAP Solution Manager and test management realized within Quality Center Adapter *) Additional license required SAP 2009 / Page 25

Test Management SAP Quality Center by HP* Goal Management of test requirements, manual / automated test cases and test result analysis Scope Definition of test requirements based on business processes and assigned business requirements Setup of manual test cases Composition of test cases based on test components Definition of test cycles and scheduling of test execution Integrated defect management capabilities Advanced test status analysis via out-of the-box reports and dashboards Benefits Comprehensive test management capabilities with high usability for end-users and power-users Tight integration with SAP Solution Manager and SAP TAO *) Additional license required SAP 2009 / Page 26

SAP Solution Manager Adapter for SAP QC by HP Integration between Defect and Incident Management The Adapter allows the exchange of Defects and solved Incidents SAP Solution Manager Adapter SAP Quality Center by HP Support Expert Tester 1) Test execution 2) Defect creation 3) Transfer of Defects 4) Incident resolution 5) Transfer of solved incident 6) Retest 7) Transfer test status 8) Project reporting SAP 2009 / Page 27 Infos and demos available at http://service.sap.com/solutionmanager

Test Management SAP Test Acceleration and Optimization (SAP TAO)* Goal Accelerated composition of automated test cases for business processes with optimized maintenance for lower TCO Scope Automatic generation of test components for SAPGUI- based SAP business processes Fast composition of automated test cases using standard functionality of SAP TAO and Quality Center. Optimized maintenance of automated test cases for lower TCO via component-based exchange of damaged test components after SAP updates Benefits Accelerated approach to create test components for SAP business processes Optimized way to maintain test cases leading to lower TCO Integrated with Quality Center and SAP Solution Manager *) Additional license required SAP 2009 / Page 28

Test Management SAP Solution Manager Work Center Test Management Workcenter: Role-specific entry point for all test related activities Test Coordinator Quality Expert Tester VP of QA Status Reporting SAP 2009 / Page 30 Infos and demos available at http://service.sap.com/solutionmanager

Test Management SAP Loadrunner by HP* Goal Load testing for identification of performance bottlenecks Scope Emulates production workload on SAP landscapes Replaces real users with thousands of virtual users Generates accurate, measurable and repeatable load on the system from a single point of control Pinpoints bottlenecks in the system Benefits Lower migration risks, increase performance, accelerate deployment cycles and increase overall client satisfaction Obtain an accurate picture of end-to-end system performance and optimize the scalability of applications *) Additional license required SAP 2009 / Page 31

Test Management SAP Test Data Migration Server (SAP TDMS)* Goal Provide the right test data at the right time for the right people Build and refresh non production systems with a reduced set of data Transfer production data for specific test cases based on business objects Scope Setup of lean test systems with a reduced set of data Selective refresh of individual clients in development, test and training environments Data extraction based on business objects, organizational units or time slices Scrambling of sensitive data Production System SAP TDMS Non Production System Benefits Current test data from production system Scrambling of sensitive data Reduce storage requirements of non production landscape *) Additional license required SAP 2009 / Page 32

Test Management SAP Solution Manager Root Cause Analysis Goal Validation of technical correctness and response time of business processes after significant software changes Scope and Approach 1. Execute End-to-End trace 2. Analyze critical technical components 3. Determine distribution of response time / error messages / inconsistencies 4. Identify coding, expensive SQL statements,.. 5. Determine and document potential improvements 6. Optimization and Verification Response time [ms] 2.500.000 2.000.000 1.500.000 1.000.000 500.000 0 0 10 20 30 40 Sales Order Items 50 60 VA01 (01.01.) VA01 (15.01.) VA01 (17.01.) VA01 (25.01.) SAP 2009 / Page 33

Test Management SAP Solution Manager Quality Gate Management Goal Better governance of change activities through Quality Gates Synchronized transports of all changes from Development to Production systems Scope Definition of quality gates and milesstones Calendar overview Quality Gates supervised by Quality Manager and Steering Board Central definition of transports with grouping of transports by change topics to ensure correct behaviour in target system Benefits Improved governance of change activities Full transparency about changes in the system landscape Synchronized transports leading to better quality in test and production system landscapes SAP 2009 / Page 34

Agenda 1. Customer Pain Points and SAP Approach 2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples 3.1. Test Option 1 3.2. Test Option 2 4. Test Services 5. Additional Test Management Capabilties 6. Summary and further Information SAP 2009 2008 / Page 35

E2E Integration Testing of SAP Solutions Customer Benefits End to End Integration Testing Methodology and capabilities to test business processes from start to finish Rich functionality from functional and regression testing to root-cause analysis Customers have choices SAP provides rich capabilities for ALM including test management Highly integrated partner test suite from HP Risk-based test planning Analysis capability to check impact of planned changes on critical business processes Integrated Solution SAP Solution Manager acts as central hub to access included and integrated test capabilities SAP 2009 / Page 36

Global Testing Solutions Target Testing Services Portfolio 1 2 Advisory & Strategy QA & Test Advisory, Audit, Methodology, Approach & Strategy Services Test Project Management Day-to-day Delivery Management 3 Test Analysis & POC Test Analysis & Execution 4 5 6 7 Performance Testing Delivery Frameworks, Script Analysis, Build Out & Execution Functional Automation Automation Frameworks, Script Analysis, Build Out & Execution Environment Management Change Configuration & Release Management, Data & Environment Solutions, Visualization etc. Training & Enablement SAP Test Solution Training & Partner Enablement Info: www.sap.com/services/testing SAP 2009 / Page 37

SAP Standards for E2E Solution Operations SAP standardizes End-to-End Solution Operations SAP Standards for Solution Operations: Definition of support processes for mission-critical operations Provide Best Practices and Implementation Roadmaps Based on a general organizational model Trainings / Certifications are available Available for download at http://service.sap.com/supportstandards SAP Standard for Test Management The standards allow to set up best-in-class operations SAP 2009 / Page 38

E2E Integration Testing of SAP Solutions Information and SAP Contacts Information SAP Standard for Test Management: http://service.sap.com/supportstandards E2E Integration Testing: http://service.sap.com/testing SAP TAO: http://service.sap.com/saptao SAP Solution Manager: http://service.sap.com/solutionmanager SAP Solution Manager e-learning material: http://service.sap.com/rkt-solman Regional SAP Contacts Americas m.de.la.cuesta@sap.com Product Information and Solution Sales jim.bisordi@sap.com Professional Services EMEA martin.hasselbalch@sap.com Product Information and Solution Sales markus.helfen@sap.com Professional Services eric.siegeris@sap.com Professional Services APJ steven.medeiros@sap.com Product Information and Solution Sales SAP 2009 / Page 39