[ ASUG Influence Council: SAP Test Data Migration Server (TDMS) Tony Schmidt Nike Peter Keller - SAP
[ Learning Points TDMS current roadmap Influence Council purpose and organization Current status on workings of subgroups Real Experience. Real Advantage. 2
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 3
SAP Test Data Migration Server High-Quality Testing Requires High-Quality Test Data Peter Keller, Solution Management, SAP America, Inc. March 2012
Agenda Market view Customer situation Solution approach Benefits Use cases Technology Facts and figures Resources & contacts 2012 SAP AG. All rights reserved. 5
2500+ shipments to date 2012 SAP AG. All rights reserved. 6
Reference customers 2012 SAP AG. All rights reserved. 7
Why buy this solution? SAP systems are becoming larger and more complex; therefore robust SAP change management processes are needed to prevent the introduction of errors SAP customers should leverage an SAP selective data copy tool to automate the selection & copying of a subset of data By introducing such a toolset, SAP customers can take pressure off the stretched Basis operations team SAP customers can leverage toolset to scramble and mask sensitive data Improved quality of test data and testing results Enabled repeatable process for refreshing nonproduction systems Reduced disk requirements by 65% Reduced system refresh time by 50% Reduced basis resource needs by 80% Increased refresh frequency by 65% Reduced hardware requirements Enabled resources to be utilized for innovation rather than manual system refresh activities Improved ability to provide data to the business faster and more accurately Improved test data in development allows us to catch defects earlier in the development cycle Enabled privacy settings for sensitive data Reduced bug-fixing cycle times Reduced the number of transports Improved availability of production data in development environment Helped create training environment based on specific data requirements Reduced database footprint from 25 TB to 3 TB in the non-production environments 2012 SAP AG. All rights reserved. 8
Customer situation Business Requirements Reduce footprint of non-production environments Provide current data for development and test teams Protect sensitive data in test & training systems Refresh data in non-production environments quickly and efficiently Enable functional teams to extract and transfer data for troubleshooting & testing purposes Allow basis team to focus on core business activities Consider implementing a solution that helps you create and refresh lean and consistent development, testing, quality assurance, and training environments based on real business data. 2012 SAP AG. All rights reserved. 9
The solution With SAP TDMS you can Reduce data volume Provide current data Scramble/eliminate sensitive data Automate & reduce runtime of data refreshes Allow functional teams to transfer subsets of data Reduce workload of already strained basis team SAP Test Data Migration Server is a high-speed data extraction tool that populates your development, test, quality assurance, and training systems with SAP business data from your live productive environment. 2012 SAP AG. All rights reserved. 10
Benefits Improved Quality Of development, test, and training activities by using businessrelevant and up-to-date test data Increased Efficiency By reducing administrative efforts and time required to manage data in development and test systems Higher Flexibility Through capability to selectively refreshing single clients in SAP systems Reduced Infrastructure Expenditures By decreasing data volume in development, test, and training systems Reduction of Testing & Development Expenses Through outsourcing of test & development activities while keeping sensitive data protected and remaining legally compliant 2012 SAP AG. All rights reserved. 11
Use cases I. Refresh of data in development systems II. Build lean project systems III. Build & flexibly refresh training systems IV. Build & easily refresh maintenance systems 2012 SAP AG. All rights reserved. 12
Use case example I. refresh of data in DEV systems Before SAP TDMS PR1 100 1.5 TB Full Copies With SAP TDMS PR1 100 1.5 TB Reduced copies 1.5 TB 1.5 TB 300 GB 300 GB TRN1 100 QA1 100 TRN1 100 QA1 100 No easy way to bring current data to DEV Selective data copies possible into DEV Stale data DEV1 100 200 GB Current data DEV1 100/200 500 GB 2012 SAP AG. All rights reserved. 13
Use case example II. build lean project systems Client-dependent Transaction Data Client-dependent Master Data Client-dependent Configuration Step 2 Copy Client-dependent Configuration Data plus All Client-dependent Master Data WITHOUT Client-dependent Transactional Data (SAP TDMS Master Data & Customizing) & Apply Scrambling Routines (e.g. customer/vendor data) Client-dependent Transaction Data Client-dependent Master Data Client-dependent Configuration Client-independent Configuration Repository Step 1 Copy Repository and Client-independent Configuration Data (SAP TDMS Shell Creation) Client-independent Configuration Repository Goal: Provide a standardized approach to deliver project systems with only master and configuration data without transactional data. 2012 SAP AG. All rights reserved. 14
Use case example III. build and flexibly refresh training systems PR1 100 1.5 TB QA1 100 300 GB Step 1: Reduced Copy 300 TRN 1.2 TB 301 Flexibility DEV1 100/200 500 GB 320 330 321 331 Step 2: Further reduced copy or 1:1 copy Goal: Provide a repeatable process to build and refresh training clients as subsets, full copies, and with flat file option for easy resetting activities. 2012 SAP AG. All rights reserved. 15
Use case example IV. build & easily refresh maintenance systems Client-dependent Transaction Data Client-dependent Master Data Client-dependent Configuration Client-independent Configuration Repository Step 2 Copy subset of Client-dependent Master Data only (e.g. Material Master), or Client-dependent Transaction Data with corresponding Master Data (e.g. Sales Order) Step 1 Create new client in existing SAP system via Client Copy (Customizing Only), or run TDMS Master/Data Customizing scenario to bring existing source and target client in sync (Clientdependent Customizing) Client-dependent Transaction Data Client-dependent Master Data Client-dependent Configuration Client-independent Configuration Repository Goal: Provide a quick & easily-repeatable process for functional teams to transfer Master Data or Transaction Data for troubleshooting. 2012 SAP AG. All rights reserved. 16
High-level architecture Sender System SAP TDMS Receiver System Sender Dictionary DDIC Comparison Receiver Dictionary RFC RFC RFC Code Generation RFC READ_DATA RFC Data Conversion RFC WRITE_DATA Sender Data Receiver Data Flat file 2012 SAP AG. All rights reserved. 17
Data reduction time slice scenario Assumption 80-90% of the production data is stored in 10-20% of client-dependent tables Data volume reduction In order to reduce the overall volume, only few tables need to be reduced All other tables (master and configuration data) are migrated entirely Customer-individual tables are transferred entirely or can be reduced via e.g. time criteria Some tables are excluded from transfer by default: E.g. change documents, user tables, etc. (customizable) Client DB Before data reduction Administration Data Configuration Data Master Data Transaction Data Client DB After data reduction (80%) Administration Data Configuration Data Transaction Data Master Data Storage Savings * Estimate based on project experience 2012 SAP AG. All rights reserved. 18
Release 4.0 delta information TDMS 3.0 New Features with TDMS 4.0 SAP Solutions available with SAP TDMS Classic: ERP, BW, CRM, HCM Industry-Specific Solutions Available with SAP TDMS: Apparel & Footwear (AFS) Discrete Industries & Mill Products (DIMP) Healthcare Retail (Time-Based Selection) Business Process Library (BPL) Data Scrambling Workbench SAP Solutions available with SAP TDMS Classic: SCM, SRM, GTS Industry-Specific Solutions Available with SAP TDMS: Banking (Loans & Deposits), Oil & Gas (Downstream), Retail (Store), Utilities (for ERP & CRM) Feature-Rich Data Scrambling Integration with SAP Solution Manager User-Friendly Work Centers BPL Modeler Data Transfer Through Files for SAP ERP Full Transfer of Client-Specific Data iphone / ipad App 2012 SAP AG. All rights reserved. 19
Release 4.0 functions-in-detail (part 1) HCM CRM ERP BI SCM GTS SRM 2012 SAP AG. All rights reserved. 20
Release 4.0 functions-in-detail (part 2) Web-based Interface Solution Manager Integration iphone / ipad App Shell Creation Data Scrambling Full Client Transfer File-based Transfer ERP HCM BI CRM SCM SRM GTS Time-Based Reduction Company Code and Time-Based Reduction Transfer of Master Data and Customizing Business Process Library Stand-alone Scrambling Out-of-the-box scrambling content E-Recruiting Process and Forms Transfer of PA Data Transfer PA & PD Data in one Step Out-of-the-box Scrambling Country- Specific Scrambling Payroll & Time Comparison Time-Based Data Reduction for Individual InfoAreas PSA Data Eliminated Time-Based Reduction Transfer of Master Data and Customizing Mobile Clients Deploy SAP TDMS Time-based Reduction SAP LiveCache reduced by Date and Planning Version Demand Planning for BI APO data reduced based on time Time-based Reduction Transfer of master data and Customizing Consistent document flow Reduced post-transfer processing activities Seamless integration with other applications 2012 SAP AG. All rights reserved. 21
Business Process Library (BPL) Master Data Business Partner Number Range Object Material Vendor Customer G/L Account A G/L Account B Asset (FI-AA) Functional Location Equipment Internal Order Profit Center Project (PS) Cost Center Purchasing Info Record Work Center Material BOM Article (Retail) Insurance Object (FS-CD) Contract (FS-CD) Loans Contract Asset (CFM) Contact Person Custom Data Empty scenario for custom-specific objects Transactional Data with Corresponding Master Data Accounting Document Purchase Requisition Purchase Order Sales Order Material Document CO Document Sales Invoice Incoming Invoice Quality Notification Maintenance Order Delivery Physical Inventory Document Allocation Table (RetaiI) FI-CA Document Process Data Purchase Order Sales Order Production Order Process Order Insurance Object (FS-CD) Contract (FS-CD) Loans Contract Asset (CFM) Bank Account (BCA) Contract (IS-U) Installation (IS-U) Business Partner (IS-U) Business Entity (RE-FX) Delivery Incoming Invoice Purchase Requisition Sales Invoice 2012 SAP AG. All rights reserved. 22
BPL example: Accounting document Provides selective Accounting Document data with depending objects (including master data) Main Business Objects: Vendor, Customer, G/L Account, Open & Balanced Posts 2012 SAP AG. All rights reserved. 23
Architecture data scrambling Production System SAP TDMS Test System RFC RFC TDMS Server Scrambling Original Data Scrambled Data (Cluster) Flat file Scrambled Data Important: 1. Sensitive Data does NOT leave PRD. 2. TDMS can also scramble data in cluster tables. 2012 SAP AG. All rights reserved. 24
Unified user interface based on WebDynpro 2012 SAP AG. All rights reserved. 25
time time SAP Test Data Migration Server software Object-oriented approach for industries Horizontal approach represents TDMS time slice throughout system Vertical approach represents object- oriented extraction with complete history Time Slice Object-oriented Data volume Data volume Goal: Combination of horizontal and vertical extraction approach 2012 SAP AG. All rights reserved. 26
Object-based approach per industry Utilities ( for ERP and CRM) Business Partner Contract Installation Device Point of Delivery Banking (Loans & Deposits) Business Partner Master Contracts Retail Store 2012 SAP AG. All rights reserved. 27
iphone/ipad Apps package settings 2012 SAP AG. All rights reserved. 28
iphone/ipad Apps analytics 2012 SAP AG. All rights reserved. 29
iphone/ipad Apps analytics 2012 SAP AG. All rights reserved. 30
iphone/ipad Apps troubleshooters 2012 SAP AG. All rights reserved. 31
System requirements (release 4.0) Requirements for TDMS Control System SAP WebAS 7.00 or higher Minimum 4000 SAPS, 20 GB hard drive Lowest supported Releases ERP: 4.7 HCM: 4.7 BW: 7.0 CRM: 5.0 SCM: 7.0 SRM: 7.0 GTS: 8.0 SAP Retail: 6.0 SAP Oil & Gas: 4.7 SAP for Banking: 6.0 SAP for Utilities: ERP 6.0, CRM 6.0 2012 SAP AG. All rights reserved. 32
Pricing & services Pricing Price is dependent on size of production database License covers one PRD system and n non-prd systems Implementation Services Various services packages offered by SAP Consulting Service and Support SAP TDMS is a standard SAP product, so you can expect service and support as for any other SAP Solution 2012 SAP AG. All rights reserved. 33
Resources SAP Service Marketplace http://service.sap.com/tdms SAP Developer Network (SDN) https://forums.sdn.sap.com/forum.jspa?forumi D=326 SAP Help Portal http://help.sap.com/saptdm 2012 SAP AG. All rights reserved. 34
Thank you Peter Keller Solution Management System Landscape Optimization Active Global Support SAP America, Inc. p.keller@sap.com +1 (610) 209-4544
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 36
[ Influence Council overview Provides a trusted platform for customers and product development teams to discuss: A specific product, service, or process Near to mid-term requirements and priorities Planned enhancements (solution roadmap) Potential future developments Real Experience. Real Advantage. 37
[ Influence Council scope Made up of SAP customers who participate in on-going and future development of TDMS Customers who understand the philosophy of TDMS Customers who see a benefit in influencing product development Customers who are willing to collaborate on requirement and help shape the future of TDMS Provide an open platform to exchange experiences with TDMS SAP customers who are ASUG members Start with an easy, on-line survey to sign up Real Experience. Real Advantage. 38
[ Influence Council overview Leadership team Tony Schmidt, Nike Chairperson Serine Wu, Agilent Technologies Co-Chairperson Rich Guidotti, Dow Chemical Co-Chairperson Peter Keller, SAP - Sponsor Real Experience. Real Advantage. 39
[ Influence Council details Monthly (or so) meetings (next one is June 14) One to two year duration IC started August 2011, first subgroup started November 2011 Develop subgroups around specific subject areas Initial potential subgroups Data Scrambling Data Integrity Across Landscape Business Process Libraries (BPL) Best Practices / Documentation Automation Performance Tuning Ramp up for TDMS 4.0 HCM Real Experience. Real Advantage. 40
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 41
[ Subgroup process On-line meetings Subgroup leader determines most of the process Introductory meeting, discuss experiences and challenges SAP contact educates and/or reviews groups initial list Eventually settle on final requirements Present back to SAP Subgroups can request SAP technical team access via Peter Keller Real Experience. Real Advantage. 42
[ Subgroup process SAP cloud workspace to share documents Real Experience. Real Advantage. 43
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 44
[ Subgroup process updates (current as of presentation submission in March) One subgroup in full swing Performance Tuning Two subgroups beginning Data Scrambling Best Practices / Documentation HCM Two subgroups waiting for a leader Business Process Libraries Automation Real Experience. Real Advantage. 45
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 46
[ TDMS venues Sapphire / ASUG annual conference May TechEd October Various regional ASUG events Webinars Real Experience. Real Advantage. 47
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 48
[ Call for volunteers Looking for Subgroup participants Participate in monthly on-line meetings Share your experiences and offer improvements Looking for Subgroup leaders Hold regular subgroup meetings on topic areas Synthesize and submit findings and recommendations Groups still needing leaders are......... New subgroups can be added as interest dictates Components ECC, CRM, BI, SCM,.... Industry areas Banking, Utilities, Apparel & Footwear Real Experience. Real Advantage. 49
[ Agenda TDMS overview Influence Council overview Subgroup process Subgroup progress updates TDMS venues Call for volunteers Q&A, subgroups, contacts Real Experience. Real Advantage. 50
[ Q&A, subgroups, contacts Data Scrambling Data Integrity Across Landscape Business Process Libraries (BPL) Best Practices / Documentation Automation Performance Tuning Ramp-Up for TDMS 4.0 TDMS for HCM I can send you a short on-line survey to get started Let the Influence Council Leaders know via email Which Sub Group you wish to work in Which Sub Group you wish to lead Tony Schmidt tony.schmidt@nike.com +1 (503) 671-2248 Serine Wu serine_wu@agilent.com Rich Guidotti RVGuidotti@dow.com Peter Keller, SAP p.keller@sap.com +1 (610) 209-4544 Real Experience. Real Advantage. 51
[ ] Thank you for participating. Please remember to complete and return your evaluation form following this session. For ongoing education on this area of focus, visit the Year-Round Community page at www.asug.com/yrc [ SESSION CODE: 4009 Real Experience. Real Advantage. 52