Optimice sus Entornos de Prueba con Datos de Producción Jose Ruiz Specialist Quality & Security Adrian Batyk Senior Consultant

Transcription

1 Optimice sus Entornos de Prueba con Datos de Producción Jose Ruiz Specialist Quality & Security Adrian Batyk Senior Consultant

2 Jose Ruiz Especialista en Calidad y Seguridad SAP Solution Architect at HP Corp Performance engineer at HSBC Focus on IT Quality Management I like to play the guitar I love reading books Meet new people 2015 SAP SE or an SAP affiliate company. All rights reserved. 2

6 Effort Situaciones comunes de TI How can you be sure that business applications are highly functioning and support the business strategy? Technology changes Business process changes Compliance requirements Time Discrete Change Events Ongoing Change Events New Implemention New Processes Consolidation Upgrades Custom Development Support Pack 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 6

8 Hallazgos Operaciones Componente Detalle Infraestructura La BD de Preproducción mide 5TB, es igual a Producción en tamaño Cada planchado se requiere incrementar recursos Seguridad La BD es una copia fiel de producción, no son enmascarados los datos La nomina se copia sin enmascaramiento, es un riesgo Tiempo Hoy en día requieren hasta 5 días para actualizar el ambiente pre productivo y la penúltima vez fue hace 3 años, por lo mismo no se realiza frecuentemente El equipo de Basis se dedica a esta tarea junto al DBA Se tiene que dedicar como mínimo 1 semana para la generación de datos de Desarrollo y Pruebas 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 8

10 Typical Scenario Current Situation TRN/ TB Stale data PRD/100 QAS/100 DEV/100 Full Copies 1.5 TB 1.5 TB No easy way to bring current data to DEV 200 GB In a nut shell Storage Costs Resources Time Efficiency Process Security directly contributes to the success of your business SAP SE or an SAP affiliate company. All rights reserved. Customer 10

11 SAP Test Data Migration Server software Business requirements LoB Heads / Functional Teams o o o Require current data in DEV & Q/A system to speed up timeto-market of new functionality Responsible for application support -> need a way to replicate data from PRD for troubleshooting Own the data need to protect sensitive data Q/A & Testing Teams o SAP Basis Teams o Depend on current data for testing and quality assurance Interested in ways to simplify/automate setup & refresh of SAP systems/clients IT Infrastructure Teams o o o Responsible for system landscape management, therefore interested in controlling cost of running/supporting it Need to support project activities by providing project systems Need to ensure sensitive data is adequately protected 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 11

12 Product Description SAP Test Data Migration Server (SAP TDMS) is a high-speed data extraction tool that transfers relevant business data from your SAP production system to your development, test, quality assurance, or training system. With SAP Test Data Migration Server (SAP TDMS), you can: Reduce the footprint of your non-production environment and minimize infrastructure and maintenance expenses - by creating lean, easy-to-maintain systems using current extracts of business data Enable functional teams to extract and transfer data for troubleshooting and testing purposes - by transferring small amount data using business objects Maximize the effectiveness of your development, test, or training activities - by providing current data frequently to test systems. Comply with data privacy laws - by scrambling your sensitive production data Migrate data across non-connected data centers - by using the file transfer technique Transition to SAP innovations such as SAP Business Suite powered by SAP HANA on premise or on Enterprise Cloud 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 12

13 SAP Test Data Migration Server software Data reduction time slice scenario Assumption 80-90% of the production data is stored in 10-20% of client-dependent tables Administration Data Client DB Before data reduction Configuration Data Master Data Data volume reduction In order to reduce the overall volume, only few tables need to be reduced (still 800+ tables) All other tables (master and configuration data) are migrated entirely Customer-individual tables are transferred in full If time stamp on table, TDMS automatically reduces them Some tables are excluded from transfer by default: E.g. change documents, user tables, etc. (customizable) Transaction Data Client DB After data reduction (80%) Administration Data Configuration Data Transaction Data Master Data Storage Savings 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 13

14 High-level Architecture Sender System Control/Central System Receiver System RFC Connection RFC Connection 1. Data Selection (cluster) File(s) 3. Data Transfer 2. Data Deletion 4. Scrambled Data Scrambled Data 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 14

15 Main Features Web-based Interface Solution Manager Integration Fiori App Shell Creation Data Scrambling Full Client Transfer File-based Transfer ERP HCM BW CRM SCM SRM IS GTS Time-Based Reduction Company Code and Time-Based Reduction Transfer of Master Data and Customizing Business Process Library Stand-alone Scrambling Data Scarmbling content Data import through Files E-Recruiting Process and Forms Transfer of PA Data Transfer PA & PD Data in one Step Stand-alone Scrambling Country-Specific Scrambling content Payroll & Time Comparison Data import through Files Time-Based Data Reduction for Individual Info Areas Data import through Files PSA Data Eliminated Time-Based Reduction Transfer of Master Data and Customizing Full Transfer of Client-Specific Data Data import through Files Time-based Reduction SAP Live Cache reduced by Date and Planning Version Demand Planning for BI APO data reduced based on time Full Transfer of Client-Specific Data Data import through Files Time-based Reduction Transfer of master data and Customizing Consistent document flow Full Transfer of Client-Specific Data Data import through Files Object-Based reduction for SAP Banking Object-Based reduction for SAP CRM for Utilities Object-Based reduction for SAP Retail Object-Based reduction for SAP Utilities Time-Based Reduction for SAP Oil & Gas (Downstream) Reduced post-transfer processing activities Seamless integration with other applications Full Transfer of Client-Specific Data Full Transfer of Client-Specific Data 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 15

16 SAP Test Data Migration Server software Business Process Library (BPL) - Excerpt Master Data Business Partner Business Partner (IS-U) Number Range Object Material Vendor Customer G/L Account A G/L Account B Asset (FI-AA) Functional Location Equipment Internal Order Profit Center Project (PS) Cost Center Purchasing Info Record Work Center Material BOM Article (Retail) Insurance Object (FS-CD) Contract (FS-CD) Loans Contract Asset (CFM) Contact Person Transactional Data with Corresponding Master Data Accounting Document Purchase Requisition Purchase Order Sales Order Material Document CO Document Sales Invoice Incoming Invoice Quality Notification Maintenance Order Delivery Physical Inventory Document Allocation Table (RetaiI) FI-CA Document Custom Data Empty scenario for custom-specific objects Transactional Data Purchase Order Sales Order Production Order Process Order Insurance Object (FS-CD) Contract (FS-CD) Loans Contract Asset (CFM) Bank Account (BCA) Contract (IS-U) Installation (IS-U) Business Entity (RE-FX) Delivery Incoming Invoice Purchase Requisition Sales Invoice 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 16

17 SAP Test Data Migration Server software Release 4.0 Industry-specific flavors Based on TDMS time-slice scenario, integration of industry-specific tables in reduction based on time: AFS Apparel & Footwear Solution (ERP) -> In general availability DIMP Discrete Industry and Mill Products (ERP) -> In general availability IS Oil & Gas (downstream) -> In general availability Object-based selection for industry-specific tables in combination with time slice for standard SAP tables: Industry Solution for Utilities (ERP & CRM) -> In general availability Industry Solution for Banking (Loans & Deposits) -> In general availability Industry Solution for Retail (Store Solution) -> In general availability Industry Solution for Insurance (ERP) -> Currently in pilot phase Industry Solution for Defense (ERP) -> Currently in pilot phase 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 17

18 SAP Test Data Migration Server software Industry-specific flavors Utilities ( for ERP and CRM) Selection options based on: Business Partner Contract Installation Device Point of Delivery BADI Interface (for very flexible selections) Banking (Loans & Deposits) Selection options based on: Business Partner Master Contracts Retail Selection options based on: Store 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 18

19 SAP Test Data Migration Server software Flexible landscape options - multiple transfers in parallel DATA FLOW PRD ERP TDMS Control PRD CRM DATA FLOW TDMS Central TDMS Package 1 TDMS Package 2 TDMS Central DATA FLOW DATA FLOW Q/A ERP TDMS Package 3 Q/A CRM DATA RFC DATA FLOW FLOW PRD BW TDMS Central Q/A BW 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 19

20 Typical Use Case Example I : Refresh Of Data In Development Systems Before SAP TDMS With SAP TDMS 1.5 TB 1.5 TB PR1 100 Full Copies PR1 100 Reduced copies TRN TB QA TB TRN GB 300 GB QA1 100 No easy way to bring current data to DEV Selective data copies possible into DEV Stale data DEV GB Current data DEV1 100/ GB 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 20

21 Typical Use Case Example II : Build And Flexibly Refresh Training Systems 1.5 TB Full Copy PR TB Step 1: Reduced copy into flat file/s Step 2: Multiple inserts into different target systems / clients TRN1 750 GB QA1 100 Flat file TRN2 Flexibility 500 GB Goal: Provide a repeatable process to build and refresh training clients as subsets, full copies, and with flat file option for easy resetting capability SAP SE or an SAP affiliate company. All rights reserved. Customer 21

22 Typical Use Case Example III : Protect Sensitive Data Before TDMS Sensitive Data System Copy TDMS ServerSensitive Data Sensitive Data Scrambling Platform TDMS Data Scrambling TDMS ServerSensitive Data After TDMS 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 22

24 Hallazgos Funcionales vs Beneficios Operaciones Componente Detalle Infraestructura La BD de Preproducción mide 5TB Cada planchado se requiere incrementar recursos Con TDMS podemos reducir hasta 80% los ambientes pre productivos Seguridad La BD es una copia fiel de producción, no son enmascarados los datos La nomina se copia sin enmascaramiento, es un riesgo Protección de los datos sensibles de forma automatizada Alineación acorde a la ley de protección de datos Tiempo Hoy en día requieren hasta 5 días para actualizar el ambiente pre productivo y la penúltima vez fue hace 3 años, por lo mismo no se realiza frecuentemente El equipo de Basis se dedica a esta tarea junto al DBA Se tiene que dedicar como mínimo 1 día para la generación de datos de Desarrollo y Pruebas Con TDMS se obtendrá una reducción de hasta un 60% en el tiempo Capacidad de mantener los ambientes preproductivos actualizados Reducción de hasta un 50% del tiempo del ciclo de Pruebas 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 24

25 Effort Beneficios en la implementación de aplicaciones SAP Instalación Ciclo 1 Ciclo 2 Ciclo 3 Pruebas Paralelo Duración <Septiembre> % % 9 Semanas de Pruebas (Ejemplo) % Detección y Reparación <Octubre> % Pruebas Reducción (*40%) en los tiempos de preparación de las pruebas: Plan Casos Datos % % % % Discrete Change Events Ongoing Change Events New Implemention New Processes Consolidation Upgrades Custom Development Support Pack Beneficios Negocio: Menos riesgo de falla en producción Asegurar salir en tiempo a producción Reducción de costos en la operación de SAP después de la implementación Reutilizar en futuros Proyectos Reducción de esfuerzo en el futuro *Benchmark 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 25

27 SAP Test Data Migration Server software Customer examples SAP systems are becoming larger and more complex; therefore robust SAP change management processes are needed to prevent the introduction of errors SAP customers should leverage an SAP selective data copy tool to automate the selection & copying of a subset of data By introducing such a toolset, SAP customers can take pressure off the stretched SAP Basis operations team SAP customers can leverage toolset to scramble and mask sensitive data Improved quality of test data and testing results Enabled repeatable process for refreshing nonproduction systems Reduced disk requirements by 65% Reduced system refresh time by 50% Reduced basis resource needs by 80% Increased refresh frequency by 65% Reduced hardware requirements Enabled resources to be utilized for innovation rather than manual system refresh activities Improved ability to provide data to the business faster and more accurately Improved test data in development allows us to catch defects earlier in the development cycle Enabled privacy settings for sensitive data Reduced bug-fixing cycle times Reduced the number of transports Improved availability of production data in development environment Helped create training environment based on specific data requirements Reduced database footprint from 25 TB to 3 TB in the nonproduction environments 2015 SAP SE or an SAP affiliate company. All rights reserved. Customer 27

30 Q&A

31 Thank you Jose Ruiz Specialist Quality & Security SAP Lac North Adrian Matias Batyk DMS/SLO Consultant SAP Solution Delivery Center System Landscape Optimization +54/11/ SAP SE or an SAP affiliate company. All rights reserved.