Software Control Data Management Presentation Sogeti Data Management Dirkjan Kaper September 2012 Today 1. Why TDM? 2. The process 4. Roll out 3. The TDM Cycle 1
TMap and Data Index: 0 hits (testdata/testgegevens) Glossary: 0 hits (testdata/testgegevens) 3. TMap in essention: 0 6. Acceptance and system tests Define central position: testgegevens > testdata: 6 pages Setting the entry situation: no single word testdata 8. Supporting processes: Tools for test t design: 10 lines for the magical testdatatool Stubs and drivers: 10 lines Data Management Why? 2
Why? Complexity Compliancy Time Size Why? >50% Reduction test data preparation >75% Smaller test environments We achieve this by: Faster Data preparation Improved efficiency of test data (designed data) Better alignment with test environments Efficient use of data tooling Continuous and pro-active process improvement >10% Improved time to market 3
Data Management The TDM process types and typical data sets type object Requirements data Unit A part of a system (part of the) system Small, simple set requirements System The system as a whole System requirements Medium set simple data System Integration ing the integrated system Interfaces and E2E Complex set across some systems User The system stem as a whole User requirements Small set production- Acceptance like across multiple A fit-for-purpose test systems Production Acceptance Ready for production test IT service management requirements (SLA, SAC, non functional requirements) Production(-like) data 4
Which data for a test type Datatype Source Enhance type determines data Demand Config Reference Logging Process Stubs Tooling Manual Production Scripting Synthetic Mask Sub/Superset Aging Process Manual Scripted oo g Scripted data sets Data Management (TDM) Landscape Data a Management Execution Script and Automation Data Applications under sync Master Data sync Managed Data Data Requirements Environment Environment Data Requirements 5
TDM, Execution in detail Data a Management Production Sources Subsetting TDM Proces Omgevingen Omgevingen Environments Masking Enhancing Data Data Sets Generation Data Requirements Requirements TDM, Maskering and subsetting in detail Data Manageme ent Production Sources Data Mapping (*) Vulnerability scan (*) Selection criteria Data Script the Script Deploy the Script Design Data Generation Masking Rules Data Design High level Data Design (*) = optional 6
TDM, Execution in detail Data Manageme ent Production Sources Subsetting TDM Process Masking Data Generation Omgevingen Omgevingen Environments Enhancing Data Sets Production TDM Repository Data Script Define Compliancy Targets Determine legal scope Limit business exposure Describe on a meta data level Only by risk/complance Prepare to scan your systems 7
Data Management The TDM Cycle The Sogeti Data Management Process Data Management Manage the Process Manage Change Demand determines the data Get requirements Design Business rules Sources Data Prepare Prepare scenario Prepare scripts Provision Execute! The right data, at the right time, on the right environment 8
TDM Cycle - Demand (1/2) Demand determines test data demand Get (test data) requirements Determine scope TDM Cycle - Demand (2/2) Tools Requirements management Deliverables Data Requirement High Level Design Planning Roles Data Analyst Business Analysts/ers 9
TDM, Capturing the demand Te est Data Manage ement Systems Connections Scope Stubs High Level Data Design Data Quality # LTC s # FTC s Automation Business Rules Environment Sources Versions Data Model(s) Planning Type Existing data Plan and Requirements (*) = optional TDM Cycle - Design (1/2) Determine datasets Business rules Constraints Interfaces Sources 10
TDM Cycle - Design (2/2) Tools Data Analysis Design tooling Deliverables Data Design Roles Data Analyst Business Analysts/ers TDM Cycle Prepare (1/2) 11
TDM Cycle Prepare (2/2) Tools Scripting Generation TDM / ETL tooling Deliverables Data Scenario Data Script Roles Data Engineer TDM Cycle - Provision (1/2) Execution Use and control Notifications The right data On the right environment At the right time 12
TDM Cycle - Provision (2/2) Tools TDM tooling Resource management Backup/Restore Stubs, drivers Deliverables TESTDATA! Roles Data Engineer environment manager TDM Costs and Benefits Costs dependent on requirements Implementation Cost Tooling Number of datastores Benefits Smaller test environments with data of right size Faster Data preparation Faster Data refresh Complex End2End testing on integrated environments Compliancy Risk reduction 13
Data Management from Sogeti Sogeti offers A defined TDM approach and process Clearly defined services National and international TDM experience Partner with leading TDM suppliers Sogeti helps you get your test data right The right data At the right moment On the right environment Data Management TDM Rollout 14
Implementation Targets & Expectations Scope Security & Governance Business Case Evaluatie Deployment Strategy Security & Governance Acceptance Evaluation Processes & Roles Knowledge & Skills Products & Tooling Project Setup TDM tool selection Roadmap Pilot Proof of Concept Processes & Roles Knowledge & Skills Realisation Changes Products, Data & Tooling Maintenance Expansions Application landscape Releases Initiation Pilot Implementation Operations 29? 15
TDM, Project stages Preparation Setup Integration Roll Out Security Policies Tool Selection Process Prioritize Scope/ Requirements Process Setup Infrastructure Manage Change Process Definition Tool installation Security Roll out Strategy Organisation Training Change Process Managing the TDM cycle 16