1 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Transcription

2 Protect and Serve: How to protect confidential data in and out of your EBS and Fusion Apps databases Jagan R. Athreya Director, Product Management, base Manageability 2 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

3 Program Agenda Costs of production data in test environments Application data model and data discovery subsetting masking Protection for Oracle Applications 3 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

4 Program Agenda Costs of production data in test environments Application data model and data discovery subsetting masking protection for Oracle Applications 4 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

5 Definitions Personal data is information that either uniquely identifies a person, or from which a person can be identified (often known as PII: personally-identifiable information), including information associated with that person. privacy is the right of individuals to expect that their personal information is treated appropriately according to company policies and applicable laws. Individual s right to exert control protection is the set of mechanisms employed to ensure that personal data is private and secure, and is accessed only on a need-to-know basis. 5 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

6 Privacy Classifications Distinction between PII, Sensitive and Personal data Personally Identifiable Information (PII) is any piece of information which can potentially be used to uniquely identify, contact, or locate a single person. Personal is any information about any identifiable individual, held electronically or manually, and normally used for business purposes. This includes information such as office address, address, office telephone. Sensitive includes a person s name along with any Personal revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, professional or personal affiliations, or health or sexual life. 6 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

8 Challenges in Setting up Test Systems Cannot use sensitive data in test without obfuscation Producing relationally intact subset is hard but necessary Full production copies for test systems not cost effective Test System Setup Error-prone, manual process 8 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

9 Complexity of Enterprise Applications Financials Supply Chain Management Human Capital Management Customer Relationship Management z What is the relationship between tables across the various applications? What are the data extraction rules that produces referentially intact subsets? Will the subsetted data fit into the available storage for test systems? What are the various types of sensitive data used across the applications? Where are these sensitive data stored and how are they related to each other? 9 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

11 Program Agenda Costs of production data in test environments Application data models and data discovery subsetting masking protection for Oracle Applications 11 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

12 Discovery and Modeling Application Models Scans application schemas to model relationships between tables and columns Extract data relationships from Oracle Applications meta-data Oracle ebusiness Suite Oracle Fusion Applications Store referential relationships stored in repository Enables test data operations such as data subsetting, masking Relationship Modeling Sensitive Identification Test System Setup Subsetting Masking 12 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

13 Discovery and Modeling Sensitive Identification Sensitive data discovery Pattern-based database scanning Import from pre-built mask templates Masking Templates for Oracle Applications Fusion Applications E-Business Suite Relationship Modeling Sensitive Identification Test System Setup Subsetting Masking 13 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

14 Sensitive Column Discovery Discover the sensitive column using patterns Create Sensitive Column Types using Regular Expression to define the pattern for column name, comment, or data Run a discovery job to scan the database and discover the sensitive columns Import from masking templates Import the masking templates for Oracle Applications such as Fusion Applications Sensitive columns will be automatically tagged Set columns as sensitive Manually Add columns directly in the sensitive column list 14 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 14

16 Subsetting What? A relationally intact and yet fractional representation of production data for test and development purposes Why? Reduce the storage overhead created by production data copies in various application z environments Allow developers to perform real world application development by using production-class data Production Application data Test Application data Relationship Modeling Sensitive Identification Test System Setup Subsetting Application metadata Subset criteria: REGION = NORTH AMERICA AND FISCAL_YEAR = 2009 Application metadata Masking 16 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

17 Select Applications for Subset Relationship Modeling Sensitive Identification Test System Setup Subsetting Masking Financials Supply Chain Management Human Capital Management Customer Relationship Management z Identifies the tables associated with the application(s) Transfers relationships between tables from ADM into Subset Definition Transfer additional metadata from the ADM into Subset Definitions Constraints, Indexes 17 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

18 Define Subset Parameters Relationship Modeling Sensitive Identification Test System Setup Subsetting Masking Time (FY:2011) Dimension (Region:Asia) Space (Size:10%) Analyzes dependencies between tables to select the subset driver tables by traversing down and across the ADM Defines extraction (WHERE) clause to select the rows for each of the tables that will included in the subset Analyzes table statistics to estimate size of the database generated from the specified subset parameter 18 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

19 Subsetting - High Performance Execution Production Export = Writing subset data via Pump Import Test pump Export file Production Clone In-Place subset = Deleting data in the same database Test base size Subset size Time* Pump method 1 Terabyte 200G (20%) 1 hour 8 minutes Clone and delete 1 Terabyte 200G (20%) 5 hours 49 minutes 19 Copyright 2012, Oracle and/or its affiliates. All rights reserved. *2-nodes Intel Xeon 6-core X5675 Processor w/ 216G memory running OEL 5.5

21 Secure Test System Deployment Masking Production LAST_NAME SSN SALARY AGUILAR ,000 Relationship Modeling Test Sensitive Identification Test System Setup Subsetting LAST_NAME SSN SALARY SMITH ,000 Masking BENSON ,000 MILLER ,000 Deploy secure test system by masking sensitive data Extensible template library and policies for automation Sophisticated masking: Condition-based, compound, deterministic Integrated masking and cloning NEW in EM 11g: Heterogeneous Masking NEW in EM 11g: Pre- and Post-mask commands and command line (EMCLI) support NEW in EM 12c: Masking integration with Real Application Testing NEW in EM 12c: Key-based reversible masking 21 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

22 Oracle Masking Comprehensive and Extensible Mask Library Mask formats for common sensitive data Accelerates solution deployment of masking Extensible mask routines Enables customization of business rules Define once, apply everywhere Ensures consistent enforcement of policies 22 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

23 Oracle Masking Sophisticated Masking Techniques Conditionbased Masking Compound Masking Compound Mask Sets of related columns masked together e.g. Address, City, State, Zip, Phone Condition-based Masking Specify separate mask format for each condition, e.g. driver s license format for each state SQL-expression based masking Use SQL functions, e.g. UPPER, SUBSTR, TO_CHAR, to generate mask values, e.g. SUBSTR(%ORIG_VALUE%,1,3) Copyright 2012, Oracle and/or its affiliates. All rights reserved.

24 Heterogeneous Masking Enterprise Manager Cloud Control with Masking Oracle bases manage manage manage Production (Oracle) Staging (Oracle) Test (Oracle) Production (non-oracle) Staging (Oracle) Test (non-oracle) Non-Oracle bases base Gateway base Gateway monitor manage monitor Relationship Modeling Sensitive Identification Test System Setup Enterprise Manager Cloud Control with Masking Subsetting Masking 24 Copyright 2012, Oracle and/or its affiliates. All rights reserved. Available for IBM DB2, Microsoft SQLServer, Sybase

25 Key-based Reversible Masking New in EM 12c Mask format is preserved Any pattern and any length Numeric, alphanumeric or mixed Deterministic Unique Key-based Unmask Reverse the masked data back to its original value with the same key 25 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

26 Secure base Testing New in EM 12c End-to-end testing with real workloads Create Test System Capture Workload SQL Performance Analyzer Replay Workload SQL unit testing for response time Identify and tune regressed SQL Integrated into SQL Tuning Advisor and SQL Plan Baseline Deploy Replay Clients base Replay Load, performance testing for throughput Remediate application concurrency problems Integrated with Oracle Application Testing Suite for superior comprehensive testing solution Seamless integration with Masking to preserve data privacy compliance 26 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

27 Masking Real Application Testing Workloads Real Application Testing Integration with Masking Copying production data to test systems puts sensitive information at risk Perform secure, production-scale testing Sensitive data found in workload capture files and STS are masked along with application data STS bind data (used with SPA) Workload Capture files (used with DB Replay) AWR sensitive bind data is purged Consistent masking across all data sources and workloads 27 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

29 Oracle Applications Cloning Techniques Enterprise Manager Enterprise Manager App Mgt Suite Source-to-Target Source-to-Image Image-to-Target Hot Cloning RAC Cloning Smart Clone 29 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

30 E-Business Suite Masking E-Business Suite Masking Template Metadata for the EM Masking tool Columns, Relationships, and Masking rules for PII and Sensitive attributes for E-Business Suite products Instructions for wiping credentials after cloning (Support Note ) 950 Columns / 1900 rules 65% HCM - Payroll, Employment Details, Personal Info Also TCA, ATG, Financials, Projects Not split out by product or family De-identification needs to be done across the DB 30 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

31 Goals in Application Masking De-Identify the data Scramble identifiers of individuals (PII) Name, account, address, location, drivers license Mask sensitive data Mask the data that, if associated with PII, would cause privacy concerns Compensation Health Employment Information Maintain Validity Don t break the application (too much ) 31 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

32 PersonaIIy Identifiable Information Name Business Location Business Phone Business ID Accounts (Bank, debit, credit) Location External ID (drivers license) National ID (social security number) Web Site Phone 32 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

33 Personally Identifiable Information Person Name Web Site Pension ID Number Maiden Name National Identifier Article Number Business Address Passport Number Civil Identifier Number Business Telephone Number Drivers License Number Hafiza Number Business Address Personal Address Social Security Number Custom Name Personal Telephone Number Trade Union Membership Number Employee Number Personal Address Pension Registration Number User Global Identifier Visa Number or Work Permit National Insurance Number Customer Number Bank Account Number Health Insurance Number Account Name Card Number (credit or debit) Personal Public Service Number Mail Stop Tax Registration Number or National Taxpayer Identifier Electronic Taxpayer Identification Number GPS Location Person Identification Number Biometrics Student Examination Hall Ticket Number Welfare Pension Insurance Number Digital ID Club Membership ID Unemployment Insurance Number Citizenship Number Library Card Number Government Affiliation ID Voter Identification Number Identity Card Number Military Service ID Residency Number (Green Card) Instant Messaging Address Social Insurance Number 33 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

34 Sensitive Compensation Employment details Nationality / Citizenship Health Information Personal information Mother's maiden name Passwords Encryption keys Audit information Session information 34 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

35 Providing access to the masked DB Masking PII helps to make identities less obvious - but it does not make it impossible to identify people in the test data. The masked database is not intended for release to the public Access should be carefully controlled Users who do have access should be as aware of their responsibilities and obligations as are the staff who use the live data The processes around test data based on live data should mirror the processes around the live data Provide individual accounts only - generic accounts (e.g. sysadmin access) can compromise security 35 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

36 Masking Considerations Masking data may break basic validation rules US address validation Lookup or valueset validated values or more complex ones Historical tax calculations / payroll runs Variations between legislations / countries Legislative address validation National identifiers (SSN, NI Number etc.) Uniqueness Setting all values the same or NULL may be valid, but undermine the value of the tests 36 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

37 What are we not masking? Financial data Results Forecasts Design Specs Unstructured data Descriptive Flex Fields However we are attempting to mask Developer and Localization flex fields where we know the content Notes Attachments Internal primary keys (user_id, person_id) 37 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

38 Masking Templates for Different Code Levels Some sensitive columns are delivered as part of product maintenance packs EBS Mask will be a superset of all columns When running against your patch level, need to remove the columns that do not exist Edit mask Sort by Type Remove columns of null type 38 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

39 Customizing the Template We ll be masking names of Apps (FND) users You won t be able to use these For seeded users (e.g. SYSADMIN) we ll be retaining the names but resetting the passwords Depending on the application you may want to maintain local users for testing New interface table to populate exempt users : Users exempted from masking If they should be renamed (JSMITH TEST1) Specify a new password 39 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

40 EM Masking vs. AMP Scrambling Apps Maintenance Pack Scrambling Tightly integrated in with AMP cloning Seed rules for EBS EM Masking More sophisticated masking mechanisms user defined, denormalized columns EBS is focusing on tighter integration with EM Masking No plans to provide a metadata upgrade from AMP Scrambling to EM Masking Results in less sophisticated masking rules Should leverage new templates 40 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

41 Availability What versions will it be available on? Fusion Applications available now E-Business Suite Initially on we re designing it to be certified on earlier releases, based on demand When will it be available? Currently in final testing 41 Copyright 2012, Oracle and/or its affiliates. All rights reserved.