Cost Effective Data Management for Oracle Utilities Applications

Transcription

1

2 Cost Effective Data Management for Oracle Utilities Applications Anthony Shorten Principal Product Manager Oracle Utilities Global Business Unit Sept, 2014

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 3

4 Data Management Overview Movement of Configuration Data Manage Storage Costs Test Subset Data Development Build Gold Verification Production 4

5 Data Management Design Principles Comprehensive set of tools Data integrity must be protected Data management is a shared responsibility Use the right tool for the right situation Flexibility is important 5

6 Data Management Strategy Data Types DM Owner Tool Configuration Data (e.g. rates) Business Administration Configuration Migration Assistant Administration Data SDK Meta Data Developers Blueprinting Configuration Migration Assistant ConfigTools Meta Data Developers Bundling Configuration Migration Assistant Master Data Business Administration Test Data Management Pack Transaction Data Business Administration Test Data Management Pack Information Lifecycle Management 6

7 Data Management Tools Feature Comments License Blueprinting Tool for transferring meta data from Oracle Utilities SDK. Primarily for developers. Included Bundling ConfigTools based migration of solutions for developers and prototypes. Included Configuration Migration Assistant (1) Information Lifecycle Management Test Data Management Pack Export of administration data with change approval/rejection facilities Storage cost reduction through application of data policies. Requires Partitioning License. Export of subset of production for test purposes with optional data masking support. Requires Test Data Management Pack license. Included Additional Additional 1. OUAF based products and above only Oracle Commercial In Confidence 7

8 Developer Tools Blueprinting Blueprints Transfer data from Oracle Utilities SDK to target environment Generates blueprint data files Used for initial transfer only Basic integrity tracking Works in conjunction with other tools (CMA, Bundling etc) to implement migrations Not recommended for other migrations Bundling Bundles Solution oriented ConfigTools migration Developer adds objects as they complete them No dependency support Order is important! Simple XML based import Designed for delivering standalone solutions Not recommended for other migrations 8

9 Configuration Migration Assistant Overview 9

10 Configuration Migration Assistant Migration of Configuration Across environments Increase agility in configuration Protect your configuration Maintain configuration sets Provide rollback capabilities Link code and data for releases Decrease risk Decrease unintentional change Decrease TCO 10

11 Configuration Migration Assistant Features Simple Concept Export Configuration Information Import Configuration Information No Technical Setup Required Reusable Meta Data driven execution Migration Plans defines relationships and sequence Migration Requests sets up group of objects, with criteria, to migrate in a single migration Supports complex objects CLOB Support XPATH Support for relationship and criteria Approval and Rejection of Individual Changes Auto Approval or Manual Approval support Request level support Request level application Request level tracking Reusable migrations Reuse the same migration across environments Support for code repositories Data validated upon import to protect integrity 11

12 Configuration Migration Flow Export File Define Migration Export Export Data Define Migration Import Import Data Apply Changes Migration Request Migration Request Approve/Reject Migration Plan Migration Plan Source Target 12

13 Meta Data Driven 13

14 Approvals Individual changes can be approved or rejected Protects test cases Unchanged data is also indicated (for verification) Advanced filtering is available Changes only Approval history is kept for auditing 14

15 Information Lifecycle Management 15

16 What are the challenges? Management Challenge Query performance Duration of basic data operations Availability of data Cost Challenge Volume of storage required Energy costs increase Overhead to manage Cost of downtime 16

17 Today's Reality Single Tier of Disk Storage Multi-tiered Disk Storage Modern Multi-tiered Storage Most customers are on single tier of storage 38% 6% 32% Flash Storage $40 - $54/GB Performance Disk $7 - $22/GB Capacity Disk $1 - $6/GB 100% 62% 60% MAID Drives $ $1/GB Average ~$15,000/TB Average ~$8,000/TB Average ~$4,000/TB Source: Horizon Information Strategies

18 Benefits of Oracle for ILM Over 30 years of Investment in Data Management Performance Security Safety Consistency Fastest and most functional access to data Retained data uses same security as current data Full protection from corruptions, errors, disasters Data is transactionally consistent Flexibility Hardware Simplicity Open Easily adapts to changing requirements Total hardware independence No specialized data stores to manage Standard SQL interfaces 18

19 Data Lifecycle Managing Data from Birth to Death Time Update Activity Read Only Activity Purge/Archive Activity Active Occasional Read Access Dormant Creation Business no longer updates the data Business no longer needs the data Data is removed Potential Storage Cost Savings 19

20 Information Lifecycle Management based approach Set of technologies and approaches within Oracle technology ILM Assistant Automatic Data Optimization (12c) Compression Adv Compression HC Compression Partitioning Automated Storage Mgmt 20

21 ILM Assistant Manages the ILM definitions Define Lifecycle Definitions Illustrates Storage Costs & Savings Manage Compliance & Security Calendar of ILM Events Simulates the impact of solution Advises how to Configure Database for savings Generates & Schedules Scripts to implement ILM policies 21

22 Oracle Utilities ILM solution 22

23 Components of the ILM Solution Master Configuration Record Maintenance Object (Options) ILM Crawler Default Retention Period ILM Retention Period In Days ILM Crawler Batch Control ILM Eligibility Algorithm etc Time Active Frequent Access Occasional Access Dormant Active Dormant ILM_DT set Retention Period ILM_DT + Retention Period reached ILM_ARCH_SW set ILM Assistant (Compression, Partitioning) 24

24 Utilities Approach to ILM IT Group Business Set Global Defaults Setup Data Groups Setup Storage Set Object specific Defaults Configure ILM Storage options Optional: Set Additional Business Rules Execute ILM Crawlers Run Cost Simulations Optional: Configure Automatic Data Optimization Generate ILM Scripts 25

25 Master Configuration Set Company defaults 26

26 CCB V2.4 SP2 ILM implementation Based on Input from a Cross Section of Implementations Financials Financial Related Operational Adjustment Bill Bill Segment Billable Charge Pay Event Payment Adjustment Approval Billable Charge Match Event Off Cycle Bill Generator Field Activity Meter Read Usage Request Order Case To Do Management Outbound Messages Service Tasks Sync Requests Object Revisions 27

27 MDM ILM implementation Based on Input from a Cross Section of Implementations Measurement Other Operational Measurement Initial Measurement Data Usage Transaction VEE Exception Device Event Activity Communication (In/Out) Completion Events To Do Management Outbound Messages Service Tasks Sync Requests Object Revisions 28

28 Test Data Management 29

29 Provisioning Secure Test Environments Data Subsetting and Data Masking Data Masking Data Subsetting Replace sensitive production data with fictitious yet realistic data in Development and Test Comply with regulations while enabling realistic application testing Effective Application Testing Provision a fractional yet relationally intact representation from production data in Development Reduce storage costs while enabling realistic application development 30

30 Test Data Management from Oracle Enterprise Manager Test Data Management Pack Test Data Management Secure subset of Production Define Application Model Define Subset rules (SQL, etc) Fast and Secure Uses Oracle Data Pump Scalable and Proven technology Transparent Data Encryption Support Data Masking Pack Data Masking Ensure PCI and Privacy Compliance Predefined algorithms to manipulate data Secure Data does not leave database (12c) Protect data but reuse data distributions for testing 31

31 Test Data Management Support No product specific support required Create Application Model Documentation in Best Practices on loading our application model Define criteria predicates as required Oracle Utilities Customer Care And Billing customers can use Account Staging for "spot" extracts. 32

32 Test Data Subsetting Export / Import Production Define new Application Data Model Create Data Subset Definition Extract Data Subset In-Place Delete Test Automatic data extraction rules from Application Data Model Estimate subset size before execution Parameter-driver before execution Unique to Oracle: Data Pump-based subset creation 33

33 Data Masking Irreversibly De-Identify Data for Non-Production Use Production Non-Production LAST_NAME SSN LAST_NAME SSN AGUILAR BENSON ANSKEKSL BKJHHEIEDK Data Never Leaves Database Makes application data securely available in non-production environments Prevents developers and testers from seeing the actual production data Provides an extensible template library and policies for data masking automation Integrates with Real Application Testing and Test Data Management 34

34 Summary Oracle Utilities has a comprehensive set of data management solutions Feature Product Additional Blueprinting Bundling Configuration Migration Assistant Test Data Management Pack (1) (2) Information Lifecycle Management (1) 1. Requires additional components and license 2. Auto-generation of Application Model in future version of Application Management Pack for Oracle Utilities 35

35 Questions 36

36

37