Private Database Cloud Database Consolidation Planning and Best Practices Nitin Vengurlekar Viscosity CTO/Cloud Evangelist Charles Kim Viscosity President/Oracle Architect 1 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Ni#n Vengurlekar Oracle Product Strategy and Private Cloud Evangelist 17 Years with Oracle, 10 years Oracle RAC development Over 24 years of Oracle Expertise, RAC, Data Guard, ASM, RMAN Private Database Cloud Evangelist and author of the Cloud Best Practices, Isolation and Security Management in Private Database Cloud Author of Oracle Press ASM Cookbook and Oracle Data Guard Handbook 2 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Charles Kim 3 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Program Agenda What is Private Database Cloud Why Database Cloud Consolidation Private Database Cloud deployment models Database Cloud Consolidation Planning and Considerations Engineered Solutions and the Private Database Cloud 4 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
NIST Definition of Cloud Computing Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model promotes availability and is composed of: 5 Essential Characteristics On-demand self-service Resource pooling Rapid elasticity Measured service Broad network access 3 Service Models SaaS PaaS IaaS Source: NIST Definition of Cloud Computing v15 4 Deployment Models Public Cloud Private Cloud Community Cloud Hybrid Cloud 5 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Customers Have a Choice of Clouds Own & Operate, Use Managed Services, Subscribe Private Cloud Managed Cloud Services Public Cloud Build Managed Subscribe Customer owns, hosts and manages. Customer owns. Service provider manages. Either may host. Customer subscribes. Service provider hosts and manages. 6 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Database Cloud Business Drivers Lower: CapEx Servers Storage OpEx Maintenance Management Enable: Online changes Rapid response Faster Time to market Reduce IT Costs Increase Agility Reduce Complex ity Increase Quality of Service Reduce: Configurations Services Standardize: OS DB Versions Enhance: IT service time Availability Security 7 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Customers Have a Choice of Clouds IaaS, PaaS or SaaS Different Users Consumer Service Provider IT Professional Developer Business End User Customizations Customizations Customizations Application Application Platform SaaS Cloud PaaS Cloud IaaS Cloud Consumer Service Provider 8 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Architectures Common building blocks are shared server and storage pools Infrastructure Cloud Database Cloud Database Cloud DW CRM ERP DW ERP CRM DW ERP CRM DB OS DB OS DB OS DB DB DB DB Hypervisor Hypervisor Platform Platform Platform Platform Server Consolidation Deploy in dedicated VMs Server virtualization Database Consolidation Share server pool Real Application Clusters Schema Consolidation Share database instances Real Application Clusters 9 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Infrastructure Cloud Server - Provision a Database in a VM Reasons for adoption Simple to implement Excellent isolation Mixed workloads As-is consolidation Legacy support Customer concerns Lower consolidation density Lower ROI Performance (latency) Managing sprawl DW DB OS CRM ERP DB DB OS OS Hypervisor 10 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
Database Cloud Database Consolidation Provision Database Reasons for adoption Consolidation density Good ROI Performance Supports any app DW DB ERP DB CRM DB Customer concerns Requires OS standardization Database only OS OS 11 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
Private Database Cloud Database Provision Schema Reasons for adoption Most efficient Extremely fast provisioning Best ROI Performance Efficient memory use Customer concerns App qualification required Requires OS and DB standardization Isolation DW OS ERP DB CRM OS 12 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
Private Database Cloud Deployment Schema Consolidation - Provision a Schema Most efficient Highest consolidation density. Capability to consolidate large number of applications. Efficient use of memory. Single large SGA opposed to several disparate SGAs Minimizes items to manage. Less OS, databases, and configurations to manage Reduces overall operational costs and overhead Extremely fast provisioning Provisioning is simply a schema and tablespace creation Performance Native performance DW OS ERP DB CRM OS 13 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment Schema Consolidation Considerations Requires OS and DB standardization Application certification required Isolation Management 14 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
ROI Private Database Cloud Greatest consolidation, maximum ROI Database Cloud Schema Database Infrastructure Cloud 2011 Oracle Corporation Storage Servers Consolidation 15 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
A View of the Private Database Cloud Cloud, An Aggregation of Cloud Pools 11gR1 Cloud Pool Database Consolidation Cloud Pool Schema Consolidation Cloud Pool Schema Consolidation Cloud Pool Infrastructure Cloud 11gR2 Cloud Pool Exadata - Database Consolidation Dev/test Cloud Pool Infrastructure Cloud 16 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Cloud Architectural Assessment Pick the architecture that best suits your needs Business Value Infrastructure Consolidation Database Consolidation Schema Consolidation Implementation Easy Easy Difficult* Application Suitability Some All Some Isolation Highest High Limited Availability High Highest Highest Scalability Limited Excellent Excellent Consolidation Density Low High Highest ROI Low High Highest * = Need to ensure application schemas can co-exist 17 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
Recommended Cloud Architectures Each architecture has unique capabilities that warrant its use for specific workloads: Workload Type Optimal Cloud Architecture Mission or Business Critical Deployment Packaged Applications Data Warehouse Applications Standardized environment Internal Applications Rapid provisioning (i.e. Test and Dev) Mixed workload consolidation As-Is consolidation 18 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Database (Dedicated Pool) Infrastructure,Database or Schema Database or Schema Database or Schema Database or Schema Database or Infrastructure Infrastructure Infrastructure
PRIVATE DATABASE CLOUD PLANNING 19 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Planning Before designing and implementing a Cloud, it is critical to carefully plan for the deployment. Selling the Plan Discovery Rationalize/ Consolidate Many of the Cloud benefits are delivered from rationalizing the existing environment and standardizing the deployment model. A thorough and complete planning phase will ensure that a customer s Cloud environment is optimal and provides the most benefit. Application Migration Exception Handling Architecture Selection Cloud Planning Process 20 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Rationalize Infrastructure IT rationalization determines the best use of IT services to reduce non-productive redundancy in enterprise IT solutions By standardizing on a set of building blocks, IT departments can easily deploy pre-defined configurations and scale-out using modular components. Standardization results in a more homogeneous environment that is easier to manage, lower cost, less complex, and more agile. 21 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Rationalize Infrastructure Can the customer reduce the number of OS and DB versions? Standardizing OS & DB versions will result in improved ROI Customers should look for opportunities to do this Can the customer standardize its hardware infrastructure? Reduce server and storage configurations Consider pre-integrated hardware platforms (Exadata) Can the customer standardize its workloads to run against a single database? 22 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Rationalize Infrastructure How will the customer rationalize the Cloud infrastructure? Can the customer reduce the number of OS and DB versions? Standardizing OS & DB versions will result in improved ROI Customers should look for opportunities to do this Can the customer standardize its hardware infrastructure? Reduce server and storage configurations Consider pre-integrated hardware platforms (Exadata) Can the customer standardize its workloads to run against a single database? 23 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Customer Case Study Example of services for large commercial bank Service Levels Silver OLTP Gold OLTP Pla2num OLTP Pla2num OLAP Pla2num OLTP+OLAP High Availability VM High Availability Dual Node Cluster 2N+1 Clustering 2N+1 Clustering 2N+1 Clustering Support Hours Office Hours Only Extended Office Hours 24 x 7 24 x 7 24 x 7 Disaster Recovery Point Objec2ve Disaster Recovery Time Objec2ve Performance Point- in- Time Recovery Typical Applica2ons Zero Data Loss Zero Data Loss Zero Data Loss Zero Data Loss Zero Data Loss 2 Business Days < 4 Hours < 4 Hours < 4 Hours < 4 Hours Not Defined 1 Weekly + Daily Incremental Backup Departmental ApplicaQons Defined Minimum 1 Weekly + Daily incremental + REDO Logs Line of Business ApplicaQons Dedicated Benchmark Environment Dedicated Benchmark Environment Dedicated Benchmark Environment Historical Data Management Historical Data Management Historical Data Management Enterprise TransacQon Processing ApplicaQons Enterprise Datawarehouse Near- Real Time AnalyQcs Infrastructure Cloud (OVM) Database Cloud (ODA) Database Cloud (on Exadata) 24 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment DB Cloud changes how you think about deployment Tenant Isolation Resource Operational Security Fault Bottom line : Contain Noisy neighbor 25 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment DB Cloud changes how you think about deployment Resource Management Enable Instance Caging with default resource plan Enable Resource Profile limits Enable Oracle QoS Management Trades-off resources just-in-time to maintain SLAs Ensure business critical applications get serviced and meet response time SLAs Quarantine application by shutting down service or move workload 26 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Database Consolidation Instance Caging: Partitioning Approach Provides maximum isolation For performance-critical databases 16 CPUs DB D 32 28 24 If one database instance is idle, its CPU allocation is unused Set CPU_COUNT minimally to 2 DB A DB B DB C 16 OS 20 16 12 8 4 0 Instance D: 4 CPUs Instance C: 4 CPUs Instance B: 4 CPUs Instance A: 4 CPUs 27 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Database Consolidation Instance Caging: Over-Provisioning Approach Best used for non-critical databases that are typically well-behaved 22 CPUs 32 Best approach if the goal is fully utilized CPUs CPU contention typically not enough contention to destabilize OS or DB instances If assumptions listed are met. If the load is significant and of longer duration, system stability can get impacted. DB A DB B DB C DB D 16 OS 28 24 20 16 12 8 4 0 Instance D: 8 CPUs Instance C: 6 CPUs Instance B: 4 CPUs Instance A: 4 CPUs 28 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment DB Cloud changes how you think about deployment Patch and Upgrade Define a Patching and planned outage strategy Leverage Rolling Upgrades Minimize downtime using out of place patching Leverage 11.2 Standby Apply First feature Emergency patch scenarios for specific application Clone new ORACLE_HOME Unplug/plug schema using TTS into new database but same diskgroup Patch the new database and new ORACLE_HOME 29 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment DB Cloud changes how you think about deployment Recovery strategies How you backup affects your recoverability Recovery Granularity Objective (RGO) becomes very important Recover the application using least impacting method Flashback technologies (Flashback transaction, table, query) TTS/PIT recovery or Datapump restore Flashback DB 30 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Deployment DB Cloud changes how you think about deployment Security Management Only Cloud DBA should have SYSDBA, SYSOPER and SYSASM privileges Tenant DBAs should only have schema level access Use database roles and privileges to further limit data access Secure each application/schema with an Oracle Database Vault Realm Deploy Multi-factor rules to enforce who, where, when, and how data is accessed Enable encryption on the tablespace 31 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Provisioning How will tenants request Cloud Services? POLL: How many customers have implemented Self-Service Provisioning? If so, what tools or products are they using How are customers implementing IT Provisioning? What is the workflow process What is the turnaround time for typically database deployments? 32 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Planning Database Cloud Considerations What type of database provisioning Self Service Requires a robust Self Service Catalog Need UI for provisioning Provisioning Workflow IT Based Very Manual Need a method for queuing and reconcillation 33 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Metering and Chargeback Customer Consideration and Questions POLL How many customers have or will implement chargeback What chargeback tools are used, are they home grown or off-theshelf? How are customers measuring resource consumption? 34 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Planning Metering-Chargeback Considerations Chargeback Provides cost relief Chargeback is a good mechanism to prevent database sprawl Many customers have chosen not to implement any chargeback Show-back Don t actually do chargeback, but do show-back Makes tenants and consumers cost conscious and consumption aware Provides accounting of usage patterns Can easily switch to chargeback model if needed. 35 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Metering and Chargeback What are your Chargeback models? Typical Fixed Costs Tenancy (i.e. Monthly charge, configuration) Resource allocations (storage, CPU) Deployment options - Data Guard, GoldenGate, etc. Service levels Charge for addiqonal service level support or higher availability Typical Variable Costs Resource utilization CPU Used - peak, average, time of day (common) Network, IOPS (rarer), Storage 36 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Metering and Chargeback Do you charge for operational changes? Service charge for operational changes Prevents excessive changes in the environment Define quantity and type of pre-paid operational requests. What is considered an additional request (i.e. first 3 change requests could be built-in to the deployment)? Additional changes in a calendar year are subject to cost/ change Init.ora change Create test/dev environment Additional physical backup Additional Patching 37 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
DB Cloud Planning Application Migration Readiness Applications may be in various states of technical readiness for a cloud environment, based on application characteristics and requirements Name-space conflicts (relevant for schema consolidation) Character set requirements (relevant for schema consolidation) I/O rate requirements Applications may have business constraints on their ability to be migrated to the cloud Service level agreements Security Compliant restrictions PCI-DSS, HIPPA, etc. datasets cannot be comingled 38 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
DB Cloud Planning Application Migration Readiness Special requirements for a given application may make it difficult to migrate Decide whether the cloud will be used for new deployments only, or existing deployments as well Determine when applications will be migrated During an existing maintenance window? As part of a stand alone event for the application to be migrated? Plan a migration process that will cause minimal disruption Choose applications that will provide the biggest benefit Choose low hanging fruit first; Go for quick wins Ensure that early migrations are successful! 39 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Application Selection Customer Example No constraints Constraint to Migrate Many constraints 1 21 7 Not Ready Unlikely to be migrated 5 Immediate Platform candidates 37 34 28 26 23 13 10 2 25 3 11 29 24 27 12 30 31 22 6 17 33 15 32 16 8 9 36 19 20 Longer term Platform prospects Technical readiness for the Platform Very Ready 18 14 35 4 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18.................................................. Workload Legend OLTP OLQP DW /BI Hybrid 19... 20...) 21.. 22... 23... 24... 25... 26... 27... 28... 29... 30... 31... 32... 33... 34... 35... 36... 37... 40 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Best Practices Consolidate & Share as much as possible Dedicate resources to pools Share as much as possible within a pool Dedicate when necessary to meet SLAs Some resources should not be shared Partitioning vs. Oversubscription models Focus on both physical and logical resources Physical resources Servers CPU, Memory Storage Capacity, IOPS Network Logical resources OS images, Homes, Instances, Schemas, Configurations 32 28 24 20 16 12 8 4 0 Instance D: 4 CPUs Instance C: 4 CPUs Instance B: 4 CPUs Instance A: 4 CPUs 16 32 28 24 20 16 12 8 4 0 16 CPUs DB A DB B DB C DB D OS Instance D: 8 CPUs Instance C: 6 CPUs Instance B: 4 CPUs Instance A: 4 CPUs 41 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Best Practices Implement Dynamic DB Services Dynamic Database Services enable Cloud functionality Virtualize service location Availability Agility Resource management Performance Required to get most value from deployment Load Balancing Load Balance Advisory Connection Load Balancing Runtime Load Balancing Agility SCAN Availability Fast Application Notification Fast Connection Failover Transparent Application Failover Performance Data affinity Temporal affinity 42 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
How are Customers Deploying Private Database Cloud Some call it by a different name - OaaS, DBaaS, Private Oracle Cloud Most use modularized building blocks (standard server type, storage, network) Typically use fixed number of Cloud Pool nodes with Data Guard for DR Schema Consolidation very common consolidation model for in-house applications Typically configurations Typically 20-30 consolidated schemas in Schema Consolidation Model and 10-20 databases in Database Consolidation Model Use Database Vault and/or tablespace encryption (ASO) anddatabase Resource Manager 43 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
ENGINEERED SOLUTIONS 44 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Database Cloud Build vs Buy Build-your-own Database Cloud Requires customers to purchase, validate and configure all components Must ensure all components are certified with each other Requires installing and testing of configuration Exadata is a pre-built environment for Database Clouds Pre-tested, pre-configured, pre-installed All components are ensured to work together Reduces overall time-to-market 45 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
The Evolution of the DBA Kind of DBA CLI DBA GUI DBA Google DBA idba RAC DBAs DMA vdba / vrac DBA Cloud DBA Timeline Early 90 s DBAs Late 90 s and Dot Com Dot Com and 2000 s Dot Com, IOUG idba Master Curriculum 2000+ a[er 9.2 (but major spike with 10.2) 2010+ Database Machine Administrator 2010+ Evolving role of a DBA in the virtual world 2011+ 46 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Engineered SoluQons All Engineered Systems are the same Delivered tested and ready-to-run Highly optimized No unique configuration issues Runs existing OLTP and DW applications No special certification required Features optimized for mixed workloads IORM, DBRM 47 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Why Exadata Instance Caging Flash Cache Storage Index XTreme Performance Up to 1.5 Million IOPs Infiniband 40gigE IORM DBRM EHCC DBFS 48 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Database Appliance (ODA) 4 TB of Usable Space Triple Mirrored All of RAC Best Practices in a box 4 SSD for Redo Logs and performance Pre-configured - ready to use out of the box Provision in hours not weeks 49 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Ideal for SMB Leverage ZFS to increase storage requirements beyond 4TB Leverage ZFS with HCC Support
Business Drivers Reduce number of databases Reduce OpEx Cost to managed services provider for tape backups Less number of personnel to manage the Exa Stack Reduce CapEx Reduce storage requirements with HCC 50 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Private Cloud Database Consolidation Oracle enables all levels of consolidation Infrastructure, Database, Schema The higher the consolidation density The greater the return on investment Oracle Exadata Database Machine Ideal Private Cloud consolidation platform Fastest time-to-market Customers already saving with consolidation 51 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 2011 Oracle Corporation
Backup Architecture D2D Forever Incrementals Exadata 1/2 Rack Production IB1 Leaf Switch-A ZFSSA Production Infiniband GigE Exadata 1/4 Rack Development IB2 Leaf Switch-B Net0 for Mgt and Data IB1 Leaf Switch-A IB2 Leaf Switch-B Non-EXA Production ZFSSA DR Non-EXA Development 52 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Tiered Storage Model Customer Case Study Leverage high transactional data on DATA disk group as Tier 1 storage Tier1 DATA Tier2 RECO Tier3 ZFSSA Move data that is older than 3 months from Tier 1 to Tier 2 Move data that is older than 3 years from Tier 2 to Tier 3 Free up 11+ TB of storage from RECO disk group 53 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Information Life Cycle Management Save more space as you go to the ZFSSA Tier1 DATA Tier2 RECO Leverage Warehouse Compression for Tier 1 storage Leverage Partitioning strategy to move data from different tiers of storage Leverage Deeper HCC (Archive High) as we move data from Tier 1 to Tier 2 Tier3 ZFSSA Make Datafiles on Tier 2 storage to be READ-ONLY so that we can skip RMAN backups (backup once and forget about it) After three years convert data to external tables or move the datafiles to the ZFS 54 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Benefits of ZFS Appliance With Exadata, we can only perform backups over network Perform disk to disk backups over extremely low latency 40 GigE Infiniband Leverage Oracle s Direct NFS Provides deep de-duplication and Exadata Hybrid Columnar Compression (EHCC) Provides cloning capabilities Perform backups and restores of 4+ TB Per hour 55 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Summary - Roadmap to Database Cloud Oracle DB Service Catalog Oracle DB-as-a-Service Heterogeneous DB Environments Standardize on Oracle Oracle DB on Exadata 56 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Summary Private Database Clouds consolidate servers, storage, operating systems, databases, and workloads Many customers are successfully deploying Private Database Clouds today They are benefiting from high quality of service, low cost, reduced complexity and increased agility Oracle EM 12c provides customers with end to end Cloud Management Self-service paradigm for database deployment and management On-demand scalability of underlying platform Metering and chargeback for IT accountability Extreme agility for developers, with enterprise control for IT 57 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
The Perfect Marriage: Oracle Exadata with Sun ZFS Storage Appliance Session ID: UGF4410 Sunday 30-SEP-2012 9:00AM 58 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Moscone West - 2018 Expert Panel: Exadata Data Protection Best Practices Session ID: CON8435 10/1/12 (Monday) 12:15 PM Moscone South - 252
59 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Questions?
Content Oracle Cloud Site : http://www.oracle.com/technetwork/database/focus-areas/database-cloud/index.html Private Database Cloud White Papers Database Consolidation onto Private Clouds Private Database Cloud on Oracle Database Appliance Best Practices for Database Consolidation in Private Clouds Best Practices for Database Consolidation on Exadata Database Machine Multiple Public Networks in Private Database Clouds Network Isolation in Private Database Clouds DbaaS Cookbook http://www.oracle.com/technetwork/oem/cloud-mgmt/em12c-dbaas-cookbook-1432364.pdf 60 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
61 Copyright 2011, Oracle and/or its affiliates. All rights reserved.