Oracle Data Protection Concepts Matthew Ellis Advisory Systems Engineer BRS Database Technologist, EMC Corporation Accelerating Transformation EMC Backup Recovery Systems Division 1
Agenda Market Conditions. Oracle Data Protection Challenges. Data De-Duplication Fundamentals. EMC Data Domain. Purpose Built Database Backup Appliance Latest Oracle and EMC Solutions Where does the De-Duplication happen? Data Domain Boost. Question and Answer 2
Purpose Built Database Protection 3
EMC Backup And Recovery for Oracle Integrated Solutions Takes Oracle Protection To Next Level Optimized Interfaces 10-30x Less Storage 99% Less Bandwidth Reliable Recovery Control And Visibility 4
Purpose Built Backup Appliances Open Systems + Mainframe Revenue EMC 65.5% EMC IBM Others HP Symantec Quantum 2011 Total Market $2.4B Source: IDC, Worldwide Purpose-Built Backup Appliance 2012 2016 Forecast and 2011 Vendor Shares, Doc #234489, Apr 2012. Above: Worldwide Supplier Revenue for 2011, Total PBBA Market 5
Backup Appliances Disrupts Backup Market $8.2B $12.2B 100% 90% Tape continues to decline Purpose Built Backup Appliances are the best alternative to protect Teradata environments 80% 70% 60% 50% 40% 30% CAGR:5.6% CAGR:21.4% CAGR:21.4% Data Protection and Recovery Software Purpose Built Backup Appliances 20% 10% CAGR: 0.7% CAGR: 0.7% 0% 2011 2012 2013 2014 2015 Tape Automation 6
Paradigm Shift 7
The Paradigm Shift Data Domain enables the industry s most advanced and flexible Oracle backup solutions for DBA s Direct backups using DD Boost for RMAN enables the fastest and most efficient backup and recovery Direct backups via NFS, dnfs and CIFS Supports Oracle backups with DD Boost for Avamar and Networker Flexibility enables customers to choose the best approach for their environment DD Boost for Oracle RMAN direct backup to Data Domain Oracle RMAN using EMC backup applications Oracle RMAN direct backup to Data Domain using NFS, dnfs or CIFS 8
Shifting Ownership and Control Over Backup to Database Administrator Virtual Applications INTEGRATED DATA PROTECTION SILOS Storage Physical Storage Node 9
Your Challenges 10
THE CHALLENGE: Ensuring Oracle Backup Isn t A Bottleneck To Your IT & Business Transformation Businesses go from driving 75 mph down the freeway to a near standstill. Backup is the bottleneck, and this must change. Stephen Manley, CTO, EMC Backup Recovery Systems 11
Oracle Backup and Recovery Challenges Backup Windows - Petabytes Storage Needed For Backup, Test, Dev, QA, Pre-Prod. Application Consistent Recovery For Virtualized Environments. DBA Control Creates Backup Silos Quotas are needed Need efficient ways to provide performance and De-Duplication 12
Data Reduction Methods Regular Storage Array 1:1 Whitespace Reduction File Level Fixed Blocks, Snapshots Variable Segments LZ Compression ~ 2:1 Single Instance ~ 3:1 Fixed Block ~ 3:1 Data Dedupe ~ 20:1 Avamar and Data Domain 13
What is Data De-Duplication? Primary Site Backup Architect WAN DR Site Oracle DBA RMAN Catalog Oracle RMAN Local Data Domain System DR Site Data Domain System Oracle RMAN Oracle/Application Database Server RMAN 1. Backup Copy 1 Oracle/Application Database Server Database 2. Replicate Copy 2 Database Desktop of DBA This Process illustrates Inline De-Duplication. 14
Where does the De- Duplication Take Place? 15
DD Boost Software DD Boost Distributes parts of deduplication process to backup server or application clients Speeds backups by up to 50 percent Enables more efficient resource utilization Provides application control of Data Domain replication process Distributed segment processing enabled Anchors and fingerprints segments Checks with Data Domain system to find which segments are new/unique Compresses and sends new segments only Avoids sending duplicate data to Data Domain system Support EMC Avamar RMAN/Boost EMC Networker 16
Golden Circle Why EMC BRS Solutions What How How What Why??? Why 17
Deduplication Changed Everything Reduce: Backup Times By Up To 90% Data Stored By Up To 30x Data Moved By Up To 95% CPU Usage By Up To 80% Replication Bandwidth By Up To 99% EMC Leads this Market. Variable Length De-duplication Global De-Duplication DDOS Enhancements Quotas and Reporting 18
Data Domain 19
Data Domain Product Family Data Domain Software Options DD Boost DD Encryption DD Extended Retention DD Replicator Large Enterprise Small Enter./ ROBO Midsize Enterprise DD160 DD620 DD640 DD670 DD860 DD890 DD990 Speed (DD Boost) 1.1 TB/hr 2.4 TB/hr 3.4 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 31.0 TB/hr Speed (other) 667 GB/hr 1.1 TB/hr 2.3 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 15.0 TB/hr Logical capacity 40 195 TB 83 415 TB 0.32 1.6 PB 0.6 2.7 PB 1.4 7.1 PB 5.7 28.5 PB 1 2.9 14.2 PB 5.7 28.5 PB 13 65 PB 1 Usable capacity Up to 3.98 TB Up to 8.3 TB Up to 32.2 TB Up to 55.9 TB Up to 142 TB Up to 570 TB 1 Up to 285 TB Up to 570 TB Up to 1.3 PB 1 1 Requires DD Extended Retention 20
Data Domain Fundamentals Easy integration with existing environment Control Tier Backup and Archive Applications EMC Symantec CIFS, NFS, NDMP, DD Boost Target Tier Disaster Recovery Tier CommVault IBM HP Veeam Ethernet Virtual Tape Library (VTL) over Fibre Channel DD890 appliance Replication DD890 appliance Quest RMAN Data Pump 21
Data Integrity: Data Invulnerability Architecture End-to-end data verification Checksum Deduplication, write to disk Verify Self-healing file system Cleaning Expired data Defrag Verify Other RAID 6 NVRAM Snapshots Generate Checksum File System Deduplication Local Compression RAID Verify Data End-to-end data verification Verify the file system metadata integrity Verify user data integrity Verify stripe integrity 22
Data Domain & Oracle 23
Oracle Backup and Recovery Options Leveraging Oracle RMAN and Data Domain Flexible; Easily integrates into existing processes 1 RMAN - Data Pump writes directly over CIFS/NFS 2 3 RMAN writes directly over Data Domain Boost RMAN integrates with Backup Application 24
Option 1: RMAN Data Pump Directly over NFS Leverages Standard or Direct NFS No 3 rd party backup application Full DBA control of backup and recovery Easy integration with RMAN processes Leverage Data Domain system as disk RMAN LAN Oracle Server Data Domain System 25
Option 2 RMAN Directly Over Data Domain Boost Database Admin Oracle Database Oracle RMAN DD Boost Data Domain System 26
Option 3 RMAN Integrated With Backup Application w/ DD Boost Database Admin Oracle Database Backup App Backup Admin DD Boost Data Domain System 27
Boost Integrated with RMAN 28
DDBoost for RMAN Primary Site Copy 1 Copy 2 DD Boost Backup Architect WAN DD Boost Copy 1 Copy 2 DR Site Oracle DBA RMAN Catalog Oracle RMAN DD Boost Plug-in Local Data Domain System DR Site Data Domain System Oracle RMAN DD Boost Plug-in RMAN Catalog Oracle/Application Database Server RMAN Oracle/Application Database Server 1. Backup Copy 1 Database 2. Replicate Copy 2 Database Desktop of DBA Dedupe makes backup and replication fast and secure. No extra backup software or catalogs. No trucks. No tape. 29
DD Boost for Oracle RMAN New DBA directly controls backup and recovery Faster, more efficient Oracle backups Catalog aware, centralized disaster recovery Simplified administration Local Data Center Disaster Recovery Site RMAN DD Boost DD Boost WAN DD Boost Oracle Database Server Data Domain System Managed File Replication Data Domain System 30
RMAN Script Sample with Replication run { alocate channel d1type 'sbt_tape parms='blksize=1048576,sbt_library=/u01/app/oracle/product/11.2.0/dbhome_1/lib/libddobk.so,env=(st ORAGE_UNIT=rmanddboost1,BACKUP_HOST=hostname)'; Allocate channel d2 type 'sbt_tape' parms='blksize=1048576,sbt_library=/u01/app/oracle/product/11.2.0/dbhome_1/lib/libddobk.so,env=(st ORAGE_UNIT=rmanddboost1,BACKUP_HOST=hostname) ; RMAN> backup copies 2 database format '%u_%p', 'destinationsystem/%u_%p filesperset=1; DATABASE; } Note: The storage unit specified in the command below must already exist on the Data Domain system. 31
Data Protection Advisor 32
With Data Protection Advisor Automated, flexible, & efficient backup and recovery management Payback typical in 12 months Reduces costs Insight drives efficiency Lowers risk Manage to service level agreements (SLAs) Minimizes complexity Single, integrated view 33
DPA & RMAN For RMAN data collection, use an Oracle username that has access to the RMAN catalog. If a separate Oracle username is created for data collection, then ensure it has SELECT access to : RMAN Recovery Catalog: RMAN Control File: rc_backup_set; rc_backup_datafile; rc_datafile; rc_database; rc_backup_piece; rc_backup_controlfile; v$backup_set; v$database; v$backup_datafile; v$datafile; v$backup_piece For Control File and Database monitoring, use an Oracle username with access to the system catalogs in each instance. DBAs don t usually provide sys or sysdba access, so another username can be setup within oracle and easiest would be to grant SELECT_CATALOG_ROLE to this user (grant list is documented in the DPA Admin Guide) 34
DPA & RMAN If customers elect to only collect RMAN data, then the Oracle SID is prefixed by the RMAN ID of the database instance and is shown under the RMAN database node 35
Customer Success Story 36
37
40+ Oracle DB s 215 Oracle DB s 38
Data Domain & Oracle Incremental Merge A Paradigm Shift in Performance DB Size Backup Channels Backup time Replication Completion TSM Oracle Prod1 Full 24tb 8 19 20 hours N/A Oracle Dev1 Full 10tb 4 19 Hours N/A Data Domain Direct Oracle Prod1 Full 36tb 64 9 hours Before 6am Oracle Prod1 Full 36tb 20 12 hours Before 6am Oracle Prod1 Incremental Merge 600gb to 1.6tb daily change 2 4 hours Before 6am Oracle Dev Full 10tb Oracle Dev Incremental Merge 10tb 1 Under 1 Hour Full site Protection Full Production 40+ Data Bases 45tb (total) 8 Hours Before 6am Full Test / Dev 215 Data Bases 45tb (total) 8 Hours 39
Daily Deduplication Summary Past 24hr After Dedupe (TiB) 2.00 1.50 1.00 0.50 0.00 Production 97X Avg. Deduplication Ratio Test/Dev/DR 5/3/2012 5/4/2012 5/5/2012 5/6/2012 5/7/2012 5/8/2012 5/9/2012 5/10/2012 5/11/2012 40
Deduplication results Pre-Comp (GiB) Post-Comp (GiB) Global-Comp Factor Local-Comp Factor Total-Comp Factor Currently Used: 2628951.8 58499.3 - - 44.9x (97.8) Written: * Logical Storage (GB) Physical Storage (GB) Compression Ratio 4/6/2012 2,188,863 60,671 37.7 5/8/2012 2,628,951 58,499 46.2 Average/Median: 43.7 / 43.9 Last 7 days 849981.0 7800.8 42.1x 2.6x 109.0x (99.1) Last 24 hrs 107756.6 835.6 42.3x 3.0x 129.0x (99.2) 41
THANK YOU 42
Top 10 IT Priorities Which of the following would you consider to be your organization's most important IT priorities over the next 12-18 months? (Percent of respondents, N=614, ten responses accepted) Improve data backup and recovery Increased use of server virtualization Major application deployments or upgrades Manage data growth Information security initiatives Business continuity/disaster recovery programs Data center consolidation Desktop virtualization Mobile workforce enablement Deploying a "private cloud" infrastructure 30% 30% 29% 27% 27% 25% 24% 23% 22% 22% Source: ESG Research Report, 2012 IT Spending Intentions Survey, January 2012. 0% 10% 20% 30% 40% 43
THE CHALLENGE: Ensuring Oracle Backup Isn t A Bottleneck To Your IT & Business Transformation Businesses go from driving 75 mph down the freeway to a near standstill. Backup is the bottleneck, and this must change. Stephen Manley, CTO, EMC Backup Recovery Systems 44