1 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

Transcription

1 1 Copyright 2011, Oracle and/or its affiliates. All rights

2 Deduplication & Compression Options for Oracle Database Backups Donna Cooksey, Sridhar Ranganathan High Availability Product Management 2 Copyright 2011, Oracle and/or its affiliates. All rights Presenting with: Lakshman Lingam

3 3 Copyright 2011, Oracle and/or its affiliates. All rights

4 Latin America 2011 December 6 8, 2011 Tokyo 2012 April 4 6, Copyright 2011, Oracle and/or its affiliates. All rights

5 Oracle OpenWorld Bookstore Visit the Oracle OpenWorld Bookstore for a fabulous selection of books on many of the conference topics and more! Bookstore located at Moscone West, Level 2 All Books at 20% Discount 5 Copyright 2011, Oracle and/or its affiliates. All rights

6 Program Agenda Data Growth Challenges for Data Protection Backup Considerations for Storage Savings The Integrated Oracle Database Protection of RMAN RMAN Storage Reduction Strategies Customer Results: Bank of America Key Takeaways Q & A 6 Copyright 2011, Oracle and/or its affiliates. All rights

7 Enterprise Data Growth Continuing for the Foreseeable Future Enterprise data is growing 10-20% per year Some industries upwards of 50%+ data growth / annually Increase in production data is magnified in the backup storage infrastructure More production data expands exponentially into the backup storage infrastructure Year over year data growth! 7 Copyright 2011, Oracle and/or its affiliates. All rights

8 Exponential Growth in Backup Infrastructure IT Challenges Data Growth Multiples in Backup Copies: Production Data Size One Month of Backups Long Term Retention Last Year: This Year: and so on and so on and so on and so on Backup retention periods remain constant based on business needs Often expanding due to regulatory requirements Storage budget doesn t scale with data growth Data center space and power constraints hamper storage scale-outs 8 Copyright 2011, Oracle and/or its affiliates. All rights

9 Program Agenda Data Growth Challenges for Data Protection Backup Considerations for Storage Savings The Integrated Oracle Database Protection of RMAN RMAN Storage Reduction Strategies Customer Results Bank of America Key Takeaways Q & A 9 Copyright 2011, Oracle and/or its affiliates. All rights

10 Backup Storage Optimization Strategies Considerations for Storage Savings Backup Compression - Software (e.g. native utilities) - Hardware (e.g. tape or disk drives) Built-in Backup Deduplication - Incremental Backups Add-on Backup Deduplication - Software - Appliance Model Empty Space Compressed Backup Deduplicated Backup Deduplicated Backup 10 Copyright 2011, Oracle and/or its affiliates. All rights

11 Backup Compression 101 Reduces Storage Costs by Reducing Backup Size Compressed Backup Empty Space Compression removes empty space and/or repeating sequences depending on the technology The compression ratio is dependent on the type of data and compression algorithm used Application backup compression can be performed at a point in the backup process: Within the application during a backup operation By the backup application By the storage Disk / appliance or tape drive 11 Copyright 2011, Oracle and/or its affiliates. All rights

12 Backup Deduplication 101 Reduces Storage Costs via Capacity Requirements Deduplication is a specialized form of compression Removes redundant data across multiple copies of the data Granularity of deduplication varies by vendor from sub-block bl to file level Three primary categories: 1) Incremental backup strategy 2) Deduplication software 3) Storage appliance deduplication Only changed blocks are backed up Incrementals are smaller & faster backups than fulls Source-side deduplication Replaces redundant data with pointers to shared copy Deduplication performed at the source or on the target Effectiveness is dependent upon awareness of the backup stream format 12 Copyright 2011, Oracle and/or its affiliates. All rights

13 General Purpose Deduplication Offerings Software or Appliance Model Deduplication Software Deduplication software is installed on each host Source-side deduplication No hardware vendor lock-in Usually the backups need to be reconstituted when copied to tape Storage Appliance Deduplication Target-side deduplication : Inline Backup is deduplicated prior to being written to disk Post-process Backup is written to a staging area, then deduplicated Backups must be reconstituted when copied to tape Distinctions between the two are blurring as hybrid offerings are emerging 13 Copyright 2011, Oracle and/or its affiliates. All rights

14 Deduplication Ratios Mileage Will Vary Deduplication ratios vary by source and backup type File system backup data is ideal for deduplication Format does not change in the backup process Deduplication ratios can range between 10x 50x! Oracle database backups are more complex than that t of file systems Storage deduplication ratios are minimal, if any 14 Copyright 2011, Oracle and/or its affiliates. All rights

15 Program Agenda Data Growth Challenges for Data Protection Backup Considerations for Storage Savings The Integrated Oracle Database Protection of RMAN RMAN Storage Reduction Strategies Customer Results Bank of America Key Takeaways Q & A 15 Copyright 2011, Oracle and/or its affiliates. All rights

16 Oracle Recovery Manager (RMAN) Integrated Backup / Recovery Engine for Oracle Database Built-in in Advanced Data Protection Capabilities Intrinsic knowledge of database file formats and recovery procedures Block validation during backup / restore Online, multi-streamed backup Native backup multiplexing Backup compression and encryption Integrated disk, tape* & cloud backup *RMAN is integrated with Oracle Secure Backup and 3 rd party media managers for tape backup. 16 Copyright 2011, Oracle and/or its affiliates. All rights

17 RMAN Delivers. Comprehensive Protection for the Oracle Database Effectively manage RMAN backup / recovery via command or Oracle Enterprise Manager (EM) RMAN backup destinations: DISK or SBT Two Oracle database backup options provide maximum flexibility for diverse requirements: Image copy: Exact copy of the datafile, archived redo log file or control file Backup is approximately same size as the production database less temp files Backup set: RMAN-specific proprietary backup format Smaller backup size than an image copy backup due to: RMAN null compression and unused block compression (pre-backup) 17 Copyright 2011, Oracle and/or its affiliates. All rights

18 Storage Deduplication Technologies Difference Between File System and RMAN Backups Understanding the backup stream is critical to identifying redundant data File System Data File system data format does not change in the backup process --- Ideal for deduplication technologies Oracle Database RMAN Integration RMAN passes a pre-packaged p backup set to backup applications via SBT interface: --- Backup stream / block format is Oracle proprietary --- RMAN backup stream is largely opaque to backup applications rd party deduplication of Oracle backup streams is at best, superficial 18 Copyright 2011, Oracle and/or its affiliates. All rights

19 Oracle Data Block Format 101 More Than Simple Bits. Oracle Database manages its logical storage in data blocks Minimum unit of I/O A data block has a well-defined structure Block header is kept consistent with payload Rows do not overlap Metadata in its place Can always verify logical consistency 19 Copyright 2011, Oracle and/or its affiliates. All rights

20 The 411 on Oracle Database Backup Blocks Block Headers May Vary Between Backups? Oracle Blocks Datafile A Datafile B Are numbered describing position from beginning of datafile Unique identifier 1A 2A 3A 4A 5A 6A 1B 2B 3B 4B 5B 6B Oracle Backup (RMAN) Blocks Datafile blocks are logically grouped into backup pieces Ordering of blocks within a backup piece different than within the datafile 1A 1B 2A 3A 2B 5A 3B 4B 6A 5B Backup Piece Headers differ Translating to different block headers / numbers between backup operations ---- Only RMAN can map backup block to datafile block 20 Copyright 2011, Oracle and/or its affiliates. All rights

21 What Storage Deduplication Ratios to Expect? Mileage Will Vary. Oracle Database Typical storage deduplication ratios for RMAN backups of the Oracle database: Full backups in the low, single-digits range Incremental backups minimal, if any Archived log backups -zero 21 Copyright 2011, Oracle and/or its affiliates. All rights

22 Program Agenda Data Growth Challenges for Data Protection Backup Considerations for Storage Savings The Integrated Oracle Database Protection of RMAN RMAN Storage Reduction Strategies Customer Results Bank of America Key Takeaways Q & A 22 Copyright 2011, Oracle and/or its affiliates. All rights

23 RMAN Incremental Backup Strategies Built-In Backup Deduplication Incremental Forever Strategy Initial RMAN image copy backup to disk (FRA), then copy updated in-place with incrementals going forward Switch to copy capability for zero restore capability On-disk retention of 1-7 days RMAN BACKUP RECOVERY AREA Optimized backup to disk or tape RMAN compression applicable to the the incremental and archived log backups High Availability Full / Incremental Strategy RMAN backup set backup operation to: Disk - retention from days to weeks Tape retention from weeks to years RMAN compression applicable to full, incremental and/or archived log backups RMAN BACKUP BACKUPSET Makes additional copy of the backup to disk or tape Space Optimization 23 Copyright 2011, Oracle and/or its affiliates. All rights

24 RMAN Full / Incremental Backup Strategy Inherent Backup Deduplication Assumptions: Database size (used space) = 450GB Database change rate = 10% Backup type = RMAN backup set Weekly full backup on Sunday Daily incremental backups Mon-Sat 24 Copyright 2011, Oracle and/or its affiliates. All rights

25 Deduplication For Oracle Database Backups Comparison Between RMAN and Storage Appliances Description RMAN Incremental Backups Backup level Incremental Full Storage Appliance Deduplication Deduplication type Source Target Inline or post process Oracle database-aware Yes No Remains deduplicated when copied to tape Yes No Backup media options Disk or tape Disk Backup performance Faster than full backup depending on the database change rate, e.g x Full backup time + deduplication and processing time Restore performance Similar to that of backup operation Similar to backup, although could be longer due to reconstitution process Backup overhead on the database server Minimum Maximum Incremental backups need less IO than full backups!!!! 25 Copyright 2011, Oracle and/or its affiliates. All rights

26 How much additional storage space can be saved if the full / incremental backups are compressed? 26 Copyright 2011, Oracle and/or its affiliates. All rights

27 Oracle Database Compression Technologies Production to Backup Exadata Hybrid Columnar Compression (EHCC) Warehouse and archive compression Oracle Advanced Compression Option (ACO) OLTP table compression SecureFiles compression and deduplicationd Data pump export compression Recovery Manager (RMAN) backup compression levels LOW, MEDIUM, HIGH Data Guard redo transport compression Oracle Database Enterprise Edition Recovery Manager backup compression level BASIC 27 Copyright 2011, Oracle and/or its affiliates. All rights

28 Backup of Compressed Oracle Database Data What is the Sizing Effect in Backup Storage? EHCC Data OLTP Compressed Tables SecureFiles Compressed/Deduplicated Remains compressed within the backup Won t benefit by additional backup compression Won t benefit from 3 rd party deduplication offerings Non-compressed production data can benefit from backup storage optimizations 28 Copyright 2011, Oracle and/or its affiliates. All rights

29 RMAN Backup Compression Oracle Database Which Level is Right for You? LOW MEDIUM BASIC HIGH Best performance, lowest CPU utilization What compression ratios can be expected? Best compression ratio Varies by data and compression level Internal and customer testing ratio ranges from 1.5 to 19x 29 Copyright 2011, Oracle and/or its affiliates. All rights

30 RMAN Backup Compression and/or Encryption Oracle Transparent Data Encryption (TDE) Data within the Database Not encrypted TDE column encryption RMAN Backup Type Compressed and Standard Compressed Encrypted Encrypted Backup is not compressed or encrypted Columns remain encrypted in the backup Backup is compressed Backup is encrypted Data is compressed first, then encrypted Backup is compressed TDE tablespace Tablespaces remain Encrypted tablespaces encryption encrypted din the backup decrypted, d compressed and re encrypted Data is encrypted, double encryption of TDE encrypted columns Encrypted blocks remain encrypted, clear text t blocks are encrypted The Secret Sauce Oracle database-aware advantage! Data is compressed first, then encrypted TDE encrypted tbl tablespaces re decrypted, compressed and re encrypted. Unencrypted tablespaces are compressed, then encrypted 30 Copyright 2011, Oracle and/or its affiliates. All rights

31 RMAN Incremental + Backup Compression Winning Combination for Maximum Storage Savings! Assumptions: Database size (used space) = 450GB Database change rate = 10% Backup type = RMAN backup set Weekly full backup on Sunday Daily incremental backups Mon-Sat Average RMAN backup compression ratio: Full backup = 11x Incremental backup = 3x Archived log backups = 2x Storage Savings with Compression: 7.6x 11.4x 31 Copyright 2011, Oracle and/or its affiliates. All rights

32 Recovery Manager Storage Optimizations 3.3x improvement using Full / Incremental strategy 7.6x improvement using Fulls and compression strategy 11.4x improvement using Full / incremental strategy along with compression 32 Copyright 2011, Oracle and/or its affiliates. All rights

33 Advantages of Database-Aware Optimizations RMAN is Tightly Integrated with Oracle Technologies Can leverage RMAN multiplexing for increased backup performance TDE encryption benefits space savings of the deduplication TDE encrypted tablespaces can be compressed or deduplicated in the backup RMAN Deduplication Yes Yes Yes Using RMAN compression Storage Appliance Deduplication No Recommend FILESPERSET=1 No Encrypted data can t be deduplicated No - Encrypted data can t be deduplicated Applicable to disk or tape media Yes No Only disk Dependency on storage pointers for No Yes consistent restoration Reduced network traffic Yes No 33 Copyright 2011, Oracle and/or its affiliates. All rights

34 Program Agenda Data Growth Challenges for Data Protection Backup Considerations for Storage Savings The Integrated Oracle Database Protection of RMAN RMAN Storage Reduction Strategies Customer Results Bank of America Key Takeaways Q & A 34 Copyright 2011, Oracle and/or its affiliates. All rights

35 Oracle Backup and Recovery Bank of America Lakshman Lingam DBA Team Manager Bank of America Merrill Lynch (BAML) Global Markets, Finance & Futures

36 Bank of America One of the World s Largest Financial i Institutions Bank of America provides a full range of banking, investing, asset management and other financial and risk management products and services In the US, Bank of America serves: 58 million consumer and small business relationships 5,700 retail banking offices and about 17,800 ATMs Online banking services over 30 million active customers Among the world s leading wealth management companies and is a global leader in corporate and investment banking Bank of America serves clients via operation in more than 40 countries

37 Data Centers Leverage 1000s of Oracle Databases Effectively manage the Oracle infrastructure leveraging a multi-tiered (0-6) strategy t based on criticality of data and the Oracle Maximum Availability Architecture (MAA) All tiers utilize RMAN for Oracle database backup / recovery and many use Oracle Data Guard for business continuity Backup strategy for the top data tiers includes: Fast Recovery Area (FRA) sized for 7 day retention on disk using a weekly full (level 0), daily incremental backup (level 1) and archived logs Backup to FRA at both primary and Oracle Data Guard locations Backup of FRA to tape from the Oracle Data Guard Database Weekly tape backup maintained for 90 days Monthly tape backup maintained for 7 years

38 Managing the Backup Infrastructure For Oracle Databases Production data amounts are growing which naturally multiplies li in the backup infrastructure t Bank of America is successfully using RMAN in a two-prong approach to reducing the backup storage footprint: Full and incremental Oracle database backup strategy RMAN backup compression level = BASIC which is included in Oracle Database 11g Enterprise Edition Our RMAN storage optimization strategy reduces both disk and tape consumption

39 Storage Savings with RMAN Full Backup Effective Space Savings > 7x Compressed full backup size = 3.10TB Space savings = 7.7x

40 Storage Savings with RMAN Archived Logs Effective Space Savings > 4x Compressed size = 53.89G Space savings = 4.8x

41 Storage Savings with RMAN Incremental Level 1 > Effective Space Savings > 50x Compressed size = 437G Space savings = 57.6x

42 Benefits of Using RMAN Optimizations An Recovery Manager (RMAN) full / incremental backup strategy is integral to our data protection strategy for the Oracle database RMAN backup compression is a natural extension of our current deployment Advantages of RMAN storage optimizations over non-oracle offerings for the Oracle database include: RMAN is integrated t with the Oracle database eco-system from Oracle Data Guard to Oracle Enterprise Manager (EM) Storage consumption savings extend from disk to tape backup media Less moving parts (single technical resource) and reduced costs (RMAN is free)

43 RMAN Best Practices Use of BCT feature for faster incremental backups. In RAC deployments, use of service to spread channels across RAC In Standby, as DB in mount mode, channel distribution to specific instance instead of service to spread channels across instances Use of RMAN for refreshes across environments. Use of RMAN to build data guards FRA backup to tape is by using backup recovery area command rather than OS backup.

44 THANK YOU!

45 Program Agenda Data Growth Challenges for Data Protection Backup Storage Optimizations i Oracle Database Compression Technologies Recovery Manager Storage Reduction Strategies Key Takeaways Q & A 45 Copyright 2011, Oracle and/or its affiliates. All rights

46 Key Takeaways RMAN Provides Backup Storage Optimizations! General purpose storage appliance advertised deduplication ratios of 10-50x: Possible for file system backups Not likely or even e close for Oracle database abase backups RMAN is built-in to the Oracle kernel and can deliver backup storage savings of up to 20x via Incremental backups (built-in deduplication) Backup compression 46 Copyright 2011, Oracle and/or its affiliates. All rights

47 Resources OTN HA Portal: Maximum Availability Architecture (MAA): MAA Blogs: com/maa Exadata on OTN: Oracle HA Customer Success Stories on OTN: html 47 Copyright 2011, Oracle and/or its affiliates. All rights

48 Key HA Sessions, Demos, Labs by Oracle Development Monday, 3 Oct Moscone South * Wednesday, 5 Oct Moscone South * 11:00a Auto Detect, Prevent and Repair Data Corruptions, Rm :15a Oracle Active Data Guard - Lessons Learned, Rm :30p Future of Oracle Exadata, Rm 104 1:15p Data Guard for Planned Maintenance, Rm :30p RMAN: Not Just for Backups Anymore, Rm 304 1:15p Understanding Oracle RAC Internals, Rm 103 2:00p Extreme Data Management, Moscone North Hall D 1:15p Clone Oracle with CloneDB and Direct NFS, Rm :00p Oracle High-Availability il System Overview, Rm 104 5:00p GoldenGate Product Update and Strategy, Intercontinental-Sutter Thursday, 6 Oct Moscone South * Tuesday, 4 Oct Moscone South * 10:15a Oracle Secure Backup - Best practices, Rm :45a Oracle Exadata Technical Deep Dive, Rm 104 3:30p RMAN & Data Guard: Seven Cool Tips from Oracle, Rm 304 3:30p Consolidation on Oracle Exadata, Rm 103 9:00a Exadata Backup and Recovery, Rm :30a Deduplication and Compression for Backups, Rm :00p Data Guard Switchover / Failover, Rm 103 3:00p Configure, Size, Monitor Fast Recovery Area, Rm 304 3:00p PeopleSoft with Active Data Guard, Moscone West 2022 Demos Moscone South DEMOGrounds Hands-on Labs Marriott Marquis, Salon 14 / 15 Mon 10:00a - 5:30p Tue 9:45a - 6:00p Wed 9:45a - 4:00p Monday, Oct 3, 5:00 pm - 6:00 pm Oracle Active Data Guard Maximum Availability Architecture (MAA) Exadata Tuesday, Oct 4, 10:15 am - 11:15 am Oracle Active Data Guard Active Data Guard Oracle Secure Backup Recovery Manager & Flashback GoldenGate *All session rooms at Moscone South unless otherwise noted Real Application Clusters ASM *After Oracle OpenWorld, ref Copyright 2011, Oracle and/or its affiliates. All rights

49 49 Copyright 2011, Oracle and/or its affiliates. All rights Q&A

50 50 Copyright 2011, Oracle and/or its affiliates. All rights

51 51 Copyright 2011, Oracle and/or its affiliates. All rights