EMC Data Deduplication Day

Transcription

1 EMC Data Deduplication Day 15 September 2010, Prague Maciej Mianowski EMC TC 1 Agenda Data Deduplication Technology (Introduction) EMC Backup Recovery Systems (Portfolio) EMC DataDomain Inline Deduplication Storage System + Lab EMC Avamar Integrated Deduplication Backup Software + Lab EMC DPA Consolidate Monitoring and Reporting + Lab 2 1

2 Do you still need a tape? Why not to do the same with rest of the tapes? Eliminate or Reduce! 3 EMC Computer Systems EMC??? 4 2

3 EMC s Focus EMC is a TECHNOLOGY company EMC s focus is IT Infrastructure Copyright 2009 EMC Corporation. All All rights rights reserved. 5 EMC Hardware Data Domain and Disk Library Centera Virtual Archive CLARiiON CX4 UltraScale Series Celerra NS-480 NS-960 Connectrix DMX-3 and DMX-4 Symmetrix DMX DMX NS-120 MDS-Series DL5000 series Data Domain Deduplication Storage Systems EMC Centera 4-Node Fibre Channel and iscsi AX4 NX4 NS-G2 Rainfinity Global File Virtualization NS-G8 B-Series V-Max SE V-Max Only Storage Only Hardware??? 6 3

4 EMC Portfolio Geniant Services Dolphin Internosis Interlink BusinessEdge Conchango Content Management Documentum Ask Once Captiva Acartus ProActivity X-Hive Document Sciences Information Security RSA Authentica Network Intelligence Valyd Tablus Verid 1/03 1/04 1/07 1/08 1/05 1/06 1/09 Virtualization/ Data Mobility VMware Rainfinity Acxiom Akimbi YottaYotta Resource Management Astrum Smarts nlayers Voyence Infra Configuresoft FastScale Data Protection/ Archiving Dantz Legato Allocity Kashya Avamar Indigo Stone Illuminator Mozy WysDM Data Iomega Domain Cloud Infrastructure and Services Pi Source Labs 7 Agenda Data Deduplication Technology 8 4

5 What is deduplication Data deduplication (often called "intelligent compression") is a method of reducing storage needs by eliminating redundant data. Only one unique instance of the data is actually retained on storage media, such as disk or tape. Redundant data is replaced with a pointer to the unique data copy. Data deduplication can generally operate at the file, block, and even the bit level. 9 Data deduplication: HOW Granularity: File level = Single Instance Store EMC Centera EMC Celerra Sub-File level = Block level Fixed block length e.g. Some EMC Competitors Variable block length (dynamic) EMC Avamar EMC Data Domain 10 5

6 Data de-duplication: WHERE Source Client software agents identify repeated sub-file data segments at the source Only new, unique segments are transferred across the network and stored to disk during backup operations Benefits include shorter backup window and lower bandwidth requirements DE-DUPLICATION AT SOURCE Target Backup application sends native data to a target storage device Data is de-duplicated once it reaches the target De-duplication can happen during or after backup Found in VTLs or LAN B2D appliances Transparency to backup application offers users a plug and play experience DE-DUPLICATION AT TARGET Network Network 11 Data de-duplication: WHEN While the backup is Running Inline Content is de-duplicated while backup is happening Only possible if de-duplication is fast enough Ideal for capacity optimization After all or some backup is complete Scheduled Content is initially stored in original format, then de-duplicated at a later time De-duplication can start as soon as a subset of the backup completes, or once the whole backup finishes Needs careful planning of activities INLINE DE-DUPLICATION SCHEDULED DE-DUPLICATION Deduplication Store Deduplication 12 6

7 Post-Process Deduplication Bottleneck 13 The Data De-duplication Ratio(s) a customer will achieve depends on many factors Type of data Data from natural sources (audio, video, scanned images) is unique User-generated data (docs, ppts, PSTs) often have duplicate content (templates, etc.) Encrypted and compressed data are not ideal candidates for de-duplication More user created content = Higher de-duplication ratio Data change rate Small data change rates result in large amounts of duplicate data in subsequent backups Less change = Higher de-duplication ratio Retention policy The longer a backup is held, the greater the chance that the same data will be backed up more than once Longer retention policy = Higher de-duplication ratio Ratio of full backups to incremental backups More full backups increases the amount of same data being repeatedly backed up More full backups = Higher de-duplication ratio 14 7

8 Back-up to Disk: Capacity = Primary Data 1x Back-up Data 15x-20x TAPE 15 Data Deduplication: Under the Hood Store more backups in a smaller footprint Friday Full Backup A B C D A E F G Mon Incr A B H Tues Incr C B I Weds Incr E G J Thurs Incr A C K Second Friday Full Backup B C D E F L G H A B C D E F G H I J K L Backup Logical Estimated Physical Data Reduction FRIDAY FULL 1 TB 2-4x 250 GB Monday Incr 100 GB 7-10x 10 GB Tuesday Incr 100 GB 7-10x 10 GB Wednesday Incr 100 GB 7-10x 10 GB Thursday Incr 100 GB 7-10x 10 GB Second FRIDAY FULL 1 TB 50-60x 18 GB TOTAL 2.4 TB 7.8x 308 GB 16 8

9 Retain: Store More for Longer with Less Backup Cumulative Estimated Physical Data Logical Reduction First Full 1 TB 4x 250 GB Week 1 Week 2 April TB 8x 308 GB April TB 10x 366 GB Week 3 Month 1 Month 2 Month 3 April TB 12x 424 GB April TB 14x 482 GB May TB 17x 714 GB June TB 19x 946 GB Month 4 July TB 20x 1178 GB TOTAL 23.4 TB 20x 1178 GB 17 De-Duplication Ratio vs Disk Space Savings It doesn t take a very high de-duplication ratio to save a lot of disk Disk Savings 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Deduplication Ratio Dedup Ratio Disk Savings 1:1 0% 2:1 50% 3:1 67% 4:1 75% 5:1 80% 6:1 83% 7:1 86% 8:1 87% 9:1 89% 10:1 90% 20:1 95% 50:1 98% 100:1 99.0% 500:1 99.8% 18 9

10 Gartner Analysis Data Deduplication 19 EMC Position in Backup Recovery Deduplication in the F1000 Competitor Competitor Competitor Competitor Competitor Competitor EMC highest in use and in plan. Competitor Competitor Competitor Competitor Source: TheInfoPro Storage Study (Q4 2009) (11/12/09): F1000 Sample. Left and Top Right Charts: n=183. Lower Right Chart: n=76. Lower Bottom Right Chart: n=

11 Why are you afraid of deduplication? Cost (disk is more expensive than tape) Performance (disk I/O bottleneck) Data Safety (only one copy on disk) 1. The main goal of good deduplication system is not to get the greatest data reduction, but rather to do deduplication at high speed in order to meet the performance requirement at low cost. 2. In backup-to-disk, the priority must be data invulnerability over performance and even availability. 21 Agenda EMC BRS Backup Recovery Systems 22 11

12 EMC Backup & Recovery Market Position Avamar #1 deduplication backup software worldwide 4,500 installations 2,500 customers Data Domain #1 deduplication storage worldwide 12,000 installations 4,300 customers Disk Library #1 VTL worldwide >$1B Sales NetWorker Top 3 enterprise backup ~30,000 customers, >40,000 installations 23 Having Great Technology is Not Enough You need to know haw to use it EMC Rep Customer What Does Customer Think? Our backups take too long. We can t recovery during promised SLA s. Reduce our backup management costs. Reduce our maintenance costs. We need the offsite copy. We are not sure that our backups are ok. To many people are involved just to keep the backup system up and running. The cost of the SAN infrastructure is very high, why not to use only LAN for backup? We need the proven technology, we can not risk. I like this EMC guy 24 12

13 Key Components of Backup Infrastructure SAN-attached Clients Backup Metadata MD D MD D MD MD MD MD D JBOD LAN-based clients NAS Storage System Master Server Media Server PST Robot and Open Control file Sharing support Databases, agents Drive Sharing Mirroring, RMAN, Open Agents Snapshots, Agents files support Cloning support Snapshots Integration Various Backup D D D SAN Storage Subsystem Tape Library D LAN-based Host s Backup Data D SAN-attached Host s Backup Data D NAS / NDMP Host s Backup Data D Data to Tape Drives / Library 25 Backup & Recovery Architectures Are In Transition from Tape to Disk Backup/Recovery Architecture Application Backup Clients Backup/Media Manager Onsite Backup Storage Disaster Recovery Storage Conventional (Tape-centric) DB Backup Software Tape Tape Backup Software VTL VTL/Tape Transformational (Disk-centric) Home VM Backup Software Deduplication storage Deduplication backup software and system Data Protection Management Software on premise off premise 26 13

14 Backup & Recovery Architectures Are In Transition from Tape to Disk Backup/Recovery Architecture Application Backup Clients Backup/Media Manager Onsite Backup Storage Disaster Recovery Storage Conventional (Tape-centric) DB NetWorker Tape Tape NetWorker Disk Library VTL/Tape Transformational (Disk-centric) Home VM NetWorker Avamar Data Domain Data Protection Advisor on premise off premise 27 EMC Backup Recovery Systems Avamar Deduplication backup software Data Domain Deduplication storage systems Disk Library Virtual Tape Library Backup Software Avamar or NetWorker NetWorker or Third-party NetWorker or Third-party Avamar VM OS Storage System Avamar Data Domain Disk Library 28 14

15 EMC NetWorker Comprehensive Data Protection File Systems Virtual Applications Deduplication Application Modules Server Recovery Disaster Recovery Remote Sites Monitoring NetWorker Centralized Management and Control Scheduling, Policies and Reporting VTL Deduplication Storage Systems Snapshots, CDP and Replication Standard Disk Tape Cloud 29 EMC NetWorker Fast Start An Integrated, Packaged Product for the Midsize Organization 20 clients and five application licenses (Exchange, SQL, SharePoint, and Oracle) Perfect if you want enterprise-class capabilities at an affordable price point and cost of ownership Simplified licensing and configuration Everything you need in one part number for Windows servers for Linux servers NetWorker server (Windows or Linux) 10 TB backup to disk, EMC Disk Library, or Data Domain NetWorker Fast Start Package NetWorker server (Windows or Linux) 20 clients Any combination of five application licenses (combination of Exchange, SQL Server, SharePoint, and Oracle) Up to 10 TB backup to disk, EMC Disk Library, or EMC Data Domain 40-slot Autochanger license Video instructor-led training 40-slot Autochanger 30 15

16 EMC Disk Library Family Open Systems Integration with DataDomain DL5100 DL5200 Storage CLARiiON CX4-240 CLARiiON CX4-960 Maximum capacity (usable) 315 TB 1.4 PB Maximum performance (compressed) 4.6 TB per hour 10.2 TB per hour Fibre Channel connectivity 8 Gb/s 8 Gb/s Engines 1 2 Back-end arrays 1 1 Drive size 1 TB/2 TB 1 TB/2 TB Active engine failover Replication Consolidated media management Hardware compression Spin Down 31 How do I determine if data will dedupe well? Factors that affect dedupe ratios: Dedupes well Does NOT Dedupe well Retention Policy** > 2 Weeks Retention < 2 Weeks Retention Data Type File systems, , databases Database logs, Scientific data, video streams Client side data modification No Encryption / No Compression / No Multiplexing Encryption / Compression / Multiplexing ** NOTE: Increasing retention policy may enable a higher dedupe ratio 32 16

17 EMC Disk Library Family Mainframe Integration with DataDomain DLm120 DLm960 Number of VTEs 1 or Connectivity FICON FICON Number of channels to host 2 or Number of virtual tape drives Up to 512 Up to 1,536 Maximum capacity (usable) 9.5 TB TB 28.5 TB PB Performance Up to 400 MB/s Up to 1.2 GB/s Number of cabinets Replication Hardware compression 33 EMC Tape on Disk Solutions for Mainframe Not virtual tape but tape on disk True IBM tape emulation 3480, 3490, 3590 Transparent to end users Leverages low cost, RAID 6 protected disk technology High performance read and write Unmatched IP replication capability IBM mainframe EMC Disk Library for Mainframe Tape Dedup Solution DLm IBM mainframe Luminex Gateway Data Domain Deduplication 34 17

18 EMC Data Protection Advisor Automated, single view eliminates manual effort, data silos Payback typical in 12 months Reduces costs insight drives efficiency Lowers risk manage to service level agreements Minimizes complexity single, integrated view 35 Typical Backup Environment 10 % of the backup clients generates 90% of the backup data 90 % of the backup clients generates 10 % of the backup data 90% 10% 10% 90% 36 18

19 Configuration Example Remote Offices Filesystems, NAS devices db with medium change rate EMC DPA monitoring Desktop/Laptop Vmware systems NetWorker, NBU, TSM, etc. Large DB Replication Replication Avamar DS Avamar DS Data Domain or Disk Library 37 Agenda EMC Data Domain Inline Deduplication Storage System 38 19

20 Deduplication Enables Next-Generation Storage Architectures Storage 1.0 When did you implement this? What made you evolve? Primary Disk Tape Storage 2.0 Why did you add SATA? What did you learn? Primary Disk SATA Tape Storage 3.0 Backup/recover + archive from disk (shrink primary) Tape: monthly Primary Dedupe SATA Before After Tape Storage 4.0 Flash for primary Everything else to dedupe Flash Dedupe SATA Before After 39 Protection Storage vs. Primary Storage Workload Primary Storage Continuous random accesses Mostly reads Lots of meta-data accesses Protection Storage Large batches of accesses Mostly writes Few meta-data accesses Cost Dollars / IOPS Dollars / TB Performance Latency and throughput, IOPS Sequential throughput Safety What are backups for? Storage of last resort 40 20

21 Data Domain - Technical Description for Amateurs 41 Data Domain - Technical Description for Proffesionals Backup Servers Appliance-based Disk Systems 8KB # 12KB # 6KB # D IP/FC 10KB # 8KB # 11KB # 16KB # 8KB # 5KB # Pattern/Hash/Bytes Generated IP/FC LAN-based Clients D NDMP Storage D # # # # # # # # # # Hash Table / Previous Stored Versions SAN-attached Clients D dd dd D D D D D dd dd D D D D D Compressed Data De-Duplicated Data 42 21

22 DataDomain Mission Make this Look Like 43 This 44 22

23 Comparison with S-ATA disks or VTL 5 TB dataset, backup retention 14 copies 1 week Fulls and Incrementals = 5.5 TB 8 x weekly backups, 6x monthly backups = 74 TB 120 TB raw space 80 TB usable space 12 TB raw space 160 TB usable space - Less power - Less cooling - Less space - Less support costs - Less management - Less hardware errors 45 Customer Example: 20x Footprint Reduction One DD560 System 180TB stored 8TB of disk used 20x Reduction 5 Months Retention 6U rack space Replicated off-site Red Line = Amount of data written to Data Domain (virtual storage) Green Line = Disk Space Consumed (physical storage) Blue Line = Cumulative Compression Effect 46 23

24 Norwegian Social Services Image Backup of.vmdk Files 47 DataDomain Customers 48 24

25 Scale: The Case Against Spindles CPU-centric 49 Price / Performance: CPU-centric wins over time Increase CPU Performance 1 MIPS 2,000,000 MIPS 2,000,000 x Memory Size 16 Kbytes 32 Gbytes 2,000,000 x Disc Drive Performance 60 msec 5.3 msec 11 x Source: Improve price / performance along with CPUs Keep price competitive with tape automation Alternative Speed through spindle count Huge amounts of wasted disk space More to manage, more to buy 50 25

26 Summary Vector for New Segments Set bits in SV in RAM for each segment stored Check bits when processing a new segment Any 0 means segment is new and should be stored 51 Segment Localities Metadata Segment data abcd A B C D efgh E F G H ijkl I J K L... stuv S T U V DDFS log structure Localities Stream-informed storage units Neighboring unique segments stored together Fingerprints and segments stored together with other metadata One seek can retrieve hundreds into RAM Fast caching for fingerprint lookup Fast reads during recovery or copy to tape 52 26

27 SISL Process Check uniqueness with Summary vector If unique, then store with local compression Summary Vector cannot conclude redundancy It can have false positives If SV test says segment may not be unique, move to next step Check in-memory fingerprint cache If hit, we know it is a duplicate, no need to store again If miss, look up index, prefetch localities of fingerprints for good hit ratio Secret sauce is how DD system goes fast, not how it de-duplicates 53 End-to-End Verification at Backup Time DD OS tests recoverability asynchronously after backups File system consistency Data integrity on disk Primary storage can t verify after write It would be too slow Primary storage discovers problems during restore The end-to-end check verifies all file system data and metadata 54 27

28 Fault Avoidance and Containment Localities Custom log-structured file system architecture New data never overwrites good data Previous backups are not at risk Fewer complex data structures mean fewer bugs No bitmaps and link counts to corrupt NVRAM for fast, safe restart DD-RAID does no partial-stripe writes No RAID vulnerability to power loss or NVRAM failure 55 Continuous Fault Detection and Healing DD-RAID 6 Protection against two disk failures Disk read errors during reconstruction Operator pulling the wrong disk Verifies data integrity and stripe coherency after writes On-the-fly Error Detection and Correction All on-disk structures covered by strong checksums Data correctness verified on every disk read Data errors corrected automatically from data redundancy Continuous Scrub Finds and fixes errors before they become a problem 56 28

29 File System Recoverability Self-describing data format Metadata structures rebuildable from Locality log File system check (FSCK), if needed, is fast Checks and repairs done on de-duplicated data Run checks on 70 TB of data, not 1.4 PB No overwrite means it s safe to bring system back on line Metadata Segment data... DDFS log structure 57 Summary Storage for data protection is different from primary storage Data Domain Restorer is designed from the ground up with unique technologies for data protection CPU-centric design leverages Moore s law Single controllers get faster over time with small footprint Data Invulnerability Architecture ensures backups are safe Secret sauce is how DD system goes fast and how protects its data not how it de-duplicates 58 29

30 Data Domain Deduplication Storage Control Tier Backup & Archive Applications, e.g. CIFS, NFS, NDMP, OpenStorage on GB/E Target Tier DR Tier Replication VTL over FC DD880 Appliance DD880 Appliance 2-4U controller 10 and 1 Gb Ethernet; 4 Gb Fibre Channel NVRAM RAID-6 Up to 142 TB usable capacity with disk shelves Deduplicating file system Deduplicated IP-based replication Easy integration makes a conventional environment transformational 59 Data Domain Deduplication Storage DD880 Global Deduplication Array DD600 Appliance Series DD140 Remote Office Appliance Software Options: DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock and DD Encryption DDX Array Series Up to 16 Controllers DD140 DD610 DD630 DD670 DD880 GDA DDX Array Speed (Other) 450 GB/hr 675 GB/hr 1.1 TB/hr 3.6 TB/hr 5.4 TB/hr TB/hr Speed (DD Boost) 490 GB/hr 1.3 TB/hr 2.1 TB/hr 5.4 TB/hr 8.8 TB/hr 12.8 TB/hr 140 TB/hr Logical Capacity TB TB TB PB PB PB PB Raw Capacity 1.5 TB Up to 6 TB Up to 12 TB Up to 76 TB Up to 192 TB Up to 384 TB Up to 3.07 PB Usable Capacity 0.86 TB Up to 3.98 TB Up to 8.4 TB Up to 55.9 TB Up to TB Up to 285 TB Up to 2.28 PB 60 30

31 Data Domain Portfolio - Throughput Guidelines Backup Write streams Backup Read streams Replication Destination DD140 DD610 DD630 DD670 DD690/g DD880/g GDA DDX Array , ,880 Replication Source ,440 Libraries N/A N/A 1,024 Virtual Tape Drives N/A N/A 2,048 Slots per VTL Total System CAPs per VTL Virtual Tape Cartridges N/A 20,000 20,000 20,000 20,000 20,000 N/A 320,000 N/A N/A 1,600 16,000 N/A 100, , , , ,000 N/A 1,600,000 Write Read Repl Destination Repl Source Confidential NDA ONLY Subject to Change Without Notice 61 The Protocol Stack Application Transparency \\DDArchive\Presentations \\DDArchive\Brochures \\DDArchive\Src Backup & Nearline Archival Applications NAS Common Dedupe Single Approach Design VTL Fibre Channel OST NFS CIFS Future Application Agnostic Feature Interoperability DDOS DDFS (DIA w/raid-6) Deduplicated Storage 62 31

32 Data Domain VTL Scalability Enhancements Fibre Channel 4-8Gbit/s Optical VTL VTL 1 VTL 64 Virtual Vault Up to 64 virtual libraries Up to 256 virtual tape drives Virtual cartridges up to 800GB (LTO-1, 2, 3) Up to 20,000 virtual slots Up to 100,000 virtual tape cartridges in virtual vault Dynamic Slots/Caps 100 CAPs per library (1000 SYS) Up to 180 concurrent streams Continuous end-to-end virtual cartridge data integrity verification & self healing capabilities Backup software manages restores &vaulting to physical tape 63 NFS / CIFS Use Cases Backup Archive NAS \\DDArchive\Presentations DiskXtender \\DDArchive\Brochures \\DDArchive\Src \\DDArchive\Ads Backup Application server NFS / CIFS Archive Application server NFS Mount Point - or - CIFS Share 1 or 10 Gbit 64 32

33 NetBackup OpenStorage Architecture NetBackup Master Server Catalog Resource Manager Disk Service Configuration Database (EMM) Clients Backup Restore NetBackup Media Servers Remote Access (Configuration & Mgmt) OpenStorage API Data Movement (bptm/bpdm) Advance d Disk Plug-in Shared Disk Plug-in Basic Disk Plugin Plugin Plug-ins 65 Data Domain: Open Storage Benefits Better Performance Catalog Media Server Local DDR Remote DDR Copy 1 Copy 2 Stream-optimized transport Aggregate throughput comparable to NFS 4 Update Catalog 1 Start Opt Dupe 2 3 Done Copy 1 Managed, bandwidth-optimized replication Media server directs replication of individual backups Single pane to manage backups, restores, and replication Manage retention of backup copies individually Reduces workload on the media server Faster and WAN efficient duplication More straightforward disaster recovery from remote site Data Transfer Copy

34 Retention Lock Software Option File level locking for forced retention Opportunity: IT Governance Fully integrated with Data Domain features Data shredding functionality to comply with DoD/NIST requirements Key Benefits Supports Enterprise IT standards for compliance and data retention Eliminates risk of inadvertent or malicious deletion of critical data Operational flexibility, allowing administrators to react to policy changes Primary Tier Nearline Tier 67 Use Case: & File Archiving & Messaging Archiving Software EMC SourceOne EMC DiskXtender File Servers Data Domain 68 34

35 Use Case: File Tiering Primary Storage Tier 1 Seamless integration with no disruption Automatic enforcement of policies Move older data from Tier 1 to Archive Tier Improve cost and performance in Tier 1 Backup reduced Tier 1 to Data Domain Data Domain Backup 69 Snapshot Data Protection up to 750 snaps Benefits for Backup Short term undelete capability; allows users to recover accidentally damaged or deleted data by copying a desired file from a Snapshot directory Benefits for Archive / Nearline Local backup for Archived data Extended retention at DR site + Fastcopy Recovery WAN 30 Day Retention - Daily 1 Year Retention - Weekly 70 35

36 Network-efficient Replication Asynchronous IP replication: Continuously replicates Network-efficient: Deduplicated and compressed data transferred NFS, CIFS, VTL or OpenStorage (OST) Backup & Archive Servers Source Pre-compressed 10 TB Sending only 1 to 5% of the original data WAN or LAN Destination Deduplication + Local compression (LZ, Gzfast, GZ) 0.5 TB Post-compressed Deduplicated data 0.5 TB Deduplicated data 71 Replication Topologies Data Access Replication types Source Entire Collection Destination Collection Replication CIFS /NFS VTL Directory VTL Pools Directory Replication OST OST Backup Image (*) Optimized- Duplication (*) File based replication controlled by NetBackup/OST Optimized Duplication 72 36

37 Multi-Site Protection for Remote Office Many-to-one consolidation Remote Sites Fan-in scalability: Supports hundreds of remote sites Any models can be a source (1 release apart max) Up to 180 incoming streams per DD % Data Center Hub DIR A DB Data Domain System Home Archive Data Backup Data Data Domain System 1-5% WAN Home 1-5% DB Data Domain System DDX with DD880s 73 Multi-Site Data Protection Cascaded Replication Deployment flexibility Multiple DR locations (2 or more) Flexible data choices: Entire system, Directory/Tapes High performance site-to-site transfer Managed centrally via Enterprise Manager GUI London Cascaded Replication Tokyo Remote sites WAN Directory Collection WAN Directory Protection Site # 1 Protection Site #

38 DD Replicator Software: One-to-Many Directory Replication Replicates the same directory to multiple remote Data Domain systems Increases protection multiple copies to different disaster recovery sites Data distribution for multi-site usage QA, testing, development One-to-Many Cascaded Replication with One-to-Many Source Destination Source Source and destination Destination Destination 75 DD Replicator Software: Enhanced Data Reduction for Small Sites Low bandwidth optimization using Delta Compression Send the difference (delta) between the segments, not the entire segment (use more CPU, so it can t be used everywhere) Improves network efficiency up to two-times additional data reduction Enables remote sites to replicate more data using same network bandwidth Home Data Domain system WAN T3 or lower (6 Mb/s) Remote sites Data Domain system Data Center Hub 76 38

39 DD Boost Software DD Boost Distributes parts of deduplication process to backup server Licensable software works across Data Domain portfolio Supports majority of backup software market Symantec NetBackup and Backup Exec currently EMC NetWorker support in 2H 2010 Speeds backups by up to 50% Process more backups with existing resources 20 40% less overall impact to backup server 80 99% less LAN bandwidth Enables Data Domain replication management from the backup application 77 DD Encryption Software Industry s first encryption of deduplicated data at rest Inline: deduplication and encryption before storing Deduplication + Encryption Protects against loss of disk or system Inline encryption provides immediate protection while preserving deduplication Works with all protocols and applications Software-based, user-selectable AES-128 or AES-256 Replicate encrypted data (payload only, not session) using DD Replicator 78 39

40 Data Domain DD880 Global Deduplication Array Global deduplication and single namespace across two DD880 controllers Speed: Up to 12.8 TB per hour (3.5 GB/s) Usable capacity: Up to 285 TB Logical capacity: Up to 14.2 PB Up to 270 concurrent write streams As replication target, up to 270 originators Simplifies backup administration Managed replication Upgrade single DD880 to Global Deduplication Array largest capacity higher performance simplified management 79 Deployment & Configurations NW 7.6 SP1 Backup to Disk with Data Domain New Q NW Server Manages NW NMC Clients & Apps Storage Node Data Domain Device Type Optimized data path Clients & Apps 80 40

41 Deployment & Configurations NW 7.6 SP1 Single Point of Management New Q NW Server Manages NW NMC Clients & Apps Storage Node Data Domain Device Type Manages the DDR Clients & Apps 81 Deployment & Configurations Replication from DDR to DDR, then to Tape New Q NW Server Data Domain Device Type Manages NW NMC Controlled by Standard NetWorker Clone Operations Manages the DDR Remote Site Storage Node Data Domain Device Type Data Domain Filecopy Replication 82 41

42 Agenda EMC Avamar Integrated deduplication Backup Software 83 Source vs Target Deduplication Source Prevent the data avalanche at the top of the mountain Reduces client and network strain New backup software Target Use existing backup software Ease of deployment De-duplicate at bottom of the mountain Would you rather stop the avalanche here? Or here? 84 42

43 EMC Avamar Backup Process Original Data Original Data Chunked Data Create variable sized objects based on Avamar patented chunking algorithm Chunks Compressed Compress the objects using non-destructive compression algorithm Atomic Hashes Hash (SHA-1) the compressed chunks to create a 20-Byte Atomic Query local hash cache with 20-byte Atomic to determine if it has been seen before Atomics present in local hash cache not sent only noted in the snap-up blueprint. Local Hash Cache Atomics not present in local hash cache, check in with Avamar Server to see if the Atomic has been seen before. For new Atomics, send original data to Avamar Server. 85 Avamar Day-Over-Day View Initial back up back up 1 back up

44 Avamar s Innovative Architecture Avamar Server Verified checkpoint U.S. Patent No. 6,826,711 Parity across storage nodes Redundant Array of Independent Nodes (RAIN) architecture Each server node includes CPU, memory, and internal disk storage Provides high availability and fault tolerance across nodes Grid architecture for online scalability and performance Daily Avamar server integrity checks Utility and spare node Data recoverability verified daily RAID protection from disk failures Available for Avamar software and Avamar Data Store 87 Avamar Server Deployment Options Avamar Software Avamar Data Store Avamar Virtual Edition for VMware Avamar VM Avamar VM Avamar VM VMware Virtualization Layer x86 Architecture Resource Pool Software for industrystandard servers Fully integrated hardware/software solution with single point of support Single-node Avamar server running as a virtual machine (virtual appliance) 88 44

45 App OS App OS App OS SNAPSHOT SNAPSHOT SNAPSHOT Avamar agents Avamar Supported Operating Systems and Applications Client operating systems supported Microsoft Windows 2000 Server and Advanced Server Microsoft Windows Server 2003 Standard and Enterprise Microsoft Windows Server 2008, 2008 R2 Microsoft Windows XP, Vista, Windows 7 Red Hat Linux 9.0 Red Hat Enterprise Linux (RHEL) 3, 4, 5 SUSE Linux Enterprise Server 8, 9, 10, 11 Oracle Linux 5.3/5.4 CentOS 4.x/5.x Debian 4.x/5.x Solaris 8, 9, 10 SPARC, x86 IBM AIX 5.2, 5.3, 6.1 HP-UX 11.0, 11iV1, 11iV2, 11iV3 Mac OS X 10.4x, 10.5x, 10.6x NetWare 6.5 Free BSD 6.2 Novell Storage Services (NSS) OES 2 SCO UNIX RHEL/SUSE on zlinux (IBM System z) Application modules Microsoft Office SharePoint Server 2007 Microsoft Exchange 2000, 2003, 2007, 2010 Microsoft SQL Server 7.0, 2000, 2005, 2008 Oracle 9i, 10g, 10gR2, 11g IBM DB2 8.2, 9.5, 9.7 NDMP (EMC Celerra with DART 5.5, 5.6) NDMP (NetApp Data ONTAP 6.5, 7.0.4, 7.0.5, 7.0.6, 7.1x. 7.2, 7.3) IBM Lotus Domino 6.5, 7.x, 8.0, 8.5 VMware infrastructure VMware ESX server 3.0.x, 3.5, 3i vsphere 4 No charge for client agents or application modules! 89 EMC Avamar and VMware Vmware Backup Vmware vsphare4 Image Backup Guest VCB Xx86 Architecture App OS App OS VMware Virtualization Layer Virtual Machines ESX Server Physical Server SAN Storage Avamar Server VCB proxy server with Avamar agent MOUNT Centralized Data Mover Virtual Machines VMware Virtualization Layer vstorage API virtual proxy server with Avamar agent Mount CPU Memory NIC Disk x86 Architecture Service Console App App App Resource Pool Avamar server OS OS OS VMware Physical server SAN storage Hardware = Avamar Software Agent CPU Memory NIC Disk Avamar Agents ESX Server VMware vstorage API Integration Avamar Server 90 45

46 Desktop/Laptop Backup Challenges and Avamar Solution Avamar Desktop/Laptop Avamar Data Store End-user initiated restore Windows or Mac OS X Puts power in end-users hands Eliminates Help Desk for restoring data to desktop or laptop End-users restore their data anytime, anywhere Self-managed restores Document-level search engine All the benefits of Avamar backup Data deduplicated at the source Daily full backups up to 10 times faster Minimal impact on PC and network resources during backup 91 Avamar Integration with Networker NW Server Manages NW NMC Avamar Storage Node Reports upon Avamar data store AFTD Saveset metadata De-duplicated data File systems & Applications 92 46

47 Case Study Remote Office Backup (June 2007) Site Backup type Backups AvgPcnt Common GBProtected GBNew Main site Exchange1 Windows Exchange Database Main site Exchange2 Windows Exchange Database Main site Exchange3 Windows Exchange Database Main site Files Windows File System Site1 Exchange Windows Exchange Database Site1 Files Windows File System Site2 Exchange Windows Exchange Database Site2 Files Windows File System Site3 Exchange Windows Exchange Database Site3 Files Windows File System Backup takes < 1h! 93 Agenda EMC Data Protection Advisor Consolidate Monitoring and Reporting 94 47

48 Typical Data Protection Environment Backup applications/ clients Replication Virtual environments Data protection silos: High manual effort Poor or unknown utilization and protection status Budget fire-drills Deduplication/ VTL/tape Backup server NAS and SAN Business applications 95 With EMC Data Protection Advisor Automated, single view eliminates manual effort, data silos Payback typical in 12 months Reduces costs insight drives efficiency Lowers risk manage to service level agreements Minimizes complexity single, integrated view 96 48

49 Data Protection Advisor Use Case Orange Business Services Environment Size 4,050 systems backed up daily (87,000 jobs) 14,000 tapes online 1.6 PB storage protected (SAN storage) 900 TB storage protected (NAS storage) Applications 600 Oracle/SAP backup clients (more than 1,300 instances) 250,000 Exchange mailboxes 376 Lotus Notes servers 278 Microsoft SQL Server/SharePoint databases Hundreds of custom applications Backup applications EMC NetWorker for enterprise backup EMC Avamar for remote site backup Data Protection Advisor at Orange provides: Utilization and bottleneck awareness Capacity management Service level agreement monitoring and reporting Environmental and performance monitoring Exposure monitoring and reporting Chargeback Data Protection Advisor benefits to Orange Tape budget reduced by 50% Hardware budget reduced by 60% Backup success rates improved to 99.8% No service level agreement penalties in over two years All audits have been successful Customer satisfaction up 50% Less tape 60% Less disk Less risk Less manual effort 99.8% Backup success SLA improvement 97 ^ 98 49