Long term retention and archiving the challenges and the solution

Transcription

1 Long term retention and archiving the challenges and the solution NAME: Yoel Ben-Ari TITLE: VP Business Development, GH Israel 1

2 Archive Before Backup EMC recommended practice 2 1 Backup/recovery process 3 3 Primary application Archive process Archive valuable information to tiered infrastructure Backup to disk active production information Retrieve from archive or recover from backup 2

3 Cost-Effective Retention for Backup Customer Challenges: Long-Term Retention Today s platforms are for backup or archive, not both Requirements: Backup throughput and deduplication Long-term retention model Backup platforms today assume months of retention, not years Throughput/capacity ratio No logical isolation of old data NAS and cloud Throughput too slow for backups Wrong deduplication, expensive Tape still has a place to live High Low Cloud NAS Support for Backup Throughput Tape automation Data Domain Most VTL systems High 3

4 Data Domain Archiver First long-term retention platform for backup and archive Backup/archive servers File servers and users Data Domain Controller System Overview Common Data Domain controller, management, and namespace Tiered storage: active and archive tiers Periodically migrates aging data from active tier to next archive unit When full, archive units are sealed for fault isolation, but remain online DATA Active tier Archive unit 2 Archive unit 1 Archive unit 0 New Recent Older Oldest e.g., 90 days 7 years + 4

5 Data Movement to Archive Tier Data Domain Controller Data movement policy based on last-modified time Only ready target unit may receive tiered data (one way) Data movement process runs periodically, subject to throttle Data Active tier Archive unit 3 Archive unit 2 Archive unit 1 Archive unit 0 Active New Recent Old Older Oldest Ready active Ready target 5

6 Data Movement Policy Configuration 6

7 Single File System with Scalable Namespace CIFS, NFS, and Data Domain Boost All data is visible to users, and file system metadata is in active tier Access through CIFS, NFS, and Data Domain Boost Trade-off: Much larger capacity vs. Access times Archive units could be swapped out of memory and may experience slower response times (less than 1 minute) Data access delay less than 1 minute Data access delay less than 1 minute Active tier Archive unit 3 Archive unit 2 Archive unit 1 Archive unit 0 Data Ready active Ready target Ready sealed Standby sealed Standby sealed 7

8 Data Integrity: Data Invulnerability Architecture End-to-end data verification Checksum Deduplication, write to disk Verify Self-healing file system Cleaning Expired data Defrag Verify Generate Checksum File System Deduplication Local Compression RAID Verify Data Verify the file system metadata integrity Verify user data integrity Verify stripe integrity Other RAID 6 NVRAM Snapshots End-to-end data verification 8

9 Fault Isolation When target storage unit becomes full, it is sealed with metadata and contents Failure of storage unit impacts only its contents As last resort, sealed units may be connected to a new controller to have its contents read (join a new system) Data Domain Controller Data Domain Controller Active tier Archive unit 3 Archive unit 2 Archive unit 1 Archive Active unit tier 0 9

10 Disaster Recovery Configuration Data Center Unit-to-unit collection replication Remote Disaster Recovery Site Active tier WAN Active tier Archive unit 0 Archive unit 0 Archive unit 1 Archive unit 2 WAN Single-unit recovery Archive unit 1 Archive unit 2 Archive unit 3 Archive unit 3 10

11 Why DD Archiver? Long-Term Retention of Backup and Archive Data Cost-effective scalability (570TB usable; up to 28.5PB logical) Fault isolation of archive units ensure long-term data retention Modular upgrades and migrations High Throughput Deduplication Storage Throughput characteristics of the new DD860 Reduced footprint: space, power, cooling NAS (NFS & CIFS) and DD Boost protocols Single point of management Data Domain Proven Resilience Data Domain Data Invulnerability Architecture DD Replicator software option for disaster recovery DD Retention Lock software option 11

12 $/GB 5 Year TCO Comparison vs. Tape $0.45 $0.40 $0.40 $0.42-5% $0.35 $0.30 $0.25 $0.20 $0.15 $0.10 $0.05 $0.00 DD Archiver Tape Real Estate (5 years) $0.05 $0.03 Power & Cooling (5 years) $0.05 $0.03 Tape Handling (5 years) $0.12 Offsite Shipping & Storage (5 years) $0.05 Tape Media Investment (2:1, 70% util) $0.06 H/W & S/W Maintenance (5 years) $0.10 $0.05 Tape Library Infra Investment $0.08 DD Archiver Investment (5.7PB, 10:1) $

13 Data Domain Archiver Customer 3 Year TCO $1.5M $1.2M -20% Capacity Required 1000TB 150TB -85% Data Access Time 48Hrs 5 Mins -99% 13

14 Data Domain Archiver Use Case Centralized Archiving of Replicated Backups 14

15 Data Domain Archiver Use Case Long-Term Retention of s, Projects, Files File Tiering Backup Applications Scripted / Manual Copy Archive Applications 15

16 Cost-effective Retention for Backup Data Domain Archiver First long-term retention system for backup and archive Requirements: Backup throughput and deduplication Long-term retention model High DD Archiver DD Archiver High-throughput deduplication storage Long-term retention model Extensible architecture: more to come over time Moving into tape s last major hideout Cloud NAS Traditional Data Domain Most VTL systems Low Support for Backup Throughput High 16

17 Ideal Customer Profiles for DD Archiver Using tape for retention Backup retention of greater than 2 years Offsite vaulting spend Planning tape refresh Already using DD for operational/disaster recovery 17

18 DD800 Appliance Series Global Deduplication Array DD Archiver DD600 Appliance Series DD140 Remote Office Appliance Software options: DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock, and DD Encryption DD140 DD610 DD630 DD670 DD860 DD890 Global Deduplication Array DD Archiver Speed (DD Boost) 490 GB/hr 1.3 TB/hr 2.1 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 26.3 TB/hr 9.8 TB/hr Speed (other) 450 GB/hr 675 GB/hr 1.1 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 10.7 TB/hr 4.3 TB/hr Logical capacity 9 43 TB TB TB PB PB PB PB PB Raw capacity 1.5 TB Up to 6 TB Up to 12 TB Up to 76 TB Up to 192 TB Up to 384 TB Up to 768 TB Up to 768 TB Usable capacity 0.86 TB Up to 3.98 TB Up to 8.4 TB Up to 55.9 TB Up to 142 TB Up to 285 TB Up to 570 TB Up to 570 TB 18

19 THANK YOU 19

20 THANK YOU 20