Sébastien CHENE Datacenter Solution Architect Geneva Business Center 12, avenue des Morgines 1213 Petit-Lancy 1

Transcription

1 Sébastien CHENE Datacenter Solution Architect Geneva Business Center 12, avenue des Morgines 1213 Petit-Lancy 1 sebastien.chene@stinco.com +41 (0)

2

3 Devenez le héros de la sécurisation des données de votre entreprise La Technologie: Déduplication EMC Data Domain Mise en œuvre de la technologie Sauvegardes Archivage Stockage Multi-Tiers Votre Partenaire: STINCO

4 Data Stored La Technologie: Déduplication Dramatically Reduces Storage Capacity Requirements times less data stored versus fulls + incrementals with typical retention policies Weeks in Use Deduplication storage Traditional storage

5 La Technologie: Déduplication Store more backups in a smaller footprint Friday Full Backup A B C D A E F G Mon Incremental A B H Tues Incremental C B I Weds Incremental E G J Thurs Incremental A C K Second Friday Full Backup B C D E F L G H A B C D E F G H I J K L Backup Estimated Data Logical Reduction Physical FRIDAY FULL 1 TB 2 4x 250 GB Monday Incremental 100 GB 7 10x 10 GB Tuesday Incremental 100 GB 7 10x 10 GB Wednesday Incremental 100 GB 7 10x 10 GB Thursday Incremental 100 GB 7 10x 10 GB Second FRIDAY FULL 1 TB 50 60x 18 GB TOTAL 2.4 TB 7.8x 308 GB

6 Methodology: Inline vs. Post-Process Deduplication INLINE Deduplication Before Storing POST-PROCESS Deduplication After Storing Deduplication Store Deduplication 3x disk accesses to shared store Other activities unimpeded Predictable Simpler The more processes, the more resource contention Copy to tape: Too slow to stream tape Recovery: Service level agreement predictability Replication: Poor time-to-disaster-recovery Deduplication: If interleaved with backup or restore More administration to fight these issues

7 Throughput MB/s Performance: CPU-Centric vs. Spindle-Bound 6,000 Data Domain Fibre Channel SATA Most deduplication vendors Number of Disk Spindles

8 Backup Data Reduction/Deduplication Time Series of Large Enterprise Implementation 2H '07 15% 15% 14% 31% 25% 2H '08 1H '09 24% 27% 12% 8% 15% 16% 28% 21% In last three years, in-use rates for 25% backup with deduplication 26% have risen from 15% to 48% 2H '09 40% 4% 14% 22% 20% 1H '10 46% 6% 14% 17% 18% 1H '11 48% 7% 16% 7% 10% 13% In Use Now In Pilot/Evaluation In Near-term Plan In Long-term Plan Past Long-term Plan Not in Plan Source: Wave 15 Storage Study Q2 2011, published 5/16/11, large-enterprise sample; H 07, n=151; 2H 08, n=127; 1H 09, n=147; 2H 09, n=182; 1H 10, n=146; 1H 11, n=31;theinfopro (

9 Purpose-Built Backup Appliances Open Systems + Mainframe EMC: 64.2% EMC IBM HP Oracle Quantum Sepaton FalconStor Dell Others Source: Worldwide Purpose-Built Backup Appliance Forecast and 2010 Vendor Shares, May 2011, IDC. Chart: Worldwide Supplier Revenue, Total PBBA Market

11 EMC Data Domain: Leadership and Innovation An history of industry firsts First deduplication NAS First deduplication volume replication First deduplication virtual tape library Largest deduplication array First deduplication directory replication First deduplication nearline storage Fastest backup controller Cascaded replication First long-term retention system for backup and archive First distributed processing STINCO Portfolio EMC Aquisition

12 Data Integrity: Data Invulnerability Architecture End-to-end data verification Checksum Deduplication, write to disk Verify Self-healing file system Cleaning Expired data Defrag Verify Other RAID 6 NVRAM Snapshots Generate Checksum File System Deduplication Local Compression RAID 6 Verify Data End-to-end data verification Verify the file system metadata integrity Verify user data integrity Verify stripe integrity

13 DD Boost Software DD Boost Distributes parts of deduplication process to backup server or application clients Licensable software works across Data Domain portfolio Supports majority of backup software market EMC Avamar and NetWorker Symantec NetBackup and Backup Exec Speeds backups by up to 50 percent Process more backups with existing resources 20 40% less overall impact to backup server 80 99% less LAN bandwidth Enables Data Domain replication management from the backup application

14 Additional Data Domain Software Options Data Domain Virtual Tape Library Easily integrates with Fibre Channel Emulates multiple tape libraries Supports open systems and IBM i operating environments Data Domain Replicator Network-efficient and encrypted Transfers only compressed, deduplicated data over the WAN Consolidate up to 270 remote sites into a single system Data Domain Retention Lock File locking to satisfy IT governance and compliance policies Electronic data shredding Data Domain Encryption Inline encryption of data at rest Satisfies internal governance rules and compliance regulations Protects against theft or loss of a physical system

15 Network-Efficient Replication for True Disaster Recovery Lowers WAN costs; improves service level agreements DB Archive data Data Domain system 1 5% Flexible replication One-to-many Many-to-one Bi-directional System-to-system Cascaded Home Backup data Data Domain system 1 5% WAN Home Source: Remote sites Data Domain system 1 5% 95 99% cross-site bandwidth reduction Data Domain Global Deduplication Array Destination: Data Center Hub Supports hundreds of remote sites

16 DD Archiver Overview Cost-optimized, long-term retention Data Domain system for backup and archive Active tier: short-term data protection; less than 90 days Archive tier: scalable long-term retention; multiple years High-throughput deduplication storage Up to 9.8 TB/hr Cost optimized for long-term retention Up to 570 TB usable, 28.5 PB logical capacity Low cost per gigabyte while maintaining high throughput Fault isolation of archive units for long-term recoverability Leverage existing Data Domain system advantages Supports DD Replicator and DD Retention Lock software Data Invulnerability Architecture to ensure data integrity

17 Throughput GB/s Data Domain Systems Trajectory Data Domain SISL Scaling Architecture: CPU-centric 5 Improvement since 2004: Throughput: ~175x Capacity: ~450x 2014 (est.) DD200 (2004) Future

18 Industry s Most Scalable Inline Deduplication Systems DD800 Appliance Series Global Deduplication Array DD Archiver DD600 Appliance Series DD160 Appliance Software options: DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock, and DD Encryption DD160 DD620 DD640 DD670 DD860 DD890 Global Deduplication Array DD Archiver Speed (DD Boost) 1.1 TB/hr 2.4 TB/hr 3.4 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 26.3 TB/hr 9.8 TB/hr Speed (other) 667 GB/hr 1.1 TB/hr 2.3 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 10.7 TB/hr 4.3 TB/hr Logical capacity TB TB PB PB PB PB PB PB Usable capacity Up to 3.98 TB Up to 8.3 TB Up to 32.2 TB Up to 55.9 TB Up to 142 TB Up to 285 TB Up to 570 TB Up to 570 TB

19 With Data Domain Deduplication Storage Systems, You Can WAN Retain longer Keep backups onsite longer with less disk for fast, reliable restores, and eliminate the use of tape for operational recovery Replicate smarter Move only deduplicated data over existing networks with up to 99% bandwidth efficiency for cost-effective disaster recovery Recover reliably Continuous fault detection and self-healing ensure data recoverability to meet service level agreements

21 Cas Pratiques Sauvegardes Environnement TPE SMB - Branch Shared Storage NFS / iscsi DD160 DD620 NFS Datastore for backup WAN Optimized Replication CLOUD Service Provider OR DataCenter Consolidation vsphere Essential Up to 30 VMs

22 Cas Pratiques Sauvegardes Environnement SMB - Enterprise DD620 DD670 Shared Storage NFS / iscsi / FC WAN Optimized Replication VTL for AS400 NFS / CIFS, Ge or 10Ge CLOUD Service Provider OR DataCenter Consolidation vsphere Standard vsphere Enterprise AS400 BRMS Backup Server Physical Environment Unix / Linuxx / MS

23 Cas Pratiques Sauvegardes Environnement NAS DD620 DD670 WAN Optimized Replication NAS NFS / CIFS NDMP NDMP VTL CLOUD Service Provider OR DataCenter Consolidation Backup Server

24 Cas Pratiques Sauvegardes Database Protection & Files Transfers Shared Storage DD620 DD670 NFS / iscsi / FC WAN Optimized Replication CIFS / NFS, Ge or 10Ge DB DUMP SQL, Oracle DB2, Sybase, Pear DataCenter OR DataCenter Consolidation VM Transfer WAN optimized DB Server

26 ARCHIVE Differents archives needs Economic Patrimonial Compliance Need: Manage exponential data growth Activities: Automate transfer of fixed-content data from primary disk to archive Index archived information Create a stub on primary storage Delete archived data from primary after transfer De-duplicate redundant data stored in the archive Benefits: Reduce backup window Save on primary storage (Space & Cost) Save on archive storage Increase performance of primary and backup systems Easily retrieve information Need: Long term retention of business critical or historical data Activities: Transfer major company assets in long term storage area Index archived information Setup policies to manage data lifecycle based on its value Benefits: Fast & easy access to the data Preserve important information for long periods of time Manage data lifecycle Need: Comply with regulations and enable e- discovery in support of litigation requirements Activities: Setup automatic policies to archive data based on legal requirements Automatically delete data Control user access Index archived information Benefits: Comply with specific regulations Easily retrieve data Enable quick access to information in case of litigation

27 What is used to do? Backup AND Archive Primary Data Backup Data Passive Archive Archives is kept as a backup extension Old backups are renamed archives The challenges: Primary Storage Explosion (Costly) Backup windows explosion (Degrade operations) Hard to access archived (Off-Line data) Searching unformatted information is a mess (no index) Store archived data on tapes: Reusability?

28 Backup OR Archive? Different usages Different storage needs Different processes Ordering data in a structured and indexed way for long term conservation ARCHIVING Automatically copying information in case files get lost or deteriorated BACKUP Target: Data Preservation & Retrieval Target: Data Recovery Primary copy of fixed content data Create copy of dynamic data Fixed content kept for future reference Content is periodically overwritten Activity for long-term retention Activity for short-term retention Used for date retrieval and Compliance Used for Recovery purposes

29 What s going-on? Archive THEN Backup Backup Data Primary Data Active Archive Fixed content: Final version of the data Unchanged data moved from primary storage to archive: Reduce Capacity on primary storage Less real production data Shorten backup window, improve backup and restore Improve primary servers performance and users access Index all archived contents Easiest researches Fastest retrievals

30 Weekly or Monthly archived 27,6 TB Daily Backup 13,8 TB Data Explosion Containment Managed Datas 41,36 TB 40 TB 30 TB Use Case 3TB capacity in % yearly growth (Gartner 2009) 2/3 to be archived (Atempo 2009) Backuped Datas Containement 20 TB Secured & Archived Data 10 TB 3TB Years

31 Cas Pratiques DD Archiver Cost-optimized, long-term retention Data Domain system for backup and archive Active tier: short-term data protection; less than 90 days Archive tier: scalable long-term retention; multiple years High-throughput deduplication storage Up to 9.8 TB/hr Cost optimized for long-term retention Up to 570 TB usable, 28.5 PB logical capacity Low cost per gigabyte while maintaining high throughput Fault isolation of archive units for long-term recoverability Leverage existing Data Domain system advantages Supports DD Replicator and DD Retention Lock software Data Invulnerability Architecture to ensure data integrity

32 BACKUP Cas Pratiques Archives Free-up space: Files & Mails Backup Server BACKUP Archive CIFS / NFS, gigabit ethernet WAN Optimized Replication DR Archive Data Transfert Data Transfert CLOUD Service Provider OR DataCenter Consolidation Stub Stub Mail Server Archive Server Mails Archive Server Mails NAS / File Server

33 Cas Pratiques Archives Legacy Archiving Retention Lock Retention Lock Archive CIFS / NFS, gigabit ethernet WAN Optimized Replication DR Archive Data Transfert CLOUD Service Provider OR DataCenter Consolidation Stub Mail Server Archive Server Mails Enterprise Vault

35 Cas Pratiques Stockage Multi-Tiers Comment gérer vos données non structurée? Applications and Users Inflexible Complex Inefficient Expensive NAS and File Servers

36 Cas Pratiques Stockage Multi-Tiers Enabling a Dynamic Storage Infrastructure Applications and Users Dynamic ARX File Virtualization Seamless Efficient Integrated NAS and File Servers

37 Cas Pratiques Stockage Multi-Tiers Comment gérer vos données non structurée? Applications and Users Global Namespace Federates and presents logical representation of underlying file systems Decouples access from physical location Masks changes to underlying storage systems from applications and users Automated Data Management Policies Automate common storage management tasks Data migration Storage tiering Capacity balancing Tasks performed without affecting access to files or requiring client re-configuration NAS and File Servers

38 Users Cas Pratiques Stockage Multi-Tiers Users mount a virtual CIFS share or NFS export presented by the ARX device 1 2 To users, files appear to reside in the virtual share CIFS / NFS CIFS / NFS Files actually reside in a physical share presented by a file server or NAS device The ARX proxies CIFS and NFS file access to the appropriate physical location TIER 1 SSD / SAS MOVE TIER 2 TIER 3 SATA MOVE $$$ $$ $ The ARX can also automatically move or place files based on customized policy DR Site BACKUP BACKUP

39 F5 ARX: Real automated ILM enabler. Global Namespace Decouple logical file access from physical file location Federate multiple storage devices and file systems Non-disruptive Data Migrations Through Automated Policies Manage movement of files Place and move files based on value Automated policies manage optimal placement of files Advantages Cas Pratiques Stockage Multi-Tiers Customize backup policies by tier Break up large file systems

41 Votre Partenaire Portfolio Services Conseils et Support en Projets Datacenter Elaboration de cahier des charges Rédaction d appel d offres - Dépouillement des réponses - Proposition d acteurs clés - Aide à la décision Architecture de centre de calcul Audits, Etudes, Analyses, Conseils - Offres complexes: matériels, logiciels & services - Adéquation IT aux contraintes business Gestion de projets complexes Architecture et Gestion Infrastructures Datacenter Interlocuteur unique - Garantie du fonctionnement opérationnel de la solution - Gestion, planification des différents intervenants - Implication dans le projet jusqu à la recette finale

42 Votre Partenaire Portfolio Solutions Business Continuity Datacenter Consolidation Data Management Desktop Consolidation Backup and Recovery Servers & Storage Virtualisation Tiered Storage Architecture Workstation Protection Disaster Recovery Planning Branch Office Consolidation Information Lifecycle Management Workstation Virtualisation High Availability Green Technologies Legacy Archiving Client Approach Thin, Thick, Laptops

43 Votre Partenaire Constructeurs & Editeurs Stratégiques

44 Votre Partenaire Quelques références

45 Data Domain Infrastructure and Ecosystem Supports a variety of workloads and data types VMware Microsoft Microsoft SharePoint Oracle SAP Backup NAS, SAN, DAS Archive Primary storage Midrange and Mainframe IBM i EMC Bus-Tech Backup Applications EMC Symantec CommVault CA HP Vizioncore IBM Atempo BakBone Archive Applications EMC F5 Networks Symantec Atempo Network Replication over WAN Disaster Recovery

46 Merci. Sébastien CHENE Datacenter Solution Architect Geneva Business Center 12, avenue des Morgines 1213 Petit-Lancy 1 sebastien.chene@stinco.com +41 (0)