NetApp Data Fabric: Secured Backup to Public Cloud Sonny Afen Senior Technical Consultant NetApp Indonesia
Agenda Introduction Solution Overview Solution Technical Overview 2
Introduction 3
Hybrid cloud: fundamental trend for IT Promises efficiency and flexibility, but has risks of loss of control Cloud Service Providers Hyperscale Cloud Providers Private Public Private Cloud 4
Backup and archive will be the first workloads to move to the cloud For which of the following purposes does/did your organization use cloud infrastructure services? N=327, multiple responses accepted Source: ESG, 2015 5 Data backup and archive Test and development 2015 NetApp, Inc. All rights reserved. NetApp Proprietary Limited Use Only Disaster recovery Pimary storage for files Web servers High-performance computing Business intelligence Temporary projects Internal production apps Application bursting Workload spikes 38% 35% 34% 32% 31% 30% 27% 27% 25% 25% 49%
Why hybrid cloud storage for backup and archive? 0,25 0,2 Private cloud Azure Storage Pricing/GB/month 49% of companies that use cloud infrastructure use it for data backup and archive * 0,15 0,1 Google Cloud Storage AWS S3 0,05 AWS Glacier 0 2010 2011 2012 2013 2014 2015 *Source: Enterprise Strategy Group, 2014. 6
The problems with backup and archive today Too Slow Too Expensive Too Risky Too Complex Users expect instant recovery and minimal data loss Backup and recovery fail to meet windows As storage grows, so does the cost of backup Too much employee time is devoted to data protection Tapes can get lost and are hard to test Companies experience increased downtime and data loss Organizations manage hundreds of backup jobs across multiple backup apps Managing copies of data across sites is a challenge 7
Solution Overview
How your peers use cloud for backup and archive Backup modernization Adding cloud-integrated backup PBBA VTL/PBBA Backup server Tape Backup server Cold storage target Public or private cloud Archival storage target File store Filestore Enterprise Vault Tape Archive or DB server 9
How your peers use cloud for backup and archive Backup modernization Adding cloud-integrated backup PBBA Backup server Cloud-integrated storage appliance Cloud-integrated storage appliance Backup server Public or private cloud Cold storage target Archival storage target Cloud-integrated storage appliance Cloud-integrated storage appliance Enterprise Vault Archive or DB server 10
Cloud can help with disaster recovery as well Recover on-premises workloads in the cloud Public cloud Backup server Cloud-integrated storage appliance Recover to another site through the cloud Public or private cloud DR site Backup server Cloud-integrated storage appliance 11
Cloud can help with disaster recovery as well Recover on-premises workloads in the cloud Backup server Cloud-integrated storage appliance Cloud-based storage appliance Public cloud Cloud-based backup server Recover to another site via the cloud Public or private cloud DR site Backup server Cloud-integrated storage appliance Cloud-integrated storage appliance 12
NetApp AltaVault cloud-integrated storage NetApp AltaVault enables customers to securely back up data to any cloud at up to 90% less cost compared to on-premises solutions. AltaVault gives customers the power to tap into cloud economics while preserving investments in existing backup infrastructure and meeting backup and recovery SLAs. 13
AltaVault ecosystem Storage NetApp SnapProtect Arcserve CommVault Simpana Dell vranger EMC NetWorker HP Data Protector IBM Spectrum Protect Veeam Veritas Backup Exec Veritas Enterprise Vault Veritas NetBackup Microsoft SQL Server Oracle RMAN NetApp AltaVault Cloud-integrated storage appliance Amazon Glacier and S3 AT&T Synaptic Storage as a Service CenturyLink NetApp StorageGRID Webscale Cleversafe Dunkel Cloud Storage EVault LTS2 Google Cloud Platform IBM SoftLayer Object Storage Microsoft Azure Rackspace Public or Private Cloud Public cloud Cloudian HyperStore EMC Atmos Swisscom Telefonica TELUS Verizon Terremark OpenStack Swift Private cloud Seamlessly integrates into existing infrastructure Deduplicates, compresses, and encrypts Caches recent backups locally, vaults everything to the cloud Store data in the public or private cloud of choice
Webscale storage for on-premises archives NetApp SnapProtect Arcserve CommVault Simpana Dell vranger EMC NetWorker HP Data Protector IBM Spectrum Protect Veeam Veritas Backup Exec Veritas Enterprise Vault Veritas NetBackup Microsoft SQL Server Oracle RMAN NetApp AltaVault Cloud-integrated storage appliance NetApp StorageGRID Webscale Private cloud storage Transparent migration from existing data sources Secure data transport on premises or off premises Massively scalable onpremises or hosted object storage Result: durable, cost-effective on-premises archives at web scale
NetApp AltaVault primary use cases Backup and recovery For organizations that want to include cloud storage as part of their backup architecture Keeps a local copy of recent backups for rapid restore, but immediately replicates them to the cloud for off-site storage Optimized for meeting backup and recovery windows Cold storage For organizations with large volumes of data that are infrequently accessed and/or need to be retained for a long time Only metadata is kept locally; all data is immediately replicated to the cloud Optimized for scale 16
Solution Technical Overview
Key components needed for backup to cloud Data optimization Shrinking data to the smallest size possible provides best usage of cloud storage as well as fast replication High-performance ingest and replication Scalable local capacity (cache) Capacity of local cache scales by adding disk packs and disk shelves Virtual appliances offer up to 32TB usable local cache Physical appliances offer 32TB usable (48TB raw) and higher local cache, up to more than 380TB usable (576TB raw) Strong security and encryption Data is encrypted before being written to disk (encryption at rest) Replication to cloud through encrypted connect (encryption in flight) Data in the cloud remains encrypted 18 Keys are kept on appliance, not stored with the data in the cloud
Data optimization Deduplication technology overview SCAN Variable Segment Length 001100111000110001 Fingerprint SHA- HASH INDEX Store references Lookup table S3 S1 S2 PACK Compact Encrypt LZ Compress Encrypt SLAB For transmission S1 S3 Slabs S2 Sn Inline variable segment length finds more duplicate data than fixed-block solutions More matches allow greater reduction of data Yields maximum data reduction Compression further compacts data Data is grouped into slabs to optimize transmission and storage within the cloud Sn Segment NetApp AltaVault storage decreases datasets, allowing you to store 10 to 30 times more on average. 19
NetApp AltaVault automatic format optimization Automatically detects stream insertions and format NetApp AltaVault storage intelligently optimizes deduplication Automatic detection of backup application files Handles multiple backup applications concurrently Automatic optimization of segments from 512 bytes to 32k bytes 1010010011011010101 101110 0011001110001100011110111 20
High-performance ingest and replication Disconnect read / write to shares from the cloud Backup Data Files HTTPS Cloud Storage AES-256 File Share Optimization Engine Encrypted Slabs Replication Engine Complete set of data asynchronously replicated to cloud Local Disk Cache 21
Introducing NetApp AltaVault models Two physical models AVA400-6U single-chassis configuration with controller/blank - 48TB to 288TB raw capacity - 1/2 to 3 AVA10S disk shelves (half-shelf increments) - 4TB NL-SAS drives - 5.5TB/hr ingest performance AVA800-6U single-chassis configuration with controller/blank - 72TB to 576TB raw capacity - 1/2 to 4 AVA10S disk shelves (half-shelf increments) - 6TB NL-SAS drives - 8.0TB/hr ingest performance 22
Introducing NetApp AltaVault virtual models Three virtual models AVA-v8-8TB local usable capacity - 4 vcpu, 24GB RAM - VMware ESXi and Hyper-V AVA-v16-16TB local usable capacity - 8 vcpu, 48GB RAM - VMware ESXi and Hyper-V AVA-v32-32TB local usable capacity - 12 vcpu, 96GB RAM - VMware ESXi and Hyper-V 23
Introducing NetApp AltaVault cloud-based models Three cloud-based models AVA-c4 - Amazon Marketplace - Microsoft Azure - 4TB local capacity AVA-c8 - Amazon Marketplace - 8TB local capacity AVA-c16 - Amazon Marketplace - 16TB local capacity 24
Introducing the NetApp AltaVault 10S disk shelf NetApp AltaVault 10S (AVA10S) disk shelf Based on DS4246 chassis 4U (rack units) IOM6 shelf modules Disks available in half-shelf increments 12 disks in a pack, preformatted especially for NetApp AltaVault storage Drives have light grey 4TB label unique to AltaVault Two drive models 4TB NL-SAS (AVA400 only) 6TB NL-SAS (AVA800 only) 512-byte format not compatible with FAS/Data ONTAP 25
Introducing NetApp AltaVault OS 4.0 Featuring a new flat-style user interface design New major release Updated user interface for greater ease of use Increased ingest performance NetApp AutoSupport system Graphical shelf display 26
Appliance tech specs overview: backup mode Cloud-based appliances Virtual cloud-integrated appliances Physical cloud-integrated appliances Model AVA-c4 AVA-c8 AVA-c16 AVA-v8 AVA-v16 AVA-v32 AVA400 AVA800 Usable local capacity 4TB 8TB 16TB 8TB 16TB 32TB 32TB-192TB 48TB-384TB Cloud capacity supported 20TB 40TB 80TB 40TB 80TB 160 TB 160TB 960TB 240TB 1.92PB Logical cloud capacity (max) 600TB 1.2PB 2.4PB 1.2PB 2.4PB 4.8PB 28PB 57PB Backup throughput (max) 300GB/hr 350GB/hr 2.6TB/hr 900GB/hr 1.8TB/hr 2.6TB/hr 5.5TB/hr 8TB/hr For details on technical specifications, contact your nearest NetApp or channel sales associate. 5x of appliance usable local capacity; for example, a maximum of 160TB of cloud capacity can be supported by 32TB of usable local capacity. Logical cloud capacity calculated using 30x deduplication, assuming backup mode. All AltaVault cloud appliances are available on the Amazon Marketplace as AMIs. Only AVA-c4 is available on Microsoft Azure as AVM. 27
Appliance tech specs overview: cold storage mode Cloud-based appliances Virtual cloud-integrated appliances Physical cloud-integrated appliances Model AVA-c4 AVA-c8 AVA-c16 AVA-v8 AVA-v16 AVA-v32 AVA400 Usable local capacity 4TB 8TB 16TB 8TB 16TB 32TB 32TB Logical cloud capacity (Maximum) 3 1.6PB 3.2PB 6.4PB 2.5PB 5PB 10PB 10PB Backup throughput (max) 175GB/hr 225GB/hr 350GB/hr 350GB/hr 350GB/hr 350GB/hr 350GB/hr For details on technical specifications, contact your nearest NetApp or channel sales associate. 5x of appliance usable local capacity; for example, a maximum of 160TB of cloud capacity can be supported by 32TB of usable local capacity. Logical cloud capacity calculated using 30x deduplication, assuming backup mode. All AltaVault cloud appliances are available on the Amazon Marketplace as AMIs. Only AVA-c4 is available on Microsoft Azure as AVM. 28
AltaVault offers unparalleled efficiency and ironclad security on an open platform 30min 90% 20 32x to get started backing up to the cloud reduction in time, cost, and data volumes public and private cloud providers supported faster restores compared to tape backups 29
AltaVault offers unparalleled efficiency and ironclad security on an open platform Simple Efficient Open Secure Get up and running with AltaVault in less than 30 minutes. In three simple steps, you can start sending data to the cloud. Accelerates cloud on ramp by deduplicating, encrypting, and rapidly streaming data to the cloud. Seamlessly integrates with all leading backup software solutions and cloud storage providers. Reduces security and compliance risks in the cloud while eliminating tape transport and reducing recovery times. 30
Thank You