Backup of NAS devices with Avamar Extremely fast / no load Video describing NAS backup using Avamar based on this ppt: https://youtu.be/swg1ejldgmw The most fresh version of this document, you will find at: https://inside.emc.com/docs/doc-182220 Daniel Olkowski Technology Consultant EMEA EAST EMC Backup Recovery Systems 1
Agenda NAS systems Classic backup of NAS Architecture: Avamar and NAS backup Avamar: Real environment results of NAS system Backup Restore What do I need to implement the solution? 2
NAS devices 3
NAS devices Files sharing EMC VNX NetApp EMC Isilon Oracle ZFS 4
NAS devices What data do we keep on NAS? User files Files generated by applications Logs Data from production lines Video, image, sounds 5
NAS devices Why NAS? Easy access through LAN Windows / Linux / UNIX Performance Sharing Management Scalability 6
NAS devices Why NAS? Easy access through LAN Windows / Linux / UNIX Performance The problem Sharing Management Scalability Backup! 7
NAS devices Classic backup LAN LAN NAS / Filer NAS / Filer Backup Server Backup Server SAN SAN Data Domain Data Domain Tape library Tape library 8
NAS devices Classic backup LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer No matter, SANwhat backup software you SAN have NDMP protocol shall be used Data Domain Data Domain Daily / Weekly full backups are a must Tape library Tape library 9
NAS devices Full backups LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer Long backup windows SAN SAN Hours Days Data Domain Data Domain Tape library Weeks Tape library 10
NAS devices Full backups LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer Huge load SAN of protected SAN NAS device Backup process Data Domain Data Domain reads all data Tape library Tape library 11
NAS devices Classic backup LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer SAN Long restore of SAN Files / directories Data Domain Entire volume Tape library Data Domain Tape library 12
NAS devices Classic backup LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer SAN SAN Restore only to the same (original) NAS No restore of files/folders to Windows / Data Domain Data Domain Linux Tape library Tape library 13
NAS devices Classic backup LAN LAN Backup Server NAS / Filer 10TB - 200TB 1 mln - 400 mln files Backup Server NAS / Filer Required SAN dedicated SAN infrastructure Transfer of huge Data Domain Data Domain amount of data Tape library Tape library 14
How can we do it otherwise? Fast? Without investments in infrastructure? With freedom in recovery? 15
Avamar: NAS Backup Architecture Preferred 10Gb / 1Gb NAS Systems (VNX, NetApp, Isilon, ZFS) 10Gb / 1Gb 16
Avamar: NAS Backup Architecture 1 Transfer of new files only 2 3 Transfer of unique blocks (not present at DD) 4 Full backup Preferred 10Gb / 1Gb NAS Systems (VNX, NetApp, Isilon, ZFS) De-duplication Transfer of unique blocks (not present at ADS) 10Gb / 1Gb 3 Full backup 4 17
Avamar: NAS Backup Architecture Preferred 10Gb / 1Gb NAS Systems (VNX, NetApp, Isilon, ZFS) 8 streams 10Gb / 1Gb One backup stream per NAS volume Single NDMP Accelerator supports 8 parallel backup streams 18
Avamar: NAS Backup Architecture Preferred 10Gb / 1Gb NAS Systems (VNX, NetApp, Isilon, ZFS) 8 streams 8 streams 8 streams 10Gb / 1Gb One backup stream per NAS volume 32 NAS volumes backuped in parallel in configuration as above 19
Avamar NAS backup Real environment results 20
The environment Topology and connections 6,5 TB Avamar NDMP Accelerator (VMware Virtual Machine) Data Domain DD670 (just head with 12 disks) SINGLE VOLUME LAN 1Gb LAN 1Gb VNX NAS System VMware environment Virtual Machines Avamar Server (VMware Virtual Machine) 21
Backup results Avamar screens Full backup size (protected data that we can restore) Increased data on Data Domain (data sent from accelerator to Data Domain) 22
Backup results Avamar log 23
Backup results Source de-duplication (info from Data Domain) ddboost show stats interval 1 24
Backup results Summary BACKUP Data amount [GB] Backup performance [TB/h] Number of files Backup time Backup performance [Files/h] 6 380 20,1 mln 59 min 6,5 20,4 mln files / h 6 380 20,1 mln 59 min 23sec 6,4 20,4 mln files / h 6 380 20,1 mln 56min 9sec 6,8 21,5 mln files / h 6 380 20,1 mln 34min 15sec 11,2 35,2 mln files / h 25
Backup results Topology and connections 6,5 TB Avamar NDMP Accelerator (VMware Virtual Machine) Data Domain DD670 (just head with 12 disks) SINGLE VOLUME LAN 1Gb VNX NAS System LAN 1Gb 1 stream VMware environment Virtual Machines Avamar Server (VMware Virtual Machine) 26
Backup results Topology and connections Backup was performed with single stream Achieved performance: 6,5TB/h (single stream) Data Domain LAN VNX NAS System LAN 1Gb 1 stream Avamar NDMP Accelerator 1Gb 27
Backup results Topology and connections If we extend the architecture to 3 accelerators / 32 streams / 32 volumes we will get the performance 208TB/h Data Domain VNX NAS System LAN 1Gb LAN 8 streams 8 streams 1Gb 8 streams Avamar NDMP Accelerator 28
Backup results Topology and connections If we extend the architecture to 3 accelerators / 32 streams / 32 volumes we will get the performance NAS storage 208TB/h VNX NAS System is not a bottleneck during backup LAN 1Gb 8 streams 8 streams 8 streams Avamar NDMP Accelerator LAN 1Gb Data Domain We almost do not read data from NAS! 29
Backup results Topology and connections First backup with empty Data Domain 30
Backup results Topology and connections First backup with fed Data Domain (full of blocks) 31
Restore of NAS device 32
Avamar NDMP restore results Avamar logs 33
Avamar NDMP restore results Avamar logs 34
Avamar NDMP restore results Summary RESTORE Restore performance [TB/h] Restre performance [Files/h] Data amount [GB] Number of files Backup time Remarks 2,87 2min 49sec 218 tys 61 218K files / h Granular recovery to NAS 35,14 20min 35sec 122 tys 102 355K files / h Granular recovery to NAS 0,55 21sec 2 tys 93 342K files / h Granular recovery to Windows 35
Avamar NDMP restore results Summary RESTORE Data amount [GB] Number of files Backup time Restore performance [TB/h] Restre performance [Files/h] Remarks 2,87 2min 49sec 218 tys 61 218K files / h Granular recovery to NAS 35,14 20min 35sec 122 tys 102 355K files / h Granular recovery to NAS 0,55 Single 21sec stream 2 tys 93 342K files restore / h Granular recovery Windows 36
Avamar NDMP restore results Restore of all data RESTORE Data amount [GB] Number of files Backup time Restore performance [TB/h] Restre performance [Files/h] 6 397 68h 14min 49sec 20,1 mln 94 293K files / h 37
Avamar NDMP restore results Restore of all data RESTORE Data amount [GB] Number of files Backup time Restore performance [TB/h] Restre performance [Files/h] 6 397 68h 14min 49sec 20,1 mln 94 293K files / h Single stream restore 1Gb LAN bottleneck 38
EMC and Isilon Internal EMC tests 39
Avamar / NDMP / Isilon Testy 40
Required components in the solution 41
Avamar: NAS Backup Required components Avamar Data Domain license 10Gb / 1Gb NAS Systems (VNX, NetApp, Isilon, ZFS) 10Gb / 1Gb Avamar server Avamar regular license 42
Avamar NAS Backup Disaster Recovery 43
Avamar: NAS Backup Required components Site A Site B Avamar Data Domain license Avamar replication license 0 USD Backup replication Avamar server Avamar server Avamar regular license Metadata replication Avamar replication license 0 USD 44
Avamar: NAS Backup Disaster Recovery Site A Replication tasks Avamar Recovery Data Domain license tasks Backup replication Site B Avamar replication license 0 USD Managed Avamar server from Metadata replication Avamar Avamar regular license console Avamar server Avamar replication license 0 USD 45
Avamar: NAS Backup Disaster Recovery On primary Avamar you setup replication 46
Avamar: NAS Backup Disaster Recovery On secondary Avamar you can easily restore your data (f.e. from Data Domain) 47
Backup NAS devices with Avamar Why? 48
Why Avamar for NAS backups? The fastest possible backup Backup window is minutes / hours for huge amount of data Always full backup Immediate restore Files Folders Restore to Windows/Linux 49
Why Avamar for NAS backups? NAS device does not feel the backup No slowness of NAS device during backup We do not read data No investments in infrastructure FC LAN Backup over WAN if required Easy Disaster Recovery 50
Why Avamar for NAS backups? Full backup on different device than production Many times the only solution to survive 51
Why Avamar for NAS backups? NAS device does not feel the backup No slowness of NAS device during backup Almost no data read during backup No investments in infrastructure FC LAN Backup over WAN if required Always full backup Direction: Do not read data Have a full backup! Easy Disaster Recovery 52
Questions Daniel.Olkowski@emc.com 53