1 Practical Backups with AMANDA Nick Brockner, Hamilton College Dustin Mitchell, Zmanda, Inc. LISA 2009
2 Backup Administrator Woes Finish backup in desired backup window When it hits the fan comes the real test Is your backup plan REALLY tested? Backup differing environments / differing media OS es, Distros, Databases, Apps Tapes, Disks,... Cloud
3 Homegrown Backup Scripts Many system administrators start with home grown backup scripts No initial budget for backup software and backup server Initially problem seems relatively easy for a Perl hacker This was the case when I started at my current $JOB Backup scripts don t scale Changing needs of the organization New platforms and applications New administrators Amanda uses similar formats as typical home-grown scripts Tar for Linux/UNIX Zip for Windows Script API: Allows for pre- and post- backup plug-ins
4 Backup Scheduling tight backup windows Difficult to predict which data set will change when Traditional backup methods require extensive planning and on-going maintenance
5 Backup Scheduling: Traditional Approach 70GB Data Size You plan for this Server 1 60GB 50GB 40GB Backup window will be different for each backup run and there will be spikes in resource utilization during full backups Server 2 Server 3 Server 4 Server 5 30GB 20GB but you mostly use THIS Server 6 Server 7 10GB 0GB Sunday Monday Tuesday Wednesday Thursday Friday Saturday
6 Backup Scheduling: The Amanda Way Data Size 70GB Server 1 60GB 50GB Backup window and resource utilization are consistent for each backup run Server 2 Server 3 Server 4 40GB 30GB Utilization is normalized! Server 5 Server 6 20GB Server 7 10GB 0GB Sunday Monday Tuesday Wednesday Thursday Friday Saturday
7 AMANDA Reporting report every night Easily setup to do a check for the next scheduled backup in cron (amcheck <config (< name
9 Advantage of Open Open Formats Proprietary format for backup archives comes with huge cost and pain In my unique position I get to see both: Backup Exec (main ITS ( Dept backups) and AMANDA (Computer Science Ability to recover with native tools: ( etc Position tape to correct file with native tape device tool (mt, /usr/bin/gzip -dc /bin/tar -xpgf One just has to keep a backup of one s index files (easy with rsync) so that you know which file to position tape to. Open discussions! forums.zmanda.com wiki.zmanda.com
10 Case Study: Hamilton College Computer Science Dept Each with separate backup device No testing of restores No plan Year I was hired Now Central Backup machine for all servers using AMANDA Tested restore plan ( 3 All machines backed up on 1 technology (LTO Very easily scaled If backup server dies? No Problem!!
11 Case Study: Wadsworth NY-based bio/medical labs and research Subject to HIPPA and other legal mandates Amanda Admin: Brian Cuttler
12 Case Study: Wadsworth ~20 Amanda servers - departmental, divisional, some standalone Variety of tape drives: DLT, SDLT, and changers: SL24/LTO4, C2/LTO3 Mostly Solaris, but some Mac OS and RHEL, even some IRIX? Tens of TB daily
13 Case Study: Wadsworth Offsiting: some move tapes to/from offsite nightly some move entire magazines weekly some force "fulls" onto a tape and send that offsite Problems: interactions of ZFS snapshots with many partitions ( server (155+ on one users tend to keep adding disk -> long restores
14 Amanda Through the Ages Originally developed at University of Maryland beginning 1992 James da Silva UMD BSD-style license Adopted by Zmanda, Inc. about 4 years ago Jean-Louis Martineau came along "2005 Linux Journal Readers' Choice Award Downloads
15 Amanda Myths Amanda can't dump across multiple tapes It can since at least v early 2005 Amanda only supports tape drives Not so! And the Device API adds a lot of new support! Amanda can't do fulls on weekends It can, but ask yourself, "why"?
16 The Amanda you Don't Know Data Storage: now: cloud, tape, RAIT coming: NDMP Coming: CD-RW (Written by Sam Couter) Applications: now: MySQL, Postgres, ZFS snapshot, "raw", samba coming: other snapshots coming: DirectTCP support
17 The Amanda you Don't Know Features: now: Vaulting coming: Multi-drive changers coming: DirectTCP support
18 Amanda Limitations Append-to-tape, varying tape sizes Really config/backward-compat problems Recovery requires reading entire dump Application API will fix this All data passes through the Amanda server DirectTCP can fix this
19 DEMO Demonstration of simple setup using 1 backup server, 2 clients. RTFM: a little knowledge goes a long way in this case.
20 Conclusion AMANDA can (affordably) provide reliable backups that are not saved in a proprietary format. Questions (and maybe answers... )
21 Credits Some images and slides used with permission of Chander Kant, CEO Zmanda, Inc. Thanks Dustin!
! Product Analysis! Datto Makes Virtual Hybrid Cloud Backup Easy! Prepared by: Colm Keegan, Senior Analyst! Prepared: October 2014 Datto Makes Virtual Hybrid Cloud Backup Easy Many businesses and service
Data Backup Options for SME s As an IT Solutions company, Alchemy are often asked what is the best backup solution? The answer has changed over the years and depends a lot on your situation. We recognize
WHITE PAPER: CA ARCserve Backup Network Data Management Protocol (NDMP) Network Attached Storage (NAS) Option: Integrated Protection for Heterogeneous NAS Environments CA ARCserve Backup: Protecting heterogeneous
Best Practices for Deploying and Managing Linux with Red Hat Network Abstract This technical whitepaper provides a best practices overview for companies deploying and managing their open source environment
Why Cloud Backup/Recovery (Private, Public, or Hybrid) WILL be Your Data Protection. Marc Staimer, President and CDS of Dragon Slayer Consulting Marc s consulting practice of 11+ years provides consulting
1221 John Q. Hammons Drive Madison, WI 53717 P.O. Box 44966, Madison, WI 53717 P: 608.826.2400 TF: 800.366.9091 F: 608.831.4243 www.sva.com Introduction Computers are the default storage medium for most
Pros 4 Technology Online Backup Features Introduction Computers are the default storage medium for most businesses and virtually all home users. Because portable media is quickly becoming an outdated and
Cyber Security: Guidelines for Backing Up Information A Non-Technical Guide Essential for Executives, Business Managers Administrative & Operations Managers This appendix is a supplement to the Cyber Security:
Data Integrity: Backups and RAID Track SA-E AfCHIX workshop Blantyre, Malawi (Original slides by Phil Regnauld) Introduction Keeping your data safe and reliable TM Backups Types of backups Strategy Tools
O N L I N E S E R V E R B A C K U P Business-class Server Backup that allows you to remotely backup a server online. Features advanced compression and de-duplication to speed backups and minimize space.
Backup and Recovery With Isilon IQ Clustered Storage An Isilon Systems Best Practices Guide August 2007 ISILON SYSTEMS 1 Table of Contents 1. Assumptions... 4 2. Introduction... 4 3. Data Protection Strategies...
Disaster Prevention and Recovery Plan for Windows Based Networks by Jeff Kendrick, 1. Prevention A. Daily tape backups B. Monthly Automated System Restore (ASR) or Windows 2008 backups and updates C. Alternate
Dell NetVault Backup Technical Overview A technical overview of NetVault Backup, including its architecture, benefits, key components and licensing options. Written by Dell Software Introduction NetVault
Bacula The leading Opensource Backup Solution OpenSource Project Bacula is a network backup solution, designed for *BSD, Linux, Mac OS X, Unix and Windows systems. Original project goals were to: backup
Remote Data Backup Introduction Computers are the default storage medium for most businesses and virtually all home users. Because portable media is quickly becoming an outdated and expensive method for
Secure online file storage ITD CLIO Server Filestore What is online file storage? ITD s server CLIO provides the University with a large, managed central online file storage. This is a service which allows
WHITE PAPER Intelligent Disaster Recovery VERITAS Backup Exec 9.1 for Windows Servers Intelligent Disaster Recovery Option 11/20/2003 1 TABLE OF CONTENTS Introduction...3 Solution: Point-in-Time Disaster
Disk-to-Disk Backup & Restore Application Note All trademark names are the property of their respective companies. This publication contains opinions of StoneFly, Inc., which are subject to change from
CCC Technologies, Inc. 700 Nicholas Blvd., Suite 300 Elk Grove Village, IL 60007 877.282.9227 www.ccctechnologies.com Online Backup Solution Features Introduction Computers are the default storage medium
Online Backup White Paper The Dollars and Sense of Online Backup Table of Contents Executive Summary...3 IT Challenges: It s ugly out there...3 The problem with tape...4 Now is the time for online backup...5
Symantec NetBackup (NBU) Design Best Practices with Data Domain GlassHouse Whitepaper Introduction Written by: Brian Sakovitch and Kelley Alexander GlassHouse Technologies, Inc. Protecting the ever expanding
HYBRID CLOUD BACKUP 101 Top Five Benefits of Cloud-Connected Appliances Hybrid cloud backup solutions will grow at a compounded average a growth rate of more than 80%. TANEJA GROUP 02 Introduction Most
Cloud Services for Backup Exec Planning and Deployment Guide Chapter 1 Introducing Cloud Services for Backup Exec This chapter includes the following topics: About Cloud Services for Backup Exec Security