Welcome to the ILTA OSSPG Presentation: Backup Tools with

Transcription

1 Welcome to the ILTA OSSPG Presentation: Open Source Backup Tools with Nate Smith & Dale Qualls

2

3 Open Source Backup with Bacula

4 Bacula Rocks Free and Open Source Software (FOSS) Bacula Case Study Conclusion

5 FOSS Free and Open Source Free as in Free Speech or Free as in beer English doesn t have a good word for this. Software Libre

6 Nate s PhilFOSSiphy Proprietary software: The glass is half empty: I better get what I paid for FOSS: The glass is half full: you get what you get and you don t throw a fit.

7 The Reality Proprietary FOSS

8 FO$$ and your budget It can be a bit of a socialist trade-off off. The software may be free but it may take more time to install, configure, and test. There is a trade-off between time and money that balances out in the end. Or does it..?

9 FO$$ and your budget

10 Bacula Open source, network-based, backup and restore software. Backup+Dracula It comes by night and sucks the vital essence from your computers.

11 Bacula Mainly written by Kern Sibbald Contributions by others Some of the best-documented t d open source software I have seen.

12

13 Bacula Consists of three main Programs File Daemon Director Daemon ++ Storage Daemon These programs can exist together on the same machine and/or be on separate machines.

14 Bacula Jobs are the basic unifying structure Name of Job must be unique Type to do: backup, Backup, Migrate, Admin, Restore Level detail of job type: Full, Differential, Incremental FileSet what to files to backup Client where to get the files (machine name) Storage where to put the files (which hardware) Pool which set of Volumes (tapes, disk) to use Schedule when to do it

15 Bacula Uses your choice of open source databases to record files. Postgres MySQL SQLite Or not Can also use Oracle and probably MS SQL Server.

16 Bacula Additional Utilities Graphical Interfaces Web wxwidgets

17

18

19

20

21

22

23 Bacula Sends

24 Case Study McKee, Voorhees & Sease, P.L.C. 20 attorneys, about 55 people total Intellectual Property Boutique firm

25 Case Study Superbowl XLll Sunday

26 February 3, 2008 Superbowl Sunday what s that clicking sound? Death by RAID

27 Case Study What crashed: NT 4 HP Proliant 3000 File Server About 300 GB RAID 5 Storage 2 DLT backup Drives 7 Mbps Internet t Connection Issues Aging Hardware and software (ArcServe) Slow Irregular Backup

28 Case Study Installed Bacula Late Summer/Fall of 2007 Local Bacula Server; 1 U Via Epia running Linux. Seven+ Terabytes of storage on a generic 2U server; offsite, running Linux and dsd Bacula Client (FD) on servers Full Backup every Friday Night + Weekend. Incremental M-F.

29 Th3s3 Things com3 in Thr33s Spring Floods of 2008 An unfortunate decision.

30 The Bacula Experience The Perfect is the enemy of the good -Voltaire

31 Parting Advice Test (test, test) your restore Document your system Do not use funky RAID features, per Ontrack data recovery. Do not depend solely on RAID Back up pyour system, the job you save may be your own.

32 Part 2

33 Open Source Misnomers Open Source is written by amateurs! In some cases, maybe, but for the most part you won t find a more talented group of people. Many Open Source developers are employed by companies such as Sun, Novell, EMC, Google and numerous other industry leaders for the sole purpose of giving back to the community.

34 Open Source Misnomers Open Source software is not as secure as commercial software! Although possible, not likely. One of the great things about open source is that it is exactly that, open. Most established projects have numerous developers (and users) eyeballing the code to make sure that it s not going to harm you or your environment. It is still good due diligence to do a bit of research before you implement any software in a production environment.

35 Open Source Misnomers Some Open Source hasn t been updated in years and is at a low release level (like !) When software is written it is possible that it is complete and may not need enhancements due to the architecture t of the code. True, release levels are squirrely in Open Source but in most cases a pre 1.0 (or beta) release of Open Source is far superior to a 1.0 release of commercial software as the Open Source developers aren t driven by market demand.

36 Pattishall environment 6 HP DL 380 Servers (SLES 10SP1) 8GB RAM 1TB DAS 4 W2K servers 10 XP desktops (for investigative e use) 14 SLES 10SP1 guests (file servers and utility servers (MX, DNS, Nagios, DimDim, Moodle)) 3 DL 140 Servers (SLES 10SP1) 2 with 4 SLES 10SP1 guests handling backups and archiving 1 with SLES 10SP1 running dual 750GB drives (litigation data fileserver, rsyncing data to the secondary drive, not backed up beyond this.)

37 Pattishall environment 2 HP EVO 510SFF Desktops (CENTOS 5) 384MB RAM 750GB HD running rdiff-backup 2 Compaq DL (RH 8) 256MB RAM 40GB HD (boot drive), 750GB HD external data drive running rsync

38 Pattishall environment (DR) 4 HP ML 370 Servers (SLES10 SP1) 4GB RAM 300 GB DAS Dual duty VM hosts and rsync ing data from office) 1 HP PC (SLES10 SP1) used as iscsi Host AMD QuadCore Phenom 8GB RAM 4-1TB SATA Drives (3 TB RAID5)

39 Why open source? Fully configurable and/or customizable by on-site talent. Community based support keeps it fresh and up-to-date. Flexible Dependability Cost

40 1 rsync and rdiff-backup Open source backup solutions that utilize delta (file differential) copying to save time and bandwidth Flexible solutions that can be utilized on a variety of platforms Free as in beer and as in speech

41 rsync Maintained by Wayne Davison Current release is (bug fix release) Provides fast incremental file transfer across LANs and WANs. Ability to limit bandwidth is built in. Can be directed to an offsite target. Freely available under the GNU GPL Perfect for duping data off-site or to removable storage.

42 rsync Can be tunneled via SSH for additional security Backup entire directory trees or file systems Retain ownership, permissions i and symbolic links on *nix file systems Can run on Windows under Cygwin (linuxlike environment for Windows)

43 rdiff-backup Maintained by Andrew Ferguson Current release (testing 1.2.1) Backups up only incremental (after initial backup) but keeps incremental copies separate. Backups are purge able based on date (to comply with retention policies) Can restore from any point in time via simple command line X-Platform

44 rdiff-backup Written using python scripts (easy to customize). Can be tunneled via SSH and can use a CIFS, SMBFS or SSHFS target Backup entire directory trees or file systems Retain ownership, permissions and symbolic links on *nix file systems Very fast and reliable set it and forget it! Good community support, the maintainer releases enhancements and patches quickly.