Bacula Open Source Project Bacula Systems (professional support)

Transcription

1 Bacula Open Source Project Bacula Systems (professional support) The Enterprise Ready Open Source Network Backup Solu<on Kern Sibbald Bacula Systems SA

2 Introduction What is Bacula? A network backup solu<on designed for *BSD, Linux, Mac OS X, Unix and Windows systems Project goals are to: Backup any client from a Palm to a mainframe computer Provide «Enterprise» features similar to the largest commercial applica<ons in an Open Source solu<on Assure data compa<bility for 30 years (providing that appropriate hardware is available) Use a Free and Open Source (GPLv2) license Page 2

3 Introduction Project History «Bacula» = Backup + Dracula It comes by night and sucks the vital essence from your computers. Time line January 2000 Project started 14 April 2002 First release to Source Forge (version 1.16) 29 June 2006 Release January 2007 Release August 2007 Release June 2008 Release July 2009 Current release Downloads to date: (Sep 2009) 1,027,109 all versions 6.9 TB Page 3

4 Bacula Download History Release Page 4

5 Why Backup? Hardware Failure Protec<on Unauthorized Intrusion (Hackers) Virus Protec<on User Error Protec<on Service Level Agreements Legal and/or Regulatory Requirements Business Cost of Time/Data Loss Disaster Recovery Page 5

6 What is «Backup»? Data protec<on All files Databases (MySQL, PostgreSQL, MSSQL, Oracle, DB2, ) Applica<ons (E mail: MS Exchange, Lotus,...) Groupware applica<ons (Lotus Notes, etc.) Enterprise Resource Planning (ERP) CRM and sales order entry systems Others Page 6

7 What is «Backup»? Off site backup Storing copies off site Disaster recovery plan (DRP) Bare Metal recovery Server configura<on Bacula Catalog database Bacula binaries and configura<on files Key people to be contacted Loca<on of recovery media Page 7

8 Module 1 What is «Backup»? Archiving Compliance with regulatory requirements Business requirements Long reten<on (7 30 years) Guarantees data are not changed or deleted Audit requirements Page 8

9 Reflection Key Questions Do you do backups? No Yes, I did one last month Yes, tar files every week Some<mes I rsync... Yes, CDs every week I use custom scripts Have you encountered the typical problems? Retrieving and restoring: How to find the files you need to restore? How to restore to a point in <me? Which files are on which medium? Scalability: Could the solu<on handle machines? Compliance: Can the solu<on assure that all government regula<ons are met? Page 9

10 Introduction the Bacula Solution Open Source (GPLv2) Centrally managed Network backup/restore Mul< plarorm support (*BSD, Linux, Mac OS X, Unix Win32,...) Different media (Tape, disk, USB, CD/DVD) Reliable Tracks comprehensively what was backed up when and where Allows restora<on of specific files required (Catalog + GUI) Restores to a point in <me Scales to handle 10,000 machines Page 10

11 What is Bacula? Enterprise backup solu<on Network based Centralized Administra<on Automa<c opera<on Performs bookkeeping Mul< plarorm Many high end features Robust design built for high performance Modular Mul<ple Backup Media Customizable Reliable Rapid Restores Advanced Repor<ng, No<fica<on, Monitoring Page 11

12 Module 1 What is Bacula? Open Source Zero cost license Large community of users and developers Ability to customize to your specific requirements Extensive configura<on Contribute to Bacula Project Security of solu<on guaranteed Users have the source code No license audits Page 12

13 Module 1 Architecture 5 Bacula Components Page 13

14 Architecture 5 Bacula Components Director (DIR) Centralized control and administra<on for all func<ons Basic unit is a Job (one client, one set of files,...) Schedules, ini<ates and supervises all Jobs Maintains the catalog (SQL database) Typical installa<on One Director per Bacula installa<on Excep<on very large environments that require addi<onal coordina<on Page 14

15 Architecture 5 Bacula Components File Daemon or Client (FD) Performs file backup, restore and verifica<on requested by Director Installed on each machine as a service (daemon) Communicates over network with Director and Storage daemon Needs access to all files to be backed up (root, SYSTEM) Typical installa<on Mul<ple File daemons per Director One for each machine 6.3 Page 15

16 Architecture 5 Bacula Components Storage daemon (SD) Reads and writes data to the physical medium Disk, Tape, CD/DVD, USB,... Accepts orders and authoriza<on from the Director Accepts and returns data to/from File daemons (FD) Sends file storage loca<on to Director > Catalog Supports mul<ple devices per SD Typical installa<on One SD per Director Page 16

17 Architecture 5 Bacula Components Console Allows user or administrator to control Bacula Communicates with Director via network Start jobs, review Job output, query/modify catalog Consoles available TTY (bconsole) bat a Qt 4 (GUI) most comprehensive wxwidgets (GUI) Linux, Unix, Win32 Mul<ple web interfaces bweb = most comprehensive Restricted consoles Users can restore their own files Page 17

18 Architecture 5 Bacula Components Catalog database Only component not wriuen by Bacula team SQL database (MySQL, PostgreSQL, or SQLite) unique Tracks Jobs run, Volumes used, File loca<ons,... Permits rapid restores Allows inquiry of when and where files were backed up Old data automa<cally pruned by Director Supports mul<ple databases for scaling Page 18

19 Bacula Release Files bacula tar.gz Primary Bacula source code release bacula docs tar.bz2 Prebuilt docs: HTML directory, single HTML file, and PDF file.. bacula gui tar.gz Non core GUI programs bweb bacula web Bimagemgr program for burning CDROM images with Bacula Volumes bacula rescue tar.gz Bare Metal Recovery CD ROM depreciated Replaced by USB key winbacula exe 32 bit installer for Windows client (File Daemon) win64bacula exe 64 bit installer for Windows client (File Daemon) Page 19

20 Bacula Administration Tool (BAT) GUI form of bconsole with many addi<onal features Key features Graphical representa<on of Jobs run by Bacula Ability to create reports more easily and quickly Sor<ng of run/failed Jobs by clicking on the column header Context sensi<ve menu with ready access to key features Page 20

21 The BAT Interface Page 21

22 The BAT Interface Job List Page 22

23 The BAT Interface Job Log Page 23

24 The BAT Interface Volume Actions Page 24

25 Module 4 The BAT Interface Running a Job Page 25

26 Module 4 The BAT Interface Restoring Files Page 26

27 Bweb Management Interface Web based management tool Key features Graphical representa<on of Jobs run by Bacula Ability drill into problem areas Restart failed jobs Point and click autochanger control Volume loca<on tracking Job grouping Page 27

28 Main Bweb Window Page 28

29 Job Log for Failed Job Page 29

30 Job Log for Job with Warnings Page 30

31 Media View (in Catalog) Page 31

32 Autochanger View (in changer) Page 32

33 Bacula Reliability Reliability designed in from the beginning Low level memory clobber and buffer loss checking Own code for vprinr avoids exploits 10 20% of code cleaned up (refactored) each release Extensive regression tes<ng User regression tes<ng posted on dashboard nightly from many machines Page 33

34 Bacula Test Dashboard Page 34

35 Failed Job Page 35

36 Failed Job Details Page 36

37 Open Bugs Database Bugs database open to everyone Can find fixes to unusual problems hup://bugs.bacula.org Page 37

38 Bacula Bugs Database Page 38

39 Bacula Bugs Database Page 39

40 Development Roadmap Version bug fix to be released by mid October Version to be released axer 1 January 2010 New features Maximum Concurrent Jobs for Devices Enhancements to Accurate backup Restore from mul<ple Storage daemons File deduplica<on with Base Jobs Bacula virtual catalog filesystem API Enhanced tape drive tes<ng func<onality Page 40

41 Development Roadmap (cont) New features Disable block checksums (performance) New Bat func<onality Restart failed Jobs recovering what was already save File daemon drops root permission but can backup all files Page 41

42 Future Projects Deduplica<on Archive Base Job deduplica<on rsync to server tree Rdiff using precomputed hash codes Laptop backup (similar to BackupPC) Jobs kept forever Par<<oned catalog Move catalog data to another database Management Console (perhaps bweb) Control of mul<ple Directors Write to mul<ple Storage daemons Page 42

43 Resources lists bacula users General forum to ask or respond to ques<ons about Bacula from other users. All users are encouraged to subscribe and par<cipate Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula users Once subscribed, send to the Bacula Users List at: bacula bacula devel For communica<on directly with developers Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula devel address: bacula Page 43

44 Typical Open Source Resources Bugs database (hup://bugs.bacula.org) Bacula Wiki (hup://wiki.bacula.org) Bacula Lists hup:// Lists Recommended: bacula announce Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula announce Read only low volume list for users who wish to be no<fied of important events (bugs, new releases,...) For no<fica<on of new package release Sign up at: hup://sourceforge.net/projects/bacula Click on Download, then Monitor next to desired package Page 44

45 Resources lists Recommended: bacula bugs (No<fica<on about new bugs) hup://bugs.bacula.org Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula bugs bacula beta (No<fica<on of new beta releases) Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula beta Bacula commits (diff of each commit to the SVN) Normally used only by developers Sign up at: hup://lists.sourceforge.net/lists/lis<nfo/bacula commits Archives (Available on Source Forge, and Gmane) hup://news.gmane.org/search.php?match=bacula Page 45

46 Resources Support op<ons Professional support from Bacula Systems or authorized partners Other professional support Free support from the Bacula community Bacula Systems Support Professional support on a fee paid basis: hup:// Bacula Community Support On an as available basis (users), by bacula users@lists.sourceforge.net Page 46

47 Bacula Systems Support If the code is free why do I need a support contract? Insurance policy in case of problems Ticket system Guaranteed response to ques<ons and problems Priority bug fixing Funded development Configura<on verifica<on Advanced informa<on on development projects Input to development project priori<es Direct contact with the Bacula developers Bacula Enterprise Edi<on binaries Page 47

48 Thank You Bacula Systems SA Rue Galilée 5 CH-1400 Yverdon-les-Bains Switzerland T: F: E: info@baculasystems.com W: German Branch Office Bacula Systems S.A. Sandstrasse 6 DE Osnabrück Germany T: +49 (0) French Branch Office Bacula Systems S.A. 18 rue de l'eglise FR Douvres La Délivrande France T: +33 (0) Page 48