Tivoli Storage Manager for Mail -- Data Protection for Exchange: A Look Under the Hood Del Hoobler Oxford University TSM Symposium 2007 September 2007
Disclaimer This presentation describes potential future enhancements to the IBM Tivoli Storage Manager family of products All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only Information in this presentation does not constitute a commitment to deliver the described enhancements or to do so in a particular timeframe IBM reserves the right to change product plans, features, and delivery schedules according to business needs and requirements This presentation uses the following designations regarding availability of potential product enhancements Planned 5.5: Planned for delivery in TSM v5.5 (2007) Next Release Candidate: Candidate for delivery in the next release after v5.5 Future Candidate: Candidate for delivery in future release 2 Tivoli Storage Manager for Mail - Data Protection for Exchange
Presentation Contents This presentation covers details on IBM Tivoli Storage Manager for Mail - Data Protection for Exchange. It provides a brief history of the product, its functions and features, best practices, and what the future holds. 3 Tivoli Storage Manager for Mail - Data Protection for Exchange
Presenter Information Del Hoobler IBMer since 1989, TSMer since 1991 IBM Tivoli Storage Manager Development Team Lead Data Protection for Exchange Server Data Protection for SQL Server TSM for Copy Services 4 Tivoli Storage Manager for Mail - Data Protection for Exchange
Agenda Tivoli Storage, IBM Software Group Microsoft Exchange Server - Background / Architecture Data Protection for Exchange DP for Exchange - Functions and Features DP for Exchange - A Look Under The Hood DP for Exchange - Strategies and Best Practices DP for Exchange - Futures Questions and Answers 5 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server - Background 6 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server - Background What is Exchange Server? Messaging (email) and collaboration application Supported on Windows Server Operating Systems History Exchange Server 5.5 1998 Exchange Server 2000 2000 Exchange Server 2003 2003 Exchange Server 2007 2007 7 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server Architecturere Exchange Server topology is tightly integrated with: Active Directory DNS Exchange hierarchical structure Servers contain Storage Groups Storage Groups contain Databases Databases contain Mailboxes 8 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server ESM GUI Screenshot* *This example was taken from the Exchange System Manager GUI on Exchange Server 2003 9 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server Architecture Exchange Servers contains Storage Groups Before Exchange 2007: Max 4 storage groups per server Exchange 2007: Max 50 storage groups per server Storage Groups contains Databases Two Database Types: Mailbox and Public Folder Before Exchange 2007: Max 5 databases per storage group Exchange 2007: Max 50 databases per server allowed Exchange 2007: Microsoft recommends 1 database per storage group 10 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server Architecture Databases are made up of databases files Based on Microsoft s ESE ( JET ) database technology.edb file rich-text database (MAPI content).stm file native content database (non-mapi) This file is no longer used in Exchange Server 2007.LOG files transaction log files Before Exchange 2007: Log files are 5 MB Exchange Server 2007: Log files are 1 MB 11 Tivoli Storage Manager for Mail - Data Protection for Exchange
Microsoft Exchange Server Backup Architecture Exchange supports two (2) backup architectures: 1. Legacy (streaming) backups Special backup and restore API Interfaces with ESE to provide consistent backup Will be going away in some future release of Exchange 2. Volume Shadow Copy Service (VSS) backups Utilizes Microsoft s s generalized snapshot architecture Started with Exchange Server 2003 12 Tivoli Storage Manager for Mail - Data Protection for Exchange
New Exchange Server 2007 Features LCR Local Continuous Replication CCR Cluster Continuous Replication SCR - Standby Continuous Replication (Exchange Server 2007 SP1) Changes for backup are centered around replication and VSS Exchange 2007 supports backing up using VSS from LCR/CCR replica database copies Note: Microsoft does not support backing up using legacy APIs from the replicas Exchange 2007 supports VSS restores into a Recovery Storage Group 13 Tivoli Storage Manager for Mail - Data Protection for Exchange
IBM Tivoli Storage Manager for Mail Data Protection for Exchange 14 Tivoli Storage Manager for Mail - Data Protection for Exchange
Challenges for Protecting Vital Data Application availability 24x7availability of revenue generating applications zero application downtime is expected shrinking backup window Increasing volume of database content complex database management backup window no longer adequate Amount of Data Backup Window Loss of vital business data because of hardware errors (computer and disk) logical errors (software bugs, operator/administrator errors, user errors) disaster (fire, water, earthquake) Mountains of critical data - - 15 Tivoli Storage Manager for Mail - Data Protection for Exchange
Tivoli Storage Manager and Exchange IBM Tivoli Storage Manager supports Exchange! IBM Tivoli Storage Manager for Mail Data Protection for Microsoft Exchange Sometimes referred to as TDP for Exchange Almost 10 years old! TSM for Copy Services is a complementary product that enables the VSS support for Data Protection for Exchange 16 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Release History Release Date Function 110 1.1.0 4/1998 Initial release of product Exchange Server 5.5 220 2.2.0 3/2001 Added Exchange 2000 support Added Integrated Policy Management 5.1.5 10/2002 Tighter Integration with BA Client 5.2.1 9/2003 Added Exchange 2003 Legacy Support 5.3.3 3/2006 Added Exchange 2003 VSS Support (Note: TSM for Copy Services is required for VSS operations) 541 5.4.1 5/2007 Added Exchange 2007 Legacy Support 5.5.0 (Planned 5.5) Adding Exchange 2007 VSS Support (2007) (Note: TSM for Copy Services is required for VSS operations) 17 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Features - Today Back up Exchange Server storage groups and transaction logs Supports Exchange Server 2003 - Legacy and VSS (*) Supports Exchange Server 2007 - Legacy Maintain multiple versions of Exchange Server storage group and transaction log backups Restore storage group and transaction ti log backups and replay the transaction log files Automatically inactivate previous backups when performing a full backup Automate scheduled backups *Note: VSS operations are enabled in the Data Protection for Exchange 5.3.3 (or later) interfaces when TSM for Copy Services is installed 18 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Features - Today Set automatic expiration of backup objects that are based on version limit and retention ti period Monitor results through the Data Protection for Exchange activity log and automatically prune the activity log Query a local Exchange Server or a Tivoli Storage Manager server for configuration information Legacy restore of mailbox databases into the Exchange Server 2003 Recovery Storage Group (RSG) Legacy back up and restore of Exchange Site Replication Service (SRS) databases Supports MSCS and Veritas Cluster Environments Globalization Support 19 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Features - Today VSS Backup - Back up Exchange Server databases via snapshots VSS Off-loaded Backup - Perform a VSS Backup to the Tivoli Storage Manager server using an alternate machine instead of a production machine VSS Restore - Restore VSS Backups that t reside on Tivoli Storage Manager server storage to their original location VSS Fast Restore -Restore VSS Backups that reside on local shadow volumes using file-level l l copy mechanisms VSS Instant Restore - Restore VSS Backups that reside on local shadow volumes using hardware-assisted volume-level copy mechanisms A single graphical user interface for performing legacy and VSS backup, restore, and query operations A single command line interface for performing legacy and VSS backup, restore, and query operations Note: VSS operations require Data Protection for Exchange 5.3.3 3 (or later) and TSM for Copy Services 5.3.3 (or later) 20 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange - Backup Support Backup Type Database Logs Logs Truncated TSM Legacy Support TSM VSS Support Full Copy Incremental Differential DBCOPY 21 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange GUI Sample 22 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange What s Inside? 23 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Overview - Legacy Exchange Server DP for Exchange TCP/IP TSM Server Storage TSM Server TSM API 1. DP Exchange tells the Exchange Server that we want to back up a storage group. TSM Server Database 2. Exchange Server prepares the environment and tells DP for Exchange what the files are to back up. This includes database and/or log files. 3. DP Exchange then opens the files using the Exchange backup/restore APIs. 4. The DP Exchange multi-threaded, multi-buffered backup engine reads the data into buffers and hands the buffers to the TSM API. 5. The TSM API sends the data directly to the TSM server. 24 Tivoli Storage Manager for Mail - Data Protection for Exchange
TSM VSS - Snapshot Support Topology Application Server Application Data Snapshot Creation Local Snapshot Versions Backup to TSM Server Backup Server Restore from Snapshot Restore from TSM Server Backup to TSM Server Policy-based snapshot management TSM Server Storage Hierarchy 25 Tivoli Storage Manager for Mail - Data Protection for Exchange
TSM VSS Component Interaction Machine A (primary) Exchange Server Source Volumes Machine B (secondary) Data Protection For Exchange VSS/VDS Local DSMAgent Snapshot Volumes VSS/VDS Remote DSMAgent TSM Server 26 Tivoli Storage Manager for Mail - Data Protection for Exchange
Strategies and Best Practices 27 Tivoli Storage Manager for Mail - Data Protection for Exchange
Sample Legacy Backup Strategy "COPY"-type legacy backups done once per month with proper policy binding for long term retention "FULL"-type legacy backups done once per week "INCREMENTAL"-type legacy backups done one or more times per day Restore Types Supported: Restore to live Exchange Server through h legacy backup API Restore to alternate location at file level (RESTOREFILES) 28 Tivoli Storage Manager for Mail - Data Protection for Exchange
Sample Backup Strategy using both VSS and Legacy "COPY"-type legacy backups done once per month with proper policy binding for long term retention "FULL"-type legacy backups done once per week "FULL"-type VSS snapshot backups done once or more times per day If multiple snapshots per day, may choose to move data to TSM only once per day Restore Types Supported: Restores from VSS snapshot backup VSS Instant Restore" (Requires IBM SVC or DS6000/DS8000 disk subsystem) VSS Fast Restore" VSS Restore Restores from Legacy backup Restore to live Exchange Server through legacy backup API Restore into the Recovery Storage Group Restore to alternate t location at file level l (RESTOREFILES) 29 Tivoli Storage Manager for Mail - Data Protection for Exchange
Recommended Best Practices See Microsoft documentation for their best practices Make sure you have a well-defined and tested recovery plan that meets your service level objectives Continue to schedule and perform a periodic legacy backup in your Exchange Server backup scheme Place databases files on separate volumes from log files Do not place database files or log files from multiple storage groups on the same "logical" volume or LUN Do not place other "data" on Exchange storage volumes Use archive logging rather than circular logging for maximum protection Use the Recovery Storage Group to help minimize downtime Use Exchange 2007 LCR and CCR to help reduce frequency of backups Did I mention. TEST your restores! 30 Tivoli Storage Manager for Mail - Data Protection for Exchange
Exchange and IMR IMR = Individual Mailbox Restore IMR describes a function to restore accidentally deleted individual Exchange mailboxes and individual mail items One common method to achieve this is through h brick-level l backups But your Exchange backup solution cannot just be at the brick level. You MUST have storage group/database level backups. Doing brick-level backups and database level backups require duplicate backup of data Microsoft has tried to remove the need for backing up at the item-level: Deleted Item Restore Deleted Mailbox Restore Recovery Storage Group 31 Tivoli Storage Manager for Mail - Data Protection for Exchange
TSM and IMR TSM provides IMR support through the Microsoft Exchange backup and restore API along with the Microsoft built-in in features, tools, and wizards IBM recommends: Exploit the Deleted Item Retention Feature Exploit the Deleted Mailbox Retention Feature Use the Recovery Storage Group and Exchange Wizards to recover needed data Want to know more? BOF session to discuss IMR 32 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange What s Next? 33 Tivoli Storage Manager for Mail - Data Protection for Exchange
Data Protection for Exchange Planned 5.5 5 (2007) Add Exchange Server 2007 - VSS Support Windows x64-bit support Exchange 2007 - VSS back up of replica copy of an LCR database Exchange 2007 - VSS back up of replica copy of a CCR database Exchange 2007 - VSS restore into a Recovery Storage Group Exchange 2007 - VSS restore into an alternate storage group Exchange 2007 - VSS restore into a relocated storage group 34 Tivoli Storage Manager for Mail - Data Protection for Exchange
Other Useful Sessions TSM for Copy Services and TSM for Advanced Copy Services: Today and Tomorrow This is a deeper dive into Exchange VSS and TSM for Copy Services. Exchange IMR Birds of a Feather (BOF) Session This is an informal discussion about IMR related questions and positioning. 35 Tivoli Storage Manager for Mail - Data Protection for Exchange
For Further Reading IBM Tivoli Storage Manager Main Product Web Page http://www-306.ibm.com/software/tivoli/products/storage-mgr-mail/ mgr mail/ Data Protection for Exchange Server Installation and User s Guide http://publib.boulder.ibm.com/tividd/td/storagemanagerformail5.3.3.html Redbook - Using IBM Tivoli Storage Manager to Back Up Microsoft Exchange with VSS http://www.redbooks.ibm.com/abstracts/sg247373.html White Paper: IBM System Storage TSM solution for Exchange Server 2003 and DS6000/DS8000 http://www-03.ibm.com/support/techdocs/atsmastr.nsf/webindex/wp101009 White Paper: IBM System Storage TSM solution for Exchange Server 2003 and DS4000 Series http://www-03.ibm.com/support/techdocs/atsmastr.nsf/webindex/prs2451 IBM TSM for Mail Support Web Page http://www-306.ibm.com/software/sysmgmt/products/support/ibmtivolistoragemanagerformail.html Microsoft Exchange Server Main Web Site http://www.microsoft.com/exchange/default.mspx 36 Tivoli Storage Manager for Mail - Data Protection for Exchange
37 Tivoli Storage Manager for Mail - Data Protection for Exchange
Questions and Answers 38 Tivoli Storage Manager for Mail - Data Protection for Exchange
39 Tivoli Storage Manager for Mail - Data Protection for Exchange