Data Deduplication in Tivoli Storage Manager. Andrzej Bugowski Spała
|
|
- Ferdinand Cummings
- 8 years ago
- Views:
Transcription
1 Data Deduplication in Tivoli Storage Manager Andrzej Bugowski Spała
2 Agenda Tivoli Storage, IBM Software Group Deduplication concepts Data deduplication in TSM 6.1 Planning for data deduplication in TSM V6 New/Changed commands and options for Data Deduplication in TSM V6 2 Data Deduplication in Tivoli Storage Manager 6.1
3 Deduplication Concepts Support Technical Exchange
4 Deduplication Concept A B C C G E J H L D H B D I B J Unique subfiles B I K F H G E Duplicate subfiles E J C C A L K F Data source 1 K Data source 2 E Data source 3 Data at source locations (backup client machines) Target data store (backup server) 4 Data Deduplication in Tivoli Storage Manager 6.1
5 How Deduplication Works Data Store Data Store Data Store C B A C B A C b a A A B A C B A A Data Store B A C B A a B a c b 1. Data chunks are evaluated to determine a unique signature for each 2. Signature values are compared to identify all duplicates 3. Duplicate data chunks are replaced with pointers to a single stored chunk, saving storage space 5 Data Deduplication in Tivoli Storage Manager 6.1
6 Data Deduplication Value Proposition Potential advantages Reduced storage capacity required for a given amount of data Ability to store significantly more data on given amount of disk Restore from disk rather than tape may improve ability to meet recovery time objective (RTO) Network bandwidth savings (some implementations) Lower storage-management and energy costs resulting from reduced storage requirements Potential tradeoffs/limitations Significant CPU and I/O resources required for deduplication processing Deduplication might not be compatible with encryption Increased sensitivity to media failure because many files could be affected by loss of common chunk Deduplication may not be suitable for data on tape because increased fragmentation of data could greatly increase access time 6 Data Deduplication in Tivoli Storage Manager 6.1
7 Where Deduplication is Performed Approach Advantages Disadvantages Source-side (client-side) Deduplication performed at the data source (e.g., by a backup client), before transfer to target location Target-side (server-side) Deduplication performed at the target (e.g. by backup software or storage appliance) Deduplication before transmission conserves network bandwidth Awareness of data usage and format may allow more effective data reduction Processing at the source may facilitate scale-out No deployment of client software at endpoints Possible use of direct comparison to confirm duplicates Deduplication consumes CPU cycles on the file/ application server Requires software deployment at source (and possibly target) endpoints Depending on design, may be subject to security attack via spoofing Deduplication consumes CPU cycles on the target server or storage device Data may be discarded after being transmitted to the target Note: Source-side and target-side deduplication are not mutually exclusive 7 Data Deduplication in Tivoli Storage Manager 6.1
8 When Deduplication is Performed Approach Advantages Disadvantages In-band Deduplication performed during data transfer from source to target Out-of-band Deduplication performed after data ingestion at the target Immediate data reduction, minimizing disk storage requirement No post-processing No impact to data ingestion Potential for deduplication of legacy data Possibility for parallel data deduplication processing May be bottleneck for data ingestion (e.g., longer backup times) Only one deduplication process for each I/O stream May not support deduplication of legacy data on the target server Data must be processed twice (during ingestion and subsequent deduplication) Storage needed to retain data until deduplication occurs Note: In-band and out-of-band deduplication are not mutually exclusive 8 Data Deduplication in Tivoli Storage Manager 6.1
9 Deduplication Ratios Used to indicate reduction achieved by deduplication If deduplication reduces 500 TB of data to 100 TB, ratio is 5:1 Ratios reflect design tradeoffs involving performance and reduction Actual compression ratios will be highly dependent on other variables Data from each source: redundancy, change rate, retention Number of data sources and redundancy of data among those sources Backup methodology: incremental forever, full+incremental, full+differential Whether data encryption occurs prior to deduplication In addition to above variables, some vendors include data reduction achieved by incremental backup and conventional compression Deduplication vendors claim ratios in the range 2:1 to 500:1 Meaningful comparison of ratios is extremely problematic beware of hype! 9 Data Deduplication in Tivoli Storage Manager 6.1
10 Deduplication and Encryption Data source 1 Important text No encryption Important text Data encryption prior to deduplication processing can subvert data reduction Data source 2 Important text Encryption key 1 txpt tnatroemi Data deduplication Data store Data source 3 Important text Encryption key 2 te tarpixtntom Important text txpt tnatroemi te tarpixtntom 1. Three data sources have the same text file 2. After encryption, text files do not match 3. Deduplication processing does not detect redundancy 4. Text files are stored without data reduction 10 Data Deduplication in Tivoli Storage Manager 6.1
11 Data Deduplication in TSM V6 Support Technical Exchange
12 Data Reduction with TSM Today Client compression Files compressed by client before transmission Conserves network bandwidth and server storage Device compression Compression performed by storage hardware Conserves server storage Client Subfile backup Only changed portions of files are transmitted Conserves network bandwidth and server storage Incremental forever After initial backup, file is not backed up again unless it changes Conserves network bandwidth and server storage Server Storage Hierarchy Appliance deduplication Deduplication performed by storage appliance (VTL or NAS) Conserves server storage 12 Data Deduplication in Tivoli Storage Manager 6.1
13 Native Data Deduplication in TSM TSM s incremental forever methodology greatly reduces data redundancy as compared to traditional methodologies based on periodic full backups Consequently, there is less potential for data reduction via deduplication in TSM as compared to other backup products Nevertheless, deduplication is an important function to TSM because it will allow more data objects to be stored on a given amount of disk for fast access Native deduplication is a key product enhancement in TSM 13 Data Deduplication in Tivoli Storage Manager 6.1
14 TSM 6.1 Deduplication Overview Client 1 A A Deduplication Node File Deduplicated disk storage pool stores unique chunks to reduce disk utilization Client 2 B B Server Client 1 Client 2 A B Client 3 C Files A, B and C have common data C Client 3 C TSM Database A B C Tape pool stores A, B, and C individually to avoid performance degradation during restore Allows more objects to be stored on disk for fast access 14 Data Deduplication in Tivoli Storage Manager 6.1
15 Deduplication Example 1. Client1 backs up files A, B, C and D. Files A and C have different names, but the same data. 2. Client2 backs up files E, F and G. File E has data in common with files B and G. A B C D E F G Client1 Server Client2 Server Vol1 A B C D Vol1 A B C D Vol2 E F G 3. Server process chunks the data and identifies duplicate chunks C1, E2 and G1. 4. Reclamation processing recovers space occupied by duplicate chunks. Server Server Vol1 A0 A1 B0 B1 C0 B2 D0 C1 D1 B1 E1 Vol3 A0 A1 B0 B1 C0 B2 D0 D1 B1 E1 E1 E3 F1 Vol2 E1 E2 E3 F1 G1 15 Data Deduplication in Tivoli Storage Manager 6.1
16 Comparison of TSM Data Reduction Methods Client compression Incremental forever Subfile backup Deduplication in TSM 6.1 How data reduction is achieved Client compresses files Client only sends changed files Client only sends changed subfiles Server eliminates redundant data chunks Conserves storage pool space? Conserves network bandwidth? Yes Yes Yes Yes Yes Yes Yes No Data supported Backup, archive, HSM, API Backup Backup (Windows only) Backup, archive, HSM, API Scope of data reduction Avoids storing identical files renamed, copied, or relocated on client node? Removes redundant data for files from different client nodes? Redundant data within same file on client node Files that do not change between backups Subfiles that do not change between backups Redundant data from any files in storage pool No No No Yes No No No Yes 16 Data Deduplication in Tivoli Storage Manager 6.1
17 Planning for Data Deduplication in TSM V6 Support Technical Exchange
18 When Do I Use ProtecTIER vs TSM 6 Built-in Deduplication? Both Solutions Offer the Benefits of Target side Deduplication: Greatly reduced storage capacity requirements Lower operational costs, energy usage and TCO Faster recoveries with more data on disk Use ProtecTIER When: Highest performance and capacity scaling are required! Up to 500 MB/sec (1GB/s with 2 node) deduplication rates are needed Deduplicated capacities up to 25 PB are required You desire deduplication be done inline during data ingest A VTL appliance model is desired Deduplicating across multiple TSM (or other backup) servers Use TSM 6 Built-in Deduplication When: Sufficient TSM server resources can be made available and you desire deduplication operations be completely integrated within TSM The benefits of deduplication are desired without separate hardware or software dependencies or licenses (ships with TSM Extended Edition) You desire end to end data lifecycle management with minimized data store Complementary Solutions Today! Can be used together but don t deduplicate the same data twice IBM ProtecTIER TSM Data Deduplication in Tivoli Storage Manager 6.1
19 Considerations for Use of TSM Deduplication Consider deduplication if Data recovery would improve by storing more data objects on limited amount of disk Data will remain on disk for extended period of time Much redundancy in data stored by TSM (e.g., for common operating-system or project files) TSM server CPU and disk I/O resources are available for intensive processing to identify duplicate chunks Deduplication might not be suitable for Mission-critical data, whose recovery could be delayed by accessing chunks that are not stored contiguously TSM servers that do not have sufficient resources Data that will soon be migrated to tape 19 Data Deduplication in Tivoli Storage Manager 6.1
20 Planning for TSM Deduplication How do I want to control data duplication processes? You can have them running all the time and have them process data as transactions commit. This could be more CPU intensive. You can run them after backups have completed and then cancel them after the identification of duplicate data has finished. Consider whether you have the extra processing time in the day to run this as a separate step. (See discussion on controlling the identify duplicates process manually for suggestions). Do you want to set up new storage pools or use existing ones? You may want only certain nodes to perform data deduplication. These could be updated to new policy domains and management classes that point to new storagepools. 20 Data Deduplication in Tivoli Storage Manager 6.1
21 Planning for TSM Deduplication How can I estimate my space savings with data deduplication in my environment? (2 possible techniques) Best way to test this is with a test system you can delete when done. Another way: Consider backing up your data from a primary storage pool to a temporary copy storage pool that has data deduplication enabled to estimate the space savings. Downside to this technique is that it will increase DB size. 1. Create a copy stgpool using a devclass type of FILE. 2. Do a BACKUP STGPOOL primary stgpool to copy stgpool. 3. Run IDENTIFY DUPLICATES against the volumes in the copy storagepool. 4. When the IDENTIFY DUPLICATES process goes to idle state, set the reclamation threshold for the storagepool to 1%. 5. After reclamation finishes, issue the q stgpool command against the copy storagepool to check the amount of space that was saved. 6. If the results are satisfactory, then update the primary stgpool to specify deduplication is to be used. (Or if type DISK, move data to a new stgpool that is defined with devclass FILE.) 21 Data Deduplication in Tivoli Storage Manager 6.1
22 Planning for TSM Deduplication How much additional log space is required for data deduplication? There are many factors in calculating this. See slide topic How can I estimate my space savings with data deduplication in my environment?, This, is addition to looking for the number of logs archived during the identify process, could be used to estimate the log consumption during the data deduplication identification process. Is data deduplication suitable for all types of disk subsystems? Restores from a deduplicated storage pool are random in nature. For disk subsystems that are slower in speed and do not have adequate cache (for example SATA), restores will be impacted with deduplicated data. 22 Data Deduplication in Tivoli Storage Manager 6.1
23 Planning for TSM Deduplication What is the possible impact on restore performance if I implement TSM data deduplication? Smaller files (less than 100K) that have been deduplicated will restore slower than files that are not deduplicated. Having more sessions doing the restore will improve restore performance. How many Identify Processes should I run on my TSM server? The Identify process is both CPU and IO intensive. You should run no more than N identify processes for an N-Way CPU. Each identify process can use the entire CPU, so if you need CPU for other processes, use less. 23 Data Deduplication in Tivoli Storage Manager 6.1
24 Planning for TSM Deduplication What is the impact on database size when implementing data deduplication? The average chunk size is 256K, and for each chunk, there is approximately 500 bytes of metadata added to the TSM DB. Also, files less than 2K are not eligible for data deduplication. How do I change my daily housekeeping schedules for data deduplication? Where does the Identify Process fit in the daily cycle? If you are going to run the identify process as part of daily housekeeping, then run it after BACKUP STGPOOL has completed but before reclamations for devclass FILE storagepools have run. You need to know when the Identify Duplicates process has gone to IDLE state, as these processes are different than other TSM processes. Sample select for to use for automation: Select count(*) from processes where status like %State: idle% and process= Identify Process 24 Data Deduplication in Tivoli Storage Manager 6.1
25 Planning for TSM Deduplication How should I start with Data Deduplication? If you are going to use data deduplication on an existing storage pool, consider the following approach: Initially set identify processes to 0. On a daily basis, run identify duplicates for some duration until all volumes in storagepool processed. Then update storagepool identifyprocess parameter to appropriate value. If you are going to use data deduplication in a new storage pool, consider the following approach: Initially set identify processes to 1 or 2. On a daily basis, do a move nodedata for a few nodes into the new storage pool, and then point them to a new policy domain. Identify will process that set of node s data. When all nodes have been moved, delete old storagepool and change copygroups to reflect new storage hierarchy. Then update storagepool identifyprocess parameter to appropriate value. 25 Data Deduplication in Tivoli Storage Manager 6.1
26 Expected Deduplication Behavior Deployment of new clients or API applications not required (but use of TSM 6.1 client or higher may improve deduplication ratio). The TSM 6.1 client separates out the metadata which will slightly improve data deduplication for the client s data. Legacy data stored in or moved to enabled FILE storage pools can be deduplicated Data migrated or copied to tape will be reduplicated to avoid excessive mounting and positioning during subsequent access Ability to control number, duration and scheduling of CPU-intensive background processes for identification of duplicate data Reporting of space savings in deduplicated storage pools Deduplication processing will skip client-encrypted objects, but should work with storagedevice encryption Native TSM implementation, with no dependency on specific hardware 26 Data Deduplication in Tivoli Storage Manager 6.1
27 New/Changed commands and options for Data Deduplication in TSM V6 Support Technical Exchange
28 New Externals DEFINE / UPDATE STGPOOL stgpoolname DEDUPlicate=No Yes IDENTIFYPRocess=nn (default number of background processes) Number of identify process specified in the storage pool definitions run indefinitely, or until you issue the identify process command, update the storage pool definition again, or cancel the process. The Identify process is different from other server processes. When other server processes finish a task, they end. When duplicate identification processes finish, they quiesce and go into an idle state. 28 Data Deduplication in Tivoli Storage Manager 6.1
29 New Externals IDentify DUPlicates stgpoolname DUration=mm (minutes to run process) NUMPRocess=nn (override stgpool setting) When setting to a lower number of identify processes than are currently running, TSM will finish processing the current file before the identify duplicate process completes. When duration expires and the identify process completes, the number of identify processes that are run reverts back to the number in the storage pool definition. Result of command is different depending on whether the duration parameter is specified. See following slides for reference. These examples assume you have a storagepool initially defined with identify processes set to a value of Data Deduplication in Tivoli Storage Manager 6.1
30 Controlling Duplicate Identify Processes Manually If you had a critical restore executing, and you wanted to temporarily cut back on the identify processes for 2 hours, you could issue: Identify duplicates stgpool-name numpr=2 dur= Data Deduplication in Tivoli Storage Manager 6.1
31 Controlling Duplicate Identify Processes Manually If you had only 1 hour left before reclamation starts, and you were not done with identify duplicates processing, you could issue for example: Identify duplicates stgpool-name numpr=4 dur=60 31 Data Deduplication in Tivoli Storage Manager 6.1
32 Controlling Duplicate Identify Processes Manually Suggestion here for doing identify after backups, assuming an 8 hour backup window. Issue the following command at beginning of backups: identify duplicates stgpool-name numpr=0 duration= Data Deduplication in Tivoli Storage Manager 6.1
33 Controlling Duplicate Identify Processes Manually 33 Data Deduplication in Tivoli Storage Manager 6.1
34 New Server Option DEDUPREQUIRESBACKUP YES NO Indicates whether a volume in a PRIMARY DEDUP storage pool can be reclaimed before it is backed up to a non-deduplicated copy pool. Copying the data to an active data pool does not meet the backup requirement. If YES, a volume in a dedup primary pool cannot be reclaimed until it has been backed up via BACKUP STGPOOL YES is the default. If NO, the reclamation criteria remains unchanged (same as previous reclamation criteria). Setting this value to NO could cause unrecoverable data loss in the highly unlikely event an object generates a false-positive match on another extent. This option can be changed dynamically with the SETOPT command. 34 Data Deduplication in Tivoli Storage Manager 6.1
35 Changed Commands/Output Delete volume, delete filespace The count of objects deleted is the number of chunks deleted, not the number of actual files. This may not match up with the number of objects in a q occ command in a filespace with deduplicated data. Q opt Shows whether a file to be deduplicated first requires a backup of the file. (DedupRequiresBackup default Yes) 35 Data Deduplication in Tivoli Storage Manager 6.1
36 Changed Commands Q pr Identify duplicate data processes are different then other TSM server processes. After they finish processing all available files, they go into idle state. 36 Data Deduplication in Tivoli Storage Manager 6.1
37 Questions? 37 Data Deduplication in Tivoli Storage Manager 6.1
Data Deduplication and Tivoli Storage Manager
Data Deduplication and Tivoli Storage Manager Dave Cannon Tivoli Storage Manager rchitect Oxford University TSM Symposium September 2007 Disclaimer This presentation describes potential future enhancements
More informationData Deduplication and Tivoli Storage Manager
Data Deduplication and Tivoli Storage Manager Dave annon Tivoli Storage Manager rchitect March 2009 Topics Tivoli Storage, IM Software Group Deduplication technology Data reduction and deduplication in
More informationEffective Planning and Use of TSM V6 Deduplication
Effective Planning and Use of IBM Tivoli Storage Manager V6 Deduplication 08/17/12 1.0 Authors: Jason Basler Dan Wolfe Page 1 of 42 Document Location This is a snapshot of an on-line document. Paper copies
More informationEffective Planning and Use of IBM Tivoli Storage Manager V6 and V7 Deduplication
Effective Planning and Use of IBM Tivoli Storage Manager V6 and V7 Deduplication 02/17/2015 2.1 Authors: Jason Basler Dan Wolfe Page 1 of 52 Document Location This is a snapshot of an on-line document.
More informationUnderstanding Disk Storage in Tivoli Storage Manager
Understanding Disk Storage in Tivoli Storage Manager Dave Cannon Tivoli Storage Manager Architect Oxford University TSM Symposium September 2005 Disclaimer Unless otherwise noted, functions and behavior
More informationIBM Tivoli Storage Manager Version 7.1.4. Introduction to Data Protection Solutions IBM
IBM Tivoli Storage Manager Version 7.1.4 Introduction to Data Protection Solutions IBM IBM Tivoli Storage Manager Version 7.1.4 Introduction to Data Protection Solutions IBM Note: Before you use this
More informationDeduplication Demystified: How to determine the right approach for your business
Deduplication Demystified: How to determine the right approach for your business Presented by Charles Keiper Senior Product Manager, Data Protection Quest Software Session Objective: To answer burning
More informationCreating a Cloud Backup Service. Deon George
Creating a Cloud Backup Service Deon George Agenda TSM Cloud Service features Cloud Service Customer, providing a internal backup service Internal Backup Cloud Service Service Provider, providing a backup
More informationEMC Backup Storage Solutions: The Value of EMC Disk Library with TSM
A Detailed Review Abstract The white paper describes how the EMC Disk Library can enhance an IBM Tivoli Storage Manager (TSM) environment. It describes TSM features, the demands these features place on
More informationIBM TSM DISASTER RECOVERY BEST PRACTICES WITH EMC DATA DOMAIN DEDUPLICATION STORAGE
White Paper IBM TSM DISASTER RECOVERY BEST PRACTICES WITH EMC DATA DOMAIN DEDUPLICATION STORAGE Abstract This white paper focuses on recovery of an IBM Tivoli Storage Manager (TSM) server and explores
More informationEfficient Backup with Data Deduplication Which Strategy is Right for You?
Efficient Backup with Data Deduplication Which Strategy is Right for You? Rob Emsley Senior Director, Product Marketing CPU Utilization CPU Utilization Exabytes Why So Much Interest in Data Deduplication?
More informationEMC Disk Library with EMC Data Domain Deployment Scenario
EMC Disk Library with EMC Data Domain Deployment Scenario Best Practices Planning Abstract This white paper is an overview of the EMC Disk Library with EMC Data Domain deduplication storage system deployment
More informationChoosing an Enterprise-Class Deduplication Technology
WHITE PAPER Choosing an Enterprise-Class Deduplication Technology 10 Key Questions to Ask Your Deduplication Vendor 400 Nickerson Road, Marlborough, MA 01752 P: 866.Sepaton or 508.490.7900 F: 508.490.7908
More informationProtect Microsoft Exchange databases, achieve long-term data retention
Technical white paper Protect Microsoft Exchange databases, achieve long-term data retention HP StoreOnce Backup systems, HP StoreOnce Catalyst, and Symantec NetBackup OpenStorage Table of contents Introduction...
More informationDeltaStor Data Deduplication: A Technical Review
White Paper DeltaStor Data Deduplication: A Technical Review DeltaStor software is a next-generation data deduplication application for the SEPATON S2100 -ES2 virtual tape library that enables enterprises
More informationProtect Data... in the Cloud
QUASICOM Private Cloud Backups with ExaGrid Deduplication Disk Arrays Martin Lui Senior Solution Consultant Quasicom Systems Limited Protect Data...... in the Cloud 1 Mobile Computing Users work with their
More informationESG REPORT. Data Deduplication Diversity: Evaluating Software- vs. Hardware-Based Approaches. By Lauren Whitehouse. April, 2009
ESG REPORT : Evaluating Software- vs. Hardware-Based Approaches By Lauren Whitehouse April, 2009 Table of Contents ESG REPORT Table of Contents... i Introduction... 1 External Forces Contribute to IT Challenges...
More informationDon t be duped by dedupe - Modern Data Deduplication with Arcserve UDP
Don t be duped by dedupe - Modern Data Deduplication with Arcserve UDP by Christophe Bertrand, VP of Product Marketing Too much data, not enough time, not enough storage space, and not enough budget, sound
More information09'Linux Plumbers Conference
09'Linux Plumbers Conference Data de duplication Mingming Cao IBM Linux Technology Center cmm@us.ibm.com 2009 09 25 Current storage challenges Our world is facing data explosion. Data is growing in a amazing
More informationDemystifying Deduplication for Backup with the Dell DR4000
Demystifying Deduplication for Backup with the Dell DR4000 This Dell Technical White Paper explains how deduplication with the DR4000 can help your organization save time, space, and money. John Bassett
More informationRestoration Technologies. Mike Fishman / EMC Corp.
Trends PRESENTATION in Data TITLE Protection GOES HERE and Restoration Technologies Mike Fishman / EMC Corp. SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless
More informationDeduplication and Beyond: Optimizing Performance for Backup and Recovery
Beyond: Optimizing Gartner clients using deduplication for backups typically report seven times to 25 times the reductions (7:1 to 25:1) in the size of their data, and sometimes higher than 100:1 for file
More informationWHY DO I NEED FALCONSTOR OPTIMIZED BACKUP & DEDUPLICATION?
WHAT IS FALCONSTOR? FalconStor Optimized Backup and Deduplication is the industry s market-leading virtual tape and LAN-based deduplication solution, unmatched in performance and scalability. With virtual
More informationSTORAGE. Buying Guide: TARGET DATA DEDUPLICATION BACKUP SYSTEMS. inside
Managing the information that drives the enterprise STORAGE Buying Guide: DEDUPLICATION inside What you need to know about target data deduplication Special factors to consider One key difference among
More informationCost Effective Backup with Deduplication. Copyright 2009 EMC Corporation. All rights reserved.
Cost Effective Backup with Deduplication Agenda Today s Backup Challenges Benefits of Deduplication Source and Target Deduplication Introduction to EMC Backup Solutions Avamar, Disk Library, and NetWorker
More informationHow To Make A Backup System More Efficient
Identifying the Hidden Risk of Data De-duplication: How the HYDRAstor Solution Proactively Solves the Problem October, 2006 Introduction Data de-duplication has recently gained significant industry attention,
More informationReducing Backups with Data Deduplication
The Essentials Series: New Techniques for Creating Better Backups Reducing Backups with Data Deduplication sponsored by by Eric Beehler Reducing Backups with Data Deduplication... 1 Explaining Data Deduplication...
More informationIBM Tivoli Storage Manager 6
Leverage next-generation data storage and recovery management capabilities IBM Tivoli Storage Manager 6 IBM Tivoli Storage Manager is the core component of an enterprise-wide data protection and recovery
More informationWHITE PAPER. How Deduplication Benefits Companies of All Sizes An Acronis White Paper
How Deduplication Benefits Companies of All Sizes An Acronis White Paper Copyright Acronis, Inc., 2000 2009 Table of contents Executive Summary... 3 What is deduplication?... 4 File-level deduplication
More informationHardware Configuration Guide
Hardware Configuration Guide Contents Contents... 1 Annotation... 1 Factors to consider... 2 Machine Count... 2 Data Size... 2 Data Size Total... 2 Daily Backup Data Size... 2 Unique Data Percentage...
More informationWHITE PAPER. DATA DEDUPLICATION BACKGROUND: A Technical White Paper
WHITE PAPER DATA DEDUPLICATION BACKGROUND: A Technical White Paper CONTENTS Data Deduplication Multiple Data Sets from a Common Storage Pool.......................3 Fixed-Length Blocks vs. Variable-Length
More informationReduce your data storage footprint and tame the information explosion
IBM Software White paper December 2010 Reduce your data storage footprint and tame the information explosion 2 Reduce your data storage footprint and tame the information explosion Contents 2 Executive
More informationReal-time Compression: Achieving storage efficiency throughout the data lifecycle
Real-time Compression: Achieving storage efficiency throughout the data lifecycle By Deni Connor, founding analyst Patrick Corrigan, senior analyst July 2011 F or many companies the growth in the volume
More informationBackup and Recovery Redesign with Deduplication
Backup and Recovery Redesign with Deduplication Why the move is on September 9, 2010 1 Major trends driving the transformation of backup environments UNABATED DATA GROWTH Backup = 4 to 30 times production
More informationIdentifying the Hidden Risk of Data Deduplication: How the HYDRAstor TM Solution Proactively Solves the Problem
Identifying the Hidden Risk of Data Deduplication: How the HYDRAstor TM Solution Proactively Solves the Problem Advanced Storage Products Group Table of Contents 1 - Introduction 2 Data Deduplication 3
More informationIBM Tivoli Storage Manager
IBM Storage Manager Leverage next-generation data storage and unified recovery management capabilities Highlights Help simplify the protection and management of your data, even as it continues to grow
More informationIBM TSM Backup with EMC Data Domain Deduplication Storage
IBM TSM Backup with EMC Data Domain Deduplication Storage Best Practices Planning Abstract This white paper provides configuration and best practices recommendations for EMC Data Domain deduplication storage
More informationDXi Accent Technical Background
TECHNOLOGY BRIEF NOTICE This Technology Brief contains information protected by copyright. Information in this Technology Brief is subject to change without notice and does not represent a commitment on
More informationThe Curious Case of Database Deduplication. PRESENTATION TITLE GOES HERE Gurmeet Goindi Oracle
The Curious Case of Database Deduplication PRESENTATION TITLE GOES HERE Gurmeet Goindi Oracle Agenda Introduction Deduplication Databases and Deduplication All Flash Arrays and Deduplication 2 Quick Show
More informationData Deduplication: An Essential Component of your Data Protection Strategy
WHITE PAPER: THE EVOLUTION OF DATA DEDUPLICATION Data Deduplication: An Essential Component of your Data Protection Strategy JULY 2010 Andy Brewerton CA TECHNOLOGIES RECOVERY MANAGEMENT AND DATA MODELLING
More informationSales Tool. Summary DXi Sales Messages November 2009 6 NOVEMBER 2009. ST00431-v06
Summary DXi Sales Messages November 2009 6 NOVEMBER 2009 ST00431-v06 Notice This Sales Tool contains proprietary information protected by copyright. Information in this Sales Tool is subject to change
More informationTSM (Tivoli Storage Manager) Backup and Recovery. Richard Whybrow Hertz Australia System Network Administrator
TSM (Tivoli Storage Manager) Backup and Recovery Richard Whybrow Hertz Australia System Network Administrator 2 Preparation meets success 3 Hertz Service Delivery Hertz has over 220 car hire locations
More informationThe Business Value of Data Deduplication DDSR SIG
The Business Value of Deduplication DDSR SIG Abstract The purpose of this presentation is to provide a base level of understanding with regards to data deduplication and its business benefits. Consideration
More informationRiverbed Whitewater/Amazon Glacier ROI for Backup and Archiving
Riverbed Whitewater/Amazon Glacier ROI for Backup and Archiving November, 2013 Saqib Jang Abstract This white paper demonstrates how to increase profitability by reducing the operating costs of backup
More informationAlternate Methods of TSM Disaster Recovery: Exploiting Export/Import Functionality
Alternate Methods of TSM Disaster Recovery: Exploiting Export/Import Functionality Presented by: Eric Gruber TSM Sr. Architect, TSM Certified Consultant www.ckaonline.com Value Recovery Time Tiers Best
More informationUNDERSTANDING DATA DEDUPLICATION. Thomas Rivera SEPATON
UNDERSTANDING DATA DEDUPLICATION Thomas Rivera SEPATON SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual members may use this material
More informationTrends in Data Protection and Restoration Technologies. Mike Fishman, EMC 2 Corporation (Author and Presenter)
Trends in Data Protection and Restoration Technologies Mike Fishman, EMC 2 Corporation (Author and Presenter) SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless
More informationData Deduplication Background: A Technical White Paper
Data Deduplication Background: A Technical White Paper NOTICE This White Paper may contain proprietary information protected by copyright. Information in this White Paper is subject to change without notice
More informationUNDERSTANDING DATA DEDUPLICATION. Tom Sas Hewlett-Packard
UNDERSTANDING DATA DEDUPLICATION Tom Sas Hewlett-Packard SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual members may use this material
More informationWHITE PAPER: customize. Best Practice for NDMP Backup Veritas NetBackup. Paul Cummings. January 2009. Confidence in a connected world.
WHITE PAPER: customize DATA PROTECTION Confidence in a connected world. Best Practice for NDMP Backup Veritas NetBackup Paul Cummings January 2009 Best Practice for NDMP Backup Veritas NetBackup Contents
More informationIBM Tivoli Storage Manager
Help maintain business continuity through efficient and effective storage management IBM Tivoli Storage Manager Highlights Increase business continuity by shortening backup and recovery times and maximizing
More informationGet Success in Passing Your Certification Exam at first attempt!
Get Success in Passing Your Certification Exam at first attempt! Exam : E22-290 Title : EMC Data Domain Deduplication, Backup and Recovery Exam Version : DEMO 1.A customer has a Data Domain system with
More informationTSM Family Capacity Pricing Special Bid Offering. 2009 IBM Corporation
TSM Family Capacity Pricing Special Bid Offering 2009 IBM Corporation Agenda TSM Family Capacity Pricing Special Bid Offering overview IBM Direct Rep - how to order IBM Business Partner how to order How
More informationProtecting Information in a Smarter Data Center with the Performance of Flash
89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com 212.367.7400 Protecting Information in a Smarter Data Center with the Performance of Flash IBM FlashSystem and IBM ProtecTIER Printed in
More informationDisk-To-Disk Backup: Making a Bigger D. Presented by Kelly J. Lipp CTO STORServer, Inc.
Disk-To-Disk Backup: Making a Bigger D Presented by Kelly J. Lipp CTO STORServer, Inc. Overview Why a Bigger D? When to use Bigger D When might disk be better than tape? Storage Configuration options TSM
More informationIBM Tivoli Storage Manager for Enterprise Resource Planning Version 6.4.1. Data Protection for SAP HANA Installation and User's Guide
IBM Tivoli Storage Manager for Enterprise Resource Planning Version 6.4.1 Data Protection for SAP HANA Installation and User's Guide IBM Tivoli Storage Manager for Enterprise Resource Planning Version
More informationBarracuda Backup Deduplication. White Paper
Barracuda Backup Deduplication White Paper Abstract Data protection technologies play a critical role in organizations of all sizes, but they present a number of challenges in optimizing their operation.
More informationBusiness Benefits of Data Footprint Reduction
Business Benefits of Data Footprint Reduction Why and how reducing your data footprint provides a positive benefit to your business and application service objectives By Greg Schulz Founder and Senior
More informationTiered Data Protection Strategy Data Deduplication. Thomas Störr Sales Director Central Europe November 8, 2007
Tiered Data Protection Strategy Data Deduplication Thomas Störr Sales Director Central Europe November 8, 2007 Overland Storage Tiered Data Protection = Good = Better = Best! NEO / ARCvault REO w/ expansion
More informationIBM Data Deduplication Strategy and Operations
Tivoli IBM Data Deduplication Strategy and Operations ii IBM Data Deduplication Strategy and Operations Contents 1 Executive Overview................................ 1 IBM data reduction and deduplication
More informationThe Archival Upheaval Petabyte Pandemonium Developing Your Game Plan Fred Moore President www.horison.com
USA The Archival Upheaval Petabyte Pandemonium Developing Your Game Plan Fred Moore President www.horison.com Did You Know? Backup and Archive are Not the Same! Backup Primary HDD Storage Files A,B,C Copy
More informationProtecting enterprise servers with StoreOnce and CommVault Simpana
Technical white paper Protecting enterprise servers with StoreOnce and CommVault Simpana HP StoreOnce Backup systems Table of contents Introduction 2 Technology overview 2 HP StoreOnce Backup systems key
More informationIBM Tivoli Storage Manager and Front-safe TSM Portal
IBM Software Tivoli Storage Manager IBM Tivoli Storage Manager and Front-safe TSM Portal For business-ready cloud infrastructures Table of Contents Abstract 3 Introduction 3 Overview of IBM Tivoli Storage
More informationWHITE PAPER Data Deduplication for Backup: Accelerating Efficiency and Driving Down IT Costs
WHITE PAPER Data Deduplication for Backup: Accelerating Efficiency and Driving Down IT Costs Sponsored by: EMC Corporation Laura DuBois May 2009 EXECUTIVE SUMMARY Global Headquarters: 5 Speen Street Framingham,
More informationUsing HP StoreOnce Backup systems for Oracle database backups
Technical white paper Using HP StoreOnce Backup systems for Oracle database backups Table of contents Introduction 2 Technology overview 2 HP StoreOnce Backup systems key features and benefits 2 HP StoreOnce
More informationEMC AVAMAR. a reason for Cloud. Deduplication backup software Replication for Disaster Recovery
EMC AVAMAR a reason for Cloud Deduplication backup software Replication for Disaster Recovery Bogdan Stefanescu (Bogs) EMC Data Protection Solutions bogdan.stefanescu@emc.com 1 BUSINESS DRIVERS Increase
More informationUNDERSTANDING DATA DEDUPLICATION. Jiří Král, ředitel pro technický rozvoj STORYFLEX a.s.
UNDERSTANDING DATA DEDUPLICATION Jiří Král, ředitel pro technický rozvoj STORYFLEX a.s. SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual
More informationEMC DATA DOMAIN OVERVIEW. Copyright 2011 EMC Corporation. All rights reserved.
EMC DATA DOMAIN OVERVIEW 1 2 With Data Domain Deduplication Storage Systems, You Can WAN Retain longer Keep backups onsite longer with less disk for fast, reliable restores, and eliminate the use of tape
More information<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures
1 Refreshing Your Data Protection Environment with Next-Generation Architectures Dale Rhine, Principal Sales Consultant Kelly Boeckman, Product Marketing Analyst Program Agenda Storage
More informationMaximize Your Virtual Environment Investment with EMC Avamar. Rob Emsley Senior Director, Product Marketing
1 Maximize Your Virtual Environment Investment with EMC Avamar Rob Emsley Senior Director, Product Marketing 2 Private Cloud is the Vision Virtualized Data Center Internal Cloud Trusted Flexible Control
More information3Gen Data Deduplication Technical
3Gen Data Deduplication Technical Discussion NOTICE: This White Paper may contain proprietary information protected by copyright. Information in this White Paper is subject to change without notice and
More informationBackup Software Data Deduplication: What you need to know. Presented by W. Curtis Preston Executive Editor & Independent Backup Expert
Backup Software Data Deduplication: What you need to know Presented by W. Curtis Preston Executive Editor & Independent Backup Expert When I was in the IT Department When I started as backup guy at $35B
More informationFuture-Proofed Backup For A Virtualized World!
! Future-Proofed Backup For A Virtualized World! Prepared by: Colm Keegan, Senior Analyst! Prepared: January 2014 Future-Proofed Backup For A Virtualized World Like death and taxes, growing backup windows
More informationEMC Data Domain Boost for Oracle Recovery Manager (RMAN)
White Paper EMC Data Domain Boost for Oracle Recovery Manager (RMAN) Abstract EMC delivers Database Administrators (DBAs) complete control of Oracle backup, recovery, and offsite disaster recovery with
More informationTivoli Storage Manager Explained
IBM Software Group Dave Cannon IBM Tivoli Storage Management Development Oxford University TSM Symposium 2003 Presentation Objectives Explain TSM behavior for selected operations Describe design goals
More informationIntroduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation
Introduction to Data Protection: Backup to Tape, Disk and Beyond Michael Fishman, EMC Corporation SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies
More informationBackup and Recovery: The Benefits of Multiple Deduplication Policies
Backup and Recovery: The Benefits of Multiple Deduplication Policies NOTICE This White Paper may contain proprietary information protected by copyright. Information in this White Paper is subject to change
More informationRedefining Backup for VMware Environment. Copyright 2009 EMC Corporation. All rights reserved.
Redefining Backup for VMware Environment 1 Agenda VMware infrastructure backup and recovery challenges Introduction to EMC Avamar Avamar solutions for VMware infrastructure Key takeaways Copyright 2009
More informationSymantec NetBackup 5220
A single-vendor enterprise backup appliance that installs in minutes Data Sheet: Data Protection Overview is a single-vendor enterprise backup appliance that installs in minutes, with expandable storage
More informationEnterprise Backup and Restore technology and solutions
Enterprise Backup and Restore technology and solutions LESSON VII Veselin Petrunov Backup and Restore team / Deep Technical Support HP Bulgaria Global Delivery Hub Global Operations Center November, 2013
More informationIBM Spectrum Protect in the Cloud
IBM Spectrum Protect in the Cloud. Disclaimer IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM s sole discretion. Information regarding
More informationDEDUPLICATION BASICS
DEDUPLICATION BASICS 4 DEDUPE BASICS 12 HOW DO DISASTER RECOVERY & ARCHIVING FIT IN? 6 WHAT IS DEDUPLICATION 14 DEDUPLICATION FOR EVERY BUDGET QUANTUM DXi4000 and vmpro 4000 8 METHODS OF DEDUPLICATION
More informationBusiness-centric Storage FUJITSU Storage ETERNUS CS800 Data Protection Appliance
Business-centric Storage FUJITSU Storage ETERNUS CS800 Data Protection Appliance The easy solution for backup to disk with deduplication If you rethink your backup strategy, then think of ETERNUS CS800
More informationIBM Tivoli Storage Manager Suite for Unified Recovery
IBM Storage Manager Suite for Unified Recovery A bundled offering delivering comprehensive data protection with simplified licensing and management Highlights Simplify procurement and deployment with per-terabyte
More informationBackup Exec Private Cloud Services. Planning and Deployment Guide
Backup Exec Private Cloud Services Planning and Deployment Guide Chapter 1 Introducing Backup Exec Private Cloud Services This chapter includes the following topics: About Backup Exec Private Cloud Services
More informationWHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression
WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression Sponsored by: Oracle Steven Scully May 2010 Benjamin Woo IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA
More informationQuantum DXi6500 Family of Network-Attached Disk Backup Appliances with Deduplication
PRODUCT BRIEF Quantum DXi6500 Family of Network-Attached Disk Backup Appliances with Deduplication NOTICE This Product Brief contains proprietary information protected by copyright. Information in this
More informationRapid Data Backup and Restore Using NFS on IBM ProtecTIER TS7620 Deduplication Appliance Express IBM Redbooks Solution Guide
Rapid Data Backup and Restore Using NFS on IBM ProtecTIER TS7620 Deduplication Appliance Express IBM Redbooks Solution Guide This IBM Redbooks Solution Guide provides an overview of how data backup and
More informationUsing HP StoreOnce Backup Systems for NDMP backups with Symantec NetBackup
Technical white paper Using HP StoreOnce Backup Systems for NDMP backups with Symantec NetBackup Table of contents Executive summary... 2 Introduction... 2 What is NDMP?... 2 Technology overview... 3 HP
More informationStep by Step Guide To vstorage Backup Server (Proxy) Sizing
Tivoli Storage Manager for Virtual Environments V6.3 Step by Step Guide To vstorage Backup Server (Proxy) Sizing 12 September 2012 1.1 Author: Dan Wolfe, Tivoli Software Advanced Technology Page 1 of 18
More informationITCertMaster. http://www.itcertmaster.com. Safe, simple and fast. 100% Pass guarantee! IT Certification Guaranteed, The Easy Way!
ITCertMaster Safe, simple and fast. 100% Pass guarantee! http://www.itcertmaster.com IT Certification Guaranteed, The Easy Way! Exam : E20-895 Title : Backup Recovery - Avamar Expert Exam for Implementation
More informationNetBackup Disk Based Data Protection Options
WHITE PAPER: TECHNICAL NetBackup Disk Based Data Protection Options Alex Davies Contents 1.0 INTRODUCTION... 4 1.1 GLOSSARY... 5 2.0 NETBACKUP ENTERPRISE DISK FOUNDATION... 6 2.1 MEDIA LOAD SERVER BALANCING
More informationTechnical White Paper for the Oceanspace VTL6000
Document No. Technical White Paper for the Oceanspace VTL6000 Issue V2.1 Date 2010-05-18 Huawei Symantec Technologies Co., Ltd. Copyright Huawei Symantec Technologies Co., Ltd. 2010. All rights reserved.
More informationReference Guide WindSpring Data Management Technology (DMT) Solving Today s Storage Optimization Challenges
Reference Guide WindSpring Data Management Technology (DMT) Solving Today s Storage Optimization Challenges September 2011 Table of Contents The Enterprise and Mobile Storage Landscapes... 3 Increased
More informationMayur Dewaikar Sr. Product Manager Information Management Group Symantec Corporation
Next Generation Data Protection with Symantec NetBackup 7 Mayur Dewaikar Sr. Product Manager Information Management Group Symantec Corporation White Paper: Next Generation Data Protection with NetBackup
More informationes T tpassport Q&A * K I J G T 3 W C N K V [ $ G V V G T 5 G T X K E G =K ULLKX LXKK [VJGZK YKX\OIK LUX UTK _KGX *VVR YYY VGUVRCUURQTV EQO
Testpassport Q&A Exam : E22-280 Title : Avamar Backup and Data Deduplication Exam Version : Demo 1 / 9 1. What are key features of EMC Avamar? A. Disk-based archive RAID, RAIN, clustering and replication
More informationEliminating Backup System Bottlenecks: Taking Your Existing Backup System to the Next Level. Jacob Farmer, CTO, Cambridge Computer
: Taking Your Existing Backup System to the Next Level Jacob Farmer, CTO, Cambridge Computer SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals
More informationBacking up Very Large Databases
Backing up Very Large Databases Charles Silvan GATE Informatic Switzerland Agenda Environment Flashcopy Principles TSM for ACS Numbers Issues Scalability C. Silvan Backing up Very Large Databases 2 Customer
More informationData Deduplication HTBackup
Data Deduplication HTBackup HTBackup and it s Deduplication technology is touted as one of the best ways to manage today's explosive data growth. If you're new to the technology, these key facts will help
More informationTake Advantage of Data De-duplication for VMware Backup
Take Advantage of Data De-duplication for VMware Backup Lauren Whitehouse Analyst, Enterprise Strategy Group Tom Martin Avamar Product Management, EMC Mike Zolla Avamar Chief Architect, EMC 1 EMC Avamar
More information