CONSOLIDATE MORE: HIGH- PERFORMANCE PRIMARY DEDUPLICATION IN THE AGE OF ABUNDANT CAPACITY

Transcription

1 CONSOLIDATE MORE: HIGH- PERFORMANCE PRIMARY DEDUPLICATION IN THE AGE OF ABUNDANT CAPACITY YONG KIM, TECHNICAL DIRECTOR, AMERICAS FILE AND CONTENT SOLUTIONS

2 WEBTECH EDUCATIONAL SERIES CONSOLIDATE MORE: HIGH-PERFORMANCE PRIMARY DEDUPLICATION IN THE AGE OF ABUNDANT CAPACITY Increase productivity, efficiency and environmental savings by eliminating silos, preventing sprawl and reducing complexity by 50%. Using powerful consolidation systems Hitachi Unified Storage or Hitachi NAS Platform lets you consolidate existing file servers and NAS devices onto fewer nodes. You can perform the same or even more work with fewer devices and lower overhead, while reducing floor space and associated power and cooling costs. Attend this webcast to learn how to Shrink your primary file data without disrupting performance. Increase productivity and utilization of available capacity. Defer additional storage purchases. Save on power, cooling and space costs.

3 UPCOMING WEBTECHS Cloud and Object Store Series Environmental Pressures Driving an Evolution in File Storage, April 3, 9 a.m. PT, noon ET Big Data Webcast Series Continues Big Data: Shining the Light on Enterprise Dark Data, April 17, 9 a.m. PT, noon ET HDS Big Data Roadmap, May 1, 9 a.m. PT, noon ET Check for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions

4 CUSTOMER CHALLENGES How do I Reduce the cost of storing data? Reduce the cost of protecting data? Archive first Back up less Consolidate more Gain IT agility? Mitigate data risk? Do more with less? Manage distributed IT more effectively?

5 TIE IT ALL TOGETHER THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the Back cost of up protecting less data Do Consolidate more with less more Reduce overall storage costs by reducing the load on primary storage by at least 40% Reduce licensing and management cost, complexity and backup by up to 75% APPLICATION APPLICATION APPLICATION CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE EDGE STORAGE REMOTE OFFICE HDDS SEARCH ACROSS ALTERNATE DATA CENTER

6 TIE IT ALL TOGETHER Simplify management, improve data protection and reduce risk THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do Consolidate more with less more Streamline backup and restore operations by 50-60% Improve reliability with >24x improvement in RPO, >30x improvement in RTO APPLICATION APPLICATION APPLICATION CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE EDGE STORAGE REMOTE OFFICE HDDS SEARCH ACROSS ALTERNATE DATA CENTER

7 TIE IT ALL TOGETHER THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do more with less Reduce or eliminate CAPEX, simplify management, offload data from primary storage Simplify management, improve data protection and reduce risk APPLICATION APPLICATION APPLICATION CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE EDGE STORAGE REMOTE OFFICE HDDS SEARCH ACROSS ALTERNATE DATA CENTER

8 DATA GROWTH CONTINUES UNABATED Data growth: Doubling every 18 months Unstructured data (files) growing even faster Worldwide data creation exceeded 1 zettabyte in 2010 for the first time 40% projected growth in global data generated per year vs. 5% growth in global IT spend *

9 FAR LESS OF THE DATA IS UNIQUE 75% duplicate data (IDC) 80% (McKinsey Global Institute)

10 DATA DEDUPLICATION WHAT IS IT? A storage-optimization technology Compression, SIS Reduces data by eliminating multiple copies of redundant data and only keeping unique data First made popular for backup (secondary) devices, the technology has been extended to support primary storage

11 DATA DEDUPLICATION BUSINESS AND CUSTOMER BENEFITS Challenge for companies today continues to be the cost and associated cost of storage Data storage Optimizing data in place, and reducing the on-disk footprint of data as it is stored provides immediate savings in capacity and new disk expenditures Drive down the cost per gigabyte store more information in the same gigabyte Data management Reduces the volume of data that needs to be managed Reduces the frequency of backups

12 WHAT MARKET RESEARCH FIRMS ARE SAYING

13 WHAT MARKET RESEARCH FIRMS ARE SAYING the percentage of deployments with musthave primary dedupe requirements will reach anywhere from 5% (conservative) to 22% (aggressive) by 2015

14 WHAT HAPPENS DURING DEDUPLICATION After Dedupe

15 DEDUPE IN ACTION Without Dedupe 54 4K Blocks Consumed Owner: Steve File Name: \home\steve\work\report.doc Size: 15 4K blocks Owner: John File Name: \home\john\tmp\myreport.doc Size: 17 4K blocks Owner: Mary File Name: \home\mary\stevereport.doc Size: 17 4K blocks With Dedupe Only 24 4K Blocks Consumed Owner: Paul File Name: \home\paul\proforma.xls Size: 5 4K blocks 30 4K Blocks (> 50%) Reclaimed

16 HITACHI NAS PLATFORM (HNAS) DEDUPLICATION OVERVIEW Leverages HNAS unique hybrid core technology Indexing engine via CPU VLSI/FPGA technology SHA256 hash of a data block detect duplicate Up to 4 SHA calculators running in parallel Post-processing File system data is analyzed and processed for dedupe after it is written to disk Not in data path no risk of losing or being unable to access data Dedupe index is used to store and identify duplicate blocks in a file system

17 IT S ALL ABOUT POINTERS Maximum (in theory) dedupe ratio is 239:1 A HNAS block can be shared up to 239 times For example, 478 duplicate blocks dedupe down to 2 blocks

18 DEDUPE EFFICIENCY Typical enterprises 2:1 to 5:1 data reduction Higher in virtual environments 2:1 50% Savings 4:1 75% Savings 5:1 80% Savings 10:1 90% Savings 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%

19 COMPETITIVE DIFFERENTIATION Extreme performance Up to 450MB/sec post-ingest throughput rate Dynamic quality of service (QoS) Avoid impacting application I/O Less degradation on I/O Performance Simple to use Not a hardware appliance Little to no administration required

20 QOS / THROTTLING MECHANISMS Automatic background process No complex scheduling process 24/7 operation No disruption to workflow QoS/auto throttling When the file serving load passes beyond 50% (of available IOPS or throughput capacity), the engine throttles back

21 RESULTS FROM A LEADING MANUFACTURER REAL-WORLD RESULTS The current HNAS algorithm appears to be far better than others (competitors) tested

22 TIE IT ALL TOGETHER THE POWER OF THE PORTFOLIO Reduce the Reduce the Back cost of up Archive cost of protecting less storing first data data Do Consolidate more with less more APPLICATION APPLICATION APPLICATION CLOUD STORAGE EDGE STORAGE REMOTE OFFICE The intelligent archive is HDDS the strong foundation of the 21st SEARCH Century ACROSS data center ALTERNATE DATA CENTER

23 QUESTIONS AND DISCUSSION

24 UPCOMING WEBTECHS Cloud and Object Store Series Environmental Pressures Driving an Evolution in File Storage, April 3, 9 a.m. PT, noon ET Big Data Webcast Series Continues Big Data: Shining the Light on Enterprise Dark Data, April 17, 9 a.m. PT, noon ET HDS Big Data Roadmap, May 1, 9 a.m. PT, noon ET Check for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions

25 THANK YOU