Decentralized Deduplication in SAN Cluster File Systems
|
|
|
- Clinton Ward
- 8 years ago
- Views:
Transcription
1 Decentralized Deduplication in SAN Cluster File Systems Austin T. Clements Irfan Ahmad Murali Vilayannur Jinyuan Li VMware, Inc. MIT CSAIL
2 Storage Area Networks
3 Storage Area Networks
4 Storage Area Networks
5 Storage Area Networks
6 Storage Area Networks 1.3 TB
7 Storage Area Networks 237 GB 1.3 TB
8 Storage Area Networks 237 GB 5X reduction 1.3 TB
9 Deduplication
10 Deduplication
11 Deduplication
12 Deduplication
13 Deduplication 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
14 Deduplication 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
15 Deduplication 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
16 Deduplication 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
17 The Problem Slow Lots of IO in the write path. Can t cache the index.
18 The Problem Slow Lots of IO in the write path. Can t cache the index. Very Slow Writes require allocation and thus coordination. No hope of disk locality.
19 The Problem Slow Lots of IO in the write path. Can t cache the index. Very Slow Writes require allocation and thus coordination. No hope of disk locality. Hopelessly Slow Multi-host lock contention on shared index.
20 Three-Stage Deduplication Decentralized Deduplication
21 Three-Stage Deduplication DeDe
22 Three-Stage Deduplication DeDe
23 Three-Stage Deduplication DeDe Out-of-band deduplication of live, primary storage Process duplicates efficiently, in large batches Minimize contention on the index Resilient to stale index information Unique blocks remain mutable and sequential = No overhead for blocks that don t benefit from deduplication
24 Three-Stage Deduplication DeDe
25 Three-Stage Deduplication DeDe
26 Three-Stage Deduplication DeDe
27 Three-Stage Deduplication DeDe
28 Three-Stage Deduplication DeDe f4bea9.. f2a4d2.. 0e7a ba2b.. d5e341.. bc ab ee b1f28.. 9b575b.. 94c9c bc7..
29 Three-Stage Deduplication DeDe f4bea9.. f2a4d2.. 0e7a ba2b.. d5e341.. bc ab ee b1f28.. 9b575b.. 94c9c bc7..
30 Three-Stage Deduplication DeDe f4bea9.. f2a4d2.. 0e7a ba2b.. d5e341.. bc ab ee b1f28.. 9b575b.. 94c9c bc7.. 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
31 Three-Stage Deduplication DeDe f4bea9.. f2a4d2.. 0e7a ba2b.. d5e341.. bc ab ee b1f28.. 9b575b.. 94c9c bc7.. 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
32 Three-Stage Deduplication DeDe ab ee b1f28.. 9b575b.. 94c9c bc7.. 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
33 Three-Stage Deduplication DeDe ab ee b1f28.. 9b575b.. 94c9c bc7.. 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
34 Three-Stage Deduplication DeDe ab ee b1f28.. 9b575b.. 94c9c bc7.. 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
35 Three-Stage Deduplication DeDe 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
36 Three-Stage Deduplication DeDe 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
37 Three-Stage Deduplication DeDe? 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..???
38 Three-Stage Deduplication DeDe? 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..???
39 Three-Stage Deduplication DeDe? 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..???
40 Implementation
41 Implementation
42 Implementation
43 Implementation 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
44 Implementation 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9..
45 VMFS Compare-and-share
46 VMFS Compare-and-share?
47 VMFS Compare-and-share
48 VMFS Compare-and-share DeDe finds duplicates. VMFS eliminates them.
49 Write Monitor
50 Write Monitor A lightweight kernel module monitors writes, computes hashes
51 Write Monitor A lightweight kernel module monitors writes, computes hashes It buffers the write log in userspace before writing it to disk
52 Write Monitor A lightweight kernel module monitors writes, computes hashes It buffers the write log in userspace before writing it to disk
53 Write Monitor A lightweight kernel module monitors writes, computes hashes It buffers the write log in userspace before writing it to disk Safe to buffer the log because index is resilient
54 Write Monitor A lightweight kernel module monitors writes, computes hashes It buffers the write log in userspace before writing it to disk Safe to buffer the log because index is resilient 150 MB of regular writes 1 MB sequential log write
55 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Map from hashes to block locators, list sorted by hash
56 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash
57 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable
58 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable
59 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable
60 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable A virtual arena stores COW references to all shared blocks
61 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable A virtual arena stores COW references to all shared blocks
62 The Index 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared Map from hashes to block locators, list sorted by hash Unique blocks are located in files and remain mutable A virtual arena stores COW references to all shared blocks
63 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
64 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
65 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
66 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. 6cd c.. c277d6.. Unique Shared
67 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea c.. 6cd412.. c277d6.. Unique Shared
68 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea c.. 6cd412.. c277d6.. Unique Shared
69 Indexing and Duplicate Elimination 0e7a ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea c.. 6cd412.. c277d6.. Unique Shared
70 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. 6cd412.. c277d6.. Unique Shared
71 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. 6cd412.. c277d6.. Unique Shared
72 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. 6cd412.. c277d6.. Unique Shared
73 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6.. Unique Shared
74 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6.. Unique Shared
75 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6.. Unique Shared
76 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6..? Unique Shared
77 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6.. Unique Shared
78 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. c277d6.. Unique Shared
79 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
80 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
81 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
82 Indexing and Duplicate Elimination 0e7a c.. 15ba2b.. 6cd412.. ab bc c277d6.. d5e341.. f2a4d2.. f4bea9.. Unique Shared
83 Phew.
84 Evaluation
85 Evaluation How much space does DeDe save?
86 Evaluation How much space does DeDe save? How much overhead does DeDe introduce?
87 Evaluation How much space does DeDe save? How much overhead does DeDe introduce? How fast can DeDe deduplicate?
88 Space Savings: VDI Cluster Corporate Virtual Desktop Infrastructure cluster Desktop XP VM s 6 12 months of active use Originally cloned from small number of base images...
89 Space Savings: VDI Cluster Corporate Virtual Desktop Infrastructure cluster Desktop XP VM s 6 12 months of active use Originally cloned from small number of base images 1.9 TB 113 VM s...
90 Space Savings: VDI Cluster Corporate Virtual Desktop Infrastructure cluster Desktop XP VM s 6 12 months of active use Originally cloned from small number of base images 1.9 TB 1.3 TB 113 VM s...
91 Space Savings: VDI Cluster 1.3 TB
92 Space Savings: VDI Cluster 237 GB 1.3 TB
93 Space Savings: VDI Cluster 237 GB 1.3 TB 173 GB unique 61 GB shared
94 Space Savings: VDI Cluster 237 GB 1.3 TB 2.7 GB 173 GB unique 61 GB shared
95 Space Savings: VDI Cluster 237 GB 1.3 TB 2.7 GB 173 GB unique 61 GB shared 1.3 GB index file 194 MB v. arena 1.1 GB FS metadata
96 Runtime Effects Write monitoring Disk array caching
97 Runtime Effects Write monitoring Disk array caching
98 Runtime Effects Write monitoring Disk array caching EMC CLARiiON CX3-40
99 Runtime Overhead: Write Monitoring Worst-case benchmark: 100% sequential write IO, No computation
100 Runtime Overhead: Write Monitoring Worst-case benchmark: 100% sequential write IO, No computation Baseline Write Monitor CPU 33% 220%
101 Runtime Overhead: Write Monitoring Worst-case benchmark: 100% sequential write IO, No computation Baseline Write Monitor CPU 33% 220% Bandwidth (MB/s) Latency (ms)
102 Runtime Overhead: Write Monitoring Worst-case benchmark: 100% sequential write IO, No computation Baseline Write Monitor CPU 33% 220% Bandwidth (MB/s) Latency (ms) (See paper for database application benchmark)
103 Runtime Gains: Disk Array Caching Reduced storage footprint Better caching Less IO
104 Runtime Gains: Disk Array Caching Reduced storage footprint Better caching Less IO Average boot time (secs) VDI "boot storm" # VMs booting concurrently
105 Runtime Gains: Disk Array Caching Reduced storage footprint Better caching Less IO Average boot time (secs) VDI "boot storm" Full copies # VMs booting concurrently
106 Runtime Gains: Disk Array Caching Reduced storage footprint Better caching Less IO Average boot time (secs) VDI "boot storm" Full copies Deduplicated # VMs booting concurrently
107 Out-of-band Deduplication Rate Index scan COW sharing
108 Out-of-band Deduplication Rate Index scan COW sharing 6.6 GB/sec Virtually no cost for unique blocks
109 Out-of-band Deduplication Rate Index scan 6.6 GB/sec COW sharing 2.6 MB/sec Virtually no cost for unique blocks
110 Out-of-band Deduplication Rate Index scan 6.6 GB/sec COW sharing 2.6 MB/sec (It s a prototype!) Virtually no cost for unique blocks
111 Out-of-band Deduplication Rate Index scan 6.6 GB/sec COW sharing 2.6 MB/sec (It s a prototype!) Virtually no cost for unique blocks 9 GB of new shared blocks per hour (And provisioning can be special-cased)
112 Related Work Centralized archival Venti Data Domain Foundation Centralized primary storage NetApp ASIS Microsoft Single Instance Store Distributed Farsite SAN with Coordinator DDE
113 Conclusion Decentralized, out-of-band, live file system deduplication.
114 Conclusion Decentralized, out-of-band, live file system deduplication. Deduplication is effective.
115 Conclusion Decentralized, out-of-band, live file system deduplication. Deduplication is effective. Deduplication is hard.
116 Conclusion Decentralized, out-of-band, live file system deduplication. Deduplication is effective. Deduplication is hard. Three-stage deduplication has only modest performance overhead.
117 Conclusion Decentralized, out-of-band, live file system deduplication. Deduplication is effective. Deduplication is hard. Three-stage deduplication has only modest performance overhead. Thank you.
Decentralized Deduplication in SAN Cluster File Systems
Decentralized Deduplication in SAN Cluster File Systems Austin T. Clements Irfan Ahmad Murali Vilayannur Jinyuan Li VMware, Inc. MIT CSAIL Transcript of talk given on Wednesday, June 17 at USENIX ATEC
Decentralized Deduplication in SAN Cluster File Systems
Decentralized Deduplication in SAN Cluster File Systems Austin T. Clements Irfan Ahmad Murali Vilayannur Jinyuan Li VMware, Inc. MIT CSAIL Abstract File systems hosting virtual machines typically contain
WHITE PAPER 1 WWW.FUSIONIO.COM
1 WWW.FUSIONIO.COM WHITE PAPER WHITE PAPER Executive Summary Fusion iovdi is the first desktop- aware solution to virtual desktop infrastructure. Its software- defined approach uniquely combines the economics
Flash Storage Roles & Opportunities. L.A. Hoffman/Ed Delgado CIO & Senior Storage Engineer Goodwin Procter L.L.P.
Flash Storage Roles & Opportunities L.A. Hoffman/Ed Delgado CIO & Senior Storage Engineer Goodwin Procter L.L.P. Overview & Background Flash Storage history First smartphones, then laptops, then onboard
Virtual server management: Top tips on managing storage in virtual server environments
Tutorial Virtual server management: Top tips on managing storage in virtual server environments Sponsored By: Top five tips for managing storage in a virtual server environment By Eric Siebert, Contributor
Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle
Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle Agenda Introduction Database Architecture Direct NFS Client NFS Server
Nimble Storage for VMware View VDI
BEST PRACTICES GUIDE Nimble Storage for VMware View VDI N I M B L E B E S T P R A C T I C E S G U I D E : N I M B L E S T O R A G E F O R V M W A R E V I E W V D I 1 Overview Virtualization is an important
Increasing Storage Performance, Reducing Cost and Simplifying Management for VDI Deployments
Increasing Storage Performance, Reducing Cost and Simplifying Management for VDI Deployments Table of Contents Introduction.......................................3 Benefits of VDI.....................................4
Using VMware VMotion with Oracle Database and EMC CLARiiON Storage Systems
Using VMware VMotion with Oracle Database and EMC CLARiiON Storage Systems Applied Technology Abstract By migrating VMware virtual machines from one physical environment to another, VMware VMotion can
Optimize VDI with Server-Side Storage Acceleration
WHITE PAPER Optimize VDI with Server-Side Storage Acceleration Eliminate Storage Bottlenecks for Fast, Reliable Virtual Desktop Performance 1 Virtual Desktop Infrastructures (VDI) give users easy access
VMware View Design Guidelines. Russel Wilkinson, Enterprise Desktop Solutions Specialist, VMware
VMware View Design Guidelines Russel Wilkinson, Enterprise Desktop Solutions Specialist, VMware 1 2 Overview Steps to follow: Getting from concept to reality Design process: Optimized for efficiency Best
Storage Considerations for VMware View BEST PRACTICES
Storage Considerations for VMware View BEST PRACTICES Table of Contents Introduction... 3 Windows Disk I/O Workloads.... 3 Base Image Considerations.... 4 Storage Protocol Choices.... 6 Storage Technology
IOmark- VDI. Nimbus Data Gemini Test Report: VDI- 130906- a Test Report Date: 6, September 2013. www.iomark.org
IOmark- VDI Nimbus Data Gemini Test Report: VDI- 130906- a Test Copyright 2010-2013 Evaluator Group, Inc. All rights reserved. IOmark- VDI, IOmark- VDI, VDI- IOmark, and IOmark are trademarks of Evaluator
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION
DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION A DIABLO WHITE PAPER AUGUST 2014 Ricky Trigalo Director of Business Development Virtualization, Diablo Technologies
GRIDCENTRIC VMS TECHNOLOGY VDI PERFORMANCE STUDY
GRIDCENTRIC VMS TECHNOLOGY VDI PERFORMANCE STUDY TECHNICAL WHITE PAPER MAY 1 ST, 2012 GRIDCENTRIC S VIRTUAL MEMORY STREAMING (VMS) TECHNOLOGY SIGNIFICANTLY IMPROVES THE COST OF THE CLASSIC VIRTUAL MACHINE
Nimble Storage VDI Solution for VMware Horizon (with View)
BEST PRACTICES GUIDE Nimble Storage VDI Solution for VMware Horizon (with View) B E S T P R A C T I C E S G U I D E : N I M B L E S T O R A G E V D I F O R V M W A R E H O R I Z O N ( w i t h V I E W )
FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures
Technology Insight Paper FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures By Leah Schoeb January 16, 2013 FlashSoft Software from SanDisk: Accelerating Virtual Infrastructures 1 FlashSoft
Low-Cost Data Deduplication for Virtual Machine Backup in Cloud Storage
Low-Cost Data Deduplication for Virtual Machine Backup in Cloud Storage Wei Zhang, Tao Yang, Gautham Narayanasamy, and Hong Tang University of California at Santa Barbara, Alibaba Inc. Abstract In a virtualized
Optimized Storage Solution for Enterprise Scale Hyper-V Deployments
Optimized Storage Solution for Enterprise Scale Hyper-V Deployments End-to-End Storage Solution Enabled by Sanbolic Melio FS and LaScala Software and EMC SAN Solutions Proof of Concept Published: March
Benchmarking Hadoop & HBase on Violin
Technical White Paper Report Technical Report Benchmarking Hadoop & HBase on Violin Harnessing Big Data Analytics at the Speed of Memory Version 1.0 Abstract The purpose of benchmarking is to show advantages
NETAPP SYNCSORT INTEGRATED BACKUP. Technical Overview. Peter Eicher Syncsort Product Management
NETAPP SYNCSORT INTEGRATED BACKUP Technical Overview Peter Eicher Syncsort Product Management Current State of Data Protection Production Data Protection Storage Physical & VM App Servers Backup Servers
NetApp Data Compression and Deduplication Deployment and Implementation Guide
Technical Report NetApp Data Compression and Deduplication Deployment and Implementation Guide Clustered Data ONTAP Sandra Moulton, NetApp April 2013 TR-3966 Abstract This technical report focuses on clustered
ALL-FLASH STORAGE ARRAY. A Hyper-Converged Infrastructure for High I/O Applications and Virtual Desktops
ALL-FLASH STORAGE ARRAY A Hyper-Converged Infrastructure for High I/O Applications and Virtual Desktops VDI through Lumenate Unpredictable workloads and changing demands on storage infrastructures are
File System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System
CS341: Operating System Lect 36: 1 st Nov 2014 Dr. A. Sahu Dept of Comp. Sc. & Engg. Indian Institute of Technology Guwahati File System & Device Drive Mass Storage Disk Structure Disk Arm Scheduling RAID
Nutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure
Nutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure with VMware vsphere 5 and View 5 Table of Contents 1. Executive Summary...1 2. Introduction to Project Colossus...2 2.1.
Speeding Up Cloud/Server Applications Using Flash Memory
Speeding Up Cloud/Server Applications Using Flash Memory Sudipta Sengupta Microsoft Research, Redmond, WA, USA Contains work that is joint with B. Debnath (Univ. of Minnesota) and J. Li (Microsoft Research,
A Deduplication File System & Course Review
A Deduplication File System & Course Review Kai Li 12/13/12 Topics A Deduplication File System Review 12/13/12 2 Traditional Data Center Storage Hierarchy Clients Network Server SAN Storage Remote mirror
Deploying and Optimizing SQL Server for Virtual Machines
Deploying and Optimizing SQL Server for Virtual Machines Deploying and Optimizing SQL Server for Virtual Machines Much has been written over the years regarding best practices for deploying Microsoft SQL
Journey to the All-Flash Data Center
Journey to the All-Flash Data Center David Abbott, IT Manager, TripPak SERVICES -- Vaughn Stewart, Chief Technical Evangelist Pure Storage Flash Memory Summit 2014 Santa Clara, CA 1 Introduction A leader
Data Compression and Deduplication. LOC 2010 2010 Cisco Systems, Inc. All rights reserved.
Data Compression and Deduplication LOC 2010 2010 Systems, Inc. All rights reserved. 1 Data Redundancy Elimination Landscape VMWARE DeDE IBM DDE for Tank Solaris ZFS Hosts (Inline and Offline) MDS + Network
VDI Optimization Real World Learnings. Russ Fellows, Evaluator Group
Russ Fellows, Evaluator Group SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material
Storage Sizing Issue of VDI System
, pp.89-94 http://dx.doi.org/10.14257/astl.2014.49.19 Storage Sizing Issue of VDI System Jeongsook Park 1, Cheiyol Kim 1, Youngchang Kim 1, Youngcheol Kim 1, Sangmin Lee 1 and Youngkyun Kim 1 1 Electronics
WHITE PAPER Optimizing Virtual Platform Disk Performance
WHITE PAPER Optimizing Virtual Platform Disk Performance Think Faster. Visit us at Condusiv.com Optimizing Virtual Platform Disk Performance 1 The intensified demand for IT network efficiency and lower
Chapter 12: Mass-Storage Systems
Chapter 12: Mass-Storage Systems Chapter 12: Mass-Storage Systems Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space Management RAID Structure
Virtualizing Performance-Critical Database Applications in VMware vsphere VMware vsphere 4.0 with ESX 4.0
Performance Study Virtualizing Performance-Critical Database Applications in VMware vsphere VMware vsphere 4.0 with ESX 4.0 VMware vsphere 4.0 with ESX 4.0 makes it easier than ever to virtualize demanding
HIGHLY AVAILABLE MULTI-DATA CENTER WINDOWS SERVER SOLUTIONS USING EMC VPLEX METRO AND SANBOLIC MELIO 2010
White Paper HIGHLY AVAILABLE MULTI-DATA CENTER WINDOWS SERVER SOLUTIONS USING EMC VPLEX METRO AND SANBOLIC MELIO 2010 Abstract This white paper demonstrates key functionality demonstrated in a lab environment
Cloud Optimize Your IT
Cloud Optimize Your IT Windows Server 2012 The information contained in this presentation relates to a pre-release product which may be substantially modified before it is commercially released. This pre-release
Benchmarking Cassandra on Violin
Technical White Paper Report Technical Report Benchmarking Cassandra on Violin Accelerating Cassandra Performance and Reducing Read Latency With Violin Memory Flash-based Storage Arrays Version 1.0 Abstract
TECHNICAL PAPER. Veeam Backup & Replication with Nimble Storage
TECHNICAL PAPER Veeam Backup & Replication with Nimble Storage Document Revision Date Revision Description (author) 11/26/2014 1. 0 Draft release (Bill Roth) 12/23/2014 1.1 Draft update (Bill Roth) 2/20/2015
Improve Business Productivity and User Experience with a SanDisk Powered SQL Server 2014 In-Memory OLTP Database
WHITE PAPER Improve Business Productivity and User Experience with a SanDisk Powered SQL Server 2014 In-Memory OLTP Database 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table of Contents Executive
W H I T E P A P E R. Performance and Scalability of Microsoft SQL Server on VMware vsphere 4
W H I T E P A P E R Performance and Scalability of Microsoft SQL Server on VMware vsphere 4 Table of Contents Introduction................................................................... 3 Highlights.....................................................................
The next step in Software-Defined Storage with Virtual SAN
The next step in Software-Defined Storage with Virtual SAN VMware vforum, 2014 Lee Dilworth, principal SE @leedilworth 2014 VMware Inc. All rights reserved. The Software-Defined Data Center Expand virtual
IOmark- VDI. HP HP ConvergedSystem 242- HC StoreVirtual Test Report: VDI- HC- 150427- b Test Report Date: 27, April 2015. www.iomark.
IOmark- VDI HP HP ConvergedSystem 242- HC StoreVirtual Test Report: VDI- HC- 150427- b Test Copyright 2010-2014 Evaluator Group, Inc. All rights reserved. IOmark- VDI, IOmark- VM, VDI- IOmark, and IOmark
Flash Storage Optimizing Virtual Desktop Deployments
Flash Storage Optimizing Virtual Desktop Deployments Ashok Rajagopalan UCS Product Management May 2014 In Collaboration with Intel Old Fashioned VDI (circa 2012) was Financially Unattractive to Most Average
ORACLE 11g AND 12c DATABASE CONSOLIDATION AND WORKLOAD SCALABILITY WITH EMC XTREMIO 3.0
ORACLE 11g AND 12c DATABASE CONSOLIDATION AND WORKLOAD SCALABILITY WITH EMC XTREMIO 3.0 Consolidation Oracle Production/Dev/Test workloads in physical and virtual environments Performance Consistent low-latency
EMC XTREMIO EXECUTIVE OVERVIEW
EMC XTREMIO EXECUTIVE OVERVIEW COMPANY BACKGROUND XtremIO develops enterprise data storage systems based completely on random access media such as flash solid-state drives (SSDs). By leveraging the underlying
idedup Latency-aware inline deduplication for primary workloads Kiran Srinivasan, Tim Bisson Garth Goodson, Kaladhar Voruganti
idedup Latency-aware inline deduplication for primary workloads Kiran Srinivasan, Tim Bisson Garth Goodson, Kaladhar Voruganti Advanced Technology Group NetApp 1 idedup overview/context Storage Clients
Maximizing VMware ESX Performance Through Defragmentation of Guest Systems. Presented by
Maximizing VMware ESX Performance Through Defragmentation of Guest Systems Presented by July, 2010 Table of Contents EXECUTIVE OVERVIEW 3 TEST EQUIPMENT AND METHODS 4 TESTING OVERVIEW 5 Fragmentation in
WITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE
WITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE 1 W W W. F U S I ON I O.COM Table of Contents Table of Contents... 2 Executive Summary... 3 Introduction: In-Memory Meets iomemory... 4 What
All Flash Arrays in Healthcare
All Flash Arrays in Healthcare Erik Ottem Director, Product Marketing, Violin Memory eottem@vmem.com Santa Clara, CA 1 Data in Health Care Electronic Records Strong incentives to go electronic Coordinate
VMware Software-Defined Storage & Virtual SAN 5.5.1
VMware Software-Defined Storage & Virtual SAN 5.5.1 Peter Keilty Sr. Systems Engineer Software Defined Storage pkeilty@vmware.com @keiltypeter Grant Challenger Area Sales Manager East Software Defined
IOmark-VM. DotHill AssuredSAN Pro 5000. Test Report: VM- 130816-a Test Report Date: 16, August 2013. www.iomark.org
IOmark-VM DotHill AssuredSAN Pro 5000 Test Report: VM- 130816-a Test Report Date: 16, August 2013 Copyright 2010-2013 Evaluator Group, Inc. All rights reserved. IOmark-VM, IOmark-VDI, VDI-IOmark, and IOmark
Configuring Apache Derby for Performance and Durability Olav Sandstå
Configuring Apache Derby for Performance and Durability Olav Sandstå Database Technology Group Sun Microsystems Trondheim, Norway Overview Background > Transactions, Failure Classes, Derby Architecture
Nutanix Tech Note. Configuration Best Practices for Nutanix Storage with VMware vsphere
Nutanix Tech Note Configuration Best Practices for Nutanix Storage with VMware vsphere Nutanix Virtual Computing Platform is engineered from the ground up to provide enterprise-grade availability for critical
Accelerating Applications and File Systems with Solid State Storage. Jacob Farmer, Cambridge Computer
Accelerating Applications and File Systems with Solid State Storage Jacob Farmer, Cambridge Computer SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise
Desktop Virtualization with VMware Horizon View 5.2 on Dell EqualLogic PS6210XS Hybrid Storage Array
Desktop Virtualization with VMware Horizon View 5.2 on Dell EqualLogic PS6210XS Hybrid Storage Array A Dell Storage Reference Architecture Enterprise Storage Solutions Cloud Client Computing December 2013
Solution Paper. Virtualization security solutions provide a competitive advantage to service providers IaaS, PaaS and SaaS
Solution Paper Virtualization security solutions provide a competitive advantage to service providers IaaS, PaaS and SaaS Contents About this Document...3 Executive Overview...3 Introduction...4 Brief
COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service
COLO: COarse-grain LOck-stepping Virtual Machine for Non-stop Service Eddie Dong, Yunhong Jiang 1 Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE,
VIDEO SURVEILLANCE WITH SURVEILLUS VMS AND EMC ISILON STORAGE ARRAYS
VIDEO SURVEILLANCE WITH SURVEILLUS VMS AND EMC ISILON STORAGE ARRAYS Successfully configure all solution components Use VMS at the required bandwidth for NAS storage Meet the bandwidth demands of a 2,200
The future is in the management tools. Profoss 22/01/2008
The future is in the management tools Profoss 22/01/2008 Niko Nelissen Co founder & VP Business development Q layer Agenda Introduction Virtualization today Server & desktop virtualization Storage virtualization
Xen and XenServer Storage Performance
Xen and XenServer Storage Performance Low Latency Virtualisation Challenges Dr Felipe Franciosi XenServer Engineering Performance Team e-mail: felipe.franciosi@citrix.com freenode: felipef #xen-api twitter:
VDI Without Compromise with SimpliVity OmniStack and Citrix XenDesktop
VDI Without Compromise with SimpliVity OmniStack and Citrix XenDesktop Page 1 of 11 Introduction Virtual Desktop Infrastructure (VDI) provides customers with a more consistent end-user experience and excellent
NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide
Technical Report NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide Carlos Alvarez January 2010 TR-3505 Rev.7 ABSTRACT This guide introduces NetApp deduplication for FAS technology,
Data Backup and Archiving with Enterprise Storage Systems
Data Backup and Archiving with Enterprise Storage Systems Slavjan Ivanov 1, Igor Mishkovski 1 1 Faculty of Computer Science and Engineering Ss. Cyril and Methodius University Skopje, Macedonia slavjan_ivanov@yahoo.com,
EMC FLASH STRATEGY. Flash Everywhere - XtremIO. Massimo Marchetti. Channel Business Units Specialty Sales EMC massimo.marchetti@emc.
EMC FLASH STRATEGY Flash Everywhere - XtremIO Massimo Marchetti Channel Business Units Specialty Sales EMC massimo.marchetti@emc.com Performance = Moore s Law, Or Does It? MOORE S LAW: 100X PER DECADE
Virtual Desktop Infrastructure (VDI) Overview
Virtual Desktop Infrastructure (VDI) Overview October 2012 : EMC Global Services Gary Ciempa, Vinay Patel EMC Technical Assessment for Virtual Desktop Infrastructure COPYRIGHT 2012 EMC CORPORATION. ALL
Enterprise Storage Solution for Hyper-V Private Cloud and VDI Deployments using Sanbolic s Melio Cloud Software Suite April 2011
Enterprise Storage Solution for Hyper-V Private Cloud and VDI Deployments using Sanbolic s Melio Cloud Software Suite April 2011 Executive Summary Large enterprise Hyper-V deployments with a large number
Deduplication in VM Environments Frank Bellosa <bellosa@kit.edu> Konrad Miller <miller@kit.edu> Marc Rittinghaus <rittinghaus@kit.
Deduplication in VM Environments Frank Bellosa Konrad Miller Marc Rittinghaus KARLSRUHE INSTITUTE OF TECHNOLOGY (KIT) - SYSTEM ARCHITECTURE GROUP
SanDisk SSD Boot Storm Testing for Virtual Desktop Infrastructure (VDI)
WHITE PAPER SanDisk SSD Boot Storm Testing for Virtual Desktop Infrastructure (VDI) August 214 951 SanDisk Drive, Milpitas, CA 9535 214 SanDIsk Corporation. All rights reserved www.sandisk.com 2 Table
Storage Solutions to Maximize Success in VDI Environments
Storage Solutions to Maximize Success in VDI Environments Contents Introduction: Why VDI?. 1 VDI Challenges. 2 Storage Solutions Optimized for VDI. 3 Conclusion. 6 Brought to you compliments of: Introduction:
Merge Healthcare Virtualization
Merge Healthcare Virtualization CUSTOMER Merge Healthcare 900 Walnut Ridge Drive Hartland, WI 53029 USA 2014 Merge Healthcare. The information contained herein is confidential and is the sole property
VMware vsphere Data Protection 6.0
VMware vsphere Data Protection 6.0 TECHNICAL OVERVIEW REVISED FEBRUARY 2015 Table of Contents Introduction.... 3 Architectural Overview... 4 Deployment and Configuration.... 5 Backup.... 6 Application
Virtualize Without Compromise. Protecting and Storing Virtualized Data
Virtualize Without Compromise Protecting and Storing Virtualized Data Joseph Castro Douglas Hammer Peter Eicher Siwel Consulting, Inc. NetApp Syncsort August 3, 2010 Agenda Virtualization and Compromise
BEST PRACTICES GUIDE: VMware on Nimble Storage
BEST PRACTICES GUIDE: VMware on Nimble Storage Summary Nimble Storage iscsi arrays provide a complete application-aware data storage solution that includes primary storage, intelligent caching, instant
NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide
Technical Report NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide Carlos Alvarez, NetApp Feb 2011 TR-3505 Version 8 ABSTRACT This technical report covers NetApp deduplication
RevDedup: A Reverse Deduplication Storage System Optimized for Reads to Latest Backups
RevDedup: A Reverse Deduplication Storage System Optimized for Reads to Latest Backups Chun-Ho Ng and Patrick P. C. Lee Department of Computer Science and Engineering The Chinese University of Hong Kong,
DELL. Dell Microsoft Windows Server 2008 Hyper-V TM Reference Architecture VIRTUALIZATION SOLUTIONS ENGINEERING
DELL Dell Microsoft Windows Server 2008 Hyper-V TM Reference Architecture VIRTUALIZATION SOLUTIONS ENGINEERING September 2008 1 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL
Microsoft Hyper-V chose a Primary Server Virtualization Platform
Roger Shupert, Integration Specialist } Lake Michigan College has been using Microsoft Hyper-V as it s primary server virtualization platform since 2008, in this presentation we will discuss the following;
NEXENTA S VDI SOLUTIONS BRAD STONE GENERAL MANAGER NEXENTA GREATERCHINA
NEXENTA S VDI SOLUTIONS BRAD STONE GENERAL MANAGER NEXENTA GREATERCHINA VDI Storage Challenge 95% of I/O is small, random writes Very challenging for a storage system End users demand low latency NexentaStor
Azure VM Performance Considerations Running SQL Server
Azure VM Performance Considerations Running SQL Server Your company logo here Vinod Kumar M @vinodk_sql http://blogs.extremeexperts.com Session Objectives And Takeaways Session Objective(s): Learn the
ISE 820 All Flash Array. Performance Review. Performance Review. March 2015
ISE 820 All Flash Array Performance Review March 2015 Performance Review March 2015 Table of Contents Executive Summary... 3 SPC-1 Benchmark Re sults... 3 Virtual Desktop Benchmark Testing... 3 Synthetic
Storage for VDI Environments
Storage for VDI Environments Planning and Considerations Evaluator Group Inc. Executive Editor: Russ Fellows Analysts: Randy Kerns, John Webster Storage Evaluation Guide Guide Series Series Version 2.0
White Paper. NexentaConnect TM Technology Review
White Paper NexentaConnect TM Technology Review By Alex Aizman and Murat Karslioglu, February 2014 Table of Contents Background... 3 Storage Deployment Options, vmotion and DRS... 4 Local Storage... 5
Dell Compellent Storage Center SAN & VMware View 1,000 Desktop Reference Architecture. Dell Compellent Product Specialist Team
Dell Compellent Storage Center SAN & VMware View 1,000 Desktop Reference Architecture Dell Compellent Product Specialist Team THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL
Leith Automotive Group: Private Hybrid Cloud Enables Company-Wide Desktop Virtualization
Leith Automotive Group: Private Hybrid Cloud Enables Company-Wide Desktop Virtualization David Prince Information Systems Director Leith Automotive Sponsored By: Setting Context: Sponsor Solutions XTREMIO
Investing Strategically in All Flash Arrays
Technology Insight Paper Investing Strategically in All Flash Arrays NetApp s All Flash FAS Storage Systems By John Webster May 2015 Enabling you to make the best technology decisions Investing Strategically
Driving Big Data with OCZ Enterprise SSDs
White Paper Driving Big Data with OCZ Enterprise SSDs Part 2: Delivering the Performance and Management Required for Big Data Applications Scott Harlin Published June 2014 OCZ Storage Solutions, Inc. A
CONSOLIDATING MICROSOFT SQL SERVER OLTP WORKLOADS ON THE EMC XtremIO ALL FLASH ARRAY
Reference Architecture CONSOLIDATING MICROSOFT SQL SERVER OLTP WORKLOADS ON THE EMC XtremIO ALL FLASH ARRAY An XtremIO Reference Architecture Abstract This Reference architecture examines the storage efficiencies
McAfee MOVE / VMware Collaboration Best Practices
McAfee MOVE / VMware Collaboration Best Practices Christie J. Karrels Sales Engineer Federal DoD January 11, 2013 1 P a g e Contents Introduction... 3 Traditional Anti-Malware vs. Optimized Anti-Malware...
EMC AVAMAR. a reason for Cloud. Deduplication backup software Replication for Disaster Recovery
EMC AVAMAR a reason for Cloud Deduplication backup software Replication for Disaster Recovery Bogdan Stefanescu (Bogs) EMC Data Protection Solutions bogdan.stefanescu@emc.com 1 BUSINESS DRIVERS Increase
VNX HYBRID FLASH BEST PRACTICES FOR PERFORMANCE
1 VNX HYBRID FLASH BEST PRACTICES FOR PERFORMANCE JEFF MAYNARD, CORPORATE SYSTEMS ENGINEER 2 ROADMAP INFORMATION DISCLAIMER EMC makes no representation and undertakes no obligations with regard to product
Virtual Desktops at the Speed of Memory
Virtual Desktops at the Speed of Memory A New Storage Approach to Achieve a Responsive User Experience with Scalability to 1,000s of Desktops at a Low TCO July 2013 Executive Summary Virtual Desktop Infrastructure
EMC VFCACHE ACCELERATES ORACLE
White Paper EMC VFCACHE ACCELERATES ORACLE VFCache extends Flash to the server FAST Suite automates storage placement in the array VNX protects data EMC Solutions Group Abstract This white paper describes
RED HAT ENTERPRISE VIRTUALIZATION
Giuseppe Paterno' Solution Architect Jan 2010 Red Hat Milestones October 1994 Red Hat Linux June 2004 Red Hat Global File System August 2005 Red Hat Certificate System & Dir. Server April 2006 JBoss April
Why Choose VMware vsphere for Desktop Virtualization? WHITE PAPER
Why Choose VMware vsphere for Desktop Virtualization? WHITE PAPER Table of Contents Thin, Legacy-Free, Purpose-Built Hypervisor.... 3 More Secure with Smaller Footprint.... 4 Less Downtime Caused by Patches...
SDFS Overview. By Sam Silverberg
SDFS Overview By Sam Silverberg Why did I do this? I had an Idea that I needed to see if it worked. Design Goals Create a dedup file system capable of effective inline deduplication for Virtual Machines
PERFORMANCE STUDY. NexentaConnect View Edition Branch Office Solution. Nexenta Office of the CTO Murat Karslioglu
PERFORMANCE STUDY NexentaConnect View Edition Branch Office Solution Nexenta Office of the CTO Murat Karslioglu Table of Contents Desktop Virtualization for Small and Medium Sized Office... 3 Cisco UCS
Chapter 10: Mass-Storage Systems
Chapter 10: Mass-Storage Systems Physical structure of secondary storage devices and its effects on the uses of the devices Performance characteristics of mass-storage devices Disk scheduling algorithms
Version 2.1. Copyright 2014 DataCore Software Corp. All Rights Reserved. Copyright 2014 DataCore Software Corp. All Rights Reserved.
Version 2.1 VDI Virtual Desktop Infrastructure "Full Featured Virtual desktops are the logical next step to server and storage virtualization." With this approach, all the components and applications are