BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything



Similar documents
June Blade.org 2009 ALL RIGHTS RESERVED

THE EMC ISILON STORY. Big Data In The Enterprise. Copyright 2012 EMC Corporation. All rights reserved.

Application Brief: Using Titan for MS SQL

Introduction to NetApp Infinite Volume

Get Success in Passing Your Certification Exam at first attempt!

10th TF-Storage Meeting

Big data management with IBM General Parallel File System

WHITE PAPER: customize. Best Practice for NDMP Backup Veritas NetBackup. Paul Cummings. January Confidence in a connected world.

ENTERPRISE STORAGE WITH THE FUTURE BUILT IN

Performance, Reliability, and Operational Issues for High Performance NAS Storage on Cray Platforms. Cray User Group Meeting June 2007

Long term retention and archiving the challenges and the solution

EMC ISILON OneFS OPERATING SYSTEM Powering scale-out storage for the new world of Big Data in the enterprise

Hitachi NAS Platform and Hitachi Content Platform with ESRI Image

OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006

SCI Briefing: A Technical Review of Hitachi Unified Storage. Silverton Consulting, Inc. StorInt Briefing

EMC BACKUP MEETS BIG DATA

Business Benefits of Data Footprint Reduction

New Hitachi Virtual Storage Platform Family. Name Date

How To Protect Data On Network Attached Storage (Nas) From Disaster

Enhancements of ETERNUS DX / SF

(Scale Out NAS System)

nexsan NAS just got faster, easier and more affordable.

Symantec NetBackup Appliances

Building Backup-to-Disk and Disaster Recovery Solutions with the ReadyDATA 5200

StoneFly SCVM TM for ESXi

EMC VNX FAMILY. Copyright 2011 EMC Corporation. All rights reserved.

Quantum DXi6500 Family of Network-Attached Disk Backup Appliances with Deduplication

EMC Backup and Recovery for Microsoft SQL Server 2008 Enabled by EMC Celerra Unified Storage

Understanding Enterprise NAS

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

ntier Verde Simply Affordable File Storage

How To Get A Storage And Data Protection Solution For Virtualization

Server and Storage Virtualization with IP Storage. David Dale, NetApp

Using HP StoreOnce Backup Systems for NDMP backups with Symantec NetBackup

Unitrends Recovery-Series: Addressing Enterprise-Class Data Protection

Diagram 1: Islands of storage across a digital broadcast workflow

Storage Design for High Capacity and Long Term Storage. DLF Spring Forum, Raleigh, NC May 6, Balancing Cost, Complexity, and Fault Tolerance

ETERNUS CS High End Unified Data Protection

Protect Microsoft Exchange databases, achieve long-term data retention

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

Lab Validation Report

STORAGE CENTER. The Industry s Only SAN with Automated Tiered Storage STORAGE CENTER

EMC: The Virtual Data Center

Whitepaper. NexentaConnect for VMware Virtual SAN. Full Featured File services for Virtual SAN

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP

How To Use An Npm On A Network Device

Technology Insight Series

Quantum StorNext. Product Brief: Distributed LAN Client

IBM System Storage DS5020 Express

THE SUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

IBM Global Technology Services September NAS systems scale out to meet growing storage demand.

Virtual server management: Top tips on managing storage in virtual server environments

Snapshot Technology: Improving Data Availability and Redundancy

How To Manage A Single Volume Of Data On A Single Disk (Isilon)

Cost Effective Backup with Deduplication. Copyright 2009 EMC Corporation. All rights reserved.

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

Storage Switzerland White Paper Storage Infrastructures for Big Data Workflows

Cisco and EMC Solutions for Application Acceleration and Branch Office Infrastructure Consolidation

The future of Storage and Storage Management Using Virtualization to Increase Productivity. Storyflex VISION 2007 Hans Lamprecht NetApp SEE Vienna

IBM Storwize Rapid Application Storage solutions

Using HP StoreOnce Backup systems for Oracle database backups

Data Domain Overview. Jason Schaaf Senior Account Executive. Troy Schuler Systems Engineer. Copyright 2009 EMC Corporation. All rights reserved.

Best Practices for Managing Storage in the Most Challenging Environments

Business-centric Storage for small and medium-sized enterprises. How ETERNUS DX powered by Intel Xeon processors improves data management

Cloud OS Vision. Modern platform for the world s apps

Efficient Backup with Data Deduplication Which Strategy is Right for You?

WHITE PAPER. Drobo TM Hybrid Storage TM

Key Messages of Enterprise Cluster NAS Huawei OceanStor N8500

Using HP StoreOnce D2D systems for Microsoft SQL Server backups

Enterprise Storage Solution for Hyper-V Private Cloud and VDI Deployments using Sanbolic s Melio Cloud Software Suite April 2011

Virtual Provisioning. Management. Capacity oversubscription Physical allocation on the fly to logical size. With Thin Provisioning enabled

A Virtual Filer for VMware s Virtual SAN A Maginatics and VMware Joint Partner Brief

ACCELERATING YOUR IT TRANSFORMATION WITH EMC NEXT-GENERATION UNIFIED STORAGE AND BACKUP

VERITAS Backup Exec 10 for Windows Servers AGENTS & OPTIONS MEDIA SERVER OPTIONS KEY BENEFITS AGENT AND OPTION GROUPS

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

EMC DATA DOMAIN OPERATING SYSTEM

How To Use The Hitachi Content Archive Platform

IBM Tivoli Storage Manager

ETERNUS Storage Systems. Fujitsu America Inc

POWER ALL GLOBAL FILE SYSTEM (PGFS)

IBM Tivoli Storage Manager Version Introduction to Data Protection Solutions IBM

E4 UNIFIED STORAGE powered by Syneto

Business Process Desktop: Acronis backup & Recovery 11.5 Deployment Guide

Optimizing IT Data Services

Scala Storage Scale-Out Clustered Storage White Paper

WHY DO I NEED FALCONSTOR OPTIMIZED BACKUP & DEDUPLICATION?

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration

Introduction to Data Protection: Backup to Tape, Disk and Beyond

The BIG Data Era has. your storage! Bratislava, Slovakia, 21st March 2013

Software-defined Storage

Evaluation of Enterprise Data Protection using SEP Software

NetApp SnapMirror. Protect Your Business at a 60% lower TCO. Title. Name

Kaminario K2 All-Flash Array

How To Make A Backup System More Efficient

NetVault Backup, NDMP and Network Attached Storage

Transcription:

BlueArc unified network storage systems 7th TF-Storage Meeting Scale Bigger, Store Smarter, Accelerate Everything

BlueArc s Heritage Private Company, founded in 1998 Headquarters in San Jose, CA Highest Performing NAS Server in the Industry Proven in the most demanding C HPC environments 6 th Generation Product Patented Hardware Accelerated Architecture Doubled performance and scale with each release

Storage Challenges Everyone needs to: Increase Delivered Performance and Capacity Scale for breakthrough differentiation Control Complexity and Simplify Administration Connect and manage thousands of elements Automate administration and optimization with smarter tools Achieve Cost Effectiveness and Reliability at Scale Optimize for the right technology use in the right place Meet space, power and cooling constraints 3 2010 BlueArc Corp. Proprietary and Confidential

Administration Work Flow in Higher Education / Academic Research Control Costs Optimize and consolidate Manage complexity $$$ and simplify administration Theoretical Models Instruments, Experiments Historical data Exponential Growth Combining new and existing data for analysis Many Researchers That Collaborate Information needs to be shared quickly without problems Long-term Archive Permanent Storage Campus / Worldwide Researchers Expedite Analysis Need to match performance of faster compute cluster Computational Cluster with Workspace Storage 4 2010 BlueArc Corp. Proprietary and Confidential

BlueArc s Technology Framework - Removes Data Storage Barriers Platforms SiliconFS File System Software Storage Ecosystem SAN 5 2010 BlueArc Corp. Proprietary and Confidential

BlueArc s File System: SiliconFS Common point of integration for all elements of a storage solution The central engine that manages all data movement Simultaneous access to native CIFS, NFS and iscsi Maps storage assets to applications, virtual clients or data life cycle Comprehensive virtualization tool set simplifies administration of file system Spans physical nodes, virtual servers and external devices Has advanced Metadata Optimization 6 2010 BlueArc Corp. Proprietary and Confidential

Metadata Optimization NEW! Cost-efficient performance is achieved by moving disk-intensive metadata ops to a high-speed storage tier Metadata operations can be 50% of all FS operations Lower cost SATA or NL-SAS for user data, 15K SAS or SSD for metadata Traditional file system all data on single storage Tier Multi tier file system Meta data and User data split Tier 1 High Speed SAS Disks Meta Data & User Data Meta Data Small Reads & Writes User Data Larger Reads & Writes Tier 0 High Speed SSD or SAS Disks Tier 1 Lower Cost NL-SAS or SATA Disks 7 2010 BlueArc Corp. Proprietary and Confidential

What is Metadata Focus on two types of metadata: Administrative metadata - This is essentially technical information about the data UNIX and/or Windows properties such as permissions/acls Ownership attributes Creation, modification and access dates and times Directories and their properties. Structural metadata - This is information about how the data is organized on the storage media. In the context of BlueArc SiliconFS this is object data as well as free space bitmaps and other object properties For more information about the structure and technology behind BlueArc file system see the SiliconFS whitepaper. 8 2010 BlueArc Corp. Proprietary and Confidential

Benefits of Metadata Optimization Nearly every file system operation requires metadata Maintaining fast access to this metadata has a direct impact on performance. BlueArc servers use dedicated Metadata caches with very aggressive caching algorithms Metadata Optimization helps with: Minimize impact of metadata cache miss: Accelerated service of cache requests Quicker access to metadata on fast storage Maximize writing metadata to storage: Faster metadata writes with more efficient checkpoint process Higher efficiency when writing metadata & data in parallel to different tiers 9 2010 BlueArc Corp. Proprietary and Confidential

Where will Metadata Optimization help? Metadata Optimization can benefit many different applications & workloads. Heavy metadata workloads with a lot of metadata cache miss Write workloads that are metadata intensive BlueArc Replication, Tape Backup, and Data Migrator Directory listings with cold cache (significant benefit on directories with many files) Aged file systems (fragmented free space can cause more metadata random write IO) 10 2010 BlueArc Corp. Proprietary and Confidential

Implementing Metadata Optimization A Metadata Optimized Storage Pool contains two tiers of disk LUNs are designated as either tier 0 or tier 1 when the pool is created Tier 0 is considered fast storage, such as SSD or SAS drives Tier 1 is slower and denser storage, such as NLSAS/SATA Metadata is nearly always required for file system operations, separating it onto fast storage can greatly improve the responsiveness of the server. Isolating metadata IO (particularly write IO) from data IO can also improve performance of tier 1 storage due to the reduced workload on the disks. 12 2010 BlueArc Corp. Proprietary and Confidential

SAN Platforms Storage Ecosystem Titan 3200 Platforms Titan 3100 Information Services Mercury 100 SiliconFS File System Mercury 50 2010 BlueArc Corp. Proprietary and Confidential 13

Platform comparison Mercury 50 Mercury 100 Titan 3100 Titan 3200 Product Class Lower Mid-range Mid-range High End Cluster Nodes 2 Up to 4 Up to 8 Max Storage Capacity 4 PB 8 PB 8 PB Max File System Size 256 TB 256 TB 256 TB NFS Throughput 700 MB/s 1100 MB/s 1200 MB/s Performance (Ops/Sec) 40,137 SPECsfs 2008 72,921 SPECsfs 2008 96,428 SPECsfs 97 High End Up to 8 16 PB 256 TB 1500 MB/s 194,909 SPECsfs 97 Storage Options Software / File Services Multiple options from several manufacturers are available with each platform All software and file system options (NFS, CIFS, iscsi) available 2010 BlueArc Corp. Proprietary and Confidential

Software Platforms SiliconFS File System Software Storage Ecosystem SAN 15 2010 BlueArc Corp. Proprietary and Confidential

BlueArc Software Data Management Data Protection Virtualization Intelligent Tiered Storage Policy Based Data Migration and Replication Support with External Storage Devices Dynamic Read Caching Active/Active and Campus Clustering Instant File System Recovery from Snapshots Synchronous and Asynchronous Replication Backup and Recovery iscsi block access Global Name Space Secure virtual storage servers Virtual Volumes Storage pools with thin provisioning 16 2010 BlueArc Corp. Proprietary and Confidential

DATA MANAGEMENT 17 2010 BlueArc Corp. Proprietary and Confidential

Intelligent Tiered Storage Cluster or Server Farm The seamless migration of data across storage tiers within a single infrastructure to ease management and reduce cost Network Storage Cluster SAN Tier 3 Deduplication Compliance Existing NAS Automatic and transparent data migration between tiers Rules based policy engine reduces manual intervention Third party or external storage devices as an integrated tier Tier 0 Solid State Cache Tier 1 High Performance Tier 2 High Capacity Reduce dependence on high performance tier for peak demand 18 2010 BlueArc Corp. Proprietary and Confidential

Dynamic Read Caching Read Caching Dynamically copies files to a high performance storage tier for use across physical or virtual servers during periods of peak demand. Copy1 Copy2 Copy3 Copy4 Aggregated bandwidth and faster response time for read intensive applications Less capacity for faster tiers required to maintain performance reducing cost Files can be cached from external devices within the namespace including de-dupe or stranded filers Fast Slow Policy based management eliminates manual intervention Copy Ideal for vertical markets with read intensive applications or unpredictable demand like ediscovery, Entertainment, Internet Services, and Life Sciences 22 2010 BlueArc Corp. Proprietary and Confidential

25 2010 BlueArc Corp. Proprietary and Confidential DATA PROTECTION

Clustering High Availability (HA) clustering Two-node Active/Active configuration or N-way (three to eight nodes) clustered configuration Scale one node at a time to quickly and flexibly grow with the business 26 2010 BlueArc Corp. Proprietary and Confidential

Snapshots Snapshots for point-in-time copies of the file system, policy based automation, manually, scripted or event driven File System Recover from Snapshots Rollback to intact file system even if live file system is inconsistent Depending on the size of the file system, rollback can be nearly instantaneous 28 2010 BlueArc Corp. Proprietary and Confidential

Snapshots Snapshot View #2 Cumulative History BlueArc snapshot methods use references to create a cumulative file system history with multiple views without data duplication Snapshot View #1 Live File System Highly efficient ~1 second granularity with no performance or storage penalty Object-based file system Hardware acceleration Instantaneous data recovery Can be integrated into data migration, replication, or backup policies 29 2010 BlueArc Corp. Proprietary and Confidential

File Based Replication Multi-stream, concurrent replication streams deliver high performance Leverages inherent snapshot and NDMP (backup and recovery) capabilities Replication of the file system, directory, virtual volume, or snapshot level for granularity Preserves user/group permissions and quota information Policy-based management and scheduling 30 2010 BlueArc Corp. Proprietary and Confidential

High Speed Replication Allows administrators to create one or more identical copies of data while keeping the source and targets synchronized. Complements existing file-based replication Disaster recovery Data archival ( remote snapshots ) Asynchronous replication over standard IP networks Server to server over LAN or WAN LAN-free replication if source and target are both connected to the same server Snapshot based file replication technology Object based for optimal performance Full or incremental copies Multiple concurrent streams Only copies changed blocks Preserves NFS and CIFS file attributes Preserves NFS handles Data compression over WAN (future) Automated rule based scheduler One time, recurring, continuous 32 2010 BlueArc, Corp. Proprietary and Confidential.

Backup LAN-free backup to tape via NDMP Integration with all major 3 rd party data protection suites 34 2010 BlueArc Corp. Proprietary and Confidential

35 2010 BlueArc Corp. Proprietary and Confidential VIRTUALIZATION

Virtualization Framework Virtual File System Global Name Space with single root Virtual File System unifies directory structure and presents a single logical view Virtual Servers Network Storage Cluster Multiple Virtual Servers per Node Virtual Servers allocate server resources for performance and high availability Virtual Storage Pools Storage Pool File System File System Storage Pool File System Virtual Volumes Multiple dynamic Virtual Volumes per File System Multiple File Systems Per Storage Pool Virtual Storage pools simplify storage provisioning for applications and workgroups Virtual Tiered Storage Parallel RAID Striping Virtual tiered storage optimizes performance, high availability and disk utilization across physical disk arrays 36 2010 BlueArc Corp. Proprietary and Confidential

Virtual File System - Global Namespace Company Geography Department CIFS and NFS Clients Creates a global namespace with a virtual unified directory structure for multiple file systems within a single Titan or across multiple Titans in a cluster. File System One File System Two Simplified Management Single, unified directory structure Logical, user friendly names Persistent after physical infrastructure changes Alter and migrate file systems without user disruption Universal access to data with NFS and CIFS support 37 2010 BlueArc Corp. Proprietary and Confidential

Secure Virtual Servers Security Policies Virtual Servers VLAN-1 Network-1 VLAN-2 VLAN-3 Network-2 VLAN-4 Company A Company B Company C Company D Mercury or Titan Cluster Enables single Titan/Mercury or clusters to span multiple network domains and assign different security policies to each Virtual Server Sets Security Profile by EVS Authentication Permissions Name services File System Access Control Very useful for multi-tenant environments or large enterprises with multiple independent departments 38 2010 BlueArc Corp. Proprietary and Confidential

Virtual Volumes Creates a logical sub-set of a file system independent of physical disk type, location or capacity. Enhanced Security Virus scanning, access based enumeration, auditing, file blocking, etc. Simplified Management Dynamic expansion or contraction via quotas or policies. Increased Storage Utilization Allows oversubscription at volume or file system level for thin provisioning Storage added as needed without over provisioning 39 2010 BlueArc Corp. Proprietary and Confidential

Virtual Storage Pools File System1 File System2 Logical Storage Pool RAID Sets File System3 Un-allocated Free Space Creates a logical storage pool of shared storage that one or more file systems and servers can pull from. Lower Capacity Costs Dynamically allocates storage to file systems and manages free space, optimizing disk utilization Simplified Management Virtualizes RAID sets Easier provisioning as file systems expand as needed by drawing from a common storage pool Improved Performance Increases throughput by aggregating the performance of multiple drives 40 2010 BlueArc Corp. Proprietary and Confidential

Storage Ecosystem Platforms SiliconFS File System Software Storage Ecosystem SAN 41 2010 BlueArc Corp. Proprietary and Confidential

Storage Ecosystem Clustering and Global Namespace Switched fabric SAN enables shared storage SAN Tier 3 De-dupe Archive / Compliance Competitive Filers Integrated third party storage devices Tier 0 Solid State Cache Tier 1 High Performance FC Disk SAS 15k Disk Tier 2 High Capacity SATA Disk Nearline SAS Disk Tier 4 Tape or VTL Archive Encryption Best in class, tiered storage optimized for different tasks 42 2010 BlueArc Corp. Proprietary and Confidential

BlueArc for Higher Education: Storage Solutions for Your Needs Exponential growth in data BlueArc scales to Petabytes of data, with easy upgrades Increasing pressure to reach conclusions faster High bandwidth cluster connection, automatic load balancing Many researchers that collaborate Stability and reliable high performance through crunch times Results available in single name space for easy sharing Control costs Automatic and policy based administration Consolidate and leverage existing storage systems Save on power and cooling with fewer systems 43 2010 BlueArc Corp. Proprietary and Confidential

Thank You! For more information: www.bluearc.com