Scale out NAS on the outside, Object storage on the inside



Similar documents
Long term retention and archiving the challenges and the solution

The Design and Implementation of the Zetta Storage Service. October 27, 2009

Software Defined Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation

Cloud Optimize Your IT

MaxDeploy Hyper- Converged Reference Architecture Solution Brief

Big data Devices Apps

Understanding Enterprise NAS

VMware Software-Defined Storage Vision

Scala Storage Scale-Out Clustered Storage White Paper

Scality Conversations (Episode 3) Ever Evolving Data Center Hardware. Leo Leung, VP of Corporate Marketing

(Scale Out NAS System)

Mit Soft- & Hardware zum Erfolg. Giuseppe Paletta

Introduction to NetApp Infinite Volume

Dell Converged Infrastructure

5 Ways to Ensure Data Availability

New Hitachi Virtual Storage Platform Family. Name Date

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

Caringo Swarm 7: beyond the limits of traditional storage. A new private cloud foundation for storage needs at scale

Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

Getting performance & scalability on standard platforms, the Object vs Block storage debate. Copyright 2013 MPSTOR LTD. All rights reserved.

Implementing Multi-Tenanted Storage for Service Providers with Cloudian HyperStore. The Challenge SOLUTION GUIDE

BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything

Storage Architectures for Big Data in the Cloud

Backup and Recovery Redesign with Deduplication

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

WOS OBJECT STORAGE PRODUCT BROCHURE DDN.COM Full Spectrum Object Storage

Data Domain Overview. Jason Schaaf Senior Account Executive. Troy Schuler Systems Engineer. Copyright 2009 EMC Corporation. All rights reserved.

Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen

A Virtual Filer for VMware s Virtual SAN A Maginatics and VMware Joint Partner Brief

Seagate Cloud Systems & Solutions

WOS. High Performance Object Storage

Diagram 1: Islands of storage across a digital broadcast workflow

THESUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

The Convergence of Software Defined Storage and Physical Appliances Hybrid Cloud Storage

Best Practices for Managing Storage in the Most Challenging Environments

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

EMC DATA DOMAIN OVERVIEW. Copyright 2011 EMC Corporation. All rights reserved.

Nutanix Tech Note. Configuration Best Practices for Nutanix Storage with VMware vsphere

StorReduce Technical White Paper Cloud-based Data Deduplication

WHITE PAPER. Software Defined Storage Hydrates the Cloud

Building Storage Service in a Private Cloud

M710 - Max 960 Drive, 8Gb/16Gb FC, Max 48 ports, Max 192GB Cache Memory

Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V. Jose Barreto Principal Program Manager Microsoft Corporation

5 Ways to Make Your Data Storage Easy to Manage

IBM ELASTIC STORAGE SEAN LEE

Maxta Storage Platform Enterprise Storage Re-defined

THE FUTURE OF STORAGE IS SOFTWARE DEFINED. Jasper Geraerts Business Manager Storage Benelux/Red Hat

Four Reasons To Start Working With NFSv4.1 Now

How To Manage A Single Volume Of Data On A Single Disk (Isilon)

Windows Server 2012 授 權 說 明

OPTIMIZING PRIMARY STORAGE WHITE PAPER FILE ARCHIVING SOLUTIONS FROM QSTAR AND CLOUDIAN

Analyzing Big Data with Splunk A Cost Effective Storage Architecture and Solution

HyperQ Storage Tiering White Paper

Extending the Power of Your Datacenter

Big data management with IBM General Parallel File System

Large Scale Storage. Orlando Richards, Information Services LCFG Users Day, University of Edinburgh 18 th January 2013

SMB Direct for SQL Server and Private Cloud

Efficient Backup with Data Deduplication Which Strategy is Right for You?

Get Success in Passing Your Certification Exam at first attempt!

Clodoaldo Barrera Chief Technical Strategist IBM System Storage. Making a successful transition to Software Defined Storage

Cloud OS Vision. Modern platform for the world s apps

Next Generation Backup Solutions

THE SUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

EMC DATA DOMAIN OPERATING SYSTEM

EMC - XtremIO. All-Flash Array evolution - Much more than high speed. Systems Engineer Team Lead EMC SouthCone. Carlos Marconi.

EMC DATA DOMAIN OPERATING SYSTEM

EMC BACKUP MEETS BIG DATA

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved.

5 Ways to Cut the Cost of Storage

HP Adaptive Backup and Recovery

Object Storage: A Growing Opportunity for Service Providers. White Paper. Prepared for: 2012 Neovise, LLC. All Rights Reserved.

RUBRIK CONVERGED DATA MANAGEMENT. Technology Overview & How It Works

EMC Data de-duplication not ONLY for IBM i

Nimble Storage + OpenStack 打 造 最 佳 企 業 專 屬 雲 端 平 台. Nimble Storage Brian Chen, Solution Architect Jay Wang, Principal Software Engineer

Transforming your Datacenter with Nimble Storage. Stephen D Amore, Senior Systems Engineer Nordics

DISASTER RECOVERY WITH AWS

(R)Evolution im Software Defined Datacenter Hyper-Converged Infrastructure

Hadoop & its Usage at Facebook

ntier Verde Simply Affordable File Storage

efficient protection, and impact-less!!

TRANSFORMING DATA PROTECTION

Whitepaper. NexentaConnect for VMware Virtual SAN. Full Featured File services for Virtual SAN

Protect Data... in the Cloud

ENABLING GLOBAL HADOOP WITH EMC ELASTIC CLOUD STORAGE

Top 5 Storage Challenges for Mid-size Businesses and How Exablox Can Help Solve Them

Top 10 Things You Always Wanted to Know About Automatic Storage Management But Were Afraid to Ask

Intro to AWS: Storage Services

StorPool Distributed Storage Software Technical Overview

Common. Next Generation Backup for IBMi. EMC Laurent Piguet Peter Wirth. Crowne Plaza 24 Septembre 2013

Apache Hadoop FileSystem and its Usage in Facebook

Maginatics Cloud Storage Platform A primer

ABC of Storage Security. M. Granata NetApp System Engineer

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS

HADOOP SOLUTION USING EMC ISILON AND CLOUDERA ENTERPRISE Efficient, Flexible In-Place Hadoop Analytics

Transcription:

Exablox Company and Business Update Douglas Brockett, CEO Launched April 2013 (Founded 2010) OneBlox - scale-out storage for the enterprise - converged storage for primary and backup / archival data OneSystem - manage on-premises storage exclusively from anywhere - visibility, control, and security without cost / complexity of traditional management 100+ customers, 30+ billion objects typical customer had 50TB a few years ago, now they need 200TB and 3x performance. And in a few years, they re going to need 800TB and 10x performance if we could reimagine storage - what would it look like? scale out dedupe snapshot replicate be simple yet powerful be managed from everywhere Unique Architecture [photo] Nearly POSIX-compliant file system on top of an object store Scale out NAS on the outside, Object storage on the inside Stanadrardized access (SMB / NFS) horizonal scaling multiple copy protection advantages of traditional NAS - suited for dynamic, transactional data - simple, traditional data access - compatible with current enterprise apps with broad applicability advantages of object storage - excellent scalability - simple storage mgmt with unified storage access - data management features such as inline dedupe, encryption - automatic OneBlox only exablox provides - scale-out dedupe - scale-out continuous snapshots

- scale-out RAID-less capacity - scale-out site-to-site DR - bring any drive - one at a time at retail pricing Auto-clustering - each node adds - capacity - performance - resiliency Appliance - 8 * 3.5 drive bays - up to 48 raw TB - SATA & SAS, mix and match OneSystem https://onesystem.exablox.com - subscription SaaS - Multi-tenant - VARs, MSPs, Departments - workflow - point-n-click, drag-n-drop, directly actionable - storage mgmt - provision, manage, monitor, trending, subscribe Exablox - combines the web scale scale out approach with plug and play app compatibility - combines off the shelf appliance with bring your own drive economics - smashes the $/TB, initial cost, $/Feature and TCO barriers for enterprise storage Powerful, simple, protected OneSystem Tad Hunt, CTO & Co-founder Technology Vision SDS + Storage mgmt - manage policy, not technology - SDS wrapped in tin for the mid market - Eliminate complexity - PnP - Next Gen features NAS features atop object storage - without metadata servers - without bolt on NAS gateways - without separate data and metadata servers - scale capacity, performance, or resilience: just add a node Intellectual Property - cloud based management - distributed filesystems - distributed object storage systems Technology Benefits Create scale out NAS + object clusters atop mixed media - HDD, SSD, Shingled drives Deliver benefits of object storage technology to traditional apps - standard file protocols

- eliminate forklift upgrade - single namespace across the scale of the cluster RAID free data protection - self-healing from multiple drive and node failures - rebalancing time proportional to quantity of objects on the failed drive - mix and match drive types, capacities, technologies - introduce next gen drives without long validation cycles Ability to scale capacity from TB to PB easily - zero config expansion - manage from anywhere Able to support all NAS workloads well - other object stores designed primarily for large files - OneBlox 3308: 1B objects 1/4 the memory needed per TB of capacity Ease of Use - all nodes perform all functions: storage, control, NAS interface - single failure domain - node OneSystem [photo] Features and Benefits (FCAPS) Fault Monitoring - zero config email alerts - fine grained, actionable intelligence: Replace the drive in slot 5 - predictive failure intelligence gathered across global customer base Configuration Management - policy based rather than tech based - Exablox manages config backups, tracks changes, etc - simple: creating a DR replica is a drag-and-drop operation Accounting - usage tracking - report generation - facilitates billing for subscription storage services Performance Management - global install base telemetry - capacity and utilisation trending - hotspot identification - predictive analytics Security Management - AD configuration - cross organisational views, drilling down to individual drives - fine-grained, hierarchical admin rights - audit trails need OneSystem connectivity to perform upgrades Management in the cloud, data on-premises User-initiated upgrades

OneBlox FileSystem SmashFS Featues and Benefits Protocol SMB - NAS + Backup NFS - NAS + Virtualisation + Backup Distributed Filesystem POSIX + Snapshots - NAS Global Namespace - Reduced operational complexity RAFT / Consensus - zero-config cluster management + scale-out Distributed Object Store Small Objects - NAS + Deduplication + IoT Content Addressability - Deduplication, snapshot, object migration Consistently Hashed - scale-out + fast repair High-level OneSystem Overview [photo - SFD7_Day3_Exablox_OneSystem_Overview_High-level_Architecture] Global Namespace Ring-wide POSIX semantics - managed via Conspiracy Per Share - policies - features - workload specific layouts No filesystem limits - unlimited nodes - unlimited user data objects - billions of objects per node! Shared nothing - no dedicated metadata server - peer to peer object and metadata distribution Ring to Ring replication - snapshot based - WAN optimised Raft Consensus Manager - Conspiracy Enables Large Clusters - robust failover - automatic discovery and growth - manages ring membership (nodes, drives) Manages Persistent Configuration - users, groups - shares - Encryption keys Manages Volatile Operational States - Lock state - namespace delegations - drive telemetry - environmental state (RPM, temps)

Manages Persistent Operational State - snapshot state - Drive membership CDP Snapshots Inline CDP Snapshots Reduplicated against - live filesystem - all other snapshots End user access via virtual namespace hierarchy Per share snapshot policies Snapshot replication - Async snapshot-by-snapshot WAN optimised On demand Promotion - R/O >> R/W is O(1) OneBlox - Object Store Object Distribution Object Router - Multiplexes objects across constituent ODBs - Manages object durability - Manages object lifetimes Object Database - Persistently stores objects and Attributes - represents a replica of a shard Benefits dedupe data protection shared-nothing, scale-out architecture Consistent Hashing and Content Addressability It starts with objects - objects have a key, and a value - the value is the content Consistent Hashing - Maps the key to a database shard via a function Content Addressability - Generates the key via a function applied to the object data - Same data -> Same key - Different Data -> different key Why do we care? - no need for metadata servers - deduplication - end-to-end data integrity Consistent Hashing - Exablox Style Hash function - cryptographic hash

- good distribution Shards - dynamically assigned to ODBs based on ODB capacity - Mapping stored in Conspiracy Store - Hash(Key) -> Shard - Write data to the ODB - Write replicas to adjacent shards Retrieve - Hash(Key) -> Shard - Retrieve data from the device connected to the shard Recover - Assign failed shard to a replica device - Rebalance Object DB Journal Fast, persistent attribute DB - key for enabling dedupe - key to scalable garbage collection and object iteration across huge clusters Append only journal - key to supporting converged primary and backup workloads - enables high performance sequential and random writes and overwrites - enables continuous snapshots - co-residing data and metadata enables small files performance avoiding seeks OneBlox and OneSystem Demo Sean Herrington, Senior Director Product Management Typical power usage is 100W for a fully loaded system Embargo Section