Netapp HPC Solution for Lustre. Rich Fenton UK Solutions Architect

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Netapp HPC Solution for Lustre. Rich Fenton (fenton@netapp.com) UK Solutions Architect"

Transcription

1 Netapp HPC Solution for Lustre Rich Fenton UK Solutions Architect

2 Agenda NetApp Introduction Introducing the E-Series Platform Why E-Series for Lustre? Modular Scale-out Capacity Density Management features Reference Architecture 2

3 NetApp At a glance Broad solutions portfolio Industry-leading partners Leading OEM storage provider 12,000+ employees Comprehensive professional services Global support 150+ offices around the world Member of the Fortune 500 Founded in 1993, Sunnyvale CA $6B $5B $4B $3B $2B $1B '05 '06 '07 '08 '09 '10 '11 '12 3

4 Scale Challenges in Two Domains Content Analytics Bandwidth 4

5 Big Data Workload Targets Stronger Bias For Scalability/BW Higher Resiliency & IOP/Perf Bias HPC Hadoop Tech Comp FMV Media & Ent DSS/DW Collab Shared IT App Dev Tier-2 BP StorageGRID IT Infra Enterprise Repositories Active Archives Stronger Bias For Simplicity & Cost Larger Capacity & Density Bias NetApp Confidential - Internal Use Only 5

6 Current Big Data Solutions NetApp Open Solution For Hadoop Increase competitive advantage with insights from your own data HPC: Seismic Processing Accelerate time to results with scalable bandwidth, unmatched density, and proven reliability Full Motion Video Ingest, Exploit and Disseminate life saving information faster HPC: Lustre Massively scalable solution for large scale cluster computing Media Content Management Improve your media workflows to better monetize your content Content Repository (Object Storage) Make informed decisions by leveraging more data from longer periods of time NetApp Confidential - Internal Use Only 6

7 Current E-Series Platforms NetApp Confidential - NDA Required 7

8 Drive Enclosure Components DE5600 2U / 24 / 2.5 SAS HDD and SSD Fully redundant Use for highest bandwidth, highest IOPs, moderate capacity DE1600 2U / 12 / 3.5 SAS & NL-SAS HDD Fully redundant Use for moderate bandwidth, moderate IOPs, high capacity DE6600 4U / 60 / 3.5 and 2.5 SAS & NL-SAS and SSD Fully redundant Use for highest bandwidth, high IOPs, highest capacity 8

9 DE6600 Drive Enclosure High-density disk shelf supporting up to 60 SAS drives 5 horizontal drawers with 12 drives per drawer Just 4U in height and fits standard 19 rack Up to 180 TB capacity with 3TB 7.2K SAS drives Superior RAS Drives remain online when drawer is extended for service Individual drawer extension and front access enables safer drive replacement 80 plus high efficiency power supplies Up to 10% reduction in power/cooling Optimal for RAID 6 layout 6 x (8+2)

10 Storage System Controllers & ESM 5400 Controller FC or IB host attach Up to 16 x 8Gb/s FC ports or 4 x 40Gb/s IB per dual controller system Up to 24GB cache memory per dual controller system Rich RAID feature set, including T10 PI 3.1GB/s writes, 350K 4K read IOPs SSD per dual controller system Use for highest bandwidth and highest IOPs 2600 Controller SAS, FC or iscsi host attach Up to 4 x 6 x 6Gb/s SAS, 8 x 8Gb/s FC, 2 x 10Gb/s GE iscsi, 8 x 1GE iscsi Up to 8GB memory per dual controller system Rich RAID feature set, including T10 PI 1.4GB/s writes, 70K 4K read IOPs SSD per dual controller system Use for balanced price/performance ESM Non-RAID, electronic card installed in drive enclosure when used as JBOD SAS 2.0 NetApp Confidential - NDA Required 10

11 Start Small Grow Big Front View Rear View Scale capacity by adding drive enclosures (e.g. DE6600) Scale bandwidth by adding systems (e.g. E5460) E5460 Dual Controller System 2 x E5460 Or 1 x E x DE x E5460 Or 1 x E x DE x E5460 Or 1 x E x DE x E5460 Or 1 x E x DE x E5460 Or 1 x E x DE x E x Controller or 2 x ESM Drives (n) 60 drives Capacity (TB) Bandwidth when scaling drive enclosures (GB/s, writes) Bandwidth when scaling systems (GB/s, writes) NetApp Confidential - Internal and Partner Use Only 11

12 Linear Scaling with E5424 Scale bandwidth by adding systems (E5424) Scale capacity by adding drive enclosures (DE5600) Front View Rear View 2 x 5400 Controller or 2 x ESM E5424 Dual Controller System 1 x E x E5424 or 1 x E x DE x E5424 or 1 x E x DE x E5424 or 1 x E x DE x E5424 or 1 x E x DE x E5424 or 1 x E x DE5600 Drives (n) Capacity (TB) Bandwidth when scaling systems (GB/s, writes)* Bandwidth when scaling drive enclosures (GB/s, writes)*

13 SANtricity Management 13

14 DDP Overview DDP dynamically distributes data, spare capacity, and protection information across a pool of drives Intelligent algorithm defines which drives should be used for segment placement (7 patents pending) Segments are dynamically recreated/redistributed as needed to maintain balanced distribution Significantly faster return to optimal state following a drive failure (all drives participate in reconstruction) NetApp Confidential - Limited Use

15 Traditional RAID Volumes Disk drives organized into RAID groups Volumes reside across the drives in a RAID group Performance is dictated by number of spindles Hot spares sit idle until a drive fails Spare capacity is stranded 24-drive system with (2) 10-drive groups (8+2) and (4) hot spares NetApp Confidential - Limited Use

16 Traditional RAID Drive Failure Data is recreated on hot spare Single drive responsible for all writes (bottleneck) Recreation happens linearly (one stripe at a time) All volumes in that group are significantly impacted 24-drive system with (2) 10-drive groups (8+2) and (4) hot spares NetApp Confidential - Limited Use

17 DDP Volumes Each volume s data, protection information and spare capacity is distributed across all drives in disk pool All drives are active; none are idle Spare capacity is available to all volumes 24-drive system with single 24-drive pool NetApp Confidential - Limited Use

18 DDP Drive Failure Data is reconstructed throughout the disk pool All drives share responsibility for writes Operations run in parallel Up to 10X faster return to optimal condition drive system with single 24-drive pool NetApp Confidential - Limited Use

19 Performance Consistent Performance Delivering consistent performance to maintain SLAs Stay in the green zone Performance drop is minimized following drive failure Significantly faster (up to 10X) return to optimal state following a drive failure Large pool of spindles for every volume reduces hot spots Each volume spread across all drives in pool Dynamic distribution/redistribution is a non-disruptive background operation Performance Impact of a Drive Failure Optimal Acceptable Time DDP RAID Rebuild NetApp Confidential - Limited Use

20 Data Protection Unmatched protection against drive failures and errors Shorter rebuild times reduces exposure to multiple cascading disk failures All drives participate in the dynamic rebuild resulting in up to 10X faster return to optimal state Any stripes experiencing multiple drive failures are given reconstruction priority Protects against unrecoverable media errors during reconstruction Provides significant improvement in data protection Larger pool provides even greater protection Time DDP Dynamic Rebuild RAID Rebuild NetApp Confidential - Limited Use

21 E-Series with Lustre NetApp Confidential - NDA Required 21

22 Why E-Series for Lustre High Bandwidth 3GB/s writes in 4U 30GB/s writes in 40U High Density 180TB per 4U 1.8PB per 40U rack High Availability DDP? Serviceability Lustre Support 22

23 HPC Solution for Lustre Configuration 23

24 HPC Solution for Lustre Configuration 24

25 Lustre on E-Series References LLNL 55PB E-Series on Lustre 1TB/s Sequoia Worlds Largest Supercomputer Lund University Sweden Genomic Data 200TB 3GB/s 25

26 Whamcloud NetApp provide level 1 & level 2 support Worldwide support for Lustre Bug fixes / patches Contract to develop features Installation / Deployment Training 26

27 More information 27

28

Dynamic Disk Pools Delivering Worry-Free Storage

Dynamic Disk Pools Delivering Worry-Free Storage Dynamic Disk Pools Delivering Worry-Free Storage Dr. Didier Gava EMEA HPC Storage Architect MEW Workshop 2012 Liverpool, Germany Historic View Of RAID Advancement RAID 5 1987 Single disk failure protection

More information

Worry-free Storage. E-Series Simple SAN Storage

Worry-free Storage. E-Series Simple SAN Storage Worry-free Storage E-Series Simple SAN Storage 1 What are Midsize Businesses Struggling with Today? #1 pain point: managing data growth (62%)* #2 pain point: managing costs (33%)* 52% view poor storage

More information

200 flash-related. petabytes of. flash shipped. patents. NetApp flash leadership. Metrics through October, 2015

200 flash-related. petabytes of. flash shipped. patents. NetApp flash leadership. Metrics through October, 2015 NetApp flash leadership Metrics through October, 2015 ~ 125 petabytes of 200 flash-related ~ flash shipped patents flash shipped in last 3 quarters hybrid systems shipped all-flash systems shipped 17 2014

More information

How E/EF-Series can help solve HPC Challenges MEW25 3 rd December 2014

How E/EF-Series can help solve HPC Challenges MEW25 3 rd December 2014 How E/EF-Series can help solve HPC Challenges MEW25 3 rd December 2014 Mohinder Toor Business Development Executive NEMEA E-Series Sales and Product Specialist Emerging Products Group 1 2014 NetApp, Inc.

More information

NetApp High-Performance Computing Solution for Lustre: Solution Guide

NetApp High-Performance Computing Solution for Lustre: Solution Guide Technical Report NetApp High-Performance Computing Solution for Lustre: Solution Guide Robert Lai, NetApp August 2012 TR-3997 TABLE OF CONTENTS 1 Introduction... 5 1.1 NetApp HPC Solution for Lustre Introduction...5

More information

Moving Beyond RAID DXi and Dynamic Disk Pools

Moving Beyond RAID DXi and Dynamic Disk Pools TECHNOLOGY BRIEF Moving Beyond RAID DXi and Dynamic Disk Pools NOTICE This Technology Brief contains information protected by copyright. Information in this Technology Brief is subject to change without

More information

Netapp @ 10th TF-Storage Meeting

Netapp @ 10th TF-Storage Meeting Netapp @ 10th TF-Storage Meeting Wojciech Janusz, Netapp Poland Bogusz Błaszkiewicz, Netapp Poland Ljubljana, 2012.02.20 Agenda Data Ontap Cluster-Mode pnfs E-Series NetApp Confidential - Internal Use

More information

THE EMC ISILON STORY. Big Data In The Enterprise. Copyright 2012 EMC Corporation. All rights reserved.

THE EMC ISILON STORY. Big Data In The Enterprise. Copyright 2012 EMC Corporation. All rights reserved. THE EMC ISILON STORY Big Data In The Enterprise 2012 1 Big Data In The Enterprise Isilon Overview Isilon Technology Summary 2 What is Big Data? 3 The Big Data Challenge File Shares 90 and Archives 80 Bioinformatics

More information

IBM System x GPFS Storage Server

IBM System x GPFS Storage Server IBM System x GPFS Storage Crispin Keable Technical Computing Architect 1 IBM Technical Computing comprehensive portfolio uniquely addresses supercomputing and mainstream client needs Technical Computing

More information

HadoopTM Analytics DDN

HadoopTM Analytics DDN DDN Solution Brief Accelerate> HadoopTM Analytics with the SFA Big Data Platform Organizations that need to extract value from all data can leverage the award winning SFA platform to really accelerate

More information

Solving Agencies Big Data Challenges: PED for On-the-Fly Decisions

Solving Agencies Big Data Challenges: PED for On-the-Fly Decisions White Paper Solving Agencies Big Data Challenges: PED for On-the-Fly Decisions Carina Veksler, NetApp March 2012 WP-7158 ABSTRACT With the growing volumes of rich sensor data and imagery used today to

More information

Meeting Increased Storage and Infrastructure Needs Accelerate Business Success

Meeting Increased Storage and Infrastructure Needs Accelerate Business Success Meeting Increased Storage and Infrastructure Needs Accelerate Business Success 2 Agenda IT Challenges Trends Standards Innovations & efficiencies Questions? 3 IT Challenges Budgets/Funding People Growth

More information

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance Hybrid Storage Performance Gains for IOPS and Bandwidth Utilizing Colfax Servers and Enmotus FuzeDrive Software NVMe Hybrid

More information

Time Matters. K.D. Polzin FlashSystems Sales Specialist - South Central

Time Matters. K.D. Polzin FlashSystems Sales Specialist - South Central K.D. Polzin FlashSystems Sales Specialist - South Central 281-520-1307 kdpolzin@us.ibm.com Simon Cambridge FlashSystems Technical Specialist South Central Time Matters Think Microseconds, not Milliseconds

More information

HPC Advisory Council

HPC Advisory Council HPC Advisory Council September 2012, Malaga CHRIS WEEDEN SYSTEMS ENGINEER WHO IS PANASAS? Panasas is a high performance storage vendor founded by Dr Garth Gibson Panasas delivers a fully supported, turnkey,

More information

With DDN Big Data Storage

With DDN Big Data Storage DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The Big

More information

Comparing Dynamic Disk Pools (DDP) with RAID-6 using IOR

Comparing Dynamic Disk Pools (DDP) with RAID-6 using IOR Comparing Dynamic Disk Pools (DDP) with RAID-6 using IOR December, 2012 Peter McGonigal petermc@sgi.com Abstract Dynamic Disk Pools (DDP) offer an exciting new approach to traditional RAID sets by substantially

More information

Understanding Microsoft Storage Spaces

Understanding Microsoft Storage Spaces S T O R A G E Understanding Microsoft Storage Spaces A critical look at its key features and value proposition for storage administrators A Microsoft s Storage Spaces solution offers storage administrators

More information

SMB Direct for SQL Server and Private Cloud

SMB Direct for SQL Server and Private Cloud SMB Direct for SQL Server and Private Cloud Increased Performance, Higher Scalability and Extreme Resiliency June, 2014 Mellanox Overview Ticker: MLNX Leading provider of high-throughput, low-latency server

More information

Practical Applications of Lustre/ZFS Hybrid Systems LUG 2014 Miami FL

Practical Applications of Lustre/ZFS Hybrid Systems LUG 2014 Miami FL Practical Applications of Lustre/ZFS Hybrid Systems LUG 2014 Miami FL Q2-2014 Josh Judd, CTO Agenda Brief Review: Luster over ZFS Brief Overview: platforms used in example solutions Discuss three cases

More information

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS Sean Lee Solution Architect, SDI, IBM Systems SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS Agenda Converging Technology Forces New Generation Applications Data Management Challenges

More information

New Hitachi Virtual Storage Platform Family. Name Date

New Hitachi Virtual Storage Platform Family. Name Date New Hitachi Virtual Storage Platform Family Name Date Familiar Challenges and Big Transformations Too Much Information Too Much Complexity 24 x 7 Expectations Continually Rising Costs Software-Defined

More information

UNIFIED HYBRID STORAGE. Performance, Availability and Scale for Any SAN and NAS Workload in Your Environment

UNIFIED HYBRID STORAGE. Performance, Availability and Scale for Any SAN and NAS Workload in Your Environment DATASHEET TM NST6000 UNIFIED HYBRID STORAGE Performance, Availability and Scale for Any SAN and NAS Workload in Your Environment UNIFIED The Nexsan NST6000 unified hybrid storage appliance is ideal for

More information

Dynamic Disk Pools Technical Report

Dynamic Disk Pools Technical Report Dynamic Disk Pools Technical Report A Dell Technical White Paper Dell PowerVault MD3 Dense Series of Storage Arrays 9/5/2012 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL

More information

New Cluster-Ready FAS3200 Models

New Cluster-Ready FAS3200 Models New Cluster-Ready FAS3200 Models Steven Miller Senior Technical Director and Platform Architect NetApp recently introduced two new models in the FAS3200 series: the FAS3220 and the FAS3250. Our design

More information

EMC XTREMIO EXECUTIVE OVERVIEW

EMC XTREMIO EXECUTIVE OVERVIEW EMC XTREMIO EXECUTIVE OVERVIEW COMPANY BACKGROUND XtremIO develops enterprise data storage systems based completely on random access media such as flash solid-state drives (SSDs). By leveraging the underlying

More information

Easier - Faster - Better

Easier - Faster - Better Highest reliability, availability and serviceability ClusterStor gets you productive fast with robust professional service offerings available as part of solution delivery, including quality controlled

More information

Panasas: High Performance Storage for the Engineering Workflow

Panasas: High Performance Storage for the Engineering Workflow 9. LS-DYNA Forum, Bamberg 2010 IT / Performance Panasas: High Performance Storage for the Engineering Workflow E. Jassaud, W. Szoecs Panasas / transtec AG 2010 Copyright by DYNAmore GmbH N - I - 9 High-Performance

More information

IBM General Parallel File System (GPFS ) 3.5 File Placement Optimizer (FPO)

IBM General Parallel File System (GPFS ) 3.5 File Placement Optimizer (FPO) IBM General Parallel File System (GPFS ) 3.5 File Placement Optimizer (FPO) Rick Koopman IBM Technical Computing Business Development Benelux Rick_koopman@nl.ibm.com Enterprise class replacement for HDFS

More information

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved.

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved. NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION 1 The Business Drivers Increase Revenue INCREASE AGILITY Lower Operational Costs Reduce Risk 2 CLOUD TRANSFORMS IT Lower Operational Costs 3 Disruptive

More information

GPFS Storage Server. Concepts and Setup in Lemanicus BG/Q system" Christian Clémençon (EPFL-DIT)" " 4 April 2013"

GPFS Storage Server. Concepts and Setup in Lemanicus BG/Q system Christian Clémençon (EPFL-DIT)  4 April 2013 GPFS Storage Server Concepts and Setup in Lemanicus BG/Q system" Christian Clémençon (EPFL-DIT)" " Agenda" GPFS Overview" Classical versus GSS I/O Solution" GPFS Storage Server (GSS)" GPFS Native RAID

More information

The Ultimate in Scale-Out Storage for HPC and Big Data

The Ultimate in Scale-Out Storage for HPC and Big Data Node Inventory Health and Active Filesystem Throughput Monitoring Asset Utilization and Capacity Statistics Manager brings to life powerful, intuitive, context-aware real-time monitoring and proactive

More information

Forward Looking Statements

Forward Looking Statements Forward Looking Statements This presentation contains certain forward- looking statements. Any statement that refers to expectations, projections or other characterizations of future events or circumstances

More information

Sun Constellation System: The Open Petascale Computing Architecture

Sun Constellation System: The Open Petascale Computing Architecture CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc. 25 Years of Technical

More information

Infortrend ESVA Family Enterprise Scalable Virtualized Architecture

Infortrend ESVA Family Enterprise Scalable Virtualized Architecture Infortrend ESVA Family Enterprise Scalable Virtualized Architecture R Optimized ROI Ensures the most efficient allocation of consolidated capacity and computing power, and meets wide array of service level

More information

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with

More information

UCS M-Series Modular Servers

UCS M-Series Modular Servers UCS M-Series Modular Servers The Next Wave of UCS Innovation Marian Klas Cisco Systems June 2015 Cisco UCS - Powering Applications at Every Scale Edge-Scale Computing Cloud-Scale Computing Seamlessly Extend

More information

EMC SOLUTION FOR SPLUNK

EMC SOLUTION FOR SPLUNK EMC SOLUTION FOR SPLUNK Splunk validation using all-flash EMC XtremIO and EMC Isilon scale-out NAS ABSTRACT This white paper provides details on the validation of functionality and performance of Splunk

More information

Transforming your Datacenter with Nimble Storage. Stephen D Amore, Senior Systems Engineer Nordics

Transforming your Datacenter with Nimble Storage. Stephen D Amore, Senior Systems Engineer Nordics Transforming your Datacenter with Nimble Storage Stephen D Amore, Senior Systems Engineer Nordics Company Snapshot Founded in January 2008 December 2013 IPO (NYSE:NMBL) Headquartered in San Jose, CA» operations

More information

IOmark- VDI. Nimbus Data Gemini Test Report: VDI- 130906- a Test Report Date: 6, September 2013. www.iomark.org

IOmark- VDI. Nimbus Data Gemini Test Report: VDI- 130906- a Test Report Date: 6, September 2013. www.iomark.org IOmark- VDI Nimbus Data Gemini Test Report: VDI- 130906- a Test Copyright 2010-2013 Evaluator Group, Inc. All rights reserved. IOmark- VDI, IOmark- VDI, VDI- IOmark, and IOmark are trademarks of Evaluator

More information

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010 Flash Memory Arrays Enabling the Virtualized Data Center July 2010 2 Flash Memory Arrays Enabling the Virtualized Data Center This White Paper describes a new product category, the flash Memory Array,

More information

Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200

Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200 Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200 Most organizations routinely utilize a server virtualization infrastructure to benefit

More information

Xyratex Update. Michael K. Connolly. Partner and Alliances Development

Xyratex Update. Michael K. Connolly. Partner and Alliances Development Xyratex Update Michael K. Connolly Partner and Alliances Development Is Now 2 The Continued Power of Xyratex Global Solutions Provider of High Quality Data Storage Hardware, Software and Services Broad

More information

ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013

ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013 ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013 POWER OF HITACHI Founded in 1910 US$118B FY11 900 subsidiaries 324,000 employees More than 760 PhDs INFORMATION and TELECOMMU- NICATIONS

More information

Introducing NetApp FAS2500 series. Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o.

Introducing NetApp FAS2500 series. Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o. Introducing NetApp FAS2500 series Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o. Complex data storage portfolio Corporate Data Centers Cloud Data Centers Flash Arrays for extreme performance

More information

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA WHITE PAPER April 2014 Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA Executive Summary...1 Background...2 File Systems Architecture...2 Network Architecture...3 IBM BigInsights...5

More information

The Data Placement Challenge

The Data Placement Challenge The Data Placement Challenge Entire Dataset Applications Active Data Lowest $/IOP Highest throughput Lowest latency 10-20% Right Place Right Cost Right Time 100% 2 2 What s Driving the AST Discussion?

More information

Software-defined Storage Architecture for Analytics Computing

Software-defined Storage Architecture for Analytics Computing Software-defined Storage Architecture for Analytics Computing Arati Joshi Performance Engineering Colin Eldridge File System Engineering Carlos Carrero Product Management June 2015 Reference Architecture

More information

Building All-Flash Software Defined Storages for Datacenters. Ji Hyuck Yun (dr.jhyun@sk.com) Storage Tech. Lab SK Telecom

Building All-Flash Software Defined Storages for Datacenters. Ji Hyuck Yun (dr.jhyun@sk.com) Storage Tech. Lab SK Telecom Building All-Flash Software Defined Storages for Datacenters Ji Hyuck Yun (dr.jhyun@sk.com) Storage Tech. Lab SK Telecom Introduction R&D Motivation Synergy between SK Telecom and SK Hynix Service & Solution

More information

Dell Converged Infrastructure

Dell Converged Infrastructure Agenda Microsoft Software Defined and Storage Economics Summary of all Dell SDS offerings Storage Trends (SAN > JBOD > Internal Disks) Legacy Storage and JBOD Enclosure Trends Software Defined Storage

More information

EMC IRODS RESOURCE DRIVERS

EMC IRODS RESOURCE DRIVERS EMC IRODS RESOURCE DRIVERS PATRICK COMBES: PRINCIPAL SOLUTION ARCHITECT, LIFE SCIENCES 1 QUICK AGENDA Intro to Isilon (~2 hours) Isilon resource driver Intro to ECS (~1.5 hours) ECS Resource driver Possibilities

More information

Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie?

Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie? Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie? Systems Engineer Sven Willholz Performance Growth Performance Gap Performance Gap Challenge Server Huge gap between CPU and storage Relatively

More information

Bosch E-Series. DSA Storage. Alex Sammer. NetApp, Manager E-Series Technical Marketing

Bosch E-Series. DSA Storage. Alex Sammer. NetApp, Manager E-Series Technical Marketing Bosch E-Series DSA Storage Alex Sammer NetApp, Manager E-Series Technical Marketing 1 Why NetApp and Bosch? Global collaboration aligns leaders in storage and video surveillance. Agreement links research

More information

Data Centre Enterprise Computing Solutions BeLux

Data Centre Enterprise Computing Solutions BeLux Data Centre Enterprise Computing Solutions BeLux NetApp and Veeam Product Bundles arrow.com The Challenge The Solution With data growing at astounding rates, IT managers are depending more and more on

More information

Seagate Lustre Update. Peter Bojanic 2015-04-13

Seagate Lustre Update. Peter Bojanic 2015-04-13 Seagate Lustre Update Peter Bojanic 2015-04-13 Seagate Cloud Systems and Solutions Delivering next-generation workloads with Intelligent Information Infrastructure tion OEM Cloud Services HPC HPC HPC Information

More information

Successfully Deploying Alternative Storage Architectures for Hadoop Gus Horn Iyer Venkatesan NetApp

Successfully Deploying Alternative Storage Architectures for Hadoop Gus Horn Iyer Venkatesan NetApp Successfully Deploying Alternative Storage Architectures for Hadoop Gus Horn Iyer Venkatesan NetApp Agenda Hadoop and storage Alternative storage architecture for Hadoop Use cases and customer examples

More information

Solid State Storage in the Evolution of the Data Center

Solid State Storage in the Evolution of the Data Center Solid State Storage in the Evolution of the Data Center Trends and Opportunities Bruce Moxon CTO, Systems and Solutions stec Presented at the Lazard Capital Markets Solid State Storage Day New York, June

More information

SolidFire and NetApp All-Flash FAS Architectural Comparison

SolidFire and NetApp All-Flash FAS Architectural Comparison SolidFire and NetApp All-Flash FAS Architectural Comparison JUNE 2015 This document provides an overview of NetApp s All-Flash FAS architecture as it compares to SolidFire. Not intended to be exhaustive,

More information

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014 Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet Anand Rangaswamy September 2014 Storage Developer Conference Mellanox Overview Ticker: MLNX Leading provider of high-throughput,

More information

Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack

Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack HIGHLIGHTS Real-Time Results Elasticsearch on Cisco UCS enables a deeper

More information

Microsoft Private Cloud Fast Track Reference Architecture

Microsoft Private Cloud Fast Track Reference Architecture Microsoft Private Cloud Fast Track Reference Architecture Microsoft Private Cloud Fast Track is a reference architecture designed to help build private clouds by combining Microsoft software with NEC s

More information

IBM System x GPFS Storage Server

IBM System x GPFS Storage Server IBM System x GPFS Storage Server Schöne Aussicht en für HPC Speicher ZKI-Arbeitskreis Paderborn, 15.03.2013 Karsten Kutzer Client Technical Architect Technical Computing IBM Systems & Technology Group

More information

Improving Time to Results for Seismic Processing with Paradigm and DDN. ddn.com. DDN Whitepaper. James Coomer and Laurent Thiers

Improving Time to Results for Seismic Processing with Paradigm and DDN. ddn.com. DDN Whitepaper. James Coomer and Laurent Thiers DDN Whitepaper Improving Time to Results for Seismic Processing with Paradigm and DDN James Coomer and Laurent Thiers 2014 DataDirect Networks. All Rights Reserved. Executive Summary Companies in the oil

More information

EMC VNX-F ALL FLASH ARRAY

EMC VNX-F ALL FLASH ARRAY EMC VNX-F ALL FLASH ARRAY Purpose-built for price, density & speed ESSENTIALS Incredible scale & density with up to 172 TB usable flash capacity in 6U @ 28.63 TB/U Consistent high performance up to 400K

More information

HPC data becomes Big Data. Peter Braam peter.braam@braamresearch.com

HPC data becomes Big Data. Peter Braam peter.braam@braamresearch.com HPC data becomes Big Data Peter Braam peter.braam@braamresearch.com me 1983-2000 Academia Maths & Computer Science Entrepreneur with startups (5x) 4 startups sold Lustre emerged Held executive jobs with

More information

ECMWF HPC Workshop: Accelerating Data Management

ECMWF HPC Workshop: Accelerating Data Management October 2012 ECMWF HPC Workshop: Accelerating Data Management Massively-Scalable Platforms and Solutions Engineered for the Big Data and Cloud Era Glenn Wright Systems Architect, DDN Data-Driven Paradigm

More information

An Alternative Storage Solution for MapReduce. Eric Lomascolo Director, Solutions Marketing

An Alternative Storage Solution for MapReduce. Eric Lomascolo Director, Solutions Marketing An Alternative Storage Solution for MapReduce Eric Lomascolo Director, Solutions Marketing MapReduce Breaks the Problem Down Data Analysis Distributes processing work (Map) across compute nodes and accumulates

More information

RAID for the 21st Century. A White Paper Prepared for Panasas October 2007

RAID for the 21st Century. A White Paper Prepared for Panasas October 2007 A White Paper Prepared for Panasas October 2007 Table of Contents RAID in the 21 st Century...1 RAID 5 and RAID 6...1 Penalties Associated with RAID 5 and RAID 6...1 How the Vendors Compensate...2 EMA

More information

Optimizing enterprise data storage capacity and performance to reduce your data footprint

Optimizing enterprise data storage capacity and performance to reduce your data footprint E-Guide Optimizing enterprise data storage capacity and performance to reduce your data footprint Every company wants to reduce their data footprint. But not every company knows the best way to go about

More information

One Platform for All Data

One Platform for All Data One Platform for All Data Storage Solutions by Hitachi Data Systems 7 October 2011 Klemen Bertoncelj Senior Solutions Consultant Hitachi Data Systems Corporation 2010. All rights reserved. HITACHI, LTD.

More information

VDI: What Does it Mean, Deploying challenges & Will It Save You Money?

VDI: What Does it Mean, Deploying challenges & Will It Save You Money? VDI: What Does it Mean, Deploying challenges & Will It Save You Money? Jack Watts, Senior Sales Executive & Cloud Solutions Specialist Neil Stobart, Director of Sales Engineering Distributor and Systems

More information

Solution Brief Network Design Considerations to Enable the Benefits of Flash Storage

Solution Brief Network Design Considerations to Enable the Benefits of Flash Storage Solution Brief Network Design Considerations to Enable the Benefits of Flash Storage Flash memory has been used to transform consumer devices such as smartphones, tablets, and ultranotebooks, and now it

More information

GDPS and Hitachi Virtual Storage Platform Qualification Test

GDPS and Hitachi Virtual Storage Platform Qualification Test GDPS GDPS / USP-100 / VSP Qualification test GDPS and Hitachi Virtual Storage Platform Qualification Test Paolo Vitali GDPS Solution Test Team, IT Specialist paolo_vitali@it.ibm.com David Petersen GDPS

More information

The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays

The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays Executive Summary Microsoft SQL has evolved beyond serving simple workgroups to a platform delivering sophisticated

More information

Datasheet NetApp FAS8000 Series

Datasheet NetApp FAS8000 Series Datasheet NetApp FAS8000 Series Respond more quickly to changing IT needs with unified scale-out storage and industry-leading data management KEY BENEFITS Support More Workloads Run SAN and NAS workloads

More information

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Einsatzfelder von IBM PureData Systems und Ihre Vorteile. Einsatzfelder von IBM PureData Systems und Ihre Vorteile demirkaya@de.ibm.com Agenda Information technology challenges PureSystems and PureData introduction PureData for Transactions PureData for Analytics

More information

OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006

OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006 OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006 EXECUTIVE SUMMARY Microsoft Exchange Server is a disk-intensive application that requires high speed storage to deliver

More information

Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk

Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk WHITE PAPER Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk 951 SanDisk Drive, Milpitas, CA 95035 2015 SanDisk Corporation. All rights reserved. www.sandisk.com Table of Contents Introduction

More information

ISILON SCALE-OUT NAS OVERVIEW AND FUTURE DIRECTIONS

ISILON SCALE-OUT NAS OVERVIEW AND FUTURE DIRECTIONS 1 ISILON SCALE-OUT NAS OVERVIEW AND FUTURE DIRECTIONS PHIL BULLINGER, SVP, EMC ISILON 2 ROADMAP INFORMATION DISCLAIMER EMC makes no representation and undertakes no obligations with regard to product planning

More information

Deploying Flash in the Enterprise Choices to Optimize Performance and Cost

Deploying Flash in the Enterprise Choices to Optimize Performance and Cost White Paper Deploying Flash in the Enterprise Choices to Optimize Performance and Cost Paul Feresten, Mohit Bhatnagar, Manish Agarwal, and Rip Wilson, NetApp April 2013 WP-7182 Executive Summary Flash

More information

ebay Storage, From Good to Great

ebay Storage, From Good to Great ebay Storage, From Good to Great Farid Yavari Sr. Storage Architect - Global Platform & Infrastructure September 11,2014 ebay Journey from Good to Great 2009 to 2011 TURNAROUND 2011 to 2013 POSITIONING

More information

Mellanox Accelerated Storage Solutions

Mellanox Accelerated Storage Solutions Mellanox Accelerated Storage Solutions Moving Data Efficiently In an era of exponential data growth, storage infrastructures are being pushed to the limits of their capacity and data delivery capabilities.

More information

Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration Nick Jarvis Director, File, Content and Cloud Solutions August 14, 2013 1 WEBTECH EDUCATIONAL SERIES HITACHI

More information

Facebook Storage Tiers

Facebook Storage Tiers Facebook Storage Tiers How the fleet is divided: Facebook runs three main storage tiers: Type III MySQL Database (user data) Type IV Hadoop (site activity analytics and logs, messages) Type V Haystack

More information

Intel RAID SSD Cache Controller RCS25ZB040

Intel RAID SSD Cache Controller RCS25ZB040 SOLUTION Brief Intel RAID SSD Cache Controller RCS25ZB040 When Faster Matters Cost-Effective Intelligent RAID with Embedded High Performance Flash Intel RAID SSD Cache Controller RCS25ZB040 When Faster

More information

IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV

IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV 11 Manager May 04, 2010 Joe Rotiroti Client Systems IBM, Federal 484 433 9756 cell 845 491 5227 fax rotiroti@us.ibm.com How is GPFS different?

More information

EonStor DS 3000 Series

EonStor DS 3000 Series EonStor DS 000 Series High speed flexible storage delivers robust reliability and management Turbo charged storage DS 000T Gen Up to 1.M read IOPS and,00 MBps read throughput High IOPS solutions ideal

More information

Introduction. Need for ever-increasing storage scalability. Arista and Panasas provide a unique Cloud Storage solution

Introduction. Need for ever-increasing storage scalability. Arista and Panasas provide a unique Cloud Storage solution Arista 10 Gigabit Ethernet Switch Lab-Tested with Panasas ActiveStor Parallel Storage System Delivers Best Results for High-Performance and Low Latency for Scale-Out Cloud Storage Applications Introduction

More information

HyperQ Storage Tiering White Paper

HyperQ Storage Tiering White Paper HyperQ Storage Tiering White Paper An Easy Way to Deal with Data Growth Parsec Labs, LLC. 7101 Northland Circle North, Suite 105 Brooklyn Park, MN 55428 USA 1-763-219-8811 www.parseclabs.com info@parseclabs.com

More information

Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology

Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology Evaluation report prepared under contract with NetApp Introduction As flash storage options proliferate and become accepted in the enterprise,

More information

NetApp Big Content Solutions: Agile Infrastructure for Big Data

NetApp Big Content Solutions: Agile Infrastructure for Big Data White Paper NetApp Big Content Solutions: Agile Infrastructure for Big Data Ingo Fuchs, NetApp April 2012 WP-7161 Executive Summary Enterprises are entering a new era of scale, in which the amount of data

More information

The BIG Data Era has. your storage! Bratislava, Slovakia, 21st March 2013

The BIG Data Era has. your storage! Bratislava, Slovakia, 21st March 2013 The BIG Data Era has arrived Re-invent your storage! Bratislava, Slovakia, 21st March 2013 Luka Topic Regional Manager East Europe EMC Isilon Storage Division luka.topic@emc.com 1 What is Big Data? 2 EXABYTES

More information

Get Success in Passing Your Certification Exam at first attempt!

Get Success in Passing Your Certification Exam at first attempt! Get Success in Passing Your Certification Exam at first attempt! Exam : E22-290 Title : EMC Data Domain Deduplication, Backup and Recovery Exam Version : DEMO 1.A customer has a Data Domain system with

More information

From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012

From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012 From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012 Safe Harbor Statement Forward Looking Statements The following information contains, or may be deemed to contain,

More information

Platfora Big Data Analytics

Platfora Big Data Analytics Platfora Big Data Analytics ISV Partner Solution Case Study and Cisco Unified Computing System Platfora, the leading enterprise big data analytics platform built natively on Hadoop and Spark, delivers

More information

Pivot3 Desktop Virtualization Appliances. vstac VDI Technology Overview

Pivot3 Desktop Virtualization Appliances. vstac VDI Technology Overview Pivot3 Desktop Virtualization Appliances vstac VDI Technology Overview February 2012 Pivot3 Desktop Virtualization Technology Overview Table of Contents Executive Summary... 3 The Pivot3 VDI Appliance...

More information

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads 89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com @EdisonGroupInc 212.367.7400 IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads A Competitive Test and Evaluation Report

More information

LSI and NCS Technologies deliver performance and savings for network security solutions.

LSI and NCS Technologies deliver performance and savings for network security solutions. Case Study The Challenge. Wire-speed capture, analysis, and retention of a wide-range of information types requiring consistently available high I/O bandwidth with rapidly growing capacity requirements.

More information

nexsan NAS just got faster, easier and more affordable.

nexsan NAS just got faster, easier and more affordable. nexsan E5000 STORAGE SYSTEMS NAS just got faster, easier and more affordable. Overview The Nexsan E5000 TM, a part of Nexsan s Flexible Storage Platform TM, is Nexsan s family of NAS storage systems that

More information