DDN in Seismic Workflows



Similar documents
ECMWF HPC Workshop: Accelerating Data Management

ANY SURVEILLANCE, ANYWHERE, ANYTIME

Object storage in Cloud Computing and Embedded Processing

HadoopTM Analytics DDN

WOS Cloud. ddn.com. Personal Storage for the Enterprise. DDN Solution Brief

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

EMC XtremSF: Delivering Next Generation Performance for Oracle Database

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved.

With DDN Big Data Storage

WOS OBJECT STORAGE PRODUCT BROCHURE DDN.COM Full Spectrum Object Storage

21 st Century Storage What s New and What s Changing

WOS. High Performance Object Storage

Modernizing Hadoop Architecture for Superior Scalability, Efficiency & Productive Throughput. ddn.com

EMC XtremSF: Delivering Next Generation Storage Performance for SQL Server

The Data Placement Challenge

Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack

Netapp HPC Solution for Lustre. Rich Fenton UK Solutions Architect

Improving Time to Results for Seismic Processing with Paradigm and DDN. ddn.com. DDN Whitepaper. James Coomer and Laurent Thiers

INCREASING EFFICIENCY WITH EASY AND COMPREHENSIVE STORAGE MANAGEMENT

SMB Direct for SQL Server and Private Cloud

Storage Fusion Xcelerator

MaxDeploy Hyper- Converged Reference Architecture Solution Brief

BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything

DDN updates object storage platform as it aims to break out of HPC niche

SFA Product Line. ddn.com. DDN Whitepaper. High Performance Solutions for Big Data: Setting the Bar in Both Bandwidth & lops

An Alternative Storage Solution for MapReduce. Eric Lomascolo Director, Solutions Marketing

The BIG Data Era has. your storage! Bratislava, Slovakia, 21st March 2013

T a c k l i ng Big Data w i th High-Performance

Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

Data management challenges in todays Healthcare and Life Sciences ecosystems

Seagate HPC /Big Data Business Tech Talk. December 2014

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

FLASH STORAGE SOLUTION

Data Center Solutions

Intel RAID SSD Cache Controller RCS25ZB040

200 flash-related. petabytes of. flash shipped. patents. NetApp flash leadership. Metrics through October, 2015

Maxta Storage Platform Enterprise Storage Re-defined

PARALLELS CLOUD STORAGE

Scala Storage Scale-Out Clustered Storage White Paper

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Mellanox Accelerated Storage Solutions

Enabling High performance Big Data platform with RDMA

Protecting Big Data Data Protection Solutions for the Business Data Lake

TCO Case Study Enterprise Mass Storage: Less Than A Penny Per GB Per Year

WHITE PAPER. Software Defined Storage Hydrates the Cloud

Data Center Storage Solutions

Overview: X5 Generation Database Machines

The last 18 months. AutoScale. IaaS. BizTalk Services Hyper-V Disaster Recovery Support. Multi-Factor Auth. Hyper-V Recovery.

Flash Storage Optimizing Virtual Desktop Deployments

SFA OS Release WOS Access S3. Version 2.0 Product Release Notes WOS7000, WOS6000, WOS1600

EOFS Workshop Paris Sept, Lustre at exascale. Eric Barton. CTO Whamcloud, Inc Whamcloud, Inc.

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS

THE EMC ISILON STORY. Big Data In The Enterprise. Copyright 2012 EMC Corporation. All rights reserved.

Virtualizing SQL Server 2008 Using EMC VNX Series and Microsoft Windows Server 2008 R2 Hyper-V. Reference Architecture

A software-defined approach to hyper-convergence with StorMagic SvSAN

FLASH ARRAY MARKET TRENDS

A Virtual Filer for VMware s Virtual SAN A Maginatics and VMware Joint Partner Brief

What Is Microsoft Private Cloud Fast Track?

An Oracle White Paper October Realizing the Superior Value and Performance of Oracle ZFS Storage Appliance

Storage, Cloud, Web 2.0, Big Data Driving Growth

EMC SOLUTION FOR SPLUNK

Software Defined Storage Needs a Platform. Piotr Biskupski. Storage Solutions Technical Leader - IBM Flash System, IBM CEE

Traditional v/s CONVRGD

IBM Storage Technical Strategy and Trends

Server-Side Virtual Controller Technology (SVCT)

ioscale: The Holy Grail for Hyperscale

Big data management with IBM General Parallel File System

Product Spotlight. A Look at the Future of Storage. Featuring SUSE Enterprise Storage. Where IT perceptions are reality

THE SUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

New Hitachi Virtual Storage Platform Family. Name Date

EMC XTREMIO EXECUTIVE OVERVIEW

Transforming your Datacenter with Nimble Storage. Stephen D Amore, Senior Systems Engineer Nordics

HGST Virident Solutions 2.0

HPC Advisory Council

Nimble Storage + OpenStack 打 造 最 佳 企 業 專 屬 雲 端 平 台. Nimble Storage Brian Chen, Solution Architect Jay Wang, Principal Software Engineer

Unlock the value of data with smarter storage solutions.

IBM ELASTIC STORAGE SEAN LEE

Sun Constellation System: The Open Petascale Computing Architecture

All-Flash Arrays: Not Just for the Top Tier Anymore

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance

A value-added service and solutions company focused on media-optimized, data storage-intensive workflows. SAN Scale-Out NAS Data Protection

Building a Scalable Storage with InfiniBand

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie?

10th TF-Storage Meeting

Private Cloud Storage for Media Applications. Bang Chang Vice President, Broadcast Servers and Storage

EMC VFCACHE ACCELERATES ORACLE

Proact whitepaper on Big Data

Optimizing Storage for Better TCO in Oracle Environments. Part 1: Management INFOSTOR. Executive Brief

Transcription:

DDN in Seismic Workflows October, 2014 Laura Shepard Director Vertical Markets

Agenda About DDN Technology & Product Portfolio Technology Preview

DDN About Us DDN is a Leader in Massively Scalable Platforms and Solutions for Big Data and Cloud Applications Established: 1998 Revenue: $250M+ Profitable, Fast Growth Main Office: Sunnyvale, California, USA Employees: ~650 Worldwide Development Centers: Sunnyvale, Los Angeles, Colorado Springs, Columbia MD, Minsk, Chennai Worldwide Presence: 20 Countries Installed Base: 1,000+ End Customers; 50+ Countries Go To Market: Global Partners, Resellers, Direct Smallest Deployment is 10s of TB, Largest is 10 s of PB World-Renowned & Award-Winning

DDN A Thriving, Global Channel 100s of DDN Value Add Resellers and Systems Integrators Worldwide

5 HPC Roots: Foundation for Big Data Leadership DDN founded 1 st Customer NASA 100 GB/s Largest Private Storage Co. 1 TB/s 5 PB/Rack 1998 2000 2002 2005 2006 2008 2009 2012 2013 2014 First Real-Time Appliance for High-Scale Big Data EXAScaler TM DDN s First Parallel File System Offering ft. Lustre First in Bandwidth + IOPS First In-Storage Processing SFX Flash Tiering First Application-Aware Hybrid Caching First in Data Center Density First Hyperscale Object Storage 2/3 of the Top100 Revolutionizing Big Data

6 Technology & Product Portfolio

7 Product Portfolio: Three Strong Pillars Platforms: SFA SSD, SAS, SATA Embedded F/S and Apps Storage and Processors File Systems: [x]scaler Accelerating Time to Insight Scale in GB/s, IOPS, TB Mixed Workloads Object Storage: WOS Collaboration and Global Distribution Private and Public Cloud Massive Scale and Low Latency

8 DDN Integrated Portfolio Compute & Data Fast Data Persistent Data Distributed Data Public Cloud End-to-End Resource Management

Storage Fusion Architecture (SFA) Software Stack Accelerating Big Data and Cloud, Optimizing TCO Over 1 Million Lines of S/W Code First Customer Shipped 2008 Designed Specifically for Big Data and Cloud Workloads DirectMon : Infrastructure Management EXAScaler Lustre Storage GRIDScaler In-Storage Processing Engine & DMA Driver Storage Fusion Architecture [Core Storage S/W Engine] Low-Latency Connect: FC, IB, Memory Real-Time, Interrupt-Free Storage Processing ReACT Adaptive Cache Technology DirectProtect Data Integrity Management Quality of Service Engine Storage Fusion Fabric hscaler Hadoop/HDFS Storage Fusion Xcelerator (SFX ) Flash Caching Parallel State-Machine Design Maximum Performance, Lowest Latency Virtualized Processing Optimized Environment for Big Data Application Hosting Robust Data Protection Quality of Service and Performance Without Compromise Flexible & Massively Scalable Best-In-Class Scalability and Density

DDN SFA Feature Breakdown SFX Storage Cache Automated and API-driven caching system to enable hybrid SSD & HDD pools Real-Time, Multi-CPU RAID Engine Full Implementation of Real-Time Storage OS, Interrupt-Free; Massively Parallel I/O Delivery System QoS Engine Real-Time Quality of Service for Read Operations SFA Embedded (Optional) Low-Latency KVM Environment with Custom DDN DMA Memory Drivers to Host File Servers and Pre/Post Process Analytics ReACT Cache Management Real-Time I/O Data-Aware Cache Optimizer, Small IOs Go to Cache; Large & Streaming I/Os Bypass Cache Storage Fusion Fabric Highly-Over-Provisioned Backend - RAIDed Fabric Withstands Failures of Drives, Enclosures, Cables, etc DirectProtect Real-Time Data Integrity Verification for every I/O Drive Power Cycling to Eliminate False Positives High Density Array Up to 840 HDDs in a single rack. 84 HDDs and SSDs in 4U

DDN SFA ReACT: Real-Time Adaptive Cache Technology Traditional Storage Caches Are Congested By Competing Streaming and Random Workloads, Resulting in Poor Performance In Mixed Workloads Full Stripe Cache Partial Stripe Battery-Backed SFA L2 Cache High-Speed Cache Link Battery-Backed SFA L2 Cache With DDN, Avoid write mirroring penalty, more headroom for random, unaligned I/Os

DDN SFA DirectProtect Intelligent & Reliable Drive Management DDN Technology is preventative data protection. As our data stores get bigger, the need for preventative data protection will become even more valuable and necessary. Delivers Enterprise-class data protection at ½ the price Makes large SATA pools reliable (not just less expensive) Works on any class of disk drive Ensures the data you wrote is the data you read, always Key Features Detects and corrects silent data corruption (PCOR & DIF Options) Protects against double disk failures in each tier Superior drive self-healing via automatic power cycling & partial rebuilding Minimal impact during drive failure events

Best-In-Class Performance World-Leading IOPS, Throughput, Scale-Out & Latency Transactional Performance Appliance IOPS Streaming Performance Appliance Bandwidth Scale-Out Performance File System Bandwidth 1.5 Write Read 50 Write Read 1200 40 900 1.0 30 Millions 0.5 20 600 10 300 0.0 VNX5500-F e5460 6616 SFA12K-40 0 6616 VNX7500 e5500 SFA12K-40 0 HNAS 3200 OnTap 8.1 OneFS GRIDScaler System R/W Latency SFA12K-40 24 µs / 88 µs Violin 6616 25 µs / 90 µs Best-In-Class Performance & Efficiency Across All Dimensions, Ideal for Mixed Workloads

DDN Parallel File System Appliances Easy-to-deploy Scale-out storage for Big Data Massively Scalable Highest Performance and Density Cloud Extensions and NAS Connectivity

Broadly Accelerating Big Data Analytics... 1-Trillion Row Big Data Queries in less than 20s. Best Runtime Ever for Drug Discovery, Warranty, Risk Analytics Enterprise Hadoop With 200%-700% Performance Gain Up to 570% faster FSI back-testing and risk management

16 Validated By Industry Experts Success Is Driven By The Growth in Big Data 2013 Magic Quadrant for General-Purpose Disk Arrays 2013 MarketScape Worldwide Object-Based Storage Vendor Assessment Challengers Leaders Leaders Ability to Execute DataDirect Networks Fujitsu Oracle Huawei Technologies NEC Nexsan AMI Dot Hill Infortrend SGI Promise Technology IBM Dell HP Coraid X-IO Nimble Storage EMC NetApp Hitachi Capabilities Major Players Contenders Participants Niche Players Visionaries Stratagies Completeness of Vision DDN Is The Breakout Story From The 2013 Magic Quadrant DDN Is A Recognized Leader In Object-Based Storage

17 Web Object Scaler (WOS ) Why Object Storage True Object Storage Online Archive Collaboration Data Protection Publication Cost-effectively archive data from 10s of TB to 10s of PB; locally or remotely Secure private & Hybrid cloud for collaborative workflows Configurable, efficient and automated data protection Publish results, data, products simply and securely

18 Web Object Scaler (WOS ) Software Stack Enabling Real-Time Global Collaboration Web-Scale, High-Performance Cloud Storage Appliances 99% Efficiency, Petabyte-Class Peer-to-Peer Object Storage WOS Cluster Management Utility WOS API C++, Java, Python, PHP, HTTP, HTTP CDN Caching Android, ios & S3 Multi-Tenancy Layer WOS Bridge for GRIDScaler & EXAScaler NFS & CIFS WOS Core: Peer-to-Peer Object Storage Replication Engine Latency-Aware Access Manager WOS Policy Engine User-Defined Metadata and Search Self-Healing Storage Clustering with Intra-Node Failover ObjectAssure Erasure Coding De-clustered Data Management & Fast Rebuild Limitless Scale and Speed Eliminates Limitations of Traditional File Systems - Access Data at Millions of Objects per Second. Scale to support 32 Trillion objects Store Objects Intelligently User-Defined Metadata Allows Customers to Understand Their Data Global, Peer: Peer Distribute Data Across 64 Sites in one Namespace Self-Healing Intelligent Data Management System Recovers from Failures Rapidly and Autonomously

19 WOS Feature Breakdown Flexible Data Protection Chose Between Replication, Erasure Coding or Both Latency-Aware Access Manager WOS Intelligently Makes Decisions on the Best Geographies to get From Based Upon Location Access Load and Latency REPLICATION AND/OR ERASURE CODING Federated, Global Object Storage Namespace Supports Clustering of up to 8,000 Nodes Across 64 Geographies, Replicate Data With Smart Policies for Performance and/or Disaster Recovery on a Per-Object Basis DeClustered Data Protection No Hard tie Between Physical Disks and Data. Failed Drives are Recovered Through Dispersed Data Placement Rebuilds Happen at Read, not Write, Speed Rebuilding Only Data. Fully-Integrated Object Storage Appliance 60 Drives in 4U WOS7000 Nodes Support In-Node Failover for Ideal HA* Object Disk Architecture Formats Drives With Custom Wos Disk File System, no Linux File I/Os, no Fragmentation, Fully Contiguous Object Read and Write Operations for Maximum Disk Efficiency User Defined Metadata and Metadata Search* Applications can Assign Their own Metadata via Object Storage API, WOS now Also Supports Simple Search of WOS User Metadata * Available Q413

20 Cloud Scale & Economic Paradigm Shift WOS Innovation Minimizes The Cost of Web-Scale Computing Storage Acquisition Costs ($/GB) Cloud Storage Acquisition Costs ($/GB) Performance Economics ($M) $4 $3 $2 $1 Economics ($M) $6 $5 $4 $3 $2 $3M in Savings Over 5 Years Billions 60 50 40 30 20 $1 10 $- Traditional WOS Source: File Storage Costs Less In The Cloud Than In-House, Forrester Research $- Amazon WOS - Total Cost of Ownership 1PB, 5 Years Source: Amazon S3 Website EMC WOS Source: EMC Press Releases

21 IME: Infinitely Extendable Non-Volatile Memory IME Delivers Extreme Application Acceleration and Highly Efficient I/O Provisioning Decouples Performance and Capacity in Physical Storage Delivers Full Utilization of Compute Processing Capabilities IME is a Game Changer for Big Data Workflows 1,000x Application Acceleration Run More Complex Simulations Faster with less Hardware Half the Latency of Flash Arrays Optimizing Workload Performance to Reduce Time to Insight and Discovery 80% Lower Cost Infinite Scalability; Provisions I/O Performance With Highest Efficiency

22 The largest, application transparent memory engine available for HPC workloads! DATA CENTER EFFICIENCY Infinite Performance Engine Smarter Storage Performance Provisioning APPLICATION ACCELERATION Infinite Memory Engine Enabling Full Compute Performance Utilization Scale I/O and Bandwidth, Without Adding Drives to Your Storage Array Purchase HDDs Only for Capacity Requirements Faster Than All-Flash Arrays and More Economical Fully Utilize the Capacity of all HDDs, Reduce Data Center Footprint, Components and Power Standard I/O Interfaces with no Custom Coding Required Reclaim 30% of Your Compute Cycles Liberate Compute and Applications From File System Activities and Bottlenecks Dramatically Reduce HPC Compute Costs Reduce Quantity of Servers and Networking by Orders or Magnitude Checkpoint With 1/10th the HDDs and floor space

23 R&D Direction DDN Mission Build the market-leading provider of massively scalable storage and processing technology for unstructured & big data applications. Core Converge and Simplify DDN s Storage and Processing Platform Cloud Enable Global Collaboration & Cloud Scale Private Cloud Tools & MTDL Enhancements Storage Class Memory Breaking through file system scaling barriers Radically new compute architectures

DDN Powers Over ½ of the world s largest Oil & Gas systems

Questions?