DDN in Seismic Workflows

Transcription

1 DDN in Seismic Workflows October, 2014 Laura Shepard Director Vertical Markets

2 Agenda About DDN Technology & Product Portfolio Technology Preview

3 DDN About Us DDN is a Leader in Massively Scalable Platforms and Solutions for Big Data and Cloud Applications Established: 1998 Revenue: $250M+ Profitable, Fast Growth Main Office: Sunnyvale, California, USA Employees: ~650 Worldwide Development Centers: Sunnyvale, Los Angeles, Colorado Springs, Columbia MD, Minsk, Chennai Worldwide Presence: 20 Countries Installed Base: 1,000+ End Customers; 50+ Countries Go To Market: Global Partners, Resellers, Direct Smallest Deployment is 10s of TB, Largest is 10 s of PB World-Renowned & Award-Winning

4 DDN A Thriving, Global Channel 100s of DDN Value Add Resellers and Systems Integrators Worldwide

5 5 HPC Roots: Foundation for Big Data Leadership DDN founded 1 st Customer NASA 100 GB/s Largest Private Storage Co. 1 TB/s 5 PB/Rack First Real-Time Appliance for High-Scale Big Data EXAScaler TM DDN s First Parallel File System Offering ft. Lustre First in Bandwidth + IOPS First In-Storage Processing SFX Flash Tiering First Application-Aware Hybrid Caching First in Data Center Density First Hyperscale Object Storage 2/3 of the Top100 Revolutionizing Big Data

6 6 Technology & Product Portfolio

7 7 Product Portfolio: Three Strong Pillars Platforms: SFA SSD, SAS, SATA Embedded F/S and Apps Storage and Processors File Systems: [x]scaler Accelerating Time to Insight Scale in GB/s, IOPS, TB Mixed Workloads Object Storage: WOS Collaboration and Global Distribution Private and Public Cloud Massive Scale and Low Latency

8 8 DDN Integrated Portfolio Compute & Data Fast Data Persistent Data Distributed Data Public Cloud End-to-End Resource Management

9 Storage Fusion Architecture (SFA) Software Stack Accelerating Big Data and Cloud, Optimizing TCO Over 1 Million Lines of S/W Code First Customer Shipped 2008 Designed Specifically for Big Data and Cloud Workloads DirectMon : Infrastructure Management EXAScaler Lustre Storage GRIDScaler In-Storage Processing Engine & DMA Driver Storage Fusion Architecture [Core Storage S/W Engine] Low-Latency Connect: FC, IB, Memory Real-Time, Interrupt-Free Storage Processing ReACT Adaptive Cache Technology DirectProtect Data Integrity Management Quality of Service Engine Storage Fusion Fabric hscaler Hadoop/HDFS Storage Fusion Xcelerator (SFX ) Flash Caching Parallel State-Machine Design Maximum Performance, Lowest Latency Virtualized Processing Optimized Environment for Big Data Application Hosting Robust Data Protection Quality of Service and Performance Without Compromise Flexible & Massively Scalable Best-In-Class Scalability and Density

10 DDN SFA Feature Breakdown SFX Storage Cache Automated and API-driven caching system to enable hybrid SSD & HDD pools Real-Time, Multi-CPU RAID Engine Full Implementation of Real-Time Storage OS, Interrupt-Free; Massively Parallel I/O Delivery System QoS Engine Real-Time Quality of Service for Read Operations SFA Embedded (Optional) Low-Latency KVM Environment with Custom DDN DMA Memory Drivers to Host File Servers and Pre/Post Process Analytics ReACT Cache Management Real-Time I/O Data-Aware Cache Optimizer, Small IOs Go to Cache; Large & Streaming I/Os Bypass Cache Storage Fusion Fabric Highly-Over-Provisioned Backend - RAIDed Fabric Withstands Failures of Drives, Enclosures, Cables, etc DirectProtect Real-Time Data Integrity Verification for every I/O Drive Power Cycling to Eliminate False Positives High Density Array Up to 840 HDDs in a single rack. 84 HDDs and SSDs in 4U

11 DDN SFA ReACT: Real-Time Adaptive Cache Technology Traditional Storage Caches Are Congested By Competing Streaming and Random Workloads, Resulting in Poor Performance In Mixed Workloads Full Stripe Cache Partial Stripe Battery-Backed SFA L2 Cache High-Speed Cache Link Battery-Backed SFA L2 Cache With DDN, Avoid write mirroring penalty, more headroom for random, unaligned I/Os

12 DDN SFA DirectProtect Intelligent & Reliable Drive Management DDN Technology is preventative data protection. As our data stores get bigger, the need for preventative data protection will become even more valuable and necessary. Delivers Enterprise-class data protection at ½ the price Makes large SATA pools reliable (not just less expensive) Works on any class of disk drive Ensures the data you wrote is the data you read, always Key Features Detects and corrects silent data corruption (PCOR & DIF Options) Protects against double disk failures in each tier Superior drive self-healing via automatic power cycling & partial rebuilding Minimal impact during drive failure events

13 Best-In-Class Performance World-Leading IOPS, Throughput, Scale-Out & Latency Transactional Performance Appliance IOPS Streaming Performance Appliance Bandwidth Scale-Out Performance File System Bandwidth 1.5 Write Read 50 Write Read Millions VNX5500-F e SFA12K VNX7500 e5500 SFA12K-40 0 HNAS 3200 OnTap 8.1 OneFS GRIDScaler System R/W Latency SFA12K µs / 88 µs Violin µs / 90 µs Best-In-Class Performance & Efficiency Across All Dimensions, Ideal for Mixed Workloads

14 DDN Parallel File System Appliances Easy-to-deploy Scale-out storage for Big Data Massively Scalable Highest Performance and Density Cloud Extensions and NAS Connectivity

15 Broadly Accelerating Big Data Analytics... 1-Trillion Row Big Data Queries in less than 20s. Best Runtime Ever for Drug Discovery, Warranty, Risk Analytics Enterprise Hadoop With 200%-700% Performance Gain Up to 570% faster FSI back-testing and risk management

16 16 Validated By Industry Experts Success Is Driven By The Growth in Big Data 2013 Magic Quadrant for General-Purpose Disk Arrays 2013 MarketScape Worldwide Object-Based Storage Vendor Assessment Challengers Leaders Leaders Ability to Execute DataDirect Networks Fujitsu Oracle Huawei Technologies NEC Nexsan AMI Dot Hill Infortrend SGI Promise Technology IBM Dell HP Coraid X-IO Nimble Storage EMC NetApp Hitachi Capabilities Major Players Contenders Participants Niche Players Visionaries Stratagies Completeness of Vision DDN Is The Breakout Story From The 2013 Magic Quadrant DDN Is A Recognized Leader In Object-Based Storage

17 17 Web Object Scaler (WOS ) Why Object Storage True Object Storage Online Archive Collaboration Data Protection Publication Cost-effectively archive data from 10s of TB to 10s of PB; locally or remotely Secure private & Hybrid cloud for collaborative workflows Configurable, efficient and automated data protection Publish results, data, products simply and securely

18 18 Web Object Scaler (WOS ) Software Stack Enabling Real-Time Global Collaboration Web-Scale, High-Performance Cloud Storage Appliances 99% Efficiency, Petabyte-Class Peer-to-Peer Object Storage WOS Cluster Management Utility WOS API C++, Java, Python, PHP, HTTP, HTTP CDN Caching Android, ios & S3 Multi-Tenancy Layer WOS Bridge for GRIDScaler & EXAScaler NFS & CIFS WOS Core: Peer-to-Peer Object Storage Replication Engine Latency-Aware Access Manager WOS Policy Engine User-Defined Metadata and Search Self-Healing Storage Clustering with Intra-Node Failover ObjectAssure Erasure Coding De-clustered Data Management & Fast Rebuild Limitless Scale and Speed Eliminates Limitations of Traditional File Systems - Access Data at Millions of Objects per Second. Scale to support 32 Trillion objects Store Objects Intelligently User-Defined Metadata Allows Customers to Understand Their Data Global, Peer: Peer Distribute Data Across 64 Sites in one Namespace Self-Healing Intelligent Data Management System Recovers from Failures Rapidly and Autonomously

19 19 WOS Feature Breakdown Flexible Data Protection Chose Between Replication, Erasure Coding or Both Latency-Aware Access Manager WOS Intelligently Makes Decisions on the Best Geographies to get From Based Upon Location Access Load and Latency REPLICATION AND/OR ERASURE CODING Federated, Global Object Storage Namespace Supports Clustering of up to 8,000 Nodes Across 64 Geographies, Replicate Data With Smart Policies for Performance and/or Disaster Recovery on a Per-Object Basis DeClustered Data Protection No Hard tie Between Physical Disks and Data. Failed Drives are Recovered Through Dispersed Data Placement Rebuilds Happen at Read, not Write, Speed Rebuilding Only Data. Fully-Integrated Object Storage Appliance 60 Drives in 4U WOS7000 Nodes Support In-Node Failover for Ideal HA* Object Disk Architecture Formats Drives With Custom Wos Disk File System, no Linux File I/Os, no Fragmentation, Fully Contiguous Object Read and Write Operations for Maximum Disk Efficiency User Defined Metadata and Metadata Search* Applications can Assign Their own Metadata via Object Storage API, WOS now Also Supports Simple Search of WOS User Metadata * Available Q413

20 20 Cloud Scale & Economic Paradigm Shift WOS Innovation Minimizes The Cost of Web-Scale Computing Storage Acquisition Costs ($/GB) Cloud Storage Acquisition Costs ($/GB) Performance Economics ($M) $4 $3 $2 $1 Economics ($M) $6 $5 $4 $3 $2 $3M in Savings Over 5 Years Billions $1 10 $- Traditional WOS Source: File Storage Costs Less In The Cloud Than In-House, Forrester Research $- Amazon WOS - Total Cost of Ownership 1PB, 5 Years Source: Amazon S3 Website EMC WOS Source: EMC Press Releases

21 21 IME: Infinitely Extendable Non-Volatile Memory IME Delivers Extreme Application Acceleration and Highly Efficient I/O Provisioning Decouples Performance and Capacity in Physical Storage Delivers Full Utilization of Compute Processing Capabilities IME is a Game Changer for Big Data Workflows 1,000x Application Acceleration Run More Complex Simulations Faster with less Hardware Half the Latency of Flash Arrays Optimizing Workload Performance to Reduce Time to Insight and Discovery 80% Lower Cost Infinite Scalability; Provisions I/O Performance With Highest Efficiency

22 22 The largest, application transparent memory engine available for HPC workloads! DATA CENTER EFFICIENCY Infinite Performance Engine Smarter Storage Performance Provisioning APPLICATION ACCELERATION Infinite Memory Engine Enabling Full Compute Performance Utilization Scale I/O and Bandwidth, Without Adding Drives to Your Storage Array Purchase HDDs Only for Capacity Requirements Faster Than All-Flash Arrays and More Economical Fully Utilize the Capacity of all HDDs, Reduce Data Center Footprint, Components and Power Standard I/O Interfaces with no Custom Coding Required Reclaim 30% of Your Compute Cycles Liberate Compute and Applications From File System Activities and Bottlenecks Dramatically Reduce HPC Compute Costs Reduce Quantity of Servers and Networking by Orders or Magnitude Checkpoint With 1/10th the HDDs and floor space

23 23 R&D Direction DDN Mission Build the market-leading provider of massively scalable storage and processing technology for unstructured & big data applications. Core Converge and Simplify DDN s Storage and Processing Platform Cloud Enable Global Collaboration & Cloud Scale Private Cloud Tools & MTDL Enhancements Storage Class Memory Breaking through file system scaling barriers Radically new compute architectures

24 DDN Powers Over ½ of the world s largest Oil & Gas systems

25 Questions?