DATA LAKE FOUNDATION 2.0 JEUDI 19 NOVEMBRE Denis FRAVAL-OLIVIER : ISD Presales Manager

Transcription

1 DATA LAKE FOUNDATION 2.0 JEUDI 19 NOVEMBRE 2015 Denis FRAVAL-OLIVIER : ISD Presales Manager

2 EMC Isilon Unifying Workloads in one place Module 4: Horizontal and Vertical Markets

3 ISILON FOR ALL TYPES OF DATA Processes & Transaction Home Directories Sync n Share File shares Surveillance BLOBS Social & Next-Gen Web Content Splunk Hadoop & Analytics Design, Test & Manufacture Consumerization Personalization Demographics Archive & Backup Target

4 EMC Isilon Scale-Out platform Protocols Clients and Applications NFS SMB HTTP FTP HDFS for Hadoop REST for Object RESTful API GET PUT POST DELETE Gig-e 10 Gig-e Network Multi-Protocol Client/Application Layer Ethernet Layer OneFS Operating Environment Intra-cluster Communication

5 DATA LAKE EMC ISILON SCALE-OUT NAS DATA PROTECTION S-Series X-Series Data Lake DATA MANAGEMENT NL-Series HD-Series DATA SECURITY PERFORMANCE MANAGEMENT 5

6 3rd Platform cloud Innovation S - Series X - Series NL-Series Isilon CloudPools FUTURE HD-Series 6

7 Support for Multiple Analytics Applications Node reply NFS SMB NFS SMB SMB, NFS, HTTP, FTP, HDFS name node name node name node data node HDFS NFS name node MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce

8 Splunk Index Architecture

9 The Big, Cold Data Lake

10 The Bottomless Cold Bucket Benefit: Unmatched Scalability = Unmatched Simplicity Single Volume scaling to Cold Isilon ****.gz ****.tsidx 50PB

11 Backupless Bliss Benefit: Snapshots + Splunk Replication = NO BACKUPS ****.gz ****.tsidx ****.gz ****.tsidx Hot/Warm XtremIO Cold Isilon Use Splunk Multi-Site Clustering For Site Protection Use Array Snapshots For Data Protection Snapshots Splunk Multi- Site Clustering

12 Bonus!! Encryption Benefit: Encryption = Piece Of Mind Hot/Warm XtremIO Using Self Encrypting Drives (SED) AES256 Encryption Algorithm Drives Taken Out Are Unreadable Cold Isilon

13 Bonus!! Always Searchable Benefit: Automation = Simplicity Cold Isilon Automated Tiering For High Density Capacity Keep Data In Cold Then Delete Write-Once-Read-Many (WORM) protection SEC Rule 17a-4(f) definition standards

14 Bonus!! HUNK Ready Benefit: Isilon HDFS = SIMPLE Hadoop Analytics Data-in-place analytics Multi-protocol access Efficiency gains of 20% vs 300% overhead Enterprise Features For Hadoop

15 Hadoop Market Leadership #1 Market Leader in Hadoop Shared Storage 250% YoY Growth 700+ Customers

16 HADOOP ARCHITECTURE - TRADITIONAL Map Red Hive Pig Hbase Storm Kafka Knox Spark Tez Sqoop YARN Data Node + Compute Node Data Node + Compute Node Data Node + Compute Node Ethernet NameNode Data Node + Compute Node Data Node + Compute Node Data Node + Compute Node

17 HADOOP ARCHITECTURE WITH ISILON Map Red Hive Pig Hbase Storm Ambari Agent Kafka Knox Spark Tez Sqoop NameNode YARN DataNode Compute Node Compute Node Compute Node Ethernet Compute Node Compute Node Compute Node name node name node name node name node data node

18 Traditional Hadoop - Layers

19 Isilon + Hadoop NO Layers

20

21

22 HDFS: Integrated Isilon and vhadoop Node reply NFS SMB SMB SMB, NFS, HTTP, FTP, HDFS name node name node name node data node HDFS Apache NFS name node

23 Si vous avez des questions sur cette présentation, n hésitez pas à prendre directement contact avec : Denis FRAVAL-OLIVIER denis.fraval@emc.com

24