DATA LAKE FOUNDATION 2.0 JEUDI 19 NOVEMBRE 2015 Denis FRAVAL-OLIVIER : ISD Presales Manager
EMC Isilon Unifying Workloads in one place Module 4: Horizontal and Vertical Markets
ISILON FOR ALL TYPES OF DATA Processes & Transaction Home Directories Sync n Share File shares Surveillance BLOBS Social & Next-Gen Web Content Splunk Hadoop & Analytics Design, Test & Manufacture Consumerization Personalization Demographics Archive & Backup Target
EMC Isilon Scale-Out platform Protocols Clients and Applications NFS SMB HTTP FTP HDFS for Hadoop REST for Object RESTful API GET PUT POST DELETE Gig-e 10 Gig-e Network Multi-Protocol Client/Application Layer Ethernet Layer OneFS Operating Environment Intra-cluster Communication
DATA LAKE EMC ISILON SCALE-OUT NAS DATA PROTECTION S-Series X-Series Data Lake DATA MANAGEMENT NL-Series HD-Series DATA SECURITY PERFORMANCE MANAGEMENT 5
3rd Platform cloud Innovation S - Series X - Series NL-Series Isilon CloudPools FUTURE HD-Series 6
Support for Multiple Analytics Applications Node reply NFS SMB NFS SMB SMB, NFS, HTTP, FTP, HDFS name node name node name node data node HDFS NFS name node MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce
Splunk Index Architecture
The Big, Cold Data Lake
The Bottomless Cold Bucket Benefit: Unmatched Scalability = Unmatched Simplicity Single Volume scaling to Cold Isilon ****.gz ****.tsidx 50PB
Backupless Bliss Benefit: Snapshots + Splunk Replication = NO BACKUPS ****.gz ****.tsidx ****.gz ****.tsidx Hot/Warm XtremIO Cold Isilon Use Splunk Multi-Site Clustering For Site Protection Use Array Snapshots For Data Protection Snapshots Splunk Multi- Site Clustering
Bonus!! Encryption Benefit: Encryption = Piece Of Mind Hot/Warm XtremIO Using Self Encrypting Drives (SED) AES256 Encryption Algorithm Drives Taken Out Are Unreadable Cold Isilon
Bonus!! Always Searchable Benefit: Automation = Simplicity Cold Isilon Automated Tiering For High Density Capacity Keep Data In Cold Then Delete Write-Once-Read-Many (WORM) protection SEC Rule 17a-4(f) definition standards
Bonus!! HUNK Ready Benefit: Isilon HDFS = SIMPLE Hadoop Analytics Data-in-place analytics Multi-protocol access Efficiency gains of 20% vs 300% overhead Enterprise Features For Hadoop
Hadoop Market Leadership #1 Market Leader in Hadoop Shared Storage 250% YoY Growth 700+ Customers
HADOOP ARCHITECTURE - TRADITIONAL Map Red Hive Pig Hbase Storm Kafka Knox Spark Tez Sqoop YARN Data Node + Compute Node Data Node + Compute Node Data Node + Compute Node Ethernet NameNode Data Node + Compute Node Data Node + Compute Node Data Node + Compute Node
HADOOP ARCHITECTURE WITH ISILON Map Red Hive Pig Hbase Storm Ambari Agent Kafka Knox Spark Tez Sqoop NameNode YARN DataNode Compute Node Compute Node Compute Node Ethernet Compute Node Compute Node Compute Node name node name node name node name node data node
Traditional Hadoop - Layers
Isilon + Hadoop NO Layers
HDFS: Integrated Isilon and vhadoop Node reply NFS SMB SMB SMB, NFS, HTTP, FTP, HDFS name node name node name node data node HDFS Apache NFS name node
Si vous avez des questions sur cette présentation, n hésitez pas à prendre directement contact avec : Denis FRAVAL-OLIVIER denis.fraval@emc.com