DIGITAL STORAGE CONCERNS AND CONSIDERATIONS JOE HEWES, EMC OEM Copyright 2015 EMC Corporation. All rights reserved. 1
DIGITAL STORAGE & ARCHIVING FOR NDT BUSINESS DRIVERS WHY DO THIS? Improve Product Safety Increase Manufacturing Quality / Yield Better Manage Component Vendor & Contractors Comply with Regulatory Requirements Mitigate Potential Liability Support Asset Maintenance & Lifecycle Initiatives 2
DIGITAL STORAGE & ARCHIVING FOR NDT CONSIDERATIONS Volume Growth Retention 3
UNSTRUCTURED DATA GROWTH 75% 78% 80% 2015 71 EB 2016 106 EB 2017 133 EB Total Capacity Shipped, Worldwide % of Unstructured Data Source: IDC 4
NDE DATA GROWTH RESOLUTION 3D MULTI-MODAL INCREASED SAMPLING LONGER RETENTION VIRTUAL/AUGMENTED REALITY? 5
SCALE-UP SYSTEM ARCHITECTURE Application servers Exchange servers Clients VMware and Hyper-V Database Servers SAN LAN Unified Storage FC iscsi TBD FC iscsi FCoE 10Gb Enet FCoE 10Gb Enet TBD VNX DataMover X-Blade Failover VNX DataMover X-Blade FILE Service Processor Failover Service Processor BLOCK Power Supply Power Supply SPS LCC SPS LCC Near-Line SAS drives Flash drives SAS drives 6
SCALE-UP SYSTEMS 7
SCALE-OUT ARCHITECTURE Servers Servers NFS HTTP CIFS FTP HDFS for Hadoop Servers Client/ Application Layer Ethernet Layer OneFS Operating Environment Intra-cluster Communication Layer 8
SCALE-OUT SYSTEMS Servers Servers NFS HTTP CIFS FTP HDFS for Hadoop Servers Client/ Application Layer Ethernet Layer OneFS Operating Environment Intra-cluster Communication Layer 9
EXPANDABILITY / UPGRADEABILITY ISILON AUTOBALANCE BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY AUTOBALANCE Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage AutoBalance automatically moves content to new storage nodes No server, client mount point or application changes Eliminates hot spots Enables unmatched storage capacity utilization of more than 80% 10
DIGITAL STORAGE & ARCHIVING FOR NDT CONSIDERATIONS Volume Growth Retention Risk of Loss Compliance 11
DATA PROTECTION AND AVAILABILITY HIGHLY RESILIENT, CLUSTERED ARCHITECTURE With With N+2, N+1 N+3, protection, and N+4 protection, data data is is 100% 100% available available if even multiple if a single drives drive or nodes or node fail fails And with Isilon, the more nodes in the cluster, the faster drive rebuild time FAILED FAILED 100% 100% 100% 100% 100% 100% 100% 100% 12
LOCAL PROTECTION: UNIFIED SNAPSHOTS Redirect on Write Modify Data D Source A B C D D A Storage Pool Modify Data A Snap Provides point-in-time snapshot copies of data Snapshots provided for both block and file resources Used as the foundation for native asynchronous replication on Unity 13
NATIVE ASYNC REPLICATION (FILE & BLOCK) Local Replication: Source Destination Remote: One to One (1:1) One to Many (1:N) Many to One (N:1) S1 S2 S3 Boston Houston D2 Austin D1 Atlanta D3 14
ENTERPRISE DATA PROTECTION OPTIONS FAST, EASY BACKUP AND DISASTER RECOVERY Primary Isilon Cluster Backup Isilon Cluster Disk-to-disk backup Remote archive and DR WAN/LAN Efficient snapshots with SnapshotIQ Data replication with SyncIQ Push-button simple failover/failback 15
TIERING OF DATA CORE CLOUD PROVIDER HOT DATA >30 days WARM DATA 1-2 Months FROZEN DATA 1-2 years 16
TIERING OF DATA CORE CLOUD PROVIDER SEAMLESS CLOUD INTEGRATION APPS & USERS Access time CLOUDPOOLS 17
SECURITY AND COMPLIANCE OPTIONS LEGAL IT ACCOUNTING MARKETING Roles-based access control (RBAC) Access Zones for secure isolation WORM Data Protection File System Auditing Data at Rest Encryption (DARE) with Self-Encrypting Drives (SEDs) Security and Technical Implementation Guide (STIG) hardening CAC/PIV Smartcard authentication FIPS OpenSSL support 18
DIGITAL STORAGE & ARCHIVING FOR NDT CONSIDERATIONS Volume Growth Retention Risk of Loss Compliance Untapped Value 19
NEXT-GEN ACCESS METHODS File Shares FILE Analytics FILE HPC Mobile Backup/Archive Cloud Apps 20
THE ISILON ADVANTAGE FOR HADOOP SCALE-OUT STORAGE WITH NATIVE HADOOP INTEGRATION In-place analytics Native integration speeds time to insight Enterprise data protection Fast snapshots, backup, and data recovery Simple, efficient data replication for disaster recovery Lower costs Eliminates the need for dedicated Hadoop infrastructure Much more efficient than DAS-based approach Increase flexibility Simultaneous support for any Apache-compliant Hadoop distribution Ambari integration for management, monitoring, and provisioning 21
CONCLUSION Anticipate Growth Start with storage architecture aligned to your Rhythm Archive objectives Protect Based on value/risk, implement proper data protection strategies Maximize Efficiency Tier data to lower-cost storage if rapid access not required* Extract Additional Information Analytics to reduce cost and/or deliver additional value Plan for the future Enable easy tech refreshes and migrations * If regulatory compliance permits 22
SCALE-UP SYSTEM ARCHITECTURE Application servers Exchange servers Clients VMware and Hyper-V Database Servers SAN LAN Unified Storage FC iscsi TBD FC iscsi FCoE 10Gb Enet FCoE 10Gb Enet TBD VNX VNX X-Blade Failover VNX VNX X-Blade FILE VNX SP Failover VNX SP BLOCK Power Supply Power Supply SPS LCC SPS LCC Near-Line SAS drives Flash drives SAS drives 24