Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration Nick Jarvis Director, File, Content and Cloud Solutions August 14, 2013 1
WEBTECH EDUCATIONAL SERIES HITACHI UNIFIED STORAGE AND HITACHI NAS PLATFORM PERFORMANCE OPTIMIZATION WITH FLASH ACCELERATION Hitachi Unified Storage (HUS) VM and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity while lowering power, cooling, and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform (HNAS) performance using flash acceleration, SSD storage, and other technologies By attending this webcast, you ll learn how to Increase HUS and HNAS performance by using flash technology Identify key technologies and products needed to achieve optimum results Locate and tune key parameters necessary for performance optimization
Drivers for High-Performance Storage
FLASH USE CASES SUPPORTS APPLICATIONS THAT REQUIRE RANDOM WORKLOADS File Shares (unstructured) SQL Server Database Analytics Apps (Unix/Linux) VMware/VDI environments Oracle Database (Red Hat/OVM) File System NFS/CIFS CSV/NTFS GPFS/GFS HDFS/JFFS VMFS OCFS/GFS All of the above applications generate high random read/write IO and require low latency. Match use cases to flash implementations to deliver on performance promises at lowest possible overall system cost
WHY ARE RANDOM IOPS WORKLOADS CRITICAL? I/O workloads are either random (many concurrent accesses to relatively small blocks of data) or streaming (sequential data transfers) Historically, random access has been associated with transactional workloads, which often represent an enterprise s most critical IT operations Adoption of scale-out architectures with networked storage drivers for scale-out include server and desktop virtualization, database consolidation, complex analytics, and data warehousing Even workloads that appear to be sequential from an individual application s point of view actually become random as they interact with other workloads using advanced disk array capabilities like de-clustered RAID, thin provisioning, and automatic storage tiering
FUNDAMENTAL STORAGE PERFORMANCE CHANGES AVAILABLE Yesterday s High Performance Today s High Performance A single Hitachi Accelerated Flash storage module can deliver 500X more IOPS than a single high-performance disk drive
A PARADIGM SHIFT IN PERFORMANCE APPROXIMATE PER-DEVICE PERFORMANCE POTENTIAL Traditional Disk Drives Solid State Capacity Capacity Drives Performance Drives Commodity SSD Hitachi Accelerated Flash storage IOPS 80 200 20,000 100,000 Resp. Time (milliseconds) 6 2 0.2 0.2
HITACHI INNOVATION: FLASH CAPACITY HITACHI ACCELERATED FLASH STORAGE Unique and patented Hitachi technology High-bandwidth, multicore architecture allows high density and predictable performance Industry improvements regarding Enterprise durability with cost-effective capacity Highest device density 5X device IOPS to SSD CPU and Flash Management Engine Block/Page Mapping Performance Manager Wear Leveling Contiguous Block Write Avoidance 100+ Related Patents Granted or Pending Data Refresh Endurance Manager
FLEXIBILITY FOR APPLICATIONS Adopting an ALL-IN-ONE enterprise storage platform provides Hitachi flash acceleration Firmware that has been re-engineered to increase scalability for host I/O processing on exiting VSP and HUS VM Can also be implemented without the need of SSD or Hitachi Accelerated Flash; however, adding either of these will provide performance improvements Hitachi Accelerated Flash (HAF) The HDS flash memory controller (HAF) is a multi-core, high-bandwidth architecture that uses block and page mapping, wear leveling, an endurance manager, and inline write compression that results in up to 94% write reduction Hitachi custom designed and built Hitachi Dynamic Tiering (HDT) hybrid storage Utilize automated sub-lun dynamic tiering for pooling storage resources for application host access Thin provisioning capability for efficient storage utilization and better performance Storage virtualization Virtualize up to 100+ external storage arrays and obtain the benefits of preserving existing assets, migration, and/or consolidation for management
HITACHI INNOVATION: FLASH ACCELERATION SOFTWARE REENGINEERING TO EXPLOIT FLASH CAPABILITIES 30+ fundamental software changes to turbo-charge performance with flash New express I/O processing Higher internal thread count support Improved wide striping capability Hitachi Storage Significant performance impacts Up to 65% reduction in response time Up to 2X Hitachi Dynamic Provisioning (HDP) scalability Nondisruptive installation and transparent to current applications HUS VM and VSP Optimized for Flash Today
HITACHI FLASH SOLUTIONS PORTFOLIO ENTERPRISE HYBRID ARRAY INTELLIGENT CACHING TEIRING Flash Acceleration Software Hitachi Accelerated Flash Hybrid Storage Tiering Performance HAF flash <1,000,000 random I/O, <1ms latency with high consistency *Flash acceleration 49% to 61% increased random I/O throughput Scale Flash acceleration improves HDP wide stripping scalability with hard drives up to 25% HAF flash enclosure <76.8TB capacity SSD <102TB, SAS <1.8PB, NL-SAS <3.7PB Data management and protection Storage tiering for HAF, SSD, SAS, NL-SAS (Hitachi Dynamic Tiering) Management with Hitachi Command Suite * Only random performance is improved by flash acceleration; sequential performance is unaffected
HITACHI FLASH SOLUTIONS PORTFOLIO ENTERPRISE MIDRANGE HYBRID AND ALL FLASH ARRAY CACHING TIERING Flash Acceleration Software Hitachi Accelerated Flash Hybrid Storage Tiering Performance HAF flash <500,000 random I/O, <1ms latency with high consistency *Flash acceleration 49% to 61% increase random I/O throughput Scale Flash acceleration improves HDP wide stripping scalability with hard drives up to 25% HAF flash enclosure <19.2TB capacity SSD <51TB, SAS <900TB, NL-SAS <3.4PB Data management and protection Storage tiering for HAF, SSD, SAS, NL-SAS (Hitachi Dynamic Tiering) Management with Hitachi Command Suite * Only random performance is improved by flash acceleration. Sequential performance is unaffected.
HUS VM ALL FLASH: NO-COMPROMISE ALL-FLASH STORAGE 500,000 IOPS, <1ms response Best storage optimization for flash Hitachi flash acceleration software Up to 154TB flash storage Best flash form factor and durability Hitachi Accelerated Flash Unified and virtualized capacity More flexible than all-flash systems Hitachi Command Suite
HITACHI VIRTUAL STORAGE PLATFORM: FLASH-ACCELERATED, ENTERPRISE-READY ADVANCED VSP FLASH OPTIONS CONTINUE ENTERPRISE LEADERSHIP Virtualize and flash-enable current Hitachi and 3rd-party storage Boost performance of multiple applications and platforms (including mainframe) Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering and Tiered Storage Manager Automate tiering of data Pin critical workloads in flash 1 Million IOPS ~200K more than EMC 40K 3X Scalability Without a forced box-swap
HITACHI NAS FAMILY COMPARISON Unified Storage Dedicated storage Easy to deploy and manage Utilize dynamic tiering File deduplication HUS 110 HUS 130 HUS 150 HUS VM Availability Symmetric HA Symmetric HA Symmetric HA Symmetric HA HNAS 4060 Clustered Failover HNAS 4080-4100 Clustered Failover Number of Nodes 1 to 4 1 to 4 1 to 4 1 to 4 1 to 2 1 to 4 Connectivity NFS, SMB, iscsi, Fibre Channel NFS, SMB, iscsi, Fibre Channel NFS, SMB, iscsi, Fibre Channel NFS, SMB, iscsi, Fibre Channel NFS, SMB, iscsi, Fibre Channel NFS, SMB, iscsi, Fibre Channel Storage HUS 110 HUS 130 HUS 150 HUS VM AMS and/or VSP AMS and/or VSP Maximum IP storage capacity 360TB raw 756TB raw 2.88PB raw 3.4PB raw 8PB usable 16PB usable FM = File Module
File System HNAS STANDARD FILE SYSTEM Meta Data SAS User Data Traditional file system approach Mixed IO on the same media All or nothing footprint One type of disk for all types of I/O
Optimized File System HNAS TIERED FILE SYSTEM Meta Data FLASH/ SSD / SAS Optimized file system approach Mixed IO placed on most effective and cost effective storage platform User Data SAS/NL -SAS Best TCO for workflow performance Provides cost efficiency with equal performance by using fewer or lower cost disks Can be deployed with or without SSD drives New installation with no degradation in I/O performance Performance benefits depend on application Improved spindle efficiency (achieve performance target with less storage) Metadata intensive operation (e.g. backup, replication or data migration) Large Files (VMware, Oracle, etc..)
Cluster Wide Read Cache HNAS CLUSTER READ CACHING Read Caches Enabled 4 x Bandwidth Cluster wide read cache Accelerate read intensive I/O at scale Cluster wide FLASH/SSD/ SAS NFS v3 environments Read Caching Copy1 Copy2 Copy3 Copy4 Meta Data Slow User Data Copy
HDT HNAS LEVERAGING HDT FLASH Optimized back-end storage Driven by HUS, HUS-VM and/or VSP Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering, Tiered Storage Manager Automate tiering of data Pin critical workloads in flash User Data FLASH/SSD TIER 1 DISK TIER 2 DISK
FLASH + VIRTUALIZATION AT TURKCELL 3rd-largest GSM operator in Europe; 34.7 million subscribers
Drivers for High-Performance Storage
QUESTIONS AND DISCUSSION
UPCOMING WEBTECHS Maximize IT WebTechs Comprehensive and Simplified Management for VMware vsphere Environments Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET Easily Deploy Microsoft Private Cloud and Microsoft SQL Server 2012 Data Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m. ET Check www.hds.com/webtech for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions Questions will be posted in the HDS Community - http://community.hds.com/groups/webtech
THANK YOU