ATA DRIVEN GLOBAL VISION CLOUD PLATFORM STRATEG N POWERFUL RELEVANT PERFORMANCE SOLUTION CLO IRTUAL BIG DATA SOLUTION ROI FLEXIBLE DATA DRIVEN V

Transcription

1 ATA DRIVEN GLOBAL VISION CLOUD PLATFORM STRATEG N POWERFUL RELEVANT PERFORMANCE SOLUTION CLO IRTUAL BIG DATA SOLUTION ROI FLEXIBLE DATA DRIVEN V ARCHITECTURE GUIDE Hitachi Unified Storage VM Architecture Guide By Hitachi Data Systems October 2013

2 ARCHITECTURE GUIDE 2 Contents Executive Summary 3 Chapter 1: Unified Storage With Enterprise Virtualization 4 A Single Virtualized Platform With Hitachi Unified Storage VM 4 Chapter 2: Hitachi Unified Storage VM Architecture 4 One Platform for All Data 5 Hitachi Unified Storage VM Hardware Components 5 High-Performance Switched Network 13 Cache and Control Memory 14 Front-End Design 14 High-Performance SAS Back-End Design 15 Hitachi Accelerated Flash 16 Chapter 3: Software Packages 19 Block Module Software Bundles 20 File Module Software Bundles 26 Conclusion: A Single Virtualized Platform for All Data 29

3 ARCHITECTURE GUIDE 3 Hitachi Unified Storage VM Architecture Guide Executive Summary Hitachi Unified Storage VM (HUS VM) is an entry-level enterprise storage platform combining storage virtualization services with unified block, file and object data management (see Figure 1). This versatile, scalable platform provides a new storage virtualization system with central storage services for existing storage assets. Unified management delivers end-to-end central storage management of all virtualized internal and external storage. A unique, hardwareaccelerated, object-based file system supports intelligent file tiering and migration as well as virtual NAS functionality without compromising performance or scalability. Hitachi Accelerated Flash storage speeds access to data for performance-centric applications. HUS VM storage platform requires less floor space and cooling due to innovative new technologies and packaging. It offers tighter integration with server virtualization and improved storage administrator productivity through Hitachi Command Suite. Hitachi Command Suite is an open, standards-based suite of tools that provides comprehensive management, control and reporting for all file, object and block services. This software suite enables single-pane-ofglass management of all virtualized internal and external storage attached to HUS VM. Using this system, you can deploy virtual server applications within a new storage virtualization framework and extend new services to your current storage investments. You can more closely align IT with business objectives by enhancing capacity efficiency. HUS VM storage systems provide the foundation for matching application service requirements to different classes of storage and for delivering critical services. Figure 1. Hitachi Unified Storage VM

4 ARCHITECTURE GUIDE 4 Chapter 1: Unified Storage With Enterprise Virtualization To achieve growth and efficiency, businesses today must overcome a range of challenges while faced with surging operating expenses and flat budgets. Building an enterprise-level storage infrastructure should not be one of their challenges. Hitachi Unified Storage VM changes the storage economics equation by introducing the world s first unified storage platform with enterprise storage virtualization. With storage virtualization, businesses gain higher value and higher functionality, resulting in greater capacity efficiency and extensive cost savings. A Single Virtualized Platform With Hitachi Unified Storage VM Hitachi Data Systems offers a unique approach to storage management: a single virtualized platform for all data (structured and unstructured) with single-pane-of-glass management for heterogeneous environments. We are focused on the evolving requirements of structured and unstructured data. And, we are the only vendor who can provide you with a single, virtualized and scalable data management architecture for all open systems platforms as well as all data and information types (see Figure 2). Figure 2. Hitachi Consolidated Storage Virtualization Hitachi Unified Storage VM enables a common set of management tools across all storage assets, whether they are the products of Hitachi Data Systems or our competitors. Our common platform and management tools improve the productivity of storage administrators. They enable better cost management (power, cooling, resource sharing), simplified data migration (block and file storage), and higher availability (IOPS and reliability) with less risk (data protection). Chapter 2: Hitachi Unified Storage VM Architecture Like Hitachi Virtual Storage Platform (VSP), which we introduced in 2010, Hitachi Unified Storage VM is based on the Hi-Star crossbar-switch architecture. This architecture provides a shared resource system where all the primary components, including front-end ports, back-end ports, cache modules and processors, are connected through an internal switched network. HUS VM supports up to 64PB of internal and external virtualized storage capacity, and up to 256GB of directly addressable cache (see Table 1).

5 ARCHITECTURE GUIDE 5 The internal processors share a global cache along with the front-end and back-end I/O modules, which creates a common pool of storage resources and disk capacity. This disk capacity can include external storage, which is connected through host-initiator Fibre Channel ports. One Platform for All Data Controller-based storage virtualization is a key enabling technology to providing one platform for all data. In addition, the internal architecture of Hitachi Unified Storage VM, with management and control processing separated from front-end and back-end processing, delivers improved performance for any unique processing required by different types of data. It provides the flexibility to mix and match front-end and back-end storage services to rapidly achieve a desired goal. Consolidated and aggregated multivendor storage resources provide a single platform of enterprise capacity for all file, object and block services functionality. Operational Simplicity Hitachi controller-based storage virtualization dramatically simplifies the storage infrastructure. Virtualization enables the consolidation and aggregation of all multivendor storage resources in a single pool of enterprise storage capacity. Existing LUNs and data on externally attached storage systems are automatically discovered by the Universal Volume Manager and presented through global cache as if they were still connected to the application server. Hitachi Command Suite offers a comprehensive set of management, control and discovery tools for file, object and block storage services. The software integrates solutions for storage resource management, tiered storage, business continuity and thin provisioning, giving storage managers a unified management solution for all enterprise storage. Hitachi Unified Storage VM Hardware Components Hitachi Unified Storage VM can be configured starting with a single diskless system up to a full, 3-rack system that comprises up to 1,152 hard disk drives (HDDs), including up to 96 Hitachi Accelerated Flash storage modules, 128 solid-state drives (SSDs) and a total of 256GB cache. The system provides a highly granular upgrade path, allowing the addition of file modules or drives to the system as storage needs increase. All are mounted in standard 19-inch racks. A basic HUS VM storage system consists of a 5U controller chassis and zero or 1 or more drive trays that contain the flash module drives (FMDs), HDDs or SSDs. HUS VM supports multiple concurrent operating systems to create a heterogeneous system environment. The controller chassis has an enterprise-grade controller, which has 2 interface or cache blades and 2 processor blades. All data passes through the interface or cache blade ASICs to cache. The processor blades execute all I/O jobs and manage cache. HUS VM hardware (see Figure 3) is composed of the following major components: Block modules storage virtualization system. File modules file virtualization system. Drive trays support for Hitachi Accelerated Flash module, large form factor (LFF) 3.5-inch drives and small form factor (SFF) 2.5-inch drives. Rack Hitachi Data Systems or standard 19-inch rack using our supplied rail kits.

6 ARCHITECTURE GUIDE 6 Figure 3. HUS VM Hardware Components Block Module Hitachi Unified Storage VM is based on a new block storage system powered by a storage virtualization controller. This virtual storage system is a single-controller chassis available without drives, and it contains the control logic, processors, memory and interfaces to the drive chassis and the host servers (see Figure 4). Its dual-node, sharedresource architecture creates a redundant configuration in which the storage system can continue operation should a component failure occur. The block module enables virtualized data access by aggregating storage servers with enterprise storage services, without added complexity (see Figure 5). It provides common enterprise storage and data services for lower level, lower cost storage by leveraging existing investments, and it provides seamless integration for future capabilities. Main components can be added, removed and replaced in the block module without shutting down a device while the storage system is in operation. The microcode can also be upgraded without shutting down the storage system. An integrated service processor is mounted in the controller chassis that monitors the running condition of the storage system. Connecting the service processor with our service center enables remote maintenance. The block module features:

7 ARCHITECTURE GUIDE 7 Up to 32 x 8GB Fibre Channel (48 without drives). 4 I/O modules each with eight 6Gb/sec SAS links. Integrated switching power supplies. Integrated service processor. Figure 4. HUS VM Controller Chassis

8 ARCHITECTURE GUIDE 8 Figure 5. Hitachi Unified Storage VM Block Module Chassis: Rear Detail The block controller module includes 2 interface or cache blades, 2 processor blades, an integrated service processor, and dual power supplies with built-in cooling fans. Each interface or cache blade has 8 DIMM slots for the system cache, a flash module for cache backup, and 6 sockets for front-end and back-end modules. Each contains an ASIC that includes most of the discrete logic previously found on VSP front-end director and back-end director boards, and a battery for data saving. If a power failure continues more than 20 milliseconds, the storage system uses power from the batteries to back up the cache memory data and the storage system configuration data onto the cache flash memory. The processor blade contains an Intel Xeon 8-core processor and local RAM. A basic HUS VM chassis has a total of: 2 cache blades, each with: Up to 128GB of cache (16 x 8GB DDR3 DIMMs). 160GB flash for cache backup (1 x 80GB or 1 x 256GB). Flash battery. 2 processor blades, each with: 1 x 8-core Intel Xeon processor. 8GB of local memory (2 x 4GB DIMMs). 8 host modules (4 x 8Gb/sec Fibre Channel ports each). 4 drive modules (8 x 6Gb/sec SAS links each). File Module Hitachi Unified Storage VM file module features a hybrid core architecture that uses the best properties of FPGAbased design to optimize data movement coupled with high-performance, multicore processors for efficient data management. Both classes of activity work at full speed without impacting each other. They can handle a number

9 ARCHITECTURE GUIDE 9 of simultaneous workloads, such as serving to thousands of users and hosting large-scale online transaction processing (OLTP) applications while maintaining high performance. The file module provides virtualized file access through a single cluster namespace, unifying the directory structure and presenting a single logical view. It provides a virtual NAS to allocate server resources for performance and high availability, and storage pools that simplify storage provisioning for applications and workgroups. Tiered storage optimizes performance, high availability and disk utilization across multiple tiers of storage. The file module provides high IOPS performance, utilizing built-in 10Gb Ethernet for high throughput NAS and iscsi networking connectivity (see Figure 6). Up to 4 nodes in a single cluster will meet demands for scalable storage with greater access, capacity and performance. Storage can be added at any time to meet new application or business needs, or to consolidate disparate storage with a single point of management and without downtime. These systems offer a total usable capacity up to 16PB under a single namespace. Easy-to-use centralized system management enables administration via command-line interface (CLI) or an intuitive graphical user interface (GUI). Figure 6. HUS VM File Module: Rear Detail HUS VM file modules are designed to meet the high-performance and scalability requirements of enterprise missioncritical applications. They can help reduce total cost of ownership (TCO) through consolidation without sacrificing performance and scalability. Hitachi NAS Silicon File System, our patented hardware-accelerated object-based file system, enables file system performance and scalability without compromise. In addition, multiple layers of storage virtualization overcome the complexities associated with large-scale file system management and data availability. Metadata optimization for improved storage efficiency is included in the Hitachi NAS Silicon File System. The number of metadata operations is significantly greater than the regular data operations and contributes to a larger share of the I/O workload mix. This function enables use of fewer high-performance disks combined with lower cost disks while achieving the same high performance. This efficiency derives from the automatic separation of metadata from user data. Metadata is placed on the faster tier of utilized storage and the user data on the slower, less expensive tier. This separation results in improved overall system performance and reduced costs. Hitachi NAS Silicon File System also includes core functionality for storage virtualization. Individual file systems belong to enterprise virtual servers (EVS) within each physical system, each with its own set of IP addresses, policies and

10 ARCHITECTURE GUIDE 10 individual port assignments. Virtual servers are used to group server resources to match the needs of application or organizational requirements. In a clustered environment, file systems can be quickly relocated among physical servers for load balancing, and virtual servers automatically migrate in a cluster failover scenario. The file system also organizes RAID storage into a logical pool of shared storage that can simultaneously provision multiple file systems. This capability allows administrators to provision file systems as needed, manually or by setting rules that automatically enforce policies, distributing data dynamically across available storage to optimize performance. Intelligent file tiering helps organizations move data among storage and archive tiers, whether internally to the data center or externally from remote or branch offices, with automated policy-driven migration tools. The cluster namespace functionality provides a single namespace with a directory structure that is independent of where data actually resides in physical storage. Virtual servers are used to group server resources to match the needs of application or organizational requirements. In a clustered environment, file systems can be quickly relocated among physical servers for load balancing, and virtual servers automatically migrate in a cluster failover scenario. High-speed deduplication results from our unique object-based file system offload engine (FOE), powered by FPGAs. Essentially, this means that hashing and chunking becomes an attribute of persisting a file. Specifically, hashing and chunking is accelerated in hardware, not in pure software. A base hashing or chunking engine license is included and, depending on performance requirements, 3 additional hashing or chunking engines can be licensed. Additional engines work in parallel, so the increase in dedupe performance is nearly 4-fold. The minimal impact to file serving activity is due to an intelligent deduplication process that knows when new data is added and automatically starts up the deduplication engine or engines as long as the system is not busy. When a file serving workload reaches preset thresholds, the deduplication engines throttle back, preventing any impact to file serving performance; then, they automatically throttle up when the system is less busy. Drive Trays Hitachi Unified Storage VM is available with a choice of storage options, ranging from high-performance flash modules and SSDs to SAS drives. Both LFF 3.5-inch drives and SFF 2.5-inch drives are supported. All drive types use a 6Gb/sec SAS interface. The Hitachi Accelerated Flash storage tray is a 2-rack unit chassis that enables the installation of up to 12 flash modules (see Figure 7). It includes 2 enclosure communication cards (ENCs) and 2 power supplies with built-in cooling fans.

11 ARCHITECTURE GUIDE 11 Figure 7. Hitachi Accelerated Flash Storage Tray: Up to 12 Flash Modules The standard drive tray is a chassis that enables the installation of up to twenty-four 2.5-inch small form factor disk drives and 2.5-inch solid state drives (see Figure 8). It includes 2 enclosure communication cards and 2 power supplies with a built-in cooling fan. Figure 8. Drive Tray: 2.5-inch SFF and 3.5-inch LFF

12 ARCHITECTURE GUIDE 12 The dense disk drive tray is configured with up to forty-eight 3.5-inch large form factor drives (see Figure 9). The ENCs and power supplies are individual for each half of the unit and are installed as a duplex configuration. Figure 9. Dense Drive Tray: 3.5-inch LFF

13 ARCHITECTURE GUIDE 13 TABLE 1. HITACHI UNIFIED STORAGE VM SPECIFICATIONS Physical Characteristics Maximum Hitachi Accelerated Flash Expansion Trays (2U, 12 x FMD) 8 Maximum Standard Disk Expansion Trays (2U, 24 x 2.5 disks) 48 Maximum Standard Disk Expansion Trays (2U, 12 x 3.5 disks) 48 Maximum Dense Expansion Trays (4U, 48 x 3.5 disks) 24 Data Cache (GB) Fibre Channel Port Performance (Gb/sec) 2/4/8 Maximum Logical Devices (LDEVs) 16,384 Number of Flash Modules per System (with spares) 0-96 Number of Disks per System (with spares) (2.5 or 3.5 ) 0-1,152 Number of Solid State Drives (SSD) per System Number of Disk Spares 1-64 Maximum Internal and External Capacity (PB) 64PB Block Modules Architecture Hierarchical Star Network Back-End SAS Links (6Gb/sec) port back-end modules (32 SAS links, 4 per port) Dimensions (Height x Width x Depth) 5U, 8.5" (217mm) x 19.0" (480mm) x 33" (838mm) Weight 156 lbs. (71kg) File Modules Nodes per Cluster 1-4 Main Board Memory per Node 32GB (4GB NVRAM) Maximum Capacity per Cluster 16PB Maximum File Size per Cluster 256TB 10Gb/sec Client Ports 4 Protocols SMB, NFS, FTP Dimensions (Height x Width x Depth) 3U, 5.2 (132mm) x 17.3 (440mm) x 28.6 (725mm) Weight 55 lbs. (25kg) FMD = flash module drive High-Performance Switched Network At the heart of Hitachi Unified Storage VM is the switched network that is used to communicate and transfer information between the various components (see Figure 10). Each block module contains a Hi-Star architecture-based controller. All cache data and control data paths are part of the switched network. This switched network is used to communicate and transfer information between the various components of Hitachi Unified Storage VM.

14 ARCHITECTURE GUIDE 14 Figure 10. Hitachi Unified Storage VM employs Hi-Star architecture-based network for high-performance data movement. Cache and Control Memory Hitachi Unified Storage VM uses partitioned cache rather than a shared global cache. A portion of this cache space (4GB to 20GB per blade, mirrored) is reserved for the system s control memory region. There is also a transfer buffer region where the host ports and drive ports transfer data blocks, and space for 2 or 4 user data cache directories (500MB each). The control memory and cache directory regions are backed up to each interface or cache blade s SSD on a planned shutdown. In the case of a power loss, all cache per blade is backed up to its local SSD. The remaining cache space is managed as a global pool. This space is evenly divided into 4 partitions for the 4 microprocessor units. A microprocessor unit may borrow some space from another partition under certain circumstances. A microprocessor unit cannot access its own data partition. Only the interface or cache blades can do so with direct memory access (DMA) transfers, but the microprocessors manage their partitions. Each processor blade microprocessor unit uses DMA to access control memory and the cache directories on the cache blades, but the cache blades do not. Front-End Design Each host I/O module contains one 4-port Tachyon QE8 8Gb/sec Fibre Channel controller. Each module is connected to 1 PCIe x8 link on the ASIC, on the interface or cache blade. Hitachi Unified Storage VM supports Fibre Channel for open systems and SAN connectivity. HUS VM supports up to 32 Fibre Channel ports from up to 8 host I/O modules per controller chassis. Additional ports, up to 48, can be added by replacing 1 to 4 drive modules per controller chassis with host I/O modules. The Fibre Channel ports support industry-standard 2Gb/sec, 4Gb/sec and 8Gb/sec transfer rates.

15 ARCHITECTURE GUIDE 15 Unique port virtualization technology dramatically expands connectivity from open systems platforms to Hitachi Unified Storage VM. Each physical Fibre Channel port supports 1,024 virtual ports. Each virtual port has access to a private storage partition called a host storage domain, which includes a bootable LUN0. Connectivity from all major open systems hosts is supported, including 1 : HP: HP-UX. IBM : AIX. Microsoft : Windows Server (2000, 2003, 2008, 2012). Novell: NetWare, SUSE Linux Enterprise Server. Red Hat: Enterprise Linux. Oracle: Sun Solaris. VMware: ESX Server. High-Performance SAS Back-End Design The back end of Hitachi Unified Storage VM is a SAS engine that is a cross between the HUS 100 family and Hitachi Virtual Storage Platform. The SAS engine elements include the drive I/O modules, up to 48 disk trays with their dual 4-link SAS switches (ENCs), and the SAS drives. The interface or cache blade controls all communications between the drive modules and the processor blades and all DMA transfers to cache. Each drive module is connected to 1 PCIe x8 link on the ASIC in the main blade. Each drive I/O module contains 1 SAS controller device with a pair of wide ports (4 x SAS 6Gb/sec lanes each). Optional I/O modules perform data-at-rest encryption. HUS VM is available with a choice of disk drives, ranging from high-performance SSDs to SAS drives (see Table 2). Both LFF 3.5-inch drives and SFF drives are supported. All drives types use a 6Gb/sec interface to the drive modules. TABLE 2. HITACHI UNIFIED STORAGE VM DRIVE TYPES Drive Type Size Capacity FMD SSD HDD Speed (RPM) n/a 1.6TB n/a n/a 3.2TB n/a GB n/a GB n/a GB 15K GB 10K GB 10K GB 10K 3.5 3TB 7.2K 3.5 4TB 7.2K FMD = file module drive, SSD = solid state disk, SAS = serial attached SCSI 1 For the most updated list of supported operating systems, refer to Hitachi Data Systems website at

16 ARCHITECTURE GUIDE 16 Hitachi Accelerated Flash Hitachi Accelerated Flash features an innovative Hitachi-developed embedded flash memory controller designed to achieve higher performance, increased durability and greater capacity compared to the commodity solid-state drives (see Figure 11). Its multicore, high-bandwidth architecture supports up to 128 flash DIMMs. Inline compression support results in faster formatting, write reduction, and extended device endurance for enterprise workloads. Enhanced error correction, learning cell program-erase, and data refresh enable superior data integrity and cell longevity. A high-performance flash translation layer is highly parallel with 8 PCIe lanes to a multicore processor with an integrated DDR-3 interface. Integrated flash controller logic supports 32 paths to the flash array. Inline compression improves sustained write performance by preserving reserved capacity for background tasks like garbage collection and wear leveling. This feature avoids wasted flash cells where data contains long sequences of zeros by detecting such patterns and minimizing actual cell usage. It features zero response time overhead to reduce setup time by performing flash formatting faster and lowers controller overhead using compression offload. It extends NAND (Not And) endurance by avoiding unnecessary erases and is transparent to storage system functions. Hitachi Accelerated Flash modules fit into a 2U flash chassis. Each enclosure holds 12 flash modules to scale up to 38.4TB of flash storage. Up to 8 flash enclosures can be housed in HUS VM, enabling more than 300TB of flash per system. Figure 11. Hitachi Accelerated Flash Storage Module Hitachi flash acceleration software speeds I/O processing to increase flash device throughput via higher thread count. Its express host I/O processing takes advantage of the high-bandwidth, low-latency architecture of the HUS VM. This software feature is transparent with other storage features like dynamic provisioning, dynamic tiering, in-system replication or remote replication. RAID Implementation Advantages Hitachi Data Systems drive-i/o modules employ advanced algorithms to manage performance. The intelligent controllers provide disk-interface and RAID management circuitry, offloading these tasks to dedicated embedded processors. Hitachi Unified Storage VM supports RAID-1+0, RAID-5 (parity RAID) and RAID-6 (see Table 3). All user data disks in the system are defined as part of a RAID array group of one type or another.

17 ARCHITECTURE GUIDE 17 TABLE 3. HITACHI UNIFIED STORAGE VM BACK-END DIRECTOR SUPPORT OF RAID CONFIGURATIONS 2 RAID Type RAID-1+0 Mirroring RAID-5 Distributed Parity RAID-6 Redundant Distributed Parity Supported Disk Configuration 2D+2D 3D+1P 7D+1P 6D+2P 14D+2P RAID-1+0 RAID-1+0 is available in 2 data plus 2 data (2D+2D) disk configuration. The configuration includes a rotating copy, where the primary and secondary stripes are toggled back and forth across the physical disk drives for performance. RAID-1+0 is best suited to applications with low cache-hit ratios, such as random I/O activity and with high write-toread ratios. RAID-5 Distributed Parity RAID-5 disk arrangements consist of 4 disks (3D+1P) or 8 disks (7D+1P). Data is striped across disks similar to RAID-1+0. However, RAID-5 keeps parity information on each stripe of data for fault resilience. If a failure occurs, the contents of the failed block can be recreated by reading back other blocks in the stripe and the parity. Parity information is distributed throughout the array to minimize bottlenecks when rebuilding data from a failed disk. The overhead of RAID-5 is equivalent to 1 disk drive, regardless of the size of the array. RAID-5 is best suited to applications using mostly sequential reads. Concatenated RAID-5 Array Groups Concatenated array groups enable users to stripe logical devices (LDEVs) across more disks than are in a single RAID-5 array group for better performance. The feature supports the concatenation of 2 or 4 RAID-5 7D+1P array groups. An LDEV created on a standard RAID-5 array group becomes a LUN when it is mapped to a host port. For concatenated array groups, the LDEV, striped across multiple elements in the joined array groups, forms a virtual device (VDEV). Mapping the VDEV to a host port creates the LUN. RAID-6 Redundant Distributed Parity Like RAID-5, RAID-6 stripes blocks of data and parity across an array of drives. However, RAID-6 maintains redundant parity information for each stripe of data. This redundancy enables RAID-6 to recover from the failure of up to 2 drives in an array, or in other words, a double fault. Other RAID configurations can only tolerate a single fault. As with RAID-5, performance is adjusted by varying stripe sizes. RAID-6 is good for applications using the largest disks and performing many sequential reads. RAID Rebuild If a disk in a RAID group fails, the information on the failed drive is rapidly and automatically rebuilt on a hot spare drive. Hitachi Unified Storage VM also allows logical volumes to be expanded online. Administrators can set rebuild priority based on the daily processing cycle and RAID configuration installed. 2 When using Open V-volumes for RAID-5, RAID-6 or RAID-1+0 configurations, Hitachi Unified Storage VM uses 2 adjacent 256KB chunks from the same disk before moving to the next disk, so the effective chunk size is 512KB. For example, in a RAID-5 7d + 1P configuration, the stripes are actually 3,584KB (7 x 512KB).

18 ARCHITECTURE GUIDE 18 Connect External Storage One of the most significant features offered by Hitachi Unified Storage VM is the ability to connect external, multivendor storage. This connectivity creates a single virtualized pool of capacity for administrators to centrally manage using Hitachi storage management software. HUS VM supports a wide range of 3rd-party storage systems (see Figure 12). Figure 12. A Single Virtualized Pool of Capacity For the latest information, see the Externally Attached Storage Systems on: Power Subsystem The power subsystem used in Hitachi Unified Storage VM has redundant power supplies in the controller. The power supplies are hot pluggable, hot swappable and N+1 redundant. This means power supplies can be removed or installed without affecting system operation. Each controller chassis in HUS VM consists of 2 redundant controller halves. Each half contains all physical and logical elements needed to sustain processing. Both storage halves support alternate connection path schemes, so if one fails, the other can continue processing for the entire storage system. Redundant power supplies are provided to power each half of the controller. In the event of a power supply failure, the power supplies in each half are capable of providing power for the entire system. System Monitoring Network The system monitoring network in Hitachi Unified Storage VM connects to all cabinets and reports on a variety of system conditions, such as component failure, fan speed, voltages and temperature. The network enables efficient predictive maintenance, so components can be replaced before they fail. It also expedites system repair after a failure, through the failure alert system.

19 ARCHITECTURE GUIDE 19 The system-monitoring network passes information to the service processor or remotely across a private LAN on a UNIX or Microsoft Windows console. Failure information is also available via Simple Network Management Protocol (SNMP). Copies of all system status and alerts are sent to Hitachi Data Systems customer support centers via the Hi-Track Remote Monitoring system. High Availability Hitachi Unified Storage VM places emphasis on high availability to satisfy the needs of the most demanding enterprise applications. Hitachi Data Systems offers a combination of unique industry solutions and best-in-class 3rd-party software integration to deliver unbeatable resilience and availability. In fact, only HDS offers a 100% data availability guarantee. Nondisruptive microcode and hardware upgrades. Automatic failover architecture with redundant, hot-swappable components. Dual data paths and dual control paths connecting every component. Active-active dual-ported disk drives. Nonvolatile backup of cache using a combination of battery and flash disk drives. Hi-Track Remote Monitoring system, which immediately sends notification of any incident that may affect availability to the Hitachi Data Systems customer support center. Chapter 3: Software Packages Hitachi Data Systems storage solutions support a full range of file, object and block storage services (see Table 4). The solutions give IT the ability to mix and match services to satisfy a desired goal. All solutions use open protocols, rather than proprietary APIs, to promote interoperability and maintain scalability. When combined with Hitachi Unified Storage VM, this complete offering of software solutions allows one storage solution to support all data types.

20 ARCHITECTURE GUIDE 20 Block Module Software Bundles TABLE 4. HITACHI UNIFIED STORAGE VM BLOCK MODULE SOFTWARE BUNDLES Bundle Hitachi Solution Application Hitachi Base Operating System (BOS) Hitachi Device Manager Hitachi Dynamic Provisioning Hitachi Universal Volume Manager Hitachi Virtual Partition Manager Hitachi Dynamic Link Manager Baseline management tools for Hitachi Unified Storage VM, including virtualization. Hitachi Base Operating System (with flash optimization feature) Hitachi Command Suite Analytics Hitachi Command Suite Mobility Hitachi Local Replication Hitachi Remote Replication Flash optimization feature Hitachi Device Manager Hitachi Dynamic Provisioning Hitachi Universal Volume Manager Hitachi Virtual Partition Manager Hitachi Dynamic Link Manager Hitachi Tuning Manager Hitachi Command Director Hitachi Tiered Storage Manager Hitachi Dynamic Tiering Hitachi Thin Image Hitachi ShadowImage Heterogeneous Replication Hitachi Replication Manager Hitachi TrueCopy synchronous remote replication Hitachi Universal Replicator Adds flash optimization to the baseline management tools for Hitachi Unified Storage VM to accelerate all flash performance. Seamlessly gathers and reports storage and application performance. Optimizes tiered storage at the volume or sub-lun level. Create and manage internal full and snapshot copies of volumes. Simplifies data replication between storage systems. The following sections describe the complementary storage capabilities and software components in depth. Hitachi Command Suite Storage Management Hitachi Command Suite is an application-centric storage management solution that incorporates the internationally recognized Information Technology Infrastructure Library (ITIL) services management best practices to simplify administration of a common pool of multivendor storage. This suite of management software gives administrators the tools to deliver dependable storage system availability and performance (see Figure 13). The software offers comprehensive management, control and discovery for file, object and block storage services and reduces complexity, costs and risk in the storage infrastructure.

21 ARCHITECTURE GUIDE 21 Figure 13. Hitachi Command Suite provides deep integration through a common GUI along with usability, data repositories and task workflows. Hitachi Base Operating System (BOS) Hitachi Base Operating System is a set of fully integrated tools for simplifying storage management and enabling the partitioning and virtualization capabilities of Hitachi Unified Storage VM (see Table 5). BOS utilizes an easy-to-use and intuitive GUI to centrally manage Hitachi storage systems and also includes a complete CLI. It provides user, logical, physical and host management views that enable provisioning and storage pooling for primary and secondary storage. The Base Operating System includes the following individual software components: TABLE 5. HITACHI BASE OPERATING SYSTEM INTEGRATED TOOLS Tool Hitachi Base Operating System (with flash optimization feature) Hitachi Device Manager Hitachi Dynamic Provisioning Hitachi Universal Volume Manager Hitachi Virtual Partition Manager Hitachi Dynamic Link Manager Advanced Function y Speeds I/O processing to increase flash device throughput. y Primary control point for Hitachi Base Operating System. y Provides a single point of management for all Hitachi physical and virtual storage. y Acts as the interface for integration with other systems. y Provides thin provisioning for simplified provisioning operations, automatic performance optimization and storage space savings. y Enables virtualization of external heterogeneous storage. y Supports up to 29 virtual cache partitions. y Provides advanced SAN multipathing with centralized management.

22 ARCHITECTURE GUIDE 22 Hitachi Device Manager Hitachi Device Manager provides centralized management of multiple Hitachi storage systems. Hitachi Device Manager v7 features a new GUI, integrated workflows for improved usability and significant improvements to both scalability and performance. By providing a single console for managing complex storage environments, Hitachi Device Manager software unifies and simplifies storage management. Featuring both an intuitive GUI and a complete CLI, Device Manager centrally manages single or multiple Hitachi storage systems. With highly efficient context-sensitive workflows, Device Manager supports multiple management views, including physical, logical, host, NAS and virtual server for provisioning and storage pooling for primary and secondary storage. Hitachi Dynamic Provisioning Hitachi Dynamic Provisioning provides Hitachi Unified Storage VM with thin provisioning services. This gives applications access to virtual storage capacity (see Figure 14). As an application writes data to a virtual volume, the storage system dynamically allocates physical disk space from a common pool. Unused capacity in the pool is available to any application that needs it, eliminating the waste of overallocated and underutilized application storage capacity. The automated allocation of application storage capacity also dramatically simplifies the storage provisioning process. Dynamic Provisioning reduces the need to perform complex storage system tuning to improve I/O performance. HUS VM automatically stripes thin provisioned volumes across the entire width of the physical pool of disks. This wide striping balances the I/O load across many disk spindles, giving consistently high performance for all I/O. Figure 14. Hitachi Dynamic Provisioning reduces the size, cost and complexity of the enterprise storage environment.

23 ARCHITECTURE GUIDE 23 HUS VM implementation of thin provisioning is unique. All internal and externally attached storage resources virtualized by the Hitachi storage controller can participate in the common physical pool used by thin provisioned volumes. Dynamic Provisioning also simplifies storage provisioning and automates data placement on disk for optimal performance. Administrators do not need to micromanage application storage allocations or perform complex, manual performance tuning. In addition, physical storage resources can be added to the thin provisioning pool at any time, without application downtime. Hitachi Universal Volume Manager Hitachi Universal Volume Manager simplifies migration of applications using 3rd-party storage to HUS VM. The software eliminates the need to reformat LUNs or perform complex extent mapping, providing a minimally disruptive migration process. Once virtualized behind HUS VM, external LUNs gain access to all Hitachi storage services. Hitachi Virtual Partition Manager Hitachi Virtual Partition Manager enables the logical partitioning of cache into independently managed virtual machines. The number of partitions and partition sizes can be adjusted nondisruptively while HUS VM is in operation. These partitions can be allocated dynamically to utilize resources based on changes in business requirements by assigning different I/O workloads to different areas of cache. Hitachi Dynamic Link Manager Advanced Hitachi Dynamic Link Manager Advanced offers robust multipath SAN connections between servers and storage systems. It provides fault-tolerant failover, failback and load balancing, and centralized path management, for improved information access, usability and availability. Automatic workload balancing helps to maintain outstanding system performance across all available paths. If one path were to fail, Dynamic Link Manager Advanced would automatically switch the I/O to an alternate path, ensuring that an active route to data is always available. Hitachi Command Suite Analytics Package Hitachi Command Suite Analytics software gathers information and reports on storage network resources, enabling storage administrators to make informed storage management decisions. It includes the following individual software components: Hitachi Tuning Manager Hitachi Tuning Manager is an automated, intelligent and path-aware storage resource management tool that maps, monitors, analyzes and measures storage network resources and performance from the application to the device. By monitoring all storage network resources, including hosts, file systems, databases, SAN switches and Hitachi storage systems, Hitachi Tuning Manager provides the necessary visibility for complete performance management of the entire storage environment. Through a Web-based interface, Tuning Manager facilitates monitoring of the storage network with a comprehensive range of performance statistics combined with predefined reports and custom reporting capabilities. Hitachi Command Director Hitachi Command Director centralizes management and reporting across Hitachi Command Suite. By consolidating reporting of storage configuration, capacity, performance and tier information, Command Director provides a businessoriented view into the storage environment (see Figure 15). From this view, administrators can easily align Hitachi storage assets with critical business applications and simplify application-to-storage reporting. Command Director also ensures compliance to application-specific storage service levels.

24 ARCHITECTURE GUIDE 24 Figure 15. Hitachi Command Director provides a business-oriented view of storage. Hitachi Command Suite Mobility Package Hitachi Command Suite Mobility software is used to optimize the system s tiered storage capabilities at the volume or sub-lun level. It includes the following individual software components: Hitachi Tiered Storage Manager Hitachi Tiered Storage Manager provides the unique ability to migrate volumes between heterogeneous tiers of storage, without affecting application access to data. The software supports up to 64 simultaneous migrations, using 64 processor threads, and it offers a single interface for all data movement between storage virtualized by Hitachi Unified Storage VM. Hitachi Dynamic Tiering Hitachi Dynamic Tiering extends Hitachi Dynamic Provisioning and takes the automation of tiered storage to a new level. It enables the management of multiple storage tiers as a single entity. It presents a new kind of virtual volume with embedded smart tiering that monitors access and moves data at the fine-grain page level (see Figure 16). Dynamic Tiering uses a dynamic storage pool that is divided into 42MB pages. Virtual volumes are made up of pages from the dynamic storage pool. Each page is mapped to a tier within the pool and can be anywhere in the pool on any tier within that pool. HUS VM, through Dynamic Tiering, determines which pages it is best to place in higher tiers and which in lower tiers. The pages can be moved up and down between the tiers within the pool for performance optimization purposes. A Hitachi Dynamic Tiering environment will have most of the highly referenced pages in the highest tier and the least referenced pages in the lowest tier. Dynamic Tiering will try to use highest tiers such as Hitachi Accelerated Flash storage as much as possible. This can provide the effective appearance that all the data is on the fastest tier of

25 ARCHITECTURE GUIDE 25 storage; in fact, most of the data resides on lower cost, lower performance storage tiers comprising SAS drives. The lowest tier also contains much of the spare capacity. A Dynamic Tiering volume is another type of volume in a virtualized storage architecture. Just like disk types and RAID configurations, multitier volumes are another way of delivering storage with tailored cost and performance service levels. Capacity can be dynamically added to or removed from a tier at any time, which means that sizing a tier for a pool is much easier. Figure 16. Volume, Page and File System Tiering With Dynamic Tiering, the storage administrator does not need to classify data or define policies. Once the tiers are configured, the storage system does all the work, freeing up the storage administrator to focus on other storagerelated responsibilities. Hitachi Local Replication Package Hitachi local replication software is used to replicate full volumes as well as to create snapshot copies of internal volumes. It includes the following individual software components: Hitachi Thin Image The high-speed, nondisruptive snapshot technology of Hitachi Thin Image snapshot software rapidly creates up to 1024 point in-time copies of mission-critical information within any Hitachi storage system or virtualized storage pool. In doing so, it does not impact host service or performance levels. Because snapshots store only the changed data, the volume of storage capacity required for each snapshot copy is substantially smaller than the source volume. As a result, Hitachi Thin Image snapshot software can provide significant savings over full volume cloning methods. Hitachi Thin Image snapshot copies are fully read/write compatible system backups, application testing and data mining applications while business continues to run at full capacity.

26 ARCHITECTURE GUIDE 26 Hitachi ShadowImage Heterogeneous Replication By providing nondisruptive, high-speed data replication within any Hitachi storage system or virtualized storage pool, Hitachi ShadowImage Heterogeneous Replication software enables immediate data use. It makes data available for decision support, software testing and development, and data protection operations. ShadowImage cloning operations are independent of operating system, application or device, allowing efficient and centralized replicated storage volume management. ShadowImage software provides heterogeneous replication between any storage systems within a virtualized storage pool managed by Hitachi Unified Storage VM. Leveraging the storage virtualization capabilities of the platform, administrators can move data that resides on an externally attached storage system from the source to a target data volume anywhere in the storage pool. This capability includes data movement to another externally attached system. Hitachi Replication Manager With Hitachi Replication Manager, administrators can configure, monitor and manage any replication systems that are based on Hitachi storage systems. Combining robust reporting, mirroring and features previously available in separate offerings, it manages in-system or distance replication for open systems environments. Replication Manager simplifies and optimizes configuration, operations, task management, automation and monitoring of the critical applications and storage components of your replication infrastructure. Hitachi Remote Replication Package Hitachi remote replication software is used to replicate volumes between primary and secondary data centers. It includes the following individual software components: Hitachi TrueCopy Synchronous Remote Replication Hitachi TrueCopy synchronous remote replication software duplicates data from one Hitachi storage system to another, across any distance. It automates the recovery process and enables normal business operations to resume in minutes rather than hours or days following an outage at the primary site. TrueCopy software provides hostindependent data replication, including heterogeneous replication capabilities for any type of data across any distance, without affecting application performance. Copies generated by Hitachi replication software products can be used for the rapid recovery of production systems or the restart of production on disaster recovery systems following an outage. They can also be used for data warehousing, data mining or data migration applications. Hitachi Universal Replicator Hitachi Universal Replicator delivers the industry s first multiplatform, multivendor, remote copy capability. Supporting asynchronous, real-time replication of data from one Hitachi Unified Storage VM to another, the software gives storage administrators a consistent replication approach using a common set of procedures, tools and skills for all data center storage. Conventional replication solutions push updates from the primary storage system to a remote location. Universal Replicator running on HUS VM at the remote site pulls changes from journal volumes maintained by HUS VM running Universal Replicator at the primary site. This approach offloads replication overhead from the primary storage system and dramatically reduces the impact of replication on the business application. Transmitted record sets include a sequence number, enabling the replication engine to verify receipt of all records at the remote site and to sequence writes in the correct order for storage replication. File Module Software Bundles Hitachi Base Operating System F provides multiprotocol file services, dynamic provisioning, intelligent file tiering, file virtualization and unified directory structure (see Table 6). Intelligent file tiering helps organizations move data among

27 ARCHITECTURE GUIDE 27 storage and archive tiers with automated, policy-driven migration tools. This integration of NAS and write once, read many (WORM) features combine NAS, archive, index and search technologies. Tiered file system (TFS), also known as metadata optimization, separates file system metadata from user data and automatically places metadata on the highest tier for improved performance and storage cost-efficiency. Complementary with the policy-based intelligent file tiering capability, it migrates data between different file systems. Cluster namespace creates a unified directory structure across storage pools and servers. Multiple file systems appear under a single common root, and both Server Message Block (SMB) and Network File System (NFS) clients obtain global access through any cluster node. Virtual file system supports SMB and NFS protocols for flexibility and power to handle very large files and millions of small files plus concurrent file system operations with no performance impact. Automatic file system expansion is also available. TABLE 6. HITACHI UNIFIED STORAGE VM FILE MODULE SOFTWARE BUNDLES Entry Value Ultra SMB and NFS Entry Bundle Plus Value Bundle Plus 2 x Virtual Server iscsi 64 x Virtual Server Storage Pool 4 x Virtual Server Hitachi NAS Replication bundle File System Audit File System Recover from Snapshot XVL (External Volume Links) (WFS2 from 6.1) File System Rollback Data Migrator Data Migrator to Cloud Quick Snapshot Restore Hitachi NAS File Clone Base Deduplication Read Caching Cluster Name Space Hitachi NAS Synchronous Image Backup High Availability Cluster Virtual Server Security Entry 90-day Trial License Virtual Server Migration Disaster Recovery The disaster recovery capabilities of Hitachi NAS Replication, based on object replication, bring data back online quickly and efficiently through enhanced tools that automate system failover and failback. A source file system can be included in multiple replication schedules, allowing for multitarget replication. The snapshots and replication states for each replication job are separately maintained. Hitachi NAS Replication also supports file replication, which allows it to recover a more granular subset of files compared to object replication, which works only at the file system level. Hitachi NAS File Clone software performs cloning at the file level. Using Hitachi NAS File Clone, multiple copies or clones of single files are made by taking snapshots of that file and saving subsequent differences separately. By referring back to the original file for most of the data, Hitachi NAS File Clone avoids making multiple copies of the common elements of the file. Using Hitachi NAS File Clone, entire development and production environments can be deployed in a matter of minutes with little incremental storage cost. Hitachi NAS Virtual Infrastructure Integrator, specifically developed for VMware environments, provides snapshot management from within a vcenter console. As an integrated plug-in to vsphere, Virtual Infrastructure Integrator allows vsphere administrators to work from their existing management interface to create snapshots for backup or