1 W H I T E P A P E R Customer-Validated Converged Solution Supports Microsoft SQL Server Very Large Database Configuration Hitachi Virtual Storage Platform with Hitachi Compute Blade 2000 Consolidates High-Transaction Deployments By Scott Davis, Mike Becker December 2012
2 2 Table of Contents Introduction 3 Solution Overview 4 Key Solution Components 6 Hardware Components 6 Software Components 11 Solution Design 14 Very Large Database Implementation for Microsoft SQL Server 14 Storage Architecture 14 Storage Configuration 16 SAN Architecture 20 Network Architecture 21 Compute Blade Configuration 23 Engineering Validation 24 Test Methodology 25 Test Results 26 Latency Measured by SQLIO and IOMeter 28 Conclusion 31 Appendix A Contributors 32
3 3 Introduction Many organizations are experiencing tremendous growth in data and must scale their infrastructure to keep pace with the data explosion. Data volumes are stressing the ability of storage to scale in performance to manage the data as well as to scale in capacity nondisruptively. Standalone servers are reaching bottlenecks in memory, processing power and I/O capabilities as data volumes increase. The very large database (VLDB) solution from Hitachi Data Systems integrates with Microsoft SQL Server 2008 R2. This integration provides a framework to consolidate SQL OLTP and other types of high-transaction deployments on a single platform capable of handling current storage and server loads reliably while providing nondisruptive growth into the future with extensive management capabilities. Provided by a single vendor, this solution provides a highly scalable server and storage platform designed for adding capacity without downtime. The components within the platform provide automatic, dynamic load balancing, avoiding the need for manual performance tuning. All components have built-in remote management and integrate with industry-leading Hitachi Command Suite as well as with Microsoft management tools. All of this leads to a highly scalable system, removing constraints on Microsoft SQL Server with better than % availability, delivering constant uptime to clients now and into the future. This white paper's configuration information is intended for IT administrators, architects, DBAs, CIOs or CTOs with an interest or responsibility for planning a very large database system using Microsoft SQL Server 2008 R2 or later. Note: Testing of this configuration was in a lab environment. Many things affect production environments beyond prediction or duplication in a lab environment. Follow the recommended practice of conducting proof-of-concept testing for acceptable results in a nonproduction, isolated test environment that otherwise matches your production environment before your production implementation of this solution.
4 4 Solution Overview The very large database (VLDB) converged solution configuration from Hitachi Data Systems provides the scalable server, storage area network, and storage to keep pace with the growth of large enterprise-level databases. The combination of the converged Hitachi solution with Microsoft SQL Server 2008 R2 provides a high-performance, extremely reliable VLDB solution with the ability to grow over the long term as business needs expand. The solution reviewed in this white paper was developed to meet a customer use case for a service bureau that provides personal reports to individuals and corporations in real time, with a requirement for rapid response times. For this customer, large amounts of data are constantly being acquired and updated to service queries from their Internet portal using a primary Microsoft SQL 2008 online transaction processing (OLTP) database approximately 12TB in size and growing to an expected size of 20TB or larger in the next 12 to 24 months. This VLDB configuration from Hitachi Data Systems comprises the following infrastructure elements: Compute infrastructure 1 Hitachi Compute Blade 2000 server supporting Microsoft SQL Server 2008 R2 with: 8 blades configured into 2 symmetric multiprocessor (SMP) servers providing compute scalability. Fibre Channel dual-ported Brocade host bus adapters (HBAs) for redundant connectivity to the storage infrastructure. 64 cores and 768GB of memory per SMP. Storage infrastructure 1 Hitachi Virtual Storage Platform: Dual controllers for active-active link redundancy and added bandwidth. 512GB total system cache. 75TB initial useable disk capacity with growth to multiple petabytes. SAN infrastructure 2 Brocade 5100 series Fibre Channel switches: Redundant active-active paths from storage to the servers using Brocade 5100 switches. 16 x 8Gb/sec Fibre Channel ports per switch. Network infrastructure redundant paths for robust connectivity. Figure 1 provides an overview of the VLDB configuration showing connections between the storage and servers. This customer configuration depicts a dual SMP configuration composed of 4 blades per SMP connected to a Hitachi Virtual Storage Platform capable of supporting a 32TB VLDB to each SMP. The design encompasses the use of various storage devices. For example solid state disks (SSDs) provide high bandwidth for heavily used database files, such as the SQL tempdb, and logs and lower-bandwidth devices, such as SAS drives, for lower-bandwidth activity.
5 5 Figure 1. Very Large Database Customer Configuration Components and Connections
6 6 Key Solution Components The following sections describe the key hardware and software components making up this solution. Hardware Components To sustain a scalable and reliable high-performance system to manage high volumes of data, the VLDB customer configuration is recommended. Table 1 lists the hardware components that this customer configuration uses. Table 1. The Very Large DataBase Architecture hardware components Component Description Firmware Quantity Hitachi Compute Blade 2000 chassis 16 8 Gb/sec dual-port Brocade host bus adapters (HBAs) 4 1 Gb LAN switch module 2 x 8 Gb Fibre Channel switch modules 2 management modules 8 cooling fan modules 4 power supply modules A0170-B Hitachi Compute Blade 2000, X57A1 blade Hitachi Virtual Storage Platform storage system Brocade 5100 switch Brocade 825 Fibre Channel HBA 2 8-core Intel Xeon X GHz 192 GB memory 1 x 4 port 1 Gb Ethernet mezzanine card 1 x 4 port 8 Gb Fibre Channel mezzanine card Multi-chassis18 x 8 Gb Fibre Channel ports used 512 GB cache memory 536x 300 GB, 10K RPM, SAS disks 28x 400 GB SSDs SAN switch with 16 x 8Gb Fibre Channel ports Dual-ported HBA 8 Gb PCI Express 2.0 EFI b 2 v x64 16
7 7 Hitachi Compute Blade 2000 Hitachi Compute Blade 2000 (CB 2000) is an enterprise-class, high-performance scalable server platform. Housed in a blade chassis, up to 8 dual-socket, 16-core blades can be accommodated. Hybrid I/O composed of internal I/O within a blade and PCI-e I/O in the chassis can be utilized for high bandwidth and scalability. All components are redundant and hot pluggable for high reliability to achieve at least five-9s (99.999%) availability. Built-in management features provide for ease of configuration and management in addition to remote management capability. Each blade has 2 processor sockets with each socket supporting up to 8 cores per processor, providing 16 cores per blade. A blade can have up to 384GB of memory to support computeintensive applications. Blades contain 2 mezzanine I/O slots and are tied to 2 PCI-e slots, which can be shared, providing greater bandwidth to enable scaling for growth. In addition to the PCI-e slots, embedded switches within the blade enclosure provide connectivity for both Ethernet and Fibre Channel. Logical partitioning (LPAR) firmware-based resources within the blade chassis can be tied together or isolated to form various-sized virtual machines. Blades can also be partitioned into 2- or 4-blade SMP systems with I/O resources segregated into the SMP. A crossbar switch between the blades within an SMP is utilized for connecting the blades. Configuring blades into a 4-blade SMP provides a secure scalable compute resource with up to 8 sockets containing 64 cores supporting up to 1.5TB of memory for server consolidation and highly scalable performance for high-performance computing environments. Components are redundant and hot swappable, reducing unplanned downtime and enabling five-9s availability. Power supplies, switches and fans are redundant and hot swappable. Blades can be set up to failover and be hot-replaced. Configurations can be created of N+M blades where N blades are backed up by M blades for failover, even across multiple Compute Blade 2000 chassis. Figure 2 provides a visualization of the layout of the CB 2000 architecture.
8 8 Figure 2. illustrates the layout of a Compute Blade 2000 Layout The blade chassis is a 19-inch rack-compatible 10U-high unit. Management modules within the blade chassis provide both command line and GUI interfaces for configuring and managing the blades and chassis components remotely. The GUI management interface provides for easy configuration of the system. Interfaces are provided through the management modules for connecting remotely to the operating systems on the blades. Using CB 2000 for the VLDB configuration removes resource constraints on the Microsoft SQL Server. It also provides for processing and I/O scalability to meet current performance requirements for a VLDB and provides for future growth scaling. Hitachi Virtual Storage Platform Hitachi Virtual Storage Platform (VSP) offers an entirely new level of scalable enterprise storage capable of handling the most demanding workloads while maintaining great flexibility. The system offers high reliability (with a 100% uptime guarantee available) while being able to dynamically scale bandwidth, processing and storage capacity independently. This provides a platform for hosting multiple scalable applications and for converging multiple existing systems. VSP is engineered to be scalable in 3 dimensions: Scale up for increased performance, adding just the processing, cache, ports, etc., that you need; scale out for increased internal capacity, with up to 1,280 large form factor drives, 2,048 small form factor drives, or combinations of the 2; scale deep to leverage industry-leading external virtualization technology and manage your existing storage through a common interface and management tools.
9 9 Virtual Storage Platform Features PERFORMANCE Predictable, scalable performance through industry-leading engineering every component of VSP is scalable independently so VSP grows as your demands grow: Up to 32 processing cores. Up to 1TB of shared global cache. Point-to-point SAS-2 internal architecture with up to 192GB/sec expandable grid switch for internal data movement. 2.5-inch and 3.5-inch SSD, SAS, nearline-sas and SATA disk options. Up to one hundred ninety-two 8Gb/sec Fibre Channel, IBM FICON and 10Gb/sec Fibre Channel over Ethernet (FCoE) host ports. Hitachi Dynamic Provisioning allows grouping of multiple RAID groups into a pool which can be dynamically grown or shrunk without disruption to production applications. Physical storage can be hot-added and appended to the pool to provide as-needed capacity and performance scaling. Dynamic provisioning utilizes a technique called "wide striping," which distributes the data across all the disks in a pool, delivering greater IOPS for performance scaling. Dynamic pools can be tailored for performance specific to different workloads, and expanded or shrunk on the fly while in production. COST EFFICIENCY Green Initiative: Best-in-class power, cooling, floorspace density, operating costs and data availability mean a truly affordable solution for the long term, including a 46% smaller footprint and up to 48% less power and cooling than other solutions. Thin provisioning: Allocates capacity only as needed and includes an ability to reclaim any unutilized capacity. RELIABILITY With the industry's only 100% uptime guarantee, backed by a US$1million bond, delivering the highest reliability with fully redundant components, VSP provides the ability to scale capacity while applications are running in production. Ability to meet increasing demands by dynamically and nondisruptively adding internal processors, cache connectivity, and capacity as well as scale externally attached storage as needed. Global support: 24/7 x 2-hour or 4-hour response. MANAGEABILITY Single integrated management suite for consolidating existing SAN and NAS systems. Common GUI dashboard and command line interface (CLI) for provisioning, replication, performance tuning and alerting. Automatic and dynamic internal load balancing means optimized performance and reduced management overhead.
10 10 SYSTEM AND DATA SECURITY Data-at-rest encryption built into firmware with no impact on system performance. Role-based management system control for delegation of responsibilities and access to resources. Cache backup provided via SSD drives to enable the unit to withstand a total power outage without data loss. Hi-Track Remote Monitoring system. In-system replication: Hitachi ShadowImage Heterogeneous Replication volume copies and Hitachi Thin Image. Logically partition storage resources, including capacity, cache and ports for security and management requirements. Deliver metered storage services and guaranteed quality of service (QoS) based on customizable application-specific requirements. VIRTUALIZATION Industry-leading virtualization of externally attached heterogeneous storage environments means you can manage all your storage via a single management tool. Provides the ability to nondisruptively and dynamically virtualize new or existing external storage systems without the need to perform large scale data migration; allows you to seamlessly migrate from older technologies to newer with just a single server reboot instead of hours or days of downtime waiting for data to migrate. Leverage existing storage assets while increasing utilization efficiency, improve performance to older storage systems, and extend new features such as VMware VAAI integration and dynamic tiering to existing storage systems. AUTOMATED TIERED STORAGE MANAGEMENT Dynamic tiering provides the ability to dynamically make more active data available on higherperformance disks (such as SSD drives) without operator intervention. At the same time, it moves less active data to lower performing drives, including modular and 3rd-party storage, without interrupting the application and delivering more effective use of storage resources. Automated policy-based mechanism transfers data volumes while matching application-driven requirements with the storage system characteristics for price, performance and availability. Automated, dynamic sub-lun tiering enables page-level placement across internal and external storage tiers, including multivendor storage systems, based upon page utilization performance requirements. REPLICATION Integrated heterogeneous replication, any-to-any long distance replication via a single interface with ability to logically group sets of volumes by individual application to ensure data consistency spanning across infrastructure. Support for enhanced capabilities such as 3 data center cascading or multi-target solutions ensures that any future business continuity requirements can be adequately met.
11 11 Ability to perform storage clustering for virtualized environments ensures automated transparent failover of applications. OPERATING SYSTEM INTEGRATION Microsoft Hyper-V support for live migration over distance. Free Microsoft System Center plug-ins for SCOM, SCCM, SCVMM. VLDBs typically grow at a high rate as new data is acquired and assimilated. VSP provides the ability to dynamically grow storage without disruption to keep pace with the new data. While data is being added, low response times are required to service database queries. The parallel paths, large cache, and high performance of the VSP platform provide the ability to respond to these queries while allowing the database to grow. The ability to add processors and cache allows VSP to keep pace with expanding processing needs. VSP also addresses VLDB backup by providing options where a database can be replicated in real time to another VSP system onsite or offsite, with data consistency, should a failover occur. Brocade 825 Fibre Channel HBA Brocade 825 Fibre Channel HBA is a dual-ported 8Gb PCI-e I/O card. The card provides highperformance data transfers and is manageable with Brocade Network Advisor. Brocade 5100 SAN Switch The Brocade 5100 SAN switch provides 40 x 8Gb/sec ports with the following characteristics: Nonblocking architecture with all ports active at 8Gb full-duplex with no oversubscription. Integrated routing capabilities to connect switches in different fabrics. ISL trunking for a single logical link of up to 64Gb/sec of balanced throughput. Software Components Table 2 outlines the software components used by this customer configuration. Table 2. Customer Configuration Software Components Software Components Version Hitachi Storage Navigator Microcode Dependent Hitachi management and monitoring tools Release dependent SQLIO disk subsystem benchmark tool 4/4/2005 Microsoft Windows Server 2008 R2 SP1, Datacenter Edition (64-Bit) Microsoft SQL Server 2008 R2 SP1, Enterprise Edition (64-Bit)
12 12 Hitachi Storage Navigator Modular 2 Hitachi Storage Navigator Modular 2 enables essential management and optimization of storage system functions on a single storage unit. Using Java agents, Storage Navigator Modular 2 runs on most browsers. A command line interface is also provided. Use Storage Navigator Modular 2 for the following: RAID-level configurations. LUN creation and expansion. Online microcode updates and other system maintenance functions. Performance metrics. For more information, see Hitachi Storage Navigator Modular 2 on Hitachi Command Suite Management and Monitoring Tools In addition to customizable dashboards, graphical reporting and service level objective management, the new Command Suite storage management tools allow simple wizard-based control of all Hitachi storage solutions, with many common tasks being completed in just a few clicks. The webbased architecture allows you to customize your view of the information with column selections, filters and dashboard modules. You can even schedule tasks for later execution, freeing you to do other work while the system keeps you apprised of the status. Command Suite 7 Module Features: Hitachi Device Manager provides centralized management of distributed Hitachi resources, with customizable views and dashboards for multisystem provisioning and management: Simple wizard-based management for common operations. Intuitive GUI with matching CLI functions improves efficiencies and flexibility for administrators. Host attachment and path management. LUN management and migrations. Cache partitioning and cache residency. Replication setup and management/monitoring. Integrated VMware and Microsoft Hyper-V capabilities. Advanced feature management. SNMP support. Hitachi Tuning Manager provides in-depth system monitoring and analysis with customizable dashboard views, dozens of flexible reporting options, alerts and custom reports. The reports are both real-time and historical, including forecasting, and they facilitate identifying, isolating and diagnosing storage bottlenecks. Tuning Manager is able to drill deeply into storage components.
13 13 Hitachi Command Director delivers graphical dashboard monitoring of service level objectives and system performance with customizable alerting and alarm thresholds. Applications such as MS SQL are monitored for capacity, response time, IOPS, throughput, read hits and write pending percentages. Hitachi Performance Monitor provides visibility into resource utilization within VSP. Data can be displayed via GUI or in-depth data acquired from the command line. Hitachi IT Operations Analyzer (ITOA) monitors configuration, availability and performance of heterogeneous data center components, including servers, switches (both IP and Fibre Channel), and storage systems. It provides end-to-end visibility and proactive monitoring of these components, allowing the user to troubleshoot issues quickly, before they turn into larger problems. ITOA can monitor and alert on the application or database services running on the server and on performance through the server components including CPU, memory and network (both IP and Fibre Channel) utilization. Application plug-ins that are available for SQL Server allow specific SQL metrics monitoring. An intuitive correlation wizard displays problem areas with percentage of accuracy ratings to help you pinpoint problem areas quickly. SQLIO Disk Subsystem Benchmark Tool SQLIO is a tool provided by Microsoft to determine the I/O capacity of a given server/storage configuration. The load and number of simulated database files can be varied to provide a simulation of users applying stress to a simulated database. Various scenarios can be run, including read random, read sequential, write random and write sequential tests. SQLIO can be downloaded from Microsoft at: Microsoft Windows Server 2008 R2 Datacenter Microsoft Windows 2008 Server R2 Datacenter is a multipurpose server operating system designed to increase the reliability and flexibility of your server or private cloud infrastructure. Additional highlights of Microsoft Windows Server 2008 R2 Datacenter include the following: Develop, deliver and manage rich user experiences and applications. Provide a highly secure network infrastructure. Increase technological efficiency and value within your organization. For more information, see "Product Information" on Microsoft SQL Server 2008 R2 Microsoft SQL Server 2012 Microsoft SQL Server 2008 R2 and Microsoft SQL Server 2012 provide a scalable, highperformance database engine for mission-critical applications that require the highest levels
14 14 of availability and security. SQL Server 2008 R2 and SQL Server 2012 also provide enhanced enterprise-class manageability for large database deployments like the one described in this customer configuration guide. With the Hitachi Virtual Storage Platform, Microsoft SQL Server 2008 R2 and Microsoft SQL Server 2012 provide a scalable, high-performance database engine for any midrange to enterprise-level application. For more information about the features of SQL Server, see the "What's New" page of SQL Server Books Online or "Product Information" on Solution Design This section provides details on the design of a Microsoft SQL Server very large database implemented with Hitachi Compute Blades and Hitachi Virtual Storage Platform. The customer configuration is based on a SQL Server cluster implementation. Very Large Database Implementation for Microsoft SQL Server The VLDB customer configuration implementation for Microsoft SQL Server provides a base configuration from which to grow and scale OLTP and other types of high-transaction databases, from 8TB to 32TB, to support growth over time. The referenced solution defines a performance- and cost-optimized design across all key components, including storage, server, application and configuration settings. This provides an optimal out-of-the-box balance between Microsoft SQL Server data processing capabilities with aggregate hardware throughput. Purchase minimum storage to satisfy storage requirements while providing for adding storage for growth and scaling as needed. Provide sufficient disk throughput for SQL Server to achieve a benchmarked maximum data processing rate. Provide ability to scale processing power as the workload increases. Storage Architecture The storage design of this customer configuration uses Hitachi Data Systems and Microsoft recommended practices for database storage design. The design uses Hitachi Dynamic Provisioning on the VSP system to allow scaling by growing storage capacity with no disruption in service to users. The configuration chosen makes use of 2 controllers, which permits spreading the storage load between controllers providing additional performance scaling. The ability of VSP to symmetrically distribute the load internally is leveraged to permit load scaling. For additional performance, high-speed drives (SSDs) are used for SQL files that require high performance, such as tempdb and transaction logs. For other SQL files with lower performance needs, SAS drives are used.
15 15 Figure 3 shows the storage configuration and port mapping for this customer configuration using the storage off controller 0. Controller 1 is configured in the same manner. Each controller comprises 2 clusters of components such that if cluster 1 fails, cluster 2 will take over all operations and vice versa. The storage is connected to the server via 2 Fibre connections such that if a connection fails, traffic will be routed to another connection. The figure depicts the RAID groups, LUNs created from the RAID groups, and port connections. The storage design provides for 2 paths to every LUN. The paths are active-active to accommodate additional bandwidth. On failure of a path, the alternate path absorbs the I/O for the failed path. Table 4 shows the storage paths and LUN assignment on VSP. Figure 3. Customer Configuration: Storage and Port Mapping
16 16 Storage Configuration The storage is configured in pools built on top of RAID groups. Each Dynamic Provisioning or "DP" pool has the pool size set to exceed a capacity beyond that to which the database will ever grow (this size exceeds the size of storage currently on the system). When the pool is created, RAID groups are assigned, and LUNs are presented to the application from the pool, only enough real storage will be allocated to the pool to accommodate the current and near-term needs of the database (the real storage will be nowhere near the maximum size of the pool). Over time, as the database grows and approaches the size of the real storage it was given initially, additional disks will be installed in the system and added to the pool. The pool will nondisruptively and transparently absorb the additional capacity, allowing the database to grow without the application or users being aware. This is called thin provisioning: A large pool is created, only enough storage is provided to meet the current needs, and then, as storage needs grow, additional storage is dynamically added to the pool without disruption. This technique allows the database to scale over time while controlling costs. Underpinning the pool are RAID groups. A failure in a disk within a RAID group is protected by the RAID mechanism. Additionally, VSP has hot spares available and will spare out predictively when a drive begins to fail, thus avoiding most RAID rebuilds. The failed disk can then be hot-replaced with a new one. Multiple pools are allocated based on disk type. For high-performance pools, SSD drives are utilized. For files needing less performance, SAS drives are used to form the pool. LUNs are created and presented as needed from these pools. Figure 4 shows the RAID group to LUN mapping. An added benefit of using dynamic pools is the data is written in what is termed "wide striping." Wide stripping distributes the data across all the disks in a given pool. This increases the potential throughput by leveraging I/O from multiple drives at once. Figure 5 shows the disk distribution within each chassis. Figure 4. RAID Group to LUN Mapping
17 17 Figure 5. Disk Layout Within Hitachi Virtual Storage Platform Racks. RAID Configuration The RAID structure used provides for maximum protection of data as well as throughput. The RAID group to pool mapping is used to create LUNs for the following purpose: Operating system (OS) pool comprises RAID-5 (3D+1P) for 2 OS drives and 2 drives containing mount points for data LUNs. Two high-performance pools (SSD drives) of RAID-1+0 (2D+2P) for tempdbs and logs for each SMP. Two pools of RAID-1+0 (2D+2P) (SAS drives) for data, 1 for each SMP. The RAID group to pool mapping is provided in Table 3, which illustrates the RAID configuration, showing the mapping of RAID groups to pools.
18 18 Table 3. RAID Configuration showing the mapping of RAID groups to pools Purpose RAID Group Configuration Number of Drives Drive Capacity Capacity Number of LUs Operating System, RAID-5 (3D+1P) 8 300GB 600GB 4 Mount Point Disk Microsoft RAID-1+0 (2D+2D) GB 2TB 2 Transaction Logs for SMP1 SQL Transaction RAID-1+0 (2D+2D) GB 2TB 2 Logs for SMP2 PRI Data Pool RAID-1+0 (2D+2D) GB 32TB 64 SMP 1 PRI Data Pool RAID-1+0 (2D+2D) GB 32TB 64 SMP 2 Hot Spares SAS N/A 8 300GB N/A N/A Hot Spares SSD N/A 4 300GB N/A N/A Storage Load Distribution The VSP storage configuration utilized 2 storage controller chassis, with each chassis containing a controller. Each controller is comprised of multiple processors. The design allocates storage for each SMP in its own chassis to permit the resources within that chassis to be applied to the SMP containing a SQL instance. Each controller has dual components with active-active paths between all components providing high throughput and full redundancy. For optimal performance, the routing of data within the controller is left to the processors in each controller, with the exception of the location of high-performance storage (SSDs) relative to lower-performance storage (SAS). It is recommended that the SSD drives be located as close to the controllers as possible, with the SAS drives located further away from the controller, as illustrated in Figure 5. The use of active-active paths allows for alternate path failover. Figure 6 depicts the data flow within a controller. Each controller contains 2 clusters or more precisely, 2 subcontrollers; if one fails, the other can pick up the load. Within each cluster are duplicate components and paths; if a component fails the other will take over, allowing the cluster to continue. Both clusters communicate with each other and all paths through the clusters are used to provide additional bandwidth for dataflow. All data is duplicated as it flows through the clusters to ensure no data loss on a component failure. All components are hot-replaceable on failure. Not shown in the diagram are high-speed crossbar switches, which facilitate the flow of data within the controller. Also note that both clusters communicate with each other via an extension of the crossbar switch, in effect creating a single larger controller and providing for higher bandwidth and reliability. The data flow for a write (for example) is to move the data from the Fibre Channel ports to cache. The system will acknowledge to the server that the write is complete, permitting the server to con-
19 19 tinue executing the application without waiting for the data to be written to the back-end disks. The data will then be written from cache through the disk controller modules to back-end storage. The use of cache permits a quick response to the I/O operation. Since the cache is backed by battery and SSD storage, all data is protected until it can be de-staged, or written, to back-end storage, even during a total power outage. Figure 6. Data Flow Within Hitachi Virtual Storage Platform from Fibre Channel Ports to Actual Storage
20 20 SAN Architecture The SAN fabric is designed around a switched network utilizing Brocade switches for all data paths between VSP and the SMPs. The OS paths are routed through embedded Fibre switches in the blade enclosure to VSP. Each SMP is connected to VSP through a Brocade switch with no zoning. Eight Fibre connections are used between each SMP and Brocade switch, and between the Brocade switch and the VSP. Each fibre link is connected to a Brocade 825 HBA port in a PCI-e slot on the SMP, and each link is active. LUNs are arranged such that each LUN is visible from 2 links for both performance scaling and failover protection. On failure the 2nd link assumes all traffic for the LUN without causing disruption to the application or OS as there is no HBA failover necessary since both links are active. Table 4 lists the LUNs and paths for each LUN. Note that since the boot LUNs were not on the data paths and were not part of the benchmarking, they did not have duplicate paths for this test. The design placed the boot LUNs on a separate path to avoid conflicts with data. The amount of traffic for the boot LUNs is minimal and probably would not conflict with data traffic if the boot LUNs were on the data paths. Table 4. SAN Configuration with LUN purpose and path assignments. LUN Purpose Primary Path SMP1 - Data 0 through Data 7 SQL Database LUNs 2e 2a SMP1 - Data 8 through Data 15 SQL Database LUNs 4e 4a SMP1 - Data 16 through Data 23 SQL Database LUNs 2a 2e SMP1 - Data 24 - Data 31 SQL Database LUNs 4a 4e SMP1 - Data 32 - Data 39 SQL Database LUNs 1a 1e SMP1 - Data 40 - Data 47 SQL Database LUNs 3a 3e SMP1 - Data 48 - Data 55 SQL Database LUNs 1e 1a SMP1 - Data 56 - Data 63 SQL Database LUNs 3e 3a SMP2 - Data 0 through Data 7 SQL Database LUNs 2q 2l SMP2 - Data 8 through Data 15 SQL Database LUNs 4q 4l SMP2 - Data 16 through Data 23 SQL Database LUNs 2l 2q SMP2 - Data 24 - Data 31 SQL Database LUNs 4l 4q SMP2 - Data 32 - Data 39 SQL Database LUNs 1l 1q SMP2 - Data 40 - Data 47 SQL Database LUNs 3l 3q SMP2 - Data 48 - Data 55 SQL Database LUNs 1q 1l SMP2 - Data 56 - Data 63 SQL Database LUNs 3q 3l SMP1 Boot LUN Boot LUN 2f SMP2 Boot LUN Boot LUN 2r Secondary Path / Failover Path
1 Hitachi Compute Blade 2000, Hitachi Adaptable Modular Storage 2500, and Microsoft Exchange 2010 Management Packs Integration with Microsoft System Center Operations Manager 2007 R2 Lab Validation Report
T E C H N I C A L B R I E F The Benefits of Virtualizing Aciduisismodo Microsoft SQL Dolore Server Eolore in Dionseq Hitachi Storage Uatummy Environments Odolorem Vel Leveraging Microsoft Hyper-V By Heidi
1 Deploying SQL Server 2008 R2 with Hyper-V on the Hitachi Virtual Storage Platform Reference Architecture Guide By Rick Andersen October 2010 Month Year Feedback Hitachi Data Systems welcomes your feedback.
1 Deploying Microsoft SQL Server 2008 R2 with Logical Partitioning on the Hitachi Virtual Storage Platform with Hitachi Dynamic Tiering Reference Architecture Guide By Eduardo Freitas May 2011 Month Year
Virtualizing Microsoft SQL Server 2008 on the Hitachi Adaptable Modular Storage 2000 Family Using Microsoft Hyper-V Implementation Guide By Eduardo Freitas and Ryan Sokolowski February 2010 Summary Deploying
1 Deploying a 48,000-user Exchange Server 2010 Environment with Hitachi Compute Blade 2000 and Hitachi Adaptable Modular Storage 2500 Reference Architecture Guide Leo Nguyen April 2011 Month Year Feedback
1 Deploying SAP on Microsoft SQL Server 2008 Environments Using the Hitachi Virtual Storage Platform Implementation Guide By Sean Siegmund June 2011 Feedback Hitachi Data Systems welcomes your feedback.
1 Deploying Microsoft Exchange Server 2010 on the Hitachi Virtual Storage Platform with Hitachi Dynamic Tiering Reference Architecture Guide By Jeff Chen May 2011 Month Year Feedback Hitachi Data Systems
Virtual Fibre Channel for Hyper-V Virtual Fibre Channel for Hyper-V, a new technology available in Microsoft Windows Server 2012, allows direct access to Fibre Channel (FC) shared storage by multiple guest
1 Deploy Hitachi Unified Compute Platform Select for Microsoft Exchange Server 2010 8,000-user Exchange Server 2010 Environment with Hitachi Compute Blade 2000 and Hitachi Adaptable Modular Storage 2300
ENTERPRISE VIRTUALIZATION ONE PLATFORM FOR ALL DATA ENTERPRISE VIRTUALIZATION ONE PLATFORM FOR ALL DATA SUMMARY ONE PLATFORM FOR ALL DATA WOULD YOU LIKE TO SAVE 20% TO 30% ON YOUR STORAGE SPEND? We can
Evaluation Report: HP Blade Server and HP MSA 16GFC Storage Evaluation Evaluation report prepared under contract with HP Executive Summary The computing industry is experiencing an increasing demand for
1 Hyper-V v2 Host Level Backups Using Symantec NetBackup 7.0 and the Hitachi VSS Hardware Provider with the Hitachi Adaptable Modular Storage 2000 Family Lab Validation Report By Steven Burns March 2011
Enterprise Storage Solution for Hyper-V Private Cloud and VDI Deployments using Sanbolic s Melio Cloud Software Suite April 2011 Executive Summary Large enterprise Hyper-V deployments with a large number
W H I T E P A P E R Aciduisismodo The 3D Scaling Dolore Advantage Eolore Dionseq Uatummy Odolorem Vel How 3D Scaling Drives Ultimate Storage Efficiency By Hitachi Data Systems September 2010 Hitachi Data
White Paper MICROSOFT HYPER-V SCALABILITY WITH EMC SYMMETRIX VMAX Abstract This white paper highlights EMC s Hyper-V scalability test in which one of the largest Hyper-V environments in the world was created.
Building a Scalable Microsoft Hyper-V Architecture on the Hitachi Universal Storage Platform Family Reference Architecture Guide By Rick Andersen April 2009 Summary Increasingly, organizations are turning
Virtualizing Microsoft SQL Server 2008 Using VMware vsphere 4 on the Hitachi Adaptable Modular Storage 2000 Family Deployment Guide By Eduardo Freitas and Bob Ingram November 2009 Summary Deploying a virtualized
Simplified Management With Hitachi Command Suite By Hitachi Data Systems April 2015 Contents Executive Summary... 2 Introduction... 3 Hitachi Command Suite v8: Key Highlights... 4 Global Storage Virtualization
Deploying Microsoft Exchange Server 2010 on the Hitachi Adaptable Modular Storage 2500 Reference Architecture Guide By Patricia Brailey July 2010 Summary IT administrators need email solutions that provide
Technical White Paper Report Best Practices Guide: Violin Memory Arrays With IBM System Storage SAN Volume Control Implementation Best Practices and Performance Considerations Version 1.0 Abstract This
Technology Concepts and Business Considerations Abstract A virtual information infrastructure allows organizations to make the most of their data center environment by sharing computing, network, and storage
TECHNICAL NOTE VMware Infrastructure 3 SAN Conceptual and Design Basics VMware ESX Server can be used in conjunction with a SAN (storage area network), a specialized high speed network that connects computer
HP SN1000E 16 Gb Fibre Channel HBA Evaluation Evaluation report prepared under contract with Emulex Executive Summary The computing industry is experiencing an increasing demand for storage performance
Dell Virtualization Solution for Microsoft SQL Server 2012 using PowerEdge R820 This white paper discusses the SQL server workload consolidation capabilities of Dell PowerEdge R820 using Virtualization.
DATASHEET VERITAS Storage Foundation 4.3 for Windows Advanced Volume Management Technology for Windows In distributed client/server environments, users demand that databases, mission-critical applications
Deploying Microsoft Exchange Server 2010 on the Hitachi Adaptable Modular Storage 2500 Implementation Guide By Patricia Brailey August 2010 Summary IT administrators need email solutions that provide data
IBM DS5020 Express Manage growth, complexity, and risk with scalable, high-performance storage Highlights Mixed host interfaces support (Fibre Channel/iSCSI) enables SAN tiering Balanced performance well-suited
Protect SQL Server 2012 AlwaysOn Availability Group with Hitachi Application Protector Tech Note Nathan Tran The purpose of this tech note is to show how organizations can use Hitachi Applications Protector
S o l u t i o n P r o f i l e Hitachi Cloud Services for Private File Tiering Low Risk Cloud at Your Own Pace Hitachi Data Systems is a premier provider of cloud storage infrastructure, services and solutions
Optimized Storage Solution for Enterprise Scale Hyper-V Deployments End-to-End Storage Solution Enabled by Sanbolic Melio FS and LaScala Software and EMC SAN Solutions Proof of Concept Published: March
The Benefit of Migrating from 4Gb to 8Gb Fibre Channel Notices The information in this document is subject to change without notice. While every effort has been made to ensure that all information in this
Building robust private cloud services infrastructures By Brian Gautreau and Gong Wang Private clouds optimize utilization and management of IT resources to heighten availability. Microsoft Private Cloud
Technical white paper HP high availability solutions for Microsoft SQL Server Fast Track Data Warehouse using SQL Server 2012 failover clustering Table of contents Executive summary 2 Fast Track reference
Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array Evaluation report prepared under contract with Lenovo Executive Summary Even with the price of flash
Test Validation Hitachi Unified Compute Platform (UCP) Pro for VMware vsphere Author:, Sr. Partner, Evaluator Group April 2013 Enabling you to make the best technology decisions 2013 Evaluator Group, Inc.
Data Sheet Cisco UCS B420 M3 Blade Server Product Overview The Cisco Unified Computing System (Cisco UCS ) combines Cisco UCS B-Series Blade Servers and C-Series Rack Servers with networking and storage
W H I T E P A P E R How to Manage Critical Data Stored in Microsoft Exchange Server 2010 By Hitachi Data Systems April 2012 2 Table of Contents Executive Summary and Introduction 3 Mission-critical Microsoft
Technology Insight Paper Hitachi Flash Storage: Flash for Multiple Enterprise Data Center Deployment Strategies By John Webster January 2016 Enabling you to make the best technology decisions Hitachi Flash
DELL Dell Microsoft Windows Server 2008 Hyper-V TM Reference Architecture VIRTUALIZATION SOLUTIONS ENGINEERING September 2008 1 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL
Best Practices for Deploying SSDs in a Microsoft SQL Server 2008 OLTP Environment with Dell EqualLogic PS-Series Arrays Database Solutions Engineering By Murali Krishnan.K Dell Product Group October 2009
Hitachi Universal Storage Platform Family Best Practices with Hyper-V Best Practices Guide By Rick Andersen and Lisa Pampuch April 2009 Summary Increasingly, businesses are turning to virtualization to
nexsan E5000 STORAGE SYSTEMS NAS just got faster, easier and more affordable. Overview The Nexsan E5000 TM, a part of Nexsan s Flexible Storage Platform TM, is Nexsan s family of NAS storage systems that
Hitachi Data Systems and Brocade Disaster Recovery Solutions for VMware Environments Technical Brief By Sarah Hamilton, Hitachi Data Systems Marcus Thordal, Brocade July 2009 Executive Summary The rapid
Best Practices for Optimizing SQL Server Database Performance with the LSI WarpDrive Acceleration Card Version 1.0 April 2011 DB15-000761-00 Revision History Version and Date Version 1.0, April 2011 Initial
Page 1 15-Drive Supports over 5 TB of reliable, low-cost, high performance storage 15200 Product Highlights First to deliver a full HW iscsi solution with SATA drives - Lower CPU utilization - Higher data
EMC VNX-F ALL FLASH ARRAY Purpose-built for price, density & speed ESSENTIALS Incredible scale & density with up to 172 TB usable flash capacity in 6U @ 28.63 TB/U Consistent high performance up to 400K
Technical white paper HP ProLiant BL660c Gen9 and Microsoft SQL Server 2014 technical brief Scale-up your Microsoft SQL Server environment to new heights Table of contents Executive summary... 2 Introduction...
The IntelliMagic White Paper on: Storage Performance Analysis for an IBM San Volume Controller (SVC) (IBM V7000) IntelliMagic, Inc. 558 Silicon Drive Ste 101 Southlake, Texas 76092 USA Tel: 214-432-7920
SOLUTION PROFILE Hitachi Data Systems and SAP Deliver Solutions for Real-Time Business Drive Real-Time Decisions With Hitachi Unified Compute Platform for the SAP HANA Platform Enable growth, resilience
Windows 8 SMB 2.2 File Sharing Performance Abstract This paper provides a preliminary analysis of the performance capabilities of the Server Message Block (SMB) 2.2 file sharing protocol with 10 gigabit
Virtualizing SQL Server 2008 Using EMC VNX Series and Microsoft Windows Server 2008 R2 Hyper-V Copyright 2011 EMC Corporation. All rights reserved. Published February, 2011 EMC believes the information
GDPS GDPS / USP-100 / VSP Qualification test GDPS and Hitachi Virtual Storage Platform Qualification Test Paolo Vitali GDPS Solution Test Team, IT Specialist email@example.com David Petersen GDPS
Using EonStor FC-host Storage Systems in VMware Infrastructure 3 and vsphere 4 Application Note Abstract This application note explains the configure details of using Infortrend FC-host storage systems
Microsoft System Center 2012 SP1 Virtual Machine Manager with Storwize family products IBM Systems and Technology Group ISV Enablement January 2014 Copyright IBM Corporation, 2014 Table of contents Abstract...
Remote/Branch Office IT Consolidation with Lenovo S2200 SAN and Microsoft Hyper-V Most data centers routinely utilize virtualization and cloud technology to benefit from the massive cost savings and resource
The Revival of Direct Attached Storage for Oracle Databases Revival of DAS in the IT Infrastructure Introduction Why is it that the industry needed SANs to get more than a few hundred disks attached to
STORAGE CENTER DATASHEET STORAGE CENTER Go Beyond the Boundaries of Traditional Storage Systems Today s storage vendors promise to reduce the amount of time and money companies spend on storage but instead
Leveraging EMC Fully Automated Storage Tiering (FAST) and FAST Cache for SQL Server Enterprise Deployments Applied Technology Abstract This white paper introduces EMC s latest groundbreaking technologies,
Microsoft SQL Server Enabled by EMC Celerra and Microsoft Hyper-V Copyright 2010 EMC Corporation. All rights reserved. Published February, 2010 EMC believes the information in this publication is accurate
Oracle Database Deployments with EMC CLARiiON AX4 Storage Systems Applied Technology Abstract This white paper investigates configuration and replication choices for Oracle Database deployment with EMC
Hitachi Data Systems and Brocade Disaster Recovery Solutions for VMware Environments Technical Brief By Sarah Hamilton, Hitachi Data Systems, and Marcus Thordal, Brocade December 2009 Executive Summary
Virtual SAN Design and Deployment Guide TECHNICAL MARKETING DOCUMENTATION VERSION 1.3 - November 2014 Copyright 2014 DataCore Software All Rights Reserved Table of Contents INTRODUCTION... 3 1.1 DataCore
White Paper EMC XtremSF: Delivering Next Generation Storage Performance for SQL Server Abstract This white paper addresses the challenges currently facing business executives to store and process the growing
SYSTEM X SERVERS SOLUTION BRIEF Maximum performance, minimal risk for data warehousing Microsoft Data Warehouse Fast Track for SQL Server 2014 on System x3850 X6 (95TB) The rapid growth of technology has
IOmark- VDI Nimbus Data Gemini Test Report: VDI- 130906- a Test Copyright 2010-2013 Evaluator Group, Inc. All rights reserved. IOmark- VDI, IOmark- VDI, VDI- IOmark, and IOmark are trademarks of Evaluator
ENTERPRISE STORAGE WITH THE FUTURE BUILT IN Breakthrough Efficiency Intelligent Storage Automation Single Platform Scalability Real-time Responsiveness Continuous Protection Storage Controllers Storage
Virtualizing Exchange Server 2007 Using VMware vsphere 4 on the Hitachi Adaptable Modular Storage 2500 Tested Deployment and Best Practices Guide By Patricia Brailey, Patrick Flueckiger, Bob Ingram and
Technical Report Dell Exchange 2013 Reference Architecture for 500 to 20,000 Microsoft Users Reliable and affordable storage for your business Table of Contents 1 Overview... 1 2 Introduction... 2 3 Infrastructure
1 Hitachi Unified Storage VM Dynamically Provisioned 24,000 Mailbox Exchange 2013 Mailbox Resiliency Storage Solution Tested with: ESRP Storage Version 4.0 Test Date: July - August 2013 Month Year Notices
MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with
Unified Computing Systems Cisco Unified Computing Systems simplify your data center architecture; reduce the number of devices to purchase, deploy, and maintain; and improve speed and agility. Cisco Unified
Dell Desktop Virtualization Solutions Simplified All-in-one VDI appliance creates a new level of simplicity for desktop virtualization Executive summary Desktop virtualization is a proven method for delivering
Microsoft Exchange Server 3 Deployment Considerations for Small and Medium Businesses A Dell PowerEdge server can provide an effective platform for Microsoft Exchange Server 3. A team of Dell engineers
SAP database backup and restore solutions for HP StorageWorks Enterprise Virtual Array using HP Data Protector 6.1 software Table of contents Executive summary... 2 Solution overview... 2 Objectives...
Performance benefit of MAX5 for databases The MAX5 Advantage: Clients Benefit running Microsoft SQL Server Data Warehouse (Workloads) on IBM BladeCenter HX5 with IBM MAX5 Vinay Kulkarni Kent Swalin IBM
white paper Best Practices for Implementing iscsi Storage in a Virtual Server Environment Server virtualization is becoming a no-brainer for any that runs more than one application on servers. Nowadays,
Deployments and Tests in an iscsi SAN SQL Server Technical Article Writer: Jerome Halmans, Microsoft Corp. Technical Reviewers: Eric Schott, EqualLogic, Inc. Kevin Farlee, Microsoft Corp. Darren Miller,
White Paper Dell Microsoft Business Intelligence and Data Warehousing Reference Configuration Performance Results Phase III Performance of Microsoft SQL Server 2008 BI and D/W Solutions on Dell PowerEdge
EMC Backup and Recovery for Microsoft SQL Server Enabled by Quest LiteSpeed Copyright 2010 EMC Corporation. All rights reserved. Published February, 2010 EMC believes the information in this publication
Data Sheet BROCADE PERFORMANCE MANAGEMENT SOLUTIONS SOLUTIONS Managing and Optimizing the Performance of Mainframe Storage Environments HIGHLIGHTs Manage and optimize mainframe storage performance, while
VMware Best Practice and Integration Guide Dot Hill Systems Introduction 1 INTRODUCTION Today s Data Centers are embracing Server Virtualization as a means to optimize hardware resources, energy resources,