SPC BENCHMARK 1C FULL DISCLOSURE REPORT SEAGATE TECHNOLOGY LLC IBM 600GB 10K 6GBPS SAS 2.5" G2HS HYBRID SPC-1C V1.5

Transcription

1 SPC BENCHMARK 1C FULL DISCLOSURE REPORT SEAGATE TECHNOLOGY LLC IBM 600GB 10K 6GBPS SAS 2.5" G2HS HYBRID SPC-1C V1.5 Submitted for Review: June 14, 2013 Submission Identifier: C00016

2 ii First Edition June 2013 THE INFORMATION CONTAINED IN THIS DOCUMENT IS DISTRIBUTED ON AN AS IS BASIS WITHOUT ANY WARRANTY EITHER EXPRESS OR IMPLIED. The use of this information or the implementation of any of these techniques is the customer s responsibility and depends on the customer s ability to evaluate and integrate them into the customer s operational environment. While each item has been reviewed by Seagate Technology LLC for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Customers attempting to adapt these techniques to their own environment do so at their own risk. This publication was produced in the United States. Seagate Technology LLC may not offer the products, services, or features discussed in this document in other countries, and the information is subject to change with notice. Consult your local Seagate Technology LLC representative for information on products and services available in your area. Copyright Seagate Technology LLC All rights reserved. Permission is hereby granted to reproduce this document in whole or in part, provided the copyright notice as printed above is set forth in full text on the title page of each item reproduced. Trademarks SPC Benchmark-1C, SPC-1C, SPC-1C IOPS and SPC-1C LRT are trademarks of the Storage Performance Council. Seagate, Seagate Technology, the Wave logo and Seagate Savvio are registered trademarks of Seagate Technology LLC in the United States and other countries. Savvio is either a trademark or registered trademark of Seagate Technology LLC or one of its affiliated companies in the United States and/or other countries. All other brands, trademarks, and product names are the property of their respective owners.

3 iii Table of Contents Audit Certification... vii Audit Certification (cont.)... viii Letter of Good Faith... ix Executive Summary Test Sponsor and Contact Information Revision Information and Key Dates Tested Storage Product (TSP) Description Summary of Results Storage Capacities, Relationships, and Utilization Response Time Throughput Curve Response Time Throughput Data Priced Storage Configuration Pricing Differences between the Tested Storage Configuration (TSC) and Priced Storage Configuration Benchmark Configuration/Tested Storage Configuration Diagram Host System and Tested Storage Configuration Components Configuration Information Benchmark Configuration (BC)/Tested Storage Configuration (TSC) Diagram. 19 Host System(s) and Tested Storage Configuration (TSC) Table of Components 19 Customer Tunable Parameters and Options Tested Storage Configuration (TSC) Description SPC-1C Workload Generator Storage Configuration ASU Pre-Fill SPC-1C Data Repository Storage Capacities and Relationships SPC-1C Storage Capacities SPC-1C Storage Hierarchy Ratios SPC-1C Storage Capacity Charts Storage Capacity Utilization Logical Volume Capacity and ASU Mapping SPC-1C Benchmark Execution Results SPC-1C Tests, Test Phases, and Test Runs Ramp-Up Test Runs Primary Metrics Test Sustainability Test Phase SPC-1C Workload Generator Input Parameters... 28

4 iv Sustainability Test Results File Sustainability Data Rate Distribution Data (MB/second) Sustainability Data Rate Distribution Graph Sustainability I/O Request Throughput Distribution Data Sustainability I/O Request Throughput Distribution Graph Sustainability Average Response Time (ms) Distribution Data Sustainability Average Response Time (ms) Distribution Graph Sustainability Response Time Frequency Distribution Data Sustainability Response Time Frequency Distribution Graph Sustainability Measured Intensity Multiplier and Coefficient of Variation Primary Metrics Test IOPS Test Phase SPC-1C Workload Generator Input Parameters IOPS Test Results File IOPS Test Run I/O Request Throughput Distribution Data IOPS Test Run I/O Request Throughput Distribution Graph IOPS Test Run Average Response Time (ms) Distribution Data IOPS Test Run Average Response Time (ms) Distribution Graph IOPS Test Run Response Time Frequency Distribution Data IOPS Test Run Response Time Frequency Distribution Graph IOPS Test Run I/O Request Information IOPS Test Run Measured Intensity Multiplier and Coefficient of Variation Primary Metrics Test Response Time Ramp Test Phase SPC-1C Workload Generator Input Parameters Response Time Ramp Test Results File Response Time Ramp Distribution (IOPS) Data Response Time Ramp Distribution (IOPS) Data (continued) Response Time Ramp Distribution (IOPS) Graph SPC-1C LRT Average Response Time (ms) Distribution Data SPC-1C LRT Average Response Time (ms) Distribution Graph SPC-1C LRT (10%) Measured Intensity Multiplier and Coefficient of Variation Repeatability Test SPC-1C Workload Generator Input Parameters Repeatability Test Results File Repeatability 1 LRT I/O Request Throughput Distribution Data Repeatability 1 LRT I/O Request Throughput Distribution Graph Repeatability 1 LRT Average Response Time (ms) Distribution Data Repeatability 1 LRT Average Response Time (ms) Distribution Graph Repeatability 1 IOPS I/O Request Throughput Distribution Data Repeatability 1 IOPS I/O Request Throughput Distribution Graph... 50

5 v Repeatability 1 IOPS Average Response Time (ms) Distribution Data Repeatability 1 IOPS Average Response Time (ms) Distribution Graph Repeatability 2 LRT I/O Request Throughput Distribution Data Repeatability 2 LRT I/O Request Throughput Distribution Graph Repeatability 2 LRT Average Response Time (ms) Distribution Data Repeatability 2 LRT Average Response Time (ms) Distribution Graph Repeatability 2 IOPS I/O Request Throughput Distribution Data Repeatability 2 IOPS I/O Request Throughput Distribution Graph Repeatability 2 IOPS Average Response Time (ms) Distribution Data Repeatability 2 IOPS Average Response Time (ms) Distribution Graph Repeatability 1 (LRT) Measured Intensity Multiplier and Coefficient of Variation Repeatability 1 (IOPS) Measured Intensity Multiplier and Coefficient of Variation Repeatability 2 (LRT) Measured Intensity Multiplier and Coefficient of Variation Repeatability 2 (IOPS) Measured Intensity Multiplier and Coefficient of Variation Data Persistence Test SPC-1C Workload Generator Input Parameters Data Persistence Test Results File Data Persistence Test Results Priced Storage Configuration Availability Date Pricing Information Tested Storage Configuration (TSC) and Priced Storage Configuration Differences Anomalies or Irregularities Appendix A: SPC-1C Glossary Decimal (powers of ten) Measurement Units Binary (powers of two) Measurement Units SPC-1C Data Repository Definitions SPC-1C Data Protection Levels SPC-1C Test Execution Definitions I/O Completion Types SPC-1C Test Run Components Appendix B: Customer Tunable Parameters and Options Appendix C: Tested Storage Configuration (TSC) Creation Create RAID-5 Array RB01_LVL.cmd Create SPC-1C Logical Volumes diskmkhdd.txt... 71

6 vi Change Parameters TuneParm_LVL.cmd Appendix D: SPC-1C Workload Generator Storage Commands and Parameters ASU Pre-Fill Primary Metrics Test, Repeatability and Persistence Tests Appendix E: SPC-1C Workload Generator Input Parameters ASU Pre-Fill Primary Metrics Test, Repeatability Test and Persistence Test Run Persistence Test Run Appendix F: Third-Party Quotations Priced Storage Configuration Priced Storage Configuration (continued)... 76

7 vii AUDIT CERTIFICATION

8 viii AUDIT CERTIFICATION (CONT.)

9 ix LETTER OF GOOD FAITH

10 EXECUTIVE SUMMARY Page 10 of 76 EXECUTIVE SUMMARY Test Sponsor and Contact Information Test Sponsor Primary Contact Test Sponsor Alternate Contact Auditor Test Sponsor and Contact Information Seagate Technology LLC Craig Parris 1280 Disc Drive Shakopee, MN Phone: (952) Seagate Technology LLC Barbara Craig 1280 Disc Drive Shakopee, MN Phone: (952) Storage Performance Council Walter E. Baker 643 Bair Island Road, Suite 103 Redwood City, CA Phone: (650) FAX: (650) Revision Information and Key Dates Revision Information and Key Dates SPC-1C Specification revision number V1.5 SPC-1C Workload Generator revision number V1.2.0 Date Results were first used publicly June 14, 2013 Date the FDR was submitted to the SPC June 14, 2013 Date the Priced Storage Configuration is available for shipment to customers currently available Date the TSC completed audit certification June 14, 2013

11 EXECUTIVE SUMMARY Page 11 of 76 Tested Storage Product (TSP) Description The amount of information that is gathered and stored by businesses continues to grow exponentially. In addition to the demand for increased storage, there are increasing requirements to quickly and effectively store and access data. Today, conventional hard disk drives and solid-state storage technology are utilized to achieve specific objectives within the data center. Conventional hard disk drives continue to be the most common storage media offering high density and basic performance in a cost-effective solution. Solid-state storage solutions enable businesses to achieve optimal input/output (IO) through variable read/write capabilities for performance intensive applications and workloads. IBM is now offering a new technology: hybrid drives. These drives combine a cache of NAND flash and conventional media to accelerate hard disk drive performance - enabling higher IO performance while leveraging the capacity and cost of spinning media for primary storage. IBM is introducing 6 Gbps SAS 2.5-inch G2HS and G2SS hybrid drives - the first generation of hybrid drives from IBM. Ideal for small and medium businesses or the distributed large enterprise, IBM 600 GB 10K 6 Gbps SAS 2.5-inch G2HS Hybrid (00AD102) and IBM 600 GB 10K 6 Gbps SAS 2.5- inch G2SS Hybrid (00AD107) provide cost-effective performance and density in a small form factor hard disk drive. In addition to the solid-state-based cache, these new drive offerings provide optimal 6 Gbps hot-swap SAS capability for your high-performance and high-availability System x environment. Hard drive functionality and 6 Gbps SAS performance of these new drives are enabled when used with IBM 6 Gbps System x servers and internal ServeRAID controllers.

12 EXECUTIVE SUMMARY Page 12 of 76 Summary of Results SPC-1C Reported Data Tested Storage Product (TSP) Name: Metric Reported Result SPC-1C Submission Identifier C00016 SPC-1C IOPS 1, Total ASU Capacity Data Protection Level 1, GB Protected 1 (RAID-5) Total Price $11, Pricing Currency Target Country for availability, sales and support U.S. Dollars USA SPC-1C Submission Identifier is the unique identifier assigned to this specific SPC-1C Result. SPC-1C IOPS represents the maximum I/O Request Throughput at the 100% load point. Total ASU (Application Storage Unit) Capacity represents the total storage capacity available to be read and written in the course of executing the SPC-1C benchmark. A Data Protection Level of Protected 1 using RAID-5 by distributing check data corresponding to user data across multiple disk in the form of bit-by-bite parity. Protected 1: The single point of failure of any storage device in the configuration will not result in permanent loss of access to or integrity of the SPC-1C Data Repository. Total Price includes the cost of the Priced Storage Configuration plus three years of hardware maintenance and software support as detailed on page 17. Pricing Currency is formal name for the currency used in calculating the Total Price. That currency may be the local currency of the Target Country or the currency of a difference country (non-local currency). The Target Country is the country in which the Priced Storage Configuration is available for sale and in which the required hardware maintenance and software support is provided either directly from the Test Sponsor or indirectly via a third-party supplier.

13 EXECUTIVE SUMMARY Page 13 of 76 Storage Capacities, Relationships, and Utilization The following four charts and table document the various storage capacities, used in this benchmark, and their relationships, as well as the storage utilization values required to be reported. Global Storage Overhead: GB 0.19% Physical Storage Capacity: 3, GB Configured Storage Capacity: 3, GB 99.78% Configured Storage Capacity Available for Application Use: 2, GB 83.15% Unused Physical Capacity GB 0.03% Data Protection Capacity: GB 16.64% RAID-5 Parity Protection

14 EXECUTIVE SUMMARY Page 14 of 76 Configured Storage Capacity: 3, GB Data Protection Capacity (used): GB 8.35% Configured Storage Capacity Available for Application Use: 2, GB 83.33% Addressable Storage Capacity: 1, GB 41.76% Unused Data Capacity: 1, GB 41.57% Data Protection Capacity (unused): GB 8.32% Addressable Storage Capacity: 1, GB 1 Logical Volume of GB (ASU 1) 1 Logical Volume of GB (ASU 2) 1 Logical Volume of GB (ASU 3) Unused Addressable Capacity: 0 GB 0.00% ASU 1 Capacity: GB 45.00% Total ASU Capacity: 1, GB % 1 Logical Volume of GB ASU 2 Capacity: GB 45.00% 1 Logical Volume of GB ASU 3 Capacity: % 1 Logical Volume of GB

15 EXECUTIVE SUMMARY Page 15 of 76 Required Capacity Utilization Details Physical Storage Capacity: 3, GB Total Unused Capacity: 1, GB 49.81% 50% Required Capacity Utilization: 1, GB 50.00% Total ASU Capacity: 1, % Global Storage Overhead: GB 0.19% ASU Data Protection: GB 8.34% The Tested Storage Configuration (TSC) must be configured so that there is either no Unused Storage or that the sum of Total ASU Capacity and storage required for data protection equals 50% (+-1 GiB) of the Physical Storage Capacity. The TSC meets the 50% requirement as documented below: 3, GB (Physical Storage Capacity) 1, GB (50% capacity requirement) 1, GB (Total ASU Capacity) GB (Data Protection) = 1, GB Detailed information for the various storage capacities and utilizations is available on pages

16 EXECUTIVE SUMMARY Page 16 of 76 Response Time Throughput Curve The Response Time-Throughput Curve illustrates the Average Response Time (milliseconds) and I/O Request Throughput at 100%, 95%, 90%, 80%, 50%, and 10% of the workload level used to generate the SPC-1C IOPS metric. The Average Response Time measured at any of the above load points cannot exceed 30 milliseconds or the benchmark measurement is invalid. Ramp Phase Response Time / Throughput Curve % Response Time (ms) % 90% 95% 50% % IO Requests per Second Response Time Throughput Data 10% Load 50% Load 80% Load 90% Load 95% Load 100% Load I/O Request Throughput , Average Response Time (ms): All ASUs ASU ASU ASU Reads Writes

17 EXECUTIVE SUMMARY Page 17 of 76 Priced Storage Configuration Pricing Part Numbers Qty Price Extended Price Description Warranty period 1 year CRU IBM 600GB 10K 6Gbps SAS 2.5'' G2HS Hybrid & On-site 9x5 Next Business Day 00AD102 6 $ $ 5, IBM system x3650 M4 Base System w/1 Xeon Processor 7915B2U 1 $ 2, $ 2, Primary drive 90Y $ $ Xeon Processor 69Y $ $ Power Supply 94Y $ $ GB DDR3 49Y $ $ GB DDR3 90Y $ $ RAID M5120 Controller 81Y $ $ RAID M MB RAID Cache 81Y $ $ Power cables 39Y $ $ yr onsite repair 24x7 4hr response 00A $ $ Total $ 11, Differences between the Tested Storage Configuration (TSC) and Priced Storage Configuration There were no differences between the TSC and Priced Storage Configuration.

18 EXECUTIVE SUMMARY Page 18 of 76 Benchmark Configuration/Tested Storage Configuration Diagram IBM System x3650 M4 6 IBM 600GB 10K 6Gbps SAS 2.5'' G2HS Hybrid (Seagate 600GB Solid State Hybrid Drives) Host System and Tested Storage Configuration Components Tested Storage Configuration (TSC): IBM System x3650 M4 rack server 2 Intel Xeon E quad core processors 2.4 GHz, 10 MB L3 cache 20 GB main memory 1 system disk drive IBM ServRAID M5110e SAS/SATA built-in controller 512 MB RAID cache Single embedded PCIe front-end (PCIe x8) connection Single SAS 6 Gb (4 lanes) backend connection 6 IBM 600GB 10K 6Gbps SAS 2.5 G2HS Hybrid disk drives (Seagate 600GB Solid State Hybrid Drives)

19 CONFIGURATION INFORMATION Page 19 of 76 In each of the following sections of this document, the appropriate Full Disclosure Report requirement, from the SPC-1C benchmark specification, is stated in italics followed by the information to fulfill the stated requirement. CONFIGURATION INFORMATION Benchmark Configuration (BC)/Tested Storage Configuration (TSC) Diagram Clause The Executive Summary will contain a one page BC/TSC diagram that illustrates all major components of the BC/TSC. The Benchmark Configuration (BC)/Tested Storage Configuration (TSC) is illustrated on page 18 (Benchmark Configuration (BC)/Tested Storage Configuration (TSC) Diagram). Host System(s) and Tested Storage Configuration (TSC) Table of Components Clause The Executive Summary will contain a table that lists the major components of each Host System and the Tested Storage Configuration (TSC). The Host System(s) and TSC table of components may be found on page 19 (Host System(s) and Tested Storage Configuration (TSC) Table of Components). Customer Tunable Parameters and Options Clause All Benchmark Configuration (BC) components with customer tunable parameters and options that have been altered from their default values must be listed in the Full Disclosure Report (FDR). The FDR entry for each of those components must include both the name of the component and the altered value of the parameter or option. If the parameter name is not self-explanatory to a knowledgeable practitioner, a brief description of the parameter s use must also be included in the FDR entry. Appendix B: Customer Tunable Parameters and Options on page 70 contains the customer tunable parameters and options that have been altered from their default values for this benchmark.

20 CONFIGURATION INFORMATION Page 20 of 76 Tested Storage Configuration (TSC) Description Clause The Full Disclosure Report must include sufficient information to recreate the logical representation of the Tested Storage Configuration (TS)C. In addition to customer tunable parameters and options (Clause ), that information must include, at a minimum: A diagram and/or description of the following: All physical components that comprise the TSC. Those components are also illustrated in the BC Configuration Diagram in Clause The logical representation of the TSC, configured from the above components that will be presented to the SPC-1C Workload Generator. Listings of scripts used to create the logical representation of the TSC. If scripts were not used, a description of the process used with sufficient detail to recreate the logical representation of the TSC. Appendix C: Tested Storage Configuration (TSC) Creation on page 71 contains the detailed information that describes how to create and configure the logical TSC. SPC-1C Workload Generator Storage Configuration Clause The Full Disclosure Report will include all SPC-1C Workload Generator storage configuration commands and parameters used in the SPC-1C benchmark measurements. The SPC-1C Workload Generator storage configuration commands and parameters for this measurement appear in Appendix D: SPC-1C Workload Generator Storage Commands and Parameters on page 73. ASU Pre-Fill Clause Each of the three SPC-1C ASUs (ASU-1, ASU-2 and ASU-3) is required to be completely filled with specified content prior to the execution of audited SPC-1C Tests. The content is required to consist of random data pattern such as that produced by an SPC recommended tool. The configuration file used to complete the required ASU pre-fill appears in Appendix D: SPC-1C Workload Generator Storage Commands and Parameters on page 73.

21 DATA REPOSITORY Page 21 of 76 SPC-1C DATA REPOSITORY This portion of the Full Disclosure Report presents the detailed information that fully documents the various SPC-1C storage capacities and mappings used in the Tested Storage Configuration. SPC-1C Data Repository Definitions on page 66 contains definitions of terms specific to the SPC-1C Data Repository. Storage Capacities and Relationships Clause Two tables and four charts documenting the storage capacities and relationships of the SPC-1C Storage Hierarchy (Clause 2.1) shall be included in the FDR. The capacity value in each chart may be listed as an integer value, for readability, rather than the decimal value listed in [the table below]. SPC-1C Storage Capacities The Physical Storage Capacity consisted of 3, GB distributed over 6 disk drives, each with a formatted capacity of GB. There was GB (0.03%) of Unused Storage within the Physical Storage Capacity. Global Storage Overhead consisted of GB (0.19%) of the Physical Storage Capacity. There was 1, GB (41.76%) of Unused Storage within the Configured Storage Capacity. The Total ASU Capacity utilized % of the Addressable Storage Capacity resulting in 0.00 GB (0.00%) of Unused Storage within the Addressable Storage Capacity. The Data Protection (RAID-5) capacity was GB of which GB was utilized. The total Unused Storage capacity was 1, GB. Note: The configured Storage Devices may include additional storage capacity reserved for system overhead, which is not accessible for application use. That storage capacity may not be included in the value presented for Physical Storage Capacity. SPC-1C Storage Capacities Storage Hierarchy Component Units Capacity Total ASU Capacity Gigabytes (GB) 1, Addressable Storage Capacity Gigabytes (GB) 1, Configured Storage Capacity Gigabytes (GB) 3, Physical Storage Capacity Gigabytes (GB) 3, Data Protection (RAID-5) Gigabytes (GB) Required Storage Gigabytes (GB) Global Storage Overhead Gigabytes (GB) Total Unused Storage Gigabytes (GB) 1,

22 DATA REPOSITORY Page 22 of 76 SPC-1C Storage Hierarchy Ratios Addressable Storage Capacity Configured Storage Capacity Physical Storage Capacity Total ASU Capacity % 41.76% 41.67% Required for Data Protection (RAID-5) 16.67% 16.64% Addressable Storage Capacity 41.76% 41.67% Required Storage 0.00% 0.00% Configured Storage Capacity 99.78% Global Storage Overhead 0.19% Unused Storage: Addressable 0.00% Configured 41.57% Physical 0.03% SPC-1C Storage Capacity Charts Global Storage Overhead: GB 0.19% Physical Storage Capacity: 3, GB Configured Storage Capacity: 3, GB 99.78% Configured Storage Capacity Available for Application Use: 2, GB 83.15% Unused Physical Capacity GB 0.03% Data Protection Capacity: GB 16.64% RAID-5 Parity Protection

23 DATA REPOSITORY Page 23 of 76 Configured Storage Capacity: 3, GB Data Protection Capacity (used): GB 8.35% Configured Storage Capacity Available for Application Use: 2, GB 83.33% Addressable Storage Capacity: 1, GB 41.76% Unused Data Capacity: 1, GB 41.57% Data Protection Capacity (unused): GB 8.32% Addressable Storage Capacity: 1, GB 1 Logical Volume of GB (ASU 1) 1 Logical Volume of GB (ASU 2) 1 Logical Volume of GB (ASU 3) Unused Addressable Capacity: 0 GB 0.00% ASU 1 Capacity: GB 45.00% Total ASU Capacity: 1, GB % 1 Logical Volume of GB ASU 2 Capacity: GB 45.00% 1 Logical Volume of GB ASU 3 Capacity: % 1 Logical Volume of GB

24 DATA REPOSITORY Page 24 of 76 Required Capacity Utilization Details Physical Storage Capacity: 3, GB Total Unused Capacity: 1, GB 49.81% 50% Required Capacity Utilization: 1, GB 50.00% Total ASU Capacity: 1, % Global Storage Overhead: GB 0.19% ASU Data Protection: GB 8.34% Storage Capacity Utilization Clause The Total ASU Capacity must be configured in one of the following relationships to the Physical Storage Capacity. Clause %: The Tested Storage Configuration must be configured so there is 1 GiB or less of total Unused Storage Clause %: Total ASU Capacity must be configured so that the sum of Total ASU Capacity and capacity required for data protection is 50% of the Physical Storage Capacity within a tolerance of ±1 GiB or 0.5% of the Physical Storage Capacity, whichever is greater. The Tested Storage Configuration meets the 50% requirement as documented below: 3, GB (Physical Storage Capacity) 1, GB (50% capacity requirement) 1, GB (Total ASU Capacity) GB (Data Protection) = 1, GB

25 DATA REPOSITORY Page 25 of 76 Logical Volume Capacity and ASU Mapping Clause A table illustrating the capacity of each ASU and the mapping of Logical Volumes to ASUs shall be provided in the FDR. Logical Volumes shall be sequenced in the table from top to bottom per its position in the contiguous address space of each ASU. The capacity of each Logical Volume shall be stated. In conjunction with this table, the Test Sponsor shall provide a complete description of the type of data protection (see Clause 2.7) used on each Logical Volume. Logical Volume Capacity and Mapping ASU-1 ( GB) ASU-2 ( GB) ASU-3 ( GB) 1 Logical Volume GB per Logical Volume ( GB used per Logical Volume) 1 Logical Volume GB per Logical Volume ( GB used per Logical Volume) 1 Logical Volume GB per Logical Volume ( GB used per Logical Volume) The Data Protection Level used for all Logical Volumes was Protected 1 using RAID-5 as described on page 12. See ASU Configuration in the IOPS Test Results File for more detailed configuration information.

26 SPC-1C BENCHMARK EXECUTION RESULTS Page 26 of 76 SPC-1C BENCHMARK EXECUTION RESULTS This portion of the Full Disclosure Report documents the results of the various SPC-1C Tests, Test Phases, and Test Runs. An SPC-1C glossary on page 66 contains definitions of terms specific to the SPC-1C Tests, Test Phases, and Test Runs. Clause The Tests must be executed in the following sequence: Primary Metrics, Repeatability, and Data Persistence. That required sequence must be uninterrupted from the start of Primary Metrics to the completion of Persistence Test Run 1. Uninterrupted means the Benchmark Configuration shall not be power cycled, restarted, disturbed, altered, or adjusted during the selected Test sequence. If the selected Test sequence is interrupted, the SPC-1C measurement is invalid. This does not apply to the interruption caused by the Host System/TSC power cycle between Persistence Test Run 1 and Persistence Test Run 2. SPC-1C Tests, Test Phases, and Test Runs The SPC-1C benchmark consists of the following Tests, Test Phases, and Test Runs: Primary Metrics Test Sustainability Test Phase and Test Run IOPS Test Phase and Test Run Response Time Ramp Test Phase o 95% of IOPS Test Run o 90% of IOPS Test Run o 80% of IOPS Test Run o 50% of IOPS Test Run o 10% of IOPS Test Run (LRT) Repeatability Test Repeatability Test Phase 1 o 10% of IOPS Test Run (LRT) o IOPS Test Run Repeatability Test Phase 2 o 10% of IOPS Test Run (LRT) o IOPS Test Run Data Persistence Test Data Persistence Test Run 1 Data Persistence Test Run 2 Each Test is an atomic unit that must be executed from start to finish before any other Test, Test Phase, or Test Run may be executed. The results from each Test, Test Phase, and Test Run are listed below along with a more detailed explanation of each component.

27 SPC-1C BENCHMARK EXECUTION RESULTS Page 27 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE Ramp-Up Test Runs Clause In order to warm-up caches or perform the initial ASU data migration in a multi-tier configuration, a Test Sponsor may perform a series of Ramp-Up Test Runs as a substitute for an initial, gradual Ramp-Up. Clause The Ramp-Up Test Runs will immediately precede the Primary Metrics Test as part of the uninterrupted SPC-1C measurement sequence. Clause If a series of Ramp-Up Test Runs were included in the SPC-1C measurement sequence, the FDR shall report the duration (ramp-up and measurement interval), BSU level, SPC-1C IOPS and average response time for each Ramp-Up Test Run in an appropriate table. There were no Ramp-Up Test Runs executed in this set of benchmark measurements. Primary Metrics Test Sustainability Test Phase Clause The Sustainability Test Phase has exactly one Test Run and shall demonstrate the maximum sustainable I/O Request Throughput within a continuous one (1) hour Measurement Interval. Clause The computed I/O Request Throughput of the Sustainability Test Run must be no less than 95% of the reported SPC-1C IOPS result or the Test Run is invalid. Clause The Average Response Time, as defined in Clause 0, will be computed and reported for the Sustainability Test Run and cannot exceed 30 milliseconds. If the Average Response Time exceeds that 30-millisecond constraint, the Test Run is invalid. Clause The FDR shall contain the following for the single Test Run in the Sustainability/IOPS Test Phase: 1. A Data Rate Distribution graph and data table. 2. I/O Request Throughput Distribution graph and data table. 3. A Response Time Frequency Distribution graph and table. 4. An Average Response Time Distribution graph and table. 5. The human readable Test Run Results File produced by the Workload Generator (may be included in an appendix). 6. A listing or screen image of all input parameters supplied to the Workload Generator (may be included in an appendix). 7. The Measured Intensity Multiplier for each I/O stream. 8. The variability of the Measured Intensity Multiplier, as defined in Clause

28 SPC-1C BENCHMARK EXECUTION RESULTS Page 28 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE SPC-1C Workload Generator Input Parameters The SPC-1C Workload Generator input parameters for the Sustainability, IOPS, Response Time Ramp, Repeatability, and Persistence Test Runs are documented in Appendix E: SPC-1C Workload Generator Input Parameters on Page 74. Sustainability Test Results File A link to the test results file generated from the Sustainability Test Run is listed below. Sustainability Test Results File Sustainability Data Rate Distribution Data (MB/second) The Sustainability Data Rate table of data is not embedded in this document due to its size. The table is available via the following URL: Sustainability Data Rate Table Sustainability Data Rate Distribution Graph Data Rate Distribution BSUs) All ASUs ASU1 ASU2 ASU3 10 Startup Measurement Interval Data Rate MBytes/Sec Test Run Minutes

29 SPC-1C BENCHMARK EXECUTION RESULTS Page 29 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE Sustainability I/O Request Throughput Distribution Data The Sustainability I/O Request Throughput table of data is not embedded in this document due to its size. The table is available via the following URL: Sustainability I/O Request Throughput Table Sustainability I/O Request Throughput Distribution Graph I/O Request Throughput Distribution BSUs) All ASUs ASU1 ASU2 ASU Startup Measurement Interval 1000 I/O Requests per Second Test Run Minutes

30 SPC-1C BENCHMARK EXECUTION RESULTS Page 30 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE Sustainability Average Response Time (ms) Distribution Data The Sustainability Average Response Time table of data is not embedded in this document due to its size. The table is available via the following URL: Sustainability Average Response Time Table Sustainability Average Response Time (ms) Distribution Graph Average Response Time Distribution BSUs) All ASUs ASU1 ASU2 ASU3 50 Startup Measurement Interval Average Response Time (ms) Test Run Minutes

31 SPC-1C BENCHMARK EXECUTION RESULTS Page 31 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE Sustainability Response Time Frequency Distribution Data Response Time (ms) > > > > > > > Read 221,910 1,085, , , , , , ,751 Write ,282 69, , , , , ,813 All ASUs 222,038 1,109,393 1,034, , , , , ,564 ASU1 189, , , , , , , ,081 ASU2 32, , , ,225 94,871 82,820 71,067 64,110 ASU3 2 8,178 53, , , , , ,373 Response Time (ms) > > > > > > > > Read 733, , , , , , , ,126 Write 630, , , , , , , ,059 All ASUs 1,364,588 1,396,181 1,264,370 1,107, , , , ,185 ASU1 796, , , , , , , ,500 ASU2 113, ,131 87,195 66,987 40,198 31,623 58,982 67,827 ASU3 455, , , , , , , ,858 Response Time (ms) > > > > > > > >30.0 Read 253, , , , , , ,955 1,102,870 Write 444, , ,595 2,017,841 1,463,692 1,065, ,099 5,094,048 All ASUs 697, , ,083 2,841,079 1,931,091 1,363,343 1,022,054 6,196,918 ASU1 412, , ,198 1,699,069 1,139, , ,917 3,421,363 ASU2 76,436 80,891 80, , , , ,157 1,129,431 ASU3 209, , , , , , ,980 1,646,124 Sustainability Response Time Frequency Distribution Graph Response Time Frequency Distribution BSUs) Read Write All ASUs 6,500,000 6,000,000 5,500,000 5,000,000 Number of Occurrances 4,500,000 4,000,000 3,500,000 3,000,000 2,500,000 2,000,000 1,500,000 1,000, ,000 0 Response Time in Milliseconds

32 SPC-1C BENCHMARK EXECUTION RESULTS Page 32 of 76 PRIMARY METRICS TEST SUSTAINABILITY TEST PHASE Sustainability Measured Intensity Multiplier and Coefficient of Variation Clause IM Intensity Multiplier: The ratio of I/Os for each I/O stream relative to the total I/Os for all I/O streams (ASU1-1 ASU3-1) as required by the benchmark specification. Clauses MIM Measured Intensity Multiplier: The Measured Intensity Multiplier represents the ratio of measured I/Os for each I/O stream relative to the total I/Os measured for all I/O streams (ASU1-1 ASU3-1). Clause COV Coefficient of Variation: This measure of variation for the Measured Intensity Multiplier cannot exceed 0.5. ASU1-1 ASU1-2 ASU1-3 ASU1-4 ASU2-1 ASU2-2 ASU2-3 ASU3-1 IM MIM COV

33 SPC-1C BENCHMARK EXECUTION RESULTS Page 33 of 76 PRIMARY METRICS TEST IOPS TEST PHASE Primary Metrics Test IOPS Test Phase Clause The IOPS Test Phase consists of one Test Run at the 100% load point with a Measurement Interval of five (5) minutes. The IOPS Test Phase immediately follows the Sustainability Test Phase without any interruption or manual intervention. The IOPS Test Run generates the SPC-1C IOPS primary metric, which is computed as the I/O Request Throughput for the Measurement Interval of the IOPS Test Run. The Average Response Time is computed for the IOPS Test Run and cannot exceed 30 milliseconds. If the Average Response Time exceeds the 30 millisecond constraint, the measurement is invalid. Clause For the IOPS Test Phase the FDR shall contain: 1. I/O Request Throughput Distribution (data and graph). 2. Response Time Frequency Distribution (data and graph). 3. Average Response Time Distribution (data and graph). 4. The human readable SPC-1C Test Run Results File produced by the SPC-1C Workload Generator. 5. A listing of all input parameters supplied to the SPC-1C Workload Generator. 6. The Measured Intensity Multiplier for each I/O Stream. 7. The variability of the Measured Intensity Multiplier, as defined in Clause The total number of I/O Requests completed in the Measurement Interval as well as the number of I/O Requests with a Response Time less than or equal to 30 milliseconds and the number of I/O Requests with a Response Time greater than 30 milliseconds. SPC-1C Workload Generator Input Parameters The SPC-1C Workload Generator input parameters for the Sustainability, IOPS, Response Time Ramp, Repeatability, and Persistence Test Runs are documented in Appendix E: SPC-1C Workload Generator Input Parameters on Page 74. IOPS Test Results File A link to the test results file generated from the IOPS Test Run is listed below. IOPS Test Results File

34 SPC-1C BENCHMARK EXECUTION RESULTS Page 34 of 76 PRIMARY METRICS TEST IOPS TEST PHASE IOPS Test Run I/O Request Throughput Distribution Data 205 BSUs Start Stop Interval Duration Start-Up/Ramp-Up 3:19:10 3:29: :10:00 Measurement Interval 3:29:10 3:39: :10:00 60 second intervals All ASUs ASU1 ASU2 ASU3 0 1, , , , , , , , , , , , , , , , , , , , Average 1, IOPS Test Run I/O Request Throughput Distribution Graph I/O Request Throughput Distribution BSUs) All ASUs ASU1 ASU2 ASU Startup Measurement Interval 1000 I/O Requests per Second Test Run Minutes

35 SPC-1C BENCHMARK EXECUTION RESULTS Page 35 of 76 PRIMARY METRICS TEST IOPS TEST PHASE IOPS Test Run Average Response Time (ms) Distribution Data 205 BSUs Start Stop Interval Duration Start-Up/Ramp-Up 3:19:10 3:29: :10:00 Measurement Interval 3:29:10 3:39: :10:00 60 second intervals All ASUs ASU1 ASU2 ASU Average IOPS Test Run Average Response Time (ms) Distribution Graph Average Response Time Distribution BSUs) All ASUs ASU1 ASU2 ASU3 50 Startup Measurement Interval Average Response Time (ms) Test Run Minutes

36 SPC-1C BENCHMARK EXECUTION RESULTS Page 36 of 76 PRIMARY METRICS TEST IOPS TEST PHASE IOPS Test Run Response Time Frequency Distribution Data Response Time (ms) > > > > > > > Read 4,671 22,084 19,614 15,601 13,884 11,649 9,794 8,474 Write ,285 2,387 3,423 4,646 5,667 6,103 All ASUs 4,674 22,510 20,899 17,988 17,307 16,295 15,461 14,577 ASU1 3,953 19,887 17,220 13,970 12,575 10,901 9,592 8,627 ASU ,493 2,714 2,105 1,939 1,701 1,469 1,308 ASU ,913 2,793 3,693 4,400 4,642 Response Time (ms) > > > > > > > > Read 15,021 12,345 9,810 5,798 2,797 2,245 4,607 5,041 Write 12,497 15,416 15,264 16,202 11,248 7,590 9,425 8,490 All ASUs 27,518 27,761 25,074 22,000 14,045 9,835 14,032 13,531 ASU1 16,274 15,075 12,918 9,806 5,739 4,211 7,193 7,690 ASU2 2,203 1,943 1,747 1, ,163 1,370 ASU3 9,041 10,743 10,409 10,854 7,515 4,988 5,676 4,471 Response Time (ms) > > > > > > > >30.0 Read 4,977 5,027 4,473 16,648 9,929 6,640 4,813 26,940 Write 8,969 9,000 8,828 38,665 28,852 21,936 17, ,196 All ASUs 13,946 14,027 13,301 55,313 38,781 28,576 22, ,136 ASU1 8,109 8,222 7,792 32,885 22,774 16,853 12,863 81,628 ASU2 1,399 1,550 1,523 6,790 5,143 4,001 3,245 27,007 ASU3 4,438 4,255 3,986 15,638 10,864 7,722 5,959 38,501 IOPS Test Run Response Time Frequency Distribution Graph Response Time Frequency Distribution BSUs) Read Write All ASUs 150, ,000 Number of Occurrances 100,000 75,000 50,000 25,000 0 Response Time in Milliseconds

37 SPC-1C BENCHMARK EXECUTION RESULTS Page 37 of 76 PRIMARY METRICS TEST IOPS TEST PHASE IOPS Test Run I/O Request Information I/O Requests Completed in the Measurement Interval I/O Requests Completed with Response Time = or < 30 ms I/O Requests Completed with Response Time > 30 ms 616, , ,136 IOPS Test Run Measured Intensity Multiplier and Coefficient of Variation Clause IM Intensity Multiplier: The ratio of I/Os for each I/O stream relative to the total I/Os for all I/O streams (ASU1-1 ASU3-1) as required by the benchmark specification. Clauses MIM Measured Intensity Multiplier: The Measured Intensity Multiplier represents the ratio of measured I/Os for each I/O stream relative to the total I/Os measured for all I/O streams (ASU1-1 ASU3-1). Clause COV Coefficient of Variation: This measure of variation for the Measured Intensity Multiplier cannot exceed 0.5. ASU1-1 ASU1-2 ASU1-3 ASU1-4 ASU2-1 ASU2-2 ASU2-3 ASU3-1 IM MIM COV

38 SPC-1C BENCHMARK EXECUTION RESULTS Page 38 of 76 PRIMARY METRICS TEST RESPONSE TIME RAMP TEST PHASE Primary Metrics Test Response Time Ramp Test Phase Clause The Response Time Ramp Test Phase consists of five Test Runs, one each at 95%, 90%, 80%, 50%, and 10% of the load point (100%) used to generate the SPC-1C IOPS primary metric. Each of the five Test Runs has a Measurement Interval of five (5) minutes. The Response Time Ramp Test Phase immediately follows the IOPS Test Phase without any interruption or manual intervention. The five Response Time Ramp Test Runs, in conjunction with the IOPS Test Run (100%), demonstrate the relationship between Average Response Time and I/O Request Throughput for the Tested Storage Configuration (TSC) as illustrated in the response time/throughput curve on page 16. In addition, the Average Response Time measured during the 10% Test Run is the value for the SPC- 1C LRT metric. That value represents the Average Response Time of a lightly loaded TSC. Clause The following content shall appear in the FDR for the Response Time Ramp Phase: 1. A Response Time Ramp Distribution graph. 2. The human readable Test Run Results File produced by the SPC-1C C Workload Generator for each Test Run within the Response Time Ramp Test Phase. 3. An Average Response Time Distribution graph and table for the 10% BSU Level Test Run (the SPC-1C LRT metric). 4. A listing of all input parameters supplied to the SPC-1C Workload Generator. SPC-1C Workload Generator Input Parameters The SPC-1C Workload Generator input parameters for the Sustainability, IOPS, Response Time Ramp, Repeatability, and Persistence Test Runs are documented in Appendix E: SPC-1C Workload Generator Input Parameters on Page 74. Response Time Ramp Test Results File A link to each test result file generated from each Response Time Ramp Test Run list listed below. 95% Load Level 90% Load Level 80% Load Level 50% Load Level 10% Load Level

39 SPC-1C BENCHMARK EXECUTION RESULTS Page 39 of 76 PRIMARY METRICS TEST RESPONSE TIME RAMP TEST PHASE TEST PHASE Response Time Ramp Distribution (IOPS) Data The five Test Runs that comprise the Response Time Ramp Phase are executed at 95%, 90%, 80%, 50%, and 10% of the Business Scaling Unit (BSU) load level used to produce the SPC-1C IOPS primary metric. The 100% BSU load level is included in the following Response Time Ramp data table and graph for completeness. 100% Load Level BSUs Start Stop Interval Duration 95% Load Level BSUs Start Stop Interval Duration Start-Up/Ramp-Up 3:19:10 3:29: :10:00 Start-Up/Ramp-Up 3:39:12 3:49: :10:00 Measurement Interval 3:29:10 3:39: :10:00 Measurement Interval 3:49:12 3:59: :10:00 (60 second intervals) All ASUs ASU-1 ASU-2 ASU-3 (60 second intervals) All ASUs ASU-1 ASU-2 ASU-3 0 1, , , , , , , , , , , , , , , , , , , , Average 1, Average % Load Level BSUs Start Stop Interval Duration 80% Load Level BSUs Start Stop Interval Duration Start-Up/Ramp-Up 3:59:14 4:09: :10:00 Start-Up/Ramp-Up 4:19:16 4:29: :10:00 Measurement Interval 4:09:14 4:19: :10:00 Measurement Interval 4:29:16 4:39: :10:00 (60 second intervals) All ASUs ASU-1 ASU-2 ASU-3 (60 second intervals) All ASUs ASU-1 ASU-2 ASU Average Average

40 SPC-1C BENCHMARK EXECUTION RESULTS Page 40 of 76 PRIMARY METRICS TEST RESPONSE TIME RAMP TEST PHASE TEST PHASE Response Time Ramp Distribution (IOPS) Data (continued) 50% Load Level BSUs Start Stop Interval Duration 10% Load Level - 20 BSUs Start Stop Interval Duration Start-Up/Ramp-Up 4:39:18 4:49: :10:00 Start-Up/Ramp-Up 4:59:20 5:09: :10:00 Measurement Interval 4:49:18 4:59: :10:00 Measurement Interval 5:09:20 5:19: :10:00 (60 second intervals) All ASUs ASU-1 ASU-2 ASU-3 (60 second intervals) All ASUs ASU-1 ASU-2 ASU Average Average Response Time Ramp Distribution (IOPS) Graph Response Time Ramp Test Phase % 95% 90% 80% 50% 10% All ASUs ASU1 ASU2 ASU I/O Request Throughput Test Run Minutes