Crossing the Performance Chasm with OpenPOWER



Similar documents
Data Centric Systems (DCS)

FLOW-3D Performance Benchmark and Profiling. September 2012

Get More Scalability and Flexibility for Big Data

HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK

IBM System x reference architecture solutions for big data

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA

Data Centric Computing Revisited

ECLIPSE Best Practices Performance, Productivity, Efficiency. March 2009

Dell Reference Configuration for Hortonworks Data Platform

Customized Report- Big Data

Evoluzione dell Infrastruttura di Calcolo e Data Analytics per la ricerca

Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack

Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array

The Foundation for Better Business Intelligence

Pentaho High-Performance Big Data Reference Configurations using Cisco Unified Computing System

Architecting for the next generation of Big Data Hortonworks HDP 2.0 on Red Hat Enterprise Linux 6 with OpenJDK 7

DeIC Watson Agreement - hvad betyder den for DeIC medlemmerne

The Rise of Industrial Big Data. Brian Courtney General Manager Industrial Data Intelligence

Business white paper. HP Process Automation. Version 7.0. Server performance

Cisco for SAP HANA Scale-Out Solution on Cisco UCS with NetApp Storage

Data Center Storage Solutions

Intel Platform and Big Data: Making big data work for you.

Maximum performance, minimal risk for data warehousing

White Paper. SAP NetWeaver Landscape Virtualization Management on VCE Vblock System 300 Family

Milestone Solution Partner IT Infrastructure MTP Certification Report Scality RING Software-Defined Storage

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

Big Data Performance Growth on the Rise

High Performance SQL Server with Storage Center 6.4 All Flash Array

Data Center Solutions

Building a Top500-class Supercomputing Cluster at LNS-BUAP

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities

Platfora Big Data Analytics

Lenovo Database Configuration for Microsoft SQL Server TB

Intel RAID SSD Cache Controller RCS25ZB040

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads

Optimizing GPU-based application performance for the HP for the HP ProLiant SL390s G7 server

White Paper. IBM POWER8: Performance and Cost Advantages in Business Intelligence Systems. 89 Fifth Avenue, 7th Floor. New York, NY 10003

MarkLogic and Cisco: A Next-Generation, Real-Time Solution for Big Data

IBM Software Information Management Creating an Integrated, Optimized, and Secure Enterprise Data Platform:

Addressing Open Source Big Data, Hadoop, and MapReduce limitations

Laurence Liew General Manager, APAC. Economics Is Driving Big Data Analytics to the Cloud

Seagate HPC /Big Data Business Tech Talk. December 2014

Built for Business. Ready for the Future.

FPGA Acceleration using OpenCL & PCIe Accelerators MEW 25

The virtualization of SAP environments to accommodate standardization and easier management is gaining momentum in data centers.

Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk

HadoopTM Analytics DDN

RESOLVING SERVER PROBLEMS WITH DELL PROSUPPORT PLUS AND SUPPORTASSIST AUTOMATED MONITORING AND RESPONSE

Unlocking the Intelligence in. Big Data. Ron Kasabian General Manager Big Data Solutions Intel Corporation

OpenPower: IBM s Strategy for Best of Breed 64-bit Linux

Modernizing Servers and Software

IBM System x and BladeCenter for Oracle s JD Edwards EnterpriseOne

How To Compare Two Servers For A Test On A Poweredge R710 And Poweredge G5P (Poweredge) (Power Edge) (Dell) Poweredge Poweredge And Powerpowerpoweredge (Powerpower) G5I (

Proact whitepaper on Big Data

HP reference configuration for entry-level SAS Grid Manager solutions

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

Infrastructure Matters: POWER8 vs. Xeon x86

HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK

ECLIPSE Performance Benchmarks and Profiling. January 2009

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

Enabling High performance Big Data platform with RDMA

Virtualization of ArcGIS Pro. An Esri White Paper December 2015

10th TF-Storage Meeting

Datasheet FUJITSU Integrated System PRIMEFLEX for Hadoop

Achieving a High Performance OLTP Database using SQL Server and Dell PowerEdge R720 with Internal PCIe SSD Storage

Can Flash help you ride the Big Data Wave? Steve Fingerhut Vice President, Marketing Enterprise Storage Solutions Corporation

Lenovo ThinkServer and Cloudera Solution for Apache Hadoop

Real-Time Big Data Analytics SAP HANA with the Intel Distribution for Apache Hadoop software

Centrata IT Management Suite 3.0

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Innovativste XEON Prozessortechnik für Cisco UCS

Data Centric Interactive Visualization of Very Large Data

HP Z Turbo Drive PCIe SSD

IBM Platform Computing : infrastructure management for HPC solutions on OpenPOWER Jing Li, Software Development Manager IBM

Remote Support Competitive Overview

EMC VFCACHE ACCELERATES ORACLE

Fujitsu PRIMERGY Servers Portfolio

Data Center Solutions

Fast, Low-Overhead Encryption for Apache Hadoop*

Datasheet FUJITSU Integrated System PRIMEFLEX for Hadoop

IBM Data Warehousing and Analytics Portfolio Summary

Transcription:

Crossing the Performance Chasm with OpenPOWER Dr. Srini Chari Cabot Partners/IBM chari@cabotpartners.com #OpenPOWERSummit Join the conversation at #OpenPOWERSummit 1

Disclosure Copyright 215. Cabot Partners Group. Inc. All rights reserved. Other companies product names, trademarks, or service marks are used herein for identification only and belong to their respective owner. All images and supporting data were obtained from IBM, NVIDIA, Mellanox or from public sources. The information and product recommendations made by the Cabot Partners Group are based upon public information and sources and may also include personal opinions both of the Cabot Partners Group and others, all of which we believe to be accurate and reliable. However, as market conditions change and not within our control, the information and recommendations are made without warranty of any kind. The Cabot Partners Group, Inc. assumes no responsibility or liability for any damages whatsoever (including incidental, consequential or otherwise), caused by your or your client s use of, or reliance upon, the information and recommendations presented herein, nor for any inadvertent errors which may appear in this document. This paper was developed with IBM funding. Although the paper may utilize publicly available material from various vendors, including IBM, it does not necessarily reflect the positions of such vendors on the issues addressed in this document. Please read accompanying Cabot Partners Whitepaper for Additional Detail, References and Notes on information presented in this document. Join the conversation at #OpenPOWERSummit 2

Agenda Key Technology Trends Cloud, HPC, Analytics, Social, Mobile and Internet of Things Centered Around Data Open Innovation Vital for Value Creation Data-Centric HPC Growing Rapidly Client Considerations in HPC Systems Evaluations System Attributes Impacting Real Life Performance Why the LINPACK Benchmark is Inadequate IBM Data Centric Approach and Solutions Why OpenPOWER Examples of Performance Gains Key Takeaways Join the conversation at #OpenPOWERSummit 3

Key Intertwined Technology Trends Join the conversation at #OpenPOWERSummit 4

Key Intertwined Technology Trends Cloud, High Performance Computing, Analytics, Social, Mobile and IoT Enterprise cloud growth - $7B (214) to $25B (217) Annual growth: Smart phones 2%. Mobile data 81% IoT at 12B today reaching over 1 Trillion in a decade Social media users - 1.79B (214) to 2.44B (218) DATA 2.5 exabytes (1 18 bytes) created daily. Individuals create 7% and enterprises manage 8% Annual spending 3% to reach $114B in 218 Join the conversation at #OpenPOWERSummit 5

What IT Must Consider to Deal with Data Volume Variety Velocity Veracity Vulnerability Visualize Virtualize V 8 Value Join the conversation at #OpenPOWERSummit 6

Extracting Value From Data with HPC Requires Open Innovation across the stack Join the conversation at #OpenPOWERSummit 7

HPC Drives Value Across Many Industries Overall HPC servers growing ~ 6.4% annually Traditional HPC Risk Analytics Life Sciences Oil and Gas Data-Centric HPC growing ~ 23.5% Emergency Response Fraud and Threat Detection Enhance Customer Experience Join the conversation at #OpenPOWERSummit 8

Considerations to Evaluate HPC Systems Not Just Point Benchmarks But Workflows Across the HPC Data Life Cycle Example in Seismic Processing Join the conversation at #OpenPOWERSummit 9

Total Value of Ownership Framework Holistic Cost Benefit Analysis for Entire HPC Workflow Value Delivered Business Value: e.g. customer revenues, new business models, compliance regulations, better products, increased business insight, faster time to market, and new breakthrough capability Operational Value: e.g. faster time to results, more accurate analyses, more users supported, improved user productivity, better capacity planning IT Value: e.g. improved system utilization, manageability, administration, and provisioning, scalability, reduced downtime, access to robust proven technology and expertise. Costs Incurred IT /Data Center Capital e.g. new servers, storage, networks, power distribution units, chillers, etc. Data Center Facilities e.g. land, buildings, containers, etc. Operational Costs: e.g. labor, energy, maintenance, software license, applications, etc. Other Costs: e.g. system management, deployment and training, downtime, migration, etc. Join the conversation at #OpenPOWERSummit 1

What Impacts Traditional HPC Performance Computer Aided Engineering Life Sciences Network Bandwidth Flops/Core Cores Structures Crash Fluids Network Bandwidth Flops/Core Quantum Chemistry Molecular Modeling Bioinformatics Cores Network Latency Memory Capacity Network Latency Memory Capacity I/O Performance Memory Bandwidth I/O Performance Memory Bandwidth Network Bandwidth Financial Services Low Latency Trading Flops/Core Monte Carlo Risk Analytics Cores Network Bandwidth Energy and Environmental Sciences Flops/Core Cores Reservoir Seismic Weather Network Latency Memory Capacity Network Latency Memory Capacity I/O Performance Memory Bandwidth I/O Performance Memory Bandwidth Join the conversation at #OpenPOWERSummit 11

Why LINPACK is Inadequate Most HPC Analytics Involve Sparse Matrices but LINPACK Solves Dense Matrix Problems LINPACK vs. HPC Analytics Flops/Core LINPACK Network Bandwidth HPC Analytics Cores Network Latency Memory Capacity I/O Performance Memory Bandwidth Join the conversation at #OpenPOWERSummit 12

Data Centric System Traditional System Design IBM s Data Centric Approach and Solutions Join the conversation at #OpenPOWERSummit 13

Major HPC Win for OpenPOWER Join the conversation at #OpenPOWERSummit 14

Performance / Core Performance / Core Key Benchmarks*: POWER8 2-2.5X Better 8 SPECint_rate26 (greater is better) 1.8 x Performance 6 SPECfp_rate26 (greater is better) 2.1 x Performance 7 6 5 5 4 4 3 3 2 2 1 1 Dell PowerEdge T62 2s/36c/72t Intel Xeon Haswell POWER S824 2s/24c/192t IBM POWER8 Dell PowerEdge T62 2s/36c/72t Intel Xeon Haswell POWER S824 2s/24c/192t IBM POWER8 Stream Triad (greater is better) 2.9 x Performance Terasort Big Data Hadoop (greater is better) Relative System Performance 35 3. GB/s 3 25 2 15 2.5 2. 1.5 2.5x 1 1. 5.5 Intel Xeon Haswell 2s/24c/48t IBM POWER8 2s/24c/192t. POWER8 Cisco Join the conversation at #OpenPOWERSummit 15

Max Paths (1 min) Nanoseconds / day Application Performance with POWER8* 1.4 2.6 X better Molecular Dynamics - NAMD apoa1 (greater is better) 1.4 x Performance 3 2.5 2 1.5 3 2.5 2 1.5 Seismic RTM (greater is better) 2.6 x Performance 2.6x 1 1.5.5 Intel E5-269 V3 2s/24c/2.6GHz Intel Xeon Haswell POWER S824L 2s/24c/3.6GHz IBM POWER8 Intel E5-269 V3 2s/24c/2.6GHz Intel Xeon Haswell POWER S822L 2s/24c/3.358GHz IBM POWER8 STAC A2 Options Pricing (greater is better) 2.7 x Performance PostGreSQL (higher is better) 3.E+7 2.5E+7 2.E+7 1.5E+7 1.E+7 5.E+6.E+ 4 x Intel E7-489 v2 2.8 GHz /1TB Intel Ivy Bridge EX Power S824 2s/24c/3.52GHz/1TB Join the conversation at #OpenPOWERSummit 16

Key Takeaways HPC is becoming more data-centric Traditional system evaluations based on point benchmarks such as LINPACK are inadequate Focus evaluation on cost-benefit analysis of workflow across HPC data lifecycle Many system features impact HPC performance Benefits of OpenPOWER HPC Offerings: Deliver Choice and Flexibility Minimize Costly Data Motion for Entire Workflow Accelerate Compute and Data Intensive Tasks with Lower TCO Provide Investment Protection Join the conversation at #OpenPOWERSummit 17

*Appendix - Additional Benchmark Detail SPECcpu (int_rate & fp_rate) SPECcpu26 results are based on best published results on E5-2699 v3 from the top 5 Intel system vendors (HP, Oracle, Lenovo, Dell, Fujitsu) submitted as of 9/8/214. For more information go to http://www.specbench.org/cpu26/results/. The IBM POWER8 published data is based on Power S824 2s/24c/3.5GHz POWER8. The x86 Xeon published data is based on Dell PowerEdge T62 2s/36c/2.3GHz E5-2699 v3. Hadoop Tersort IBM Analytics Stack: IBM Power System S822L; 8 nodes each with 24 cores / 192 threads, POWER8; 3.GHz, 512 GB memory, RHEL 6.5, InfoSphere BigInsights 3. Cisco Stack: 16 high-density Cisco UCS C24 M3 Rack Servers each with 16 cores / 32 threads, Intel Xeon E5-2665; 2.4 GHz, 256 GB of memory, Cisco UCS VIC 1225, and LSI 9266 8i with 24 1-TB SATA 72-rpm disk running Apache Hadoop open source distribution. Stream Triad The Stream Triad results are based on results reported in published papers. IBM POWER8: http://www.dcs.warwick.ac.uk/~sdh/pmbs14/pmbs14/workshop_schedule_files/2-performancepower8.pdf Intel Xeon E5-26 v3 http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=cb8qfjaa&url=http%3a%2f%2fdownload.boston.co.uk%2fd ownloads%2f9%2f3%2fc%2f93c22fd-d6d-46a4-9124-28c9e32f2533%2fintel- Whitepaper.pdf&ei=mLgBVbysL8KrggT774CICw&usg=AFQjCNFal5q5Vz2- ly6zbsakz2qppad1fg&sig2=3lzkttxekpvs2qw9ndxgfq&bvm=bv.8792726,d.exy STAC and all STAC names are trademarks or registered trademarks of Securities Technology Analysis Center LLC. https://stacresearch.com/system/files/asset/files/stac-a2%2intel%2composer%2on%24%2x%2ivt%2ex%2-%2intc1459.pdf Join the conversation at #OpenPOWERSummit 18