Performance Evaluation of Amazon EC2 for NASA HPC Applications!

Transcription

1 National Aeronautics and Space Administration Performance Evaluation of Amazon EC2 for NASA HPC Applications! Piyush Mehrotra!! J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff,! S. Saini, R. Biswas! NASA Advanced Supercomputing (NAS) Division! NASA Ames Research Center!

2 Cloud Computing! Cloud computing is becoming ubiquitous! - Allows organizations to outsource hardware acquisition and maintenance! - Satisfies burst computational demands at the cost of performance! - Provides support for customized execution environments! - Increasing catalog of useful software services! Extensively being used for enterprise/business tasks! Increasing use for scientific and engineering (S&E) tasks, e.g., bioinformatics, oil exploration, data analytics, etc.! - Embarrassingly parallel or loosely coupled parallel tasks! To attract the High Performance Computing (HPC) market Amazon EC2 provides HPC instance types! Are Clouds ready for NASA s HPC applications? 2

3 Clouds! Systems tested! Outline! Benchmarks and Applications used! Performance achieved! Conclusions! 3

4 Systems Tested! Pleiades: NASAʼs primary supercomputer! - SGI Altix ICE 4 generations of Intel Xeon processors: Harpertown (4c), Nehalem (4c), Westmere (6c), Sandy Bridge (8c) total 11,776 nodes, 126,720 cores, peak 1.75 Pflops! Amazon EC2: premier public cloud computing environment! Pleiades Amazon HPC cc1.4xlarge CPU Intel Xeon X5570 Intel Xeon X5570 Nehalem Nehalem Clock Speed 2.93 GHz 2.93 GHz No. of cores/node 8 8 RAM 24 GB 23 GB Hyper-threading Enabled Enabled Network 4 InfiniBand QDR 10 GigE Interconnect Topology Hypercube Unknown OS Type SLES11SP1 SLES11SP1 Virtualization No Yes Multi-tenancy No No Compiler Intel Intel MPI Library MPT 2.04 Open MPI File Structure Lustre NFS 4

5 Benchmarks/Applications! HPCC Benchmarks! - DGEMM floating point rate measurement! - Bandwidth and latency tests! NPBs:! - Kernel benchmarks! MG: multi-grid on a sequence of meshes, long- and short-distance communication, memory intensive! FT: discrete 3D FFTs, all-to-all communication! IS: integer sort, random memory access! CG: conjugate gradient, irregular memory access and communication! EP: embarrassingly parallel with some communication! - Compact Application benchmarks! BT: block tri-diagonal solver! SP: scalar penta-diagonal solver! LU: lower-upper Gauss Seidel! Applications:! - Cart3D: high-fidelity inviscid CFD code; multiple cartesian grids; cpuintensive and memory bound! - DDSCAT: embarrassingly parallel code to calculate the absorption and scattering properties oftargets! - ENZO: Simulation of cosmological structure formulation using adaptive mesh refinement! - MITGcm: Global ocean circulation model; memory bound; latency bound large number of cores! 5

6 Performance Results! 6

7 HPCC results (64 cores)! Pleiades Amazon HPC EP DGEMM N=5773 (Gflops) Single DGEMM N=5773 (Gflops) Max Ping Pong Latency (usec) Min Ping Pong Latency (usec) Avg Ping Pong Latency (usec) Naturally Ordered Ring Latency (usec) Randomly Ordered Ring Latency (usec) Max Ping Pong Bandwidth (Gbytes) Min Ping Pong Bandwidth (Gbytes) Avg Ping Pong Bandwidth (Gbytes) Naturally Ordered Ring Bandwidth (Gbytes) Randomly Ordered Ring Bandwidth (Gbytes)

8 NPB Results! 8

9 NPB Results (MG)! EC2-HPC relative to Pleiades 9

10 NPB Results (contd.)! 10

11 Application Performance! 11

12 CART3D Performance! EC2-HPC relative to Pleiades 12

13 DDSCAT Performance! EC2-HPC relative to Pleiades 13

14 EC2-HPC Performance Relative to Pleiades! 14

15 Communication Impact! 15

16 Communication Impact (2)! 16

17 Virtualization Overhead! Pleiades Amazon HPC Perf. Diff. EP DGEMM N=5773 (Gflops) % Single DGEMM N=5773 (Gflops) % 17

18 Performance Variability! 18

19 Summary! Amazon EC2-HPC performance lags Pleiades supercomputer for most NASA HPC applications! - Network technology! - Virtualization overhead! Other issues with clouds for NASA scientists! - Cost! - Security! - Usability! - Reliability! Cloud computing currently not a viable solution for NASA HPC applications but they are catching up fast!!! 19

20 Characteristics Cloud Environments NASA HPC Center On demand self-service Broad network access For users with a credit card Worldwide For approved users with allocation Worldwide (subject to NASA security constraints) Resource Pooling Yes Across the Agency Rapid Elasticity Measured Service Extreme Users credit cards charged according to usage Users can provision multiple thousands of cores Users allocations charged according to usage Service Model Mainly IaaS PaaS Deployment Model Public Private NASA s HECC facility is a private, PaaS, HPC cloud 20

21 21