Platform HPC The Easiest and Most Complete HPC-Management Software. Jörg Ruther Strategic Alliances Manager CEE

Transcription

1 Platform HPC The Easiest and Most Complete HPC-Management Software Jörg Ruther Strategic Alliances Manager CEE

2 Introduction

3 Platform Computing complements IBM Complement IBM Portfolio Complement Smarter Computing Strategy Accelerate Growth Market Strategy Adds Complementary Expertise Platform s offering is a strategic element for the transformation of HPC into the high-growth segment of technical computing and an important part of IBM s key initiative in the Smarter Planet strategy Helene Armitage, GM for IBM's Systems Software Group (STG).

4 How Does Platform Fit Within IBM?

5 How Does Platform Fit Within IBM? Platform Computing will integrate with the IBM Technical Computing Software and Solutions Portfolio

6 What s Platform HPC?

7 Solving the Cluster Software Challenge Operating systems Red Hat Enterprise Linux SUSE Linux Enterprise Server Scientific Linux CentOS Windows HPC Server Workload management InfiniBand software OFED Message passing libraries Platform MPI MPICH MVAPICH OpenMPI Intel MPI Networking hardware Gigabit Ethernet Cisco InfiniBand Qlogic InfiniBand Mellanox InfiniBand Monitoring tools Memory on a node CPU Load on a node Logged In users Processes on a node Certification tools Intel Cluster Checker Cluster provisioning Package Diskless Imaged Cluster update Update via Red Hat Network Update via Yum Update individual rpms Configuration management Node templates/classes Cluster file synchronization Network topology management Cluster administration ntop for network traffic monitoring Nagios configured to manage & notify Nodes in the cluster Web server Load average Logged in users DNS server status MySQL server status NTP daemon status Node 'PING' status Root partition disk SSH daemon SWAP space Total processes on node notifications to administrator Power/console management Repository management Multiple repositories Repository snapshots Full dependency checking Package Parallel shell pdsh for administering nodes on the cluster Apache webserver Manual pages for PCM commands Documentation for PCM 5 List of installed Kits on the cluster Development Tools GNU Compilers GNU Debugger Applications & Benchmarks Atlas blacs bonnie++ fftw hdf5 iozone iperf hpl/linpack modules netcdf scalapack stream Can you imagine installing, configuring, and managing all this? Now you can install, configure & manage with one Product!

8 Other Cluster Management Solutions Require customers to Assemble disparate software components oopen source components omultiple commercial components Certify each component individually Get support from multiple vendors However, many customers Lack Linux OS admin experience Experience different quality levels for each component

9 Platform HPC The easiest and most complete HPC cluster solution Platform HPC

10 Platform HPC Complete Product Ansys Fluent MSC NASTRAN Blast LS-DYNA Home- Grown App Unified Web-Based Interface Cluster Management MPI Library OS Multi-Boot Workload Management GPU Scheduling App Integration OS OS OS OS OS Package Image Diskless / Stateless (PXE Boot)

11 Platform HPC Who controlls the cash wants countability!

12 Add Value by Selling a Complete Solution Reference Ecosystem Leveraging tight integration between Platform, QLogic, Mellanox, NVIDIA, Intel, Terascala & other key partners ANSYS MSC Simulia NVIDIA GPUs 3 rd Party Storage Application Integration Platform HPC Management Software Q Logic InfiniBand Mellanox InfiniBand IBM Cluster RHEL SLES MS

13 Key Features

14 Effective Cluster Management Faster time to full system readiness Support silent install from USB drive Just a handful of questions to answer Install application optionally In GUI Or single command Push a button to deploy OS + Platform HPC to compute nodes Install applications Publish application templates

15 Unified, Web-Based Interface Job Submission & Management Easy Easy to make your cluster production-ready Easy to manage your cluster Easy to submit & manage jobs Cluster Provisioning & Management Simplified Simplified software deployment Simplified application integration Powerful Powerful, yet easy to use unified interface Powerful security policies

16 Effective Cluster Management Quickly build and configure your HPC cluster Rapid provisioning and deployment Manage HPC clusters with unprecedented ease Ensure maximum uptime Designed to manage both small & large clusters Interactive dashboards simplifies administration

17 Effective Cluster Management Comprehensive cluster management interface for provisioning your HPC cluster Action applies to multiple objects or highlighted object Object list within the selected group Organized, easy to use objects tree Detail of the selected object within the group

18 Effective Cluster Management Comprehensive cluster management interface for managing your HPC cluster Custom actions can be added Alert summary linked to the alerts page Monitoring section allowing selections of multiple metrics Enhanced rack view with support of blade centers

19 Effective Cluster Management Comprehensive cluster management interface for monitoring your HPC cluster External load metrics can be used for alerts Alert summary Last update time etc.

20 Powerful Application Support Webeb based job submission portal and templates, enabling integration of any batch application Easy to use interfaces Self-documenting Rapid user productivity Minimize job submission errors AvailableTemplates: ANSYS Mechanical ANSYS Fluent ClustalW HMMER LS-DYNA MSC Nastran NCBI Blast NWChem Schlumberger ECLIPSE Simulia Abaqus Generic template for in-house / open source apps Additional templates coming soon! Run applications without wrapper scripts

21 Powerful Workload Management Based on Platform LSF The most powerful, comprehensive, policy driven workload manager Very easy to use and maintain Extremely flexible and customizable Without Platform HPC Platform HPC is not LSF and does not substitute LSF!! With Platform HPC No optimization for jobs and resources Faster time to results Use fewer resources By scheduling workloads intelligently according to policy, Platform HPC increases job throughput and maximizes resource utilization

22 Powerful Workload Management Comprehensive workload management interface Start, pause and cancel jobs Monitor & report on job status Easily manage job input & output data Define policies based on SLAs

23 GPUs: Schedule, Monitor & Manage DEPLOY: Quickly deploy workload to GPU resources Submit jobs to resources with GPUs & CPUs within the same cluster Remotely manage & view the status of your jobs MANAGE: Easily manage heterogeneous clusters Install CUDA across a cluster is a couple of clicks Deploy & manage both CPU & GPU resources MONITOR: Monitor resources with GPUs GPU utilization, temperature & status Detect ECC error accumulation Take immediate advantage of the exceptional HPC performance provided by GPUs

24 Powerful Application Support Highest performing MPI Platform MPI 55% faster than MVAPICH 25% faster than OpenMPI Source: NAMD Performance Benchmark and Profiling, HPC Advisory Council, February 2011

25 Workload/Cluster Monitoring & Reporting Operational dashboard Comprehensive reports on workload & system load Measure & report on throughput and utilisation Proactively manage compute resources Drill-in/out capability for operational insight Troubleshoot job and cluster issues

26 3 rd Party Management SW Integration Easily customize Platform HPC based on your organization s unique requirements Monitor status for non-server devices in the HPC environment Set up alerts for 3 rd party devices Customize to interface with 3 rd party management software Storage Mngr Fabric Mngr 3 rd Party SW Platform HPC

27 PlatformHPC - Life Demo via YouTube

28 Overcoming Objections

29 Why should I spend my money on software? It s expensive Licensing is complicated I can get equivalent functionalities with open source Support will also be expensive I can buy more hardware if I don t buy software I don t need the fancy graphics user interface

30 Capability vs. Productivity Traditional HPC - Capability Approach Buy as many CPUs as budgets allow Choose free, open source software wherever possible Accept ramp-up time to full system availability Accept ramp-up time to full productive use Queues used to provide resource allocation Provide support through use of internal resources Take ownership for evolving the capability of the system

31 Capability Approach Utilization Extended time to fully operational system Extended learning period for users Invisible cost of delay to productive use &utilization It takes a long time to Sweat the Assets Open source management software Time in months

32 Capability vs. Productivity Platform HPC - Productivity Approach Use throughput & utilization as benchmarks of success Invest in tools to measure & drive throughput & utilization No ramp-up time to full system availability No ramp-up time to full productive use by users Policies drive allocation of resources External 24x7 commercial grade HPC support Joint ownership for developing & evolving the capability of the system

33 Productivity Approach Utilization Faster time to full system readiness Faster time to full user productivity Better throughput & utilization Strong policies drive allocation of resources Open source management software Sweat the Assets much earlier Who controlls the cash wants countability! Time in months Platform HPC

34 The Result - Lower Cost of Ownership 3-year management software TCO for a 32-node cluster Open source cost less, but Lost productivity due to integration, troubleshooting & user learning curve Costly to integrate software components Source: The Hidden Cost of Open Source white paper, Platform Computing, November 2010

35 Questions