IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

Transcription

1 IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25,

2 Agenda v Mapping clients needs to cloud technologies v Addressing your pain points v Introducing IBM Platform Computing Cloud Service v Product features and benefits v Use cases v Performance benchmarks 2

3 HPC cloud characteristics and economics are different than general-purpose computing High-end hardware and special purpose devices (e.g. GPUs) are typically used to supply the needed processing, memory, network, and storage capabilities The performance requirements of technical computing and service-oriented workloads means that performance may be impacted in a virtualized cloud environment, especially when latency or I/O is a constraint HPC cluster/grid utilization is usually in the 70-90% range, removing a major potential advantage of a public cloud service provider for stable workload volumes HPC Workloads Recommended for Private Cloud HPC Workloads with Best Potential for Virtualized Public & Hybrid Cloud Primary HPC Workloads 3

4 IBM s HPC cloud strategy provides a flexible approach to address a variety of client needs Private Clouds Hybrid Clouds Public Clouds Evolve existing infrastructure to HPC Cloud to enhance responsiveness, flexibility, and cost effectiveness. Enable integrated approach to improve HPC cost and capability Access additional HPC capacity with variable cost model 60% Based on HPC Cloud s potential impact, organizations are evolving their infrastructures to enable private cloud deployments, exploring hybrid clouds, and considering public clouds. 4

5 Are you experiencing any of these pain points? Unable to meet business objectives (delay to market, etc.) Existing resources insufficient to meet peek compute demand Long run times on existing cluster or grid No access to local technical computing resources (workstation users) Technical resources expensive and time consuming to acquire The skills/staff to architect and manage a technical computing infrastructure can be difficult to acquire 50,000 40,000 30,000 20,000 10,000 - Planned Daily Cycle (24 x 365) Planned Project April May June Financial Services Life Sciences 5

6 IBM Platform Computing Cloud Service Making the cloud work for you Build Manage Support Protect Complete, ready to run clusters in the cloud Add additional capacity in hours instead of months Seamless workload management, onpremise and in the cloud Transparent user experience 24X7 cloud operation support Access to technical computing expertise when you need it Data encryption, dedicated physical machines and network Security through physical isolation Complete, end to end dynamic cloud solution 6

7 Ready to use Platform LSF & Platform Symphony clusters in the cloud Client and ISV Applications IBM Platform Computing Cloud Service (SaaS) IBM Platform LSF IBM Platform Symphony SoftLayer, an IBM Company Infrastructure 24X7 CloudOps Support 7

8 Dedicated physical and virtual machine infrastructure as a service 13+ data centers 17 network PoPs Global private network Bare metal and virtual machines 190, , ,000,000+ SERVERS CUSTOMERS DOMAINS 8

9 Ready to use Platform LSF & Platform Symphony clusters in the cloud DIFFERENTIATOR RATING IBM ADVANTAGES Workload I/O intensity Low intensity workloads High intensity workloads SoftLayer s architecture outperforms by >50% equivalent AWS instances for high I/O workloads Control (APIs, hardware / network configurability) Low degree of control and customization High degree of control and customization SoftLayer offers hundreds of hardware configurations vs. 14 for AWS ~2,000 APIs for SoftLayer vs. ~60 for AWS and none for RAX Integrated platform of multiple architectures Single platform Seamless integration Unified integration & control panel for multiple cloud architectures RAX requires paid bridge, different control interfaces AWS RAX IBM 9

10 Non-shared physical machines for added security and performance Dedicated and isolated compute environment All machine instances are dedicated to the client Each cluster is isolated on a VLAN Only the VPN gateway has an addressable interface All customer data at rest is encrypted on shared file systems When machines instances are decommissioned the disks are scrubbed using DoD approved methods 10

11 Optimal performance for technical computing apps EDA Benchmark (IBM-MESA) Industrial Manufacturing Benchmark Structural Mechanics 11 Note: Benchmark results were obtained by IBM and have not yet been externally audited or validated.

12 Run and supported by dedicated, 24X7 HPC Cloud Operations Team CloudOps functions Pre-provisioning: Provide guidance to client on how to enable VPN, multi-cluster settings & security settings on the client on-premise environment One time setup testing: Extensive testing of the cluster prior to release to the client Extensive testing of the cluster on every event of flex-up prior to release to the client alerts prior to flex-down & cluster shutdown operations alerts in case of any overage (compute hours, download bandwidth) Provide billing details of monthly usage including overage details Provide support under IBM SLA by experts highly experienced in Platform Computing products Value: quality, peace of mind & minimum disruption to business Extensive quality checks ensures minimum loss of usage hours & disruptions Proactive alerts ensures that in-progress critical jobs are not killed in case of Flex-down & Cluster Shutdowns and Overages Highly trained & experienced Support ensures smooth on-boarding and minimize disruptions 12

13 Industry-leading workload management 20 years managing distributed scale-out systems with customers in many industries High performance workload management combined with intelligent resource scheduling engine Unmatched scalability (small clusters to global grids) and production-proven reliability Heterogeneous manages System x and Power plus 3rd party systems, virtual and bare metal, accelerators / GPU, cloud, etc. Shared services for both compute and data intensive workloads Integrated solutions with vertical reference architectures 23 of 30 largest commercial enterprises 60% of top financial services companies Over 5M CPUs under management 13

14 IBM Platform LSF Overview Powerful workload management for demanding, distributed and mission-critical high performance computing environments. Key Capabilities Powerful 14 - Policy and resource-aware scheduling - Resource consolidation for optimal performance - Advanced self-management Flexible - Heterogeneous platform support - Policy-driven automation - CLI, web services, APIs Scalable - Thousands of concurrent users and jobs - Virtualized pool of shared resources - Flexible control, multiple policies Client Benefits Optimal utilization: reduced infrastructure cost Robust capabilities: improved productivity High throughput: faster time to results 14

15 IBM Platform Symphony Overview Low-latency grid management platform for distributed computing and analytics with sophisticated resource sharing Key Capabilities Accelerates service-oriented applications Extreme app scalability and throughput with very low latency Compute and data-intensive applications on a single platform Sophisticated, hierarchical resource sharing Open and flexible: choice of OS, frameworks and languages Client Benefits Increase performance and analytic result quality Reduces IT costs - increase utilization, simplify application onboarding, reduce administration costs Low Latency / High throughput Sub-millisecond, 17,000 tasks per second Large Scale 10k cores per application, 40k cores per grid Efficient shared services Heterogeneous & Open Linux, Windows, AIX, C/C++, C#, Java, Excel, Python, R 15 15

16 Use case 1 hybrid cluster The problem Existing resources cannot meet peak demand Resources are expensive and time consuming to acquire Skills to architect and manage clusters are difficult to find Fixed or reduced budgets On-premise constraints in space, cooling and power The solution Fully functioning IBM Platform LSF or Symphony clusters are provisioned on the SoftLayer cloud and connected to the onpremise cluster, expanding capacity as needed Leverage MultiCluster capability for managed forwarding of jobs from on premise cluster to off premise cluster The Value Access to additional compute capacity on a temporary basis as needed Near-zero wait times Reduce costs by paying for only what is used Pay for additional capacity as an operating expense Fully supported, end-to-end solution, from the on-premise to the on-cloud clusters Expected and reliable performance from running technical computing workloads on physical machines Transparent access to cloud resources, the end user experience does not change 16

17 Use case 2 stand-alone cluster in the cloud The problem New and emerging need for technical computing Skills to architect and manage clusters are difficult to find Resources are expensive and time consuming to acquire Inconsistent demand does not justify the investment The solution Fully functioning Platform LSF and Symphony clusters are provisioned on the SoftLayer cloud providing resources as needed The value Market-leading Platform LSF and Platform Symphony software Access to technical computing resources on a temporary basis without the need to acquire, install and configure the infrastructure and cluster software Keep costs low by paying for only what is used Pay for capacity as an operating expense Fully supported solution Expected and reliable performance from running workloads on physical machines 17

18 Is IBM Platform Computing Cloud Service a good fit for you? Business pain points And you experiencing lost profit due to missed deadlines? Do you experience pressure to convert your compute environment capital expense to operational expense? Have you ever missed a deadline or delayed a project because technical computing resource procurement took too long? Technology pain points Do your users ever scale back their analyses to lower fidelity or less accuracy in order to fit them into the local compute environment or to a time window? Do you regularly, occasionally, or permanently have fewer resources (CPUs, disk, memory, etc) than you would like to have to service the user s compute demand? Do you experience a large variance in compute resource utilization? Have you reached, or will you reach the capacity of your datacenter(s), and do you need a plan to grow beyond that capacity? Are your customers asking you for cloud licenses for Platform LSF or Platform Symphony? 18

19 Platform Computing IBM Platform Computing Cloud Service Making the Cloud Work for You IBM Hybrid Cloud On Premise On SmartCloud powered by Software & Systems Unmatched Capabilities Cloud Leadership Policy-driven Workload Management Expertise from Client Engagements Unmatched Expertise Analytics, Technical Computing, Software, Services and ISV Partnerships Consolidation Supporting heterogeneous IBM and non-ibm infrastructure 19

20 Thank You 20

21 SoftLayer and Amazon EC2 Products tested NAME SL PM SL VM SL PM (ded) EC2 CC2 EC2 2XL IaaS CPU Cores Memory Disk Space Physical / Hourly Provider (GB) (GB) Virtual Rate (USD) So'Layer [1] Physical $1.85[2] So'Layer [3] Virtual $0.88 So'Layer [1] Physical $3.83[5] Amazon EC2 (CC2) Amazon EC2 (c1.xlarge) Virtual $2.40[4] Virtual $0.58 SL Physical Machine SL Physical Machine (dedicated) SL Virtual Machine Amazon CCI2 Amazon 2XL Intel(R) Xeon(R) CPU E GHz Intel Xeon CPU E GHz Intel(R) Xeon(R) CPU E GHz Intel(R) Xeon(R) CPU E GHz Intel(R) Xeon(R) CPU E GHz 21

22 Platform Computing Memory Bandwidth STREAM (higher is better) SL PM SL VM EC2 CCI2 EC2 2XL SL PM (ded) COPY SCALE ADD TRIAD 4, , , , , STREAM Price Performance (higher is better) COPY SCALE ADD TRIAD 2, , , SL PM SL VM EC2 CCI2 EC2 2XL SL PM (ded) 22

23 CPU Performance SuperPI (lower is better) Elapsed Time SL PM SL VM EC2 CCI2 EC2 2XL SL PM (ded) SuperPI Price-Performance (higher is better) throughput per dollar SL PM SL VM EC2 CCI2 EC2 2XL SL PM (ded) 23

24 Network Bandwidth openmpi Bandwidth (Mbits/s) SLVM EC2 2XL EC2 CCI2 SL PM SL PM Dedicated Message Size (Bytes) 24

25 Network Latency openmpi Latency (lower is better) SL VM MPI 2 node EC2 2XL MPI 2 node EC2 CCI2 MPI 2 node SL PM MPI 2 node SL PM (ded) MPI 2 node 25

26 Input / Output Performance I/O Bandwidth - WRITE (higher is better) kb/sec I/O file size (factor of memory size) SL VM Write EC2 2XL Write EC2 CCI2 Write SL PM Write SL PM Ded Write I/O Bandwidth - READ (higher is better) kb/sec SL VM Read EC2 CCI2 Read EC2 2XL Read SL PM Read I/O file size (factor of memory size) SL PM Ded Read

27 Software Compilation Elapsed Time (s) Software Compile Performance (lower is better) SL VM SL PM EC2 2XL EC2 CCI SL PM Ded Runs / $ Software Compile Price-Performance (higher is better) SL VM SL PM EC2 2XL EC2 CCI SL PM Ded

28 Life Science (BWA) Life Sciences Benchmark (BWA) (lower is better) Elapsed time (sec) Life Sciences Benchmark (BWA) Price Performance (lower is better) SL PM (ded) SL PM SL VM EC2 CCI2 EC2 2XL Series $ / run SL PM (ded) SL PM SL VM EC2 CCI2 EC2 2XL 28 Series

29 EDA Benchmark (IBM-MESA) 3500 EDA - IBM Mesa (lower is better) Elapsed Time (sec) SL PM (ded) SL PM SL VM EC2 2XL EC2 CCI EDA - IBM Mesa - Price-Performance (higher is better) 2.00 Runs / $ SL PM (ded) SL PM SL VM EC2 2XL EC2 CCI2 29

30 Provisioning Time Provisioning Time (sec) (lower is better) SL PM SL VM EC2 CCI2 EC2 2XL SL PM Ded 30

31 Industrial Manufacturing Structural Mechanics Speedup (relative to EC2 2XL) Speedup (relative to EC2 2XL) One Node - S4D CPUs Two Nodes - S4D CPUs SL PM EC2 CCI2 SL VM EC2 2XL Speedup (relative to EC2 2XL) SL PM (ded) 1 SL PM EC2 CCI2 SL VM EC2 2XL SL PM (ded) Speedup (relative to EC2 2XL) One Node - S6 SL PM EC2 CCI2 SL VM EC2 2XL SL PM (ded) CPUs Two Nodes - S6 SL PM EC2 CCI2 SL VM EC2 2XL SL PM (ded) CPUs

32 Industrial Manufacturing CFD Speedup (relative to EC2 2XL) OpenFoam Speedup Backplane (higher is better) # cores SL PM (ded) SL PM SL VM EC2 CCI2 EC2 2XL 8 OpenFoam Speedup Ethernet (higher is better) 32 Speedup (relative to EC2 2XL) # cores SL PM (ded) SL PM SL VM EC2 CCI2 EC2 2XL