High Productivity Computing With Windows

Transcription

1 High Productivity Computing With Windows Windows HPC Server 2008 Justin Alderson 16-April-2009

2 Agenda

3 The purpose of computing is... The purpose of computing is insight not numbers. Richard Hamming

4 Why Microsoft in HPC? Current Issues HPC and IT data centers merging: isolated cluster management Developers can t easily program for parallelism Users don t have broad access to the increase in processing cores and data How can Microsoft help? Well positioned to mainstream integration of application parallelism Have already begun to enable parallelism broadly to the developer community Can expand the value of HPC by integrating productivity and management tools Microsoft Investments in HPC Comprehensive software portfolio: Client, Server, Management, Development, and Collaboration Dedicated teams focused on Cluster Computing Unified Parallel development through the Parallel Computing Initiative Partnerships with the Technical Computing Institutes

5 Microsoft s Vision for HPC Provide the platform, tools and broad ecosystem to reduce the complexity of HPC by making parallelism more accessible to address future computational needs. Ease deployment for larger scale clusters Simplify management for clusters of all scale Integrate with existing infrastructure Enable non-technical users to harness the power of HPC Address emerging cross-industry computation trends Address needs of traditional supercomputing Increase number of parallel applications and codes Offer choice of parallel development tools, languages and libraries Drive larger universe of developers and ISVs

6 Today s HPC Environment Across Industries Public Sector

7 A brief history of HPC at Microsoft

8 Spring 2008, NCSA, # cores, 68.5 TF, 77.7% Spring 2008, Umea, # cores, 46 TF, 85.5% Fall 2007, Microsoft, # cores, 11.8 TF, 77.1% 30% efficiency improvement Spring 2007, Microsoft, # cores, 9 TF, 58.8% Spring 2008, Aachen, # cores, 18.8 TF, 76.5% Rank Organisation Rmax Cores 10 Shangai Supercomputer Center Windows HPC Server 2008 Windows Compute Cluster NCSA UMEA University, Sweden Spring 2006, NCSA, # cores, 4.1 TF Winter 2005, Microsoft 4 procs, 9.46 GFlops

9 Microsoft s in-house cluster Less than 2 hours to deploy 256 nodes Location Tukwila, WA Hardware Machines 256 Dual-CPU, quad-core Intel 5320 Clovertown 1.86GHz processors and 8GB RAM Hardware Networking Private & Public: Broadcom GigE MPI: Cisco Infiniband SDR incl/ 34 IB switches in leaf&node configuration Number of Compute Nodes 256 Total Number of Cores 2048 Total Memory 2+ TB of RAM Particulars of for current Linpack Runs Best Linpack rating so far TeraFLOPS Best cluster efficiency so far 77.1% For Comparison Linpack rating from June TeraFLOPS Top500 run (#106) on the same hardware Cluster efficiency from June % Top500 run (#106) on the same hardware Typical Top500 efficiency for 65-77% Clovertown motherboards w/ IB (2 instances of 79%) regardless of Operating System #106 (Jun 07) #116 (Nov 07) #303 (Jun 08) 30% improvement in efficiency on the same hardware between versions

10 Broad Partner Support for Windows HPC

11 Customers Ferrari is always looking for the most advanced technological solutions and, of course, the same applies for software and engineering. To achieve industry leading power-to-weight ratios, reduction in gear change times, and revolutionary aerodynamics, we can rely on Windows HPC Server It provides a fast, familiar, high performance computing platform for our users, engineers and administrators. -- Antonio Calabrese, Responsabile Sistemi Informativi (Head of Information Systems), Ferrari The Umeåcluster with Windows HPC Server 2008 performed well enough to become the fastest academic system in Sweden. We are very happy with that result. --Bo Kågström, Professor and Director, High Performance Computing Center North Umeå University Financial analysts in Europe mainly use Windows systems. As such, the deployment of a Windows HPC Server 2008 cluster renders our HPC services extremely attractive to a large potential user base. -- Dr. M. Rosati, Manager of the Computational Materials Science and Finance Group, CASPUR We are really impressed with many of the new features of Windows HPC Server Microsoft is a pretty young player in the HPC market, but this is already a very solid product. --Christian Terboven, Project Lead for HPC on Windows, Center forcomputing and Communication, RWTH Aachen University

12 Integrated HPC of the Future Development Tools Visual Studio: C#, C++, WCF, OpenMP, MPI, MPI.NET Numerical Libraries Fortran Existing Cluster Infrastructure UNIX/Linux System HPC Profile Trace Analysis Profiling MPI Debugging MPI Tracing Windows HPC Server 2008 Job Scheduler w/ Failover New TCP/IP Clients/Job Submission Batch Applications WCF Applications CCS Job Console CCS Scripts Compute Nodes Node Manager Applications: WCF, C#, C++, Fortran MPI w/network Direct SharePoint Excel Windows Workflow Foundation Administration Windows HPC Server 2008 Administration Console: System, Scheduling, Networking, Imaging, Diagnostics Windows Powershell System Center Operations Manager System Center Data Protection Manager System Center Configuration Manager Windows Server Update Services Software Protection Services 3 rd Party Systems Management Utilities Business Intelligence Storage Storage Storage Key Partner Microsoft HPC Server 2008 Parallel/Clustered Storage SQL Structured Storage Windows Storage Server with DFS SQL Server Integration Services SQL Server Analysis/ Reporting

13 Parallel Programming Available Now Development and Parallel debugging in Visual Studio 3 rd party Compilers, Debuggers, Runtimes etc.. available Emerging Technologies Parallel Framework LINQ/PLINQ natural OO language for SQL queries in.net C# Futures way to explicitly make loops parallel For the future: Parallel Computing Initiative (PCI) Triple investment with a new engineering team Focused on common tools for developing multi-core codes from desktops to clusters

14 A final thought: The Cloud Software and Services enables the choice between on-premise and cloud deployment with consist development tools and experiences across clients. Your Application

15 Summary

16 2008 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.