High Productivity Computing With Windows Windows HPC Server 2008

Transcription

1 High Productivity Computing With Windows Windows HPC Server 2008

2 Product Unit Manager Windows HPC Server Microsoft Corporation

3 Trends affecting HPC Make HPC Broadly Accessible Upgrade IT skills Easy access for end users Accelerate Innovation Multi-core platforms Heterogeneous systems Trends Impacting HPC Landscape Data Proliferation Management Data Explosion Managing data Control & Align Costs Enmeshing of Enterprise IT and HPC System Management Costs

4 Today s HPC Environment Corporate infrastructure Clusters/super computers High speed networking Storage Information workers Scientists Engineers Financial analysts Mainstream technologies Compilers Specialized languages Debuggers

5 High Productivity Computing Combined infrastructure HPC and IT data centers merge, streamlined cluster management Users with broad access to multiple cores and servers Integrated desktop and HPC environment Simplified parallel development Unified development environment

6 Microsoft Entry into HPC Personal Super Computing Built on Windows Server 2003 Microsoft Entry into HPC Addressing Personal And Workgroup Needs End User Applications available for Windows Parallel and HPC Development Tools Ease of Management and Deployment

7 Microsoft HPC Server Today Broad Reaching HPC Built on Windows Server 2008 Support Traditional & Emerging HPC Larger Cluster support & Top500 Range Better integration for Windows-based Users Broader Developer support with tools and SOA Improved Management and Deployment

8 HPC Pack 2008 Overview New System Center UI PowerShell for CLI Management High Availability for Head Nodes Windows Deployment Services Diagnostics/Reporting Support for Operations Manager Systems Management Job Scheduling Support for SOA and WCF Granular resource scheduling Improved scalability for larger clusters New Job scheduling policies Interoperability via HPC Profile NetworkDirect (RDMA) for MPI Improved Network Configuration Wizard Shared Memory MS-MPI for multi-core MS-MPI integrated with Windows Event Tracing Networking & MPI Storage Improved iscsi SAN & parallel file system Support in Win2008 Improved Server Message Block ( SMB v2) New 3 rd party parallel file system support for Windows New Memory Cache Vendors

9 Microsoft HPC MOMENTUM #10 Gordon Bell: Congratulations on making it into the HPC club! You guys have come a long way, especially since Bill s Keynote at Supercomputing 2005 in Seattle. Ansys: We have achieved some impressive performance gains on the latest solution from Microsoft. The combination of ANSYS software and Windows HPC Server 2008 enhances cluster computing as an option for our customers who need more HPC capacity. Wall Street Journal: The Cray HPC brand name and experience, combined with Microsoft's strategy of extending the familiar Windows environment upward to the server level, gives the Cray CX1 solution strong potential for exploiting the anticipated growth of this market segment. Ferrari: We are always looking for the most advanced technological solutions and, of course, the same applies for software and engineering. To achieve industry leading powerto-weight ratios, reduction in gear change times, and revolutionary aerodynamics, we can rely on Windows HPC Server Gartner: Windows HPC Server 2008 should be seriously considered as the sole operating environment or as an alternative mode sideby-side with Linux. HPCWire Editors Choice Award: Best HPC software product or technology Windows HPC Server 2008

10

11 Improved Efficiency for the Systems Admin Simple to setup and manage in a familiar environment Turnkey cluster solutions through OEMs Simplify system and application deployment Base images, patches, drivers, applications Focus on ease of management Comprehensive diagnostics, troubleshooting and monitoring Familiar, flexible and pivotal management interface Equivalent command line support for unattended management Scale up Scale deployment, administration, infrastructure Head node failover Cluster usage reporting Compute node filtering Better integration with enterprise management Patch Management System Center Operations Management PowerShell Windows 2008 high Availability Services

12 NetworkDirect A new RDMA networking interface built for speed and stability Priorities Comparable with hardware-optimized MPI stacks Focus on MPI-Only Solution for version 2 Verbs-based design for close fit with native, high-perf networking interfaces Coordinated w/ Win Networking team s long-term plans Implementation MS-MPIv2 capable of 4 networking paths: Shared Memory between processors on a motherboard TCP/IP Stack ( normal Ethernet) Winsock Direct (and SDP) for sockets-based RDMA New RDMA networking interface HPC team partners with networking IHVs to develop/distribute drivers for this new interface TCP/Ethernet Networking Socket-Based App Windows Sockets (Winsock + WSD) TCP IP NDIS Networking Networking Mini-port Hardware Hardware Driver Networking Hardware Networking Hardware Hardware Driver MPI App MS-MPI Networking WinSock Networking Hardware Direct Hardware NetworkDirect Networking Provider Provider Hardware Networking Networking Hardware Hardware User Mode Access Layer Networking Hardware Networking Hardware Networking Hardware RDMA Networking Kernel By-Pass User Mode Kernel Mode (ISV) App CCP Component OS Component IHV Component

13 Scenario: Broaden Application Support V1 (focusing on batch jobs) V2 (focusing on Interactive jobs) Engineering Applications Structural Analysis Crash Simulation Oil & Gas Applications Reservoir simulation Seismic Processing Life Science Applications Structural Analysis Crash Simulation Financial Services Portfolio analysis Risk analysis Compliance Actual Excel Pricing Modeling Interactive Cluster Applications Your applications here Job Scheduler Resource allocation Process Launching Resource usage tracking Integrated MPI execution Integrated Security + WCF Service Router WS Virtual Endpoint Reference Request load balancing Integrated Service activation Service life time management Integrated WCF Tracing App.exe App.exe App.exe App.exe Service (DLL) Service (DLL) Service (DLL) Service (DLL)

14 Tuning Wizard for Linpack Single pack with HPL 1.0a + Intel math Kernel Lib

15 Demo

16 Microsoft in HPC, A Solution Component Boosting Developer Productivity - Visual Studio for Parallel Programming - Range of compilers/ libraries / debuggers and profilers for Visual Studio - Program SOA based workloads and deploy on Windows HPC using Visual Studio Developer Productivity IT Pro Productivity Boosting IT Pro Productivity - HPC Server built in tools - Enterprise management tools - MOAB Adaptive HPC Suite Boosting End User Productivity - Rich Ecosystem of ISV applications 100 s of applications are now integrated with Windows HPC Server -Sharepoint HPC oriented web parts for customizing Sharepoint integration with HPCS -XLRunner and UDF Offloading Scale long running Excel spreadsheets using Windows HPC Server End User Productivity

17 Parametric Sweeps End user scheduling of long running calculations Schedule Job Jobs Results Head Node Job Mgmt Scheduling Cluster Mgmt Resource Mgmt Office SharePoint (Document Libraries) Excel 14 using Excel Runner

18 Customer Momentum

19 Windows HPC Tomorrow 2010 Parallel Extensions Highly Scalable, Efficient HPC Built on Windows Server 2008 R2 Scalable HPC Infrastructure for nodes Customizable management elements for superior control Evolved SOA support for scale and programmability Programming Patterns for HPC with Extensions.NET Continued support for integration with Microsoft Infrastructure

20 What s coming in R2 Beta 1 Windows HPC Server 2008 R2 dramatically increases the scale of HPC clusters with an out-of-the-box experience to deploy, manage and schedule large scale HPC systems. Scalability Ease of Use Efficiency Systems Management Reliable deployment at scale Admin tool experience at scale Support for enterprise databases Heat map customization Updated node template and software patching wizard Filter by node location iscsi boot for diskless compute nodes Saved views and filtering Extensible diagnostics Support for custom reporting Job Scheduler High volume job & task scheduling Dynamic parametric tasks Job progress tracking Node prep and release tasks Streamlined job troubleshooting Improved password management Service job resource balancing Activate GPGPU jobs SOA Model Duplex Message Exchange Pattern Message persistence Automated broker restart or failover Enhanced environment diagnostics Fire & Recollect SOA jobs Service list and configuration Out-of-the-box setup for broker Graceful service shutdown Unified WCF configuration SOA job monitoring

21 Demo

22 Demo

23 Release Schedule Q Q Q Q May June July Aug Sept Oct Nov Dec Jan Feb Mar Q Community Technical Preview May 2009 CTP 2 Sept 2009 Beta Nov 2009 RC Feb 2010 RTM H Windows HPC Server 2008 SP1 RTM Spring 2010 English, Chinese, Japanese

24 Interoperability Microsoft s strategy for growing HPC market Support for non-cs domain experts Matlab, R, Excel users doing data analytics Integration with the enterprise data center Rich programming models MPI, SOA, and the new Parallel Computing Platform Reduce support costs and provide great performance for existing HPC ISVs

25 Interoperability Present New categories of apps on HPC Server Horizontal applications starting to use clusters Major HPC apps on Windows Windows Linux

26 Interoperability Future Windows support helps grow HPC market New application types flourish Horizontal applications regularly leverage clusters Major HPC apps on Windows Windows Expands HPC reach within your organization Take advantage of new Windows HPC capabilities for new HPC users Linux

27 Interoperability Dynamic workloads require a dynamic datacenter Moab Adaptive HPC Suite to dynamically change OS Sophisticated policies and SLAs to determine OS mix Applications still integrate directly with HPC Server job scheduler Progress, troubleshooting, integrated security provided by HPC Server T = 1 T = 2 T = 3 T = 4

28 Dynamic Adaptation A New Model: Hybrid Windows/Linux HPC Clusters Allows you to address both Windows HPC and Linux demand as needed Enables new HPC cluster users stuck on Windows Workstations Can still take direct advantage of Windows HPC benefits (Excel,...) Expand Cluster Utilization by enabling both Windows and Linux users to co-exist Provides a framework for your cluster to dynamically respond to user demand over time

29 Working Together

30 Rocky Mountain Supercomputing Centers

31 Windows HPC in the Future Seamless Parallelism Addressing the data explosion with petabyte data analytics tools Tackling scalable applications from workstation to cluster to cloud Dynamic and elastic virtualized clusters Uniform programming model for scalable applications Easily deploy and manage scalable applications Capacity without limitations for users of those applications

32 Industry Focused Partners

33 Additional Information Microsoft HPC Web site Evaluate Today! Windows HPC Community site Windows HPC TechCenter HPC on MSDN Windows Server Compare website

34 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.