The GRID according to Microsoft

Transcription

1 JM4Grid 2008 The GRID according to Microsoft Andrea Passadore l.i.d.o.- DIST University of Genoa

2 Agenda Windows Compute Cluster Server 2003 Overview Applications Windows HPC Server 2008 Overview Architecture WCCS 2003 vs WHPCS 2008 Microsoft support:.net Framework 3.5 Other tools. 24/02/2008 2

3 Windows CCS CPU: (up to 4 processors) Intel Pentium or Xeon. (Intel EM64T) AMD Opteron or Athlon 64. RAM: Min: 512 MB Max: 32 GB Disk volumes: at least 2 on the head node. Disk space: 4GB. Network cards: 1 or 2 NICs. 24/02/2008 3

4 Windows CCS 2003 The head and compute nodes support: Windows Server 2003 Compute Cluster Windows Server 2003 Standard x64 Windows Server 2003 Enterprise x64 For remote management: Windows Server 2003 SP1 Windows XP SP2 Windows XP x64 24/02/2008 4

5 Windows CCS Security - Access point - Management - Job Scheduler - Computing 24/02/2008 5

6 Windows CCS 2003 Network topology: 24/02/ NICs on each node 3 NICs on the head node and 2 on cluster nodes 2 NICs on each node 2 NICs on the head node and 1 on cluster node. 1 NIC on each node. Public corporate network Private cluster management High-speed MPI network

7 WCCS Management Monitoring page To Do List Node Management Remote Desktop Sessions Performance Monitor Remote Installation Services 24/02/2008 7

8 MS-MPI Based on Argonne National Labs MPI2 (Open Source) Compatible with MPICH2 Reference implementation * Based on WinSock Direct protocol over: Gigabit Ethernet Myrinet InfiniBand 24/02/2008 8

9 MS-MPI It supports: C Fortran77 Fortran90 and provides: A parallel debugger for Visual Studio. 24/02/2008 9

10 Scheduler Compute Cluster Management allows users to: Schedule job Allocate resources Supported languages: Perl, Fortran, C/C++, C# and Java Job features: Multi-task, processor booking, priority. 24/02/

11 Scheduler Important features: Error recovery Automated clean-up Security Active Directory Role-based security Credential linked directly to the job. 24/02/

12 Case Studies Customers: Enterprises: Northrop Grumman, UniCredit, Boeing, BAE Systems, Petrobras, Daewoo, Bombardier. Universities: Queen s, Cincinnati, Virginia Polytechnic, Beira, Manchester, Nanyang. 24/02/

13 Case Studies Topics: IT Services, Education, Civil Engineering, Architecture, Investments, Banking, Biology, Automotive, Aerospace, Defence, Shipping, Railroad, Oil & Gas, Government, Medical, Gaming. 24/02/

14 Top 500 (November 2007) 24/02/

15 Top Microsoft Windows HPC Group 2048 processors (Intel Xeon) Manufacturer: DELL (poweredge) Interconnect family: InfiniBand 24/02/

16 Top National Taiwan University (IBM, Intel Xeon, InfiniBand) 309 Online Gaming (Singapore) (IBM, Intel Xeon, Gigabit Ethernet) 406, 407 Financial Institution (France) (IBM, AMD Opteron, Gigabit Ethernet) 422 Mitsubishi UFJ Securities (Japan) (IBM, Intel Xeon, Gigabit Ethernet) 24/02/

17 Windows HPC Server 2008 Windows Server longhorn 2008: Same code base of Vista. Network, IPv6 native, speed and security improvements..net 3.5, WCF, WF. Server core Active Directory Terminal Service Powershell Hyper-V /02/

18 Powershell Command-line shell Scripting language Based on:.net common language runtime.net framework It supports.net objects. cmdlet 24/02/

19 Powershell cmdlet $strcomputer = "." $colitems = get-wmiobject -class "Win32_Service" -namespace "root\cimv2" ` -computername $strcomputer foreach ($objitem in $colitems) { write-host "Name: " $objitem.name write-host "Path Name: " $objitem.pathname write-host "Process ID: " $objitem.processid write-host "Service Specific Exit Code: " $objitem.servicespecificexitcode write-host "Service Type: " $objitem.servicetype write-host "Started: " $objitem.started write-host "Start Mode: " $objitem.startmode write-host "Start Name: " $objitem.startname write-host "State: " $objitem.state write-host "Status: " $objitem.status } 24/02/

20 .NET Framework 3.5 Language Integrated Query Applications Development tools Windows Communication Foundation.NET 3.5 LINQ WCF WPF CardSpace WF Windows Presentation Foundation.NET 2.0 Windows workflow Foundation Windows Vista, XP, /02/ Hardware

21 WCF It is a model that unifies: Web services.net Remoting Distributed Transactions Message queues. It is based on SOAP. 24/02/

22 WF Expressed in XAML.NET language Supports: Visual Studio editor Runtime execution 24/02/

23 Parallel FX Library Parallel FX: PLINQ (Parallel LINQ) Parallel.For(0, 100, delegate(int i) { a[i] = a[i]*a[i]; } ); TPL (Task Parallel Library) IEnumerable<T> data =...; var q = from x in data.asparallel() where p(x) orderby k(x) select f(x); foreach (var e in q) { } 24/02/

24 Windows HPC Server 2008 System Management: Restyling of the Admin Interface. Node grouping Multiple head nodes. Power Shell Built-in diagnostic, monitoring, reporting. 24/02/

25 Administration Console 24/02/

26 Windows HPC Server 2008 Job Scheduling: Integration with WCF (SOA!). Granularity (processor core, processor socket, compute node levels). External database support. Support for Open Grid Forum s HPCbasic Profile Interface 24/02/

27 Windows HPC Server 2008 Storage: New parallel file system support. Networking and MPI: Dramatic performance improvements for MPI applications (Network Direct). 24/02/

28 MS-MPI Network Direct 24/02/

29 Solution Architecture 24/02/

30 Ecosystem HPC Profile 24/02/

31 WCCS 03 vs WHPCS 08 Feature Operating System Processor Type Node Deployment Head Node Redundancy Network topology Management Windows Server 2003 SP1 x64 (AMD or Intel) RIS WDS N/A Wizard WCCS 2003 Basic nodes and job management Windows Server 2008 x64 (AMD or Intel) WDS WHPCS 2008 Failover Clustering Improved wizard Integrated, node grouping, monitoring, diagnostics. 24/02/

32 WCCS 03 vs WHPCS 08 Feature MS-MPI Scheduler Reporting Monitoring Diagnostics WCCS 2003 Winsock Direct-based Command line or GUI N/A Basic service N/A WHPCS 2008 Network Direct-based. New shared memory Integrated, PowerShell, improved speed and scalability, SOA support Integrated, support for SQL analysis Service Heat map, performance overview Verification tests, performance tests, history 24/02/

33 Conclusions Windows HPC Server 2008: Easy to deploy and manage Integrated in the Microsoft ecosystem open system 24/02/

34 The end 24/02/