JM4Grid 2008 The GRID according to Microsoft Andrea Passadore passa@dist.unige.it l.i.d.o.- DIST University of Genoa
Agenda Windows Compute Cluster Server 2003 Overview Applications Windows HPC Server 2008 Overview Architecture WCCS 2003 vs WHPCS 2008 Microsoft support:.net Framework 3.5 Other tools. 24/02/2008 2
Windows CCS 2003 2006 CPU: (up to 4 processors) Intel Pentium or Xeon. (Intel EM64T) AMD Opteron or Athlon 64. RAM: Min: 512 MB Max: 32 GB Disk volumes: at least 2 on the head node. Disk space: 4GB. Network cards: 1 or 2 NICs. 24/02/2008 3
Windows CCS 2003 The head and compute nodes support: Windows Server 2003 Compute Cluster Windows Server 2003 Standard x64 Windows Server 2003 Enterprise x64 For remote management: Windows Server 2003 SP1 Windows XP SP2 Windows XP x64 24/02/2008 4
Windows CCS 2003 - Security - Access point - Management - Job Scheduler - Computing 24/02/2008 5
Windows CCS 2003 Network topology: 24/02/2008 6 3 NICs on each node 3 NICs on the head node and 2 on cluster nodes 2 NICs on each node 2 NICs on the head node and 1 on cluster node. 1 NIC on each node. Public corporate network Private cluster management High-speed MPI network
WCCS Management Monitoring page To Do List Node Management Remote Desktop Sessions Performance Monitor Remote Installation Services 24/02/2008 7
MS-MPI Based on Argonne National Labs MPI2 (Open Source) Compatible with MPICH2 Reference implementation * Based on WinSock Direct protocol over: Gigabit Ethernet Myrinet InfiniBand 24/02/2008 8
MS-MPI It supports: C Fortran77 Fortran90 and provides: A parallel debugger for Visual Studio. 24/02/2008 9
Scheduler Compute Cluster Management allows users to: Schedule job Allocate resources Supported languages: Perl, Fortran, C/C++, C# and Java Job features: Multi-task, processor booking, priority. 24/02/2008 10
Scheduler Important features: Error recovery Automated clean-up Security Active Directory Role-based security Credential linked directly to the job. 24/02/2008 11
Case Studies Customers: Enterprises: Northrop Grumman, UniCredit, Boeing, BAE Systems, Petrobras, Daewoo, Bombardier. Universities: Queen s, Cincinnati, Virginia Polytechnic, Beira, Manchester, Nanyang. 24/02/2008 12
Case Studies Topics: IT Services, Education, Civil Engineering, Architecture, Investments, Banking, Biology, Automotive, Aerospace, Defence, Shipping, Railroad, Oil & Gas, Government, Medical, Gaming. 24/02/2008 13
Top 500 (November 2007) 24/02/2008 14
Top 500 116 - Microsoft Windows HPC Group 2048 processors (Intel Xeon) Manufacturer: DELL (poweredge) Interconnect family: InfiniBand 24/02/2008 15
Top 500 239 National Taiwan University (IBM, Intel Xeon, InfiniBand) 309 Online Gaming (Singapore) (IBM, Intel Xeon, Gigabit Ethernet) 406, 407 Financial Institution (France) (IBM, AMD Opteron, Gigabit Ethernet) 422 Mitsubishi UFJ Securities (Japan) (IBM, Intel Xeon, Gigabit Ethernet) 24/02/2008 16
Windows HPC Server 2008 Windows Server longhorn 2008: Same code base of Vista. Network, IPv6 native, speed and security improvements..net 3.5, WCF, WF. Server core Active Directory Terminal Service Powershell Hyper-V 27-02-08 24/02/2008 17
Powershell Command-line shell Scripting language Based on:.net common language runtime.net framework It supports.net objects. cmdlet 24/02/2008 18
Powershell cmdlet $strcomputer = "." $colitems = get-wmiobject -class "Win32_Service" -namespace "root\cimv2" ` -computername $strcomputer foreach ($objitem in $colitems) { write-host "Name: " $objitem.name write-host "Path Name: " $objitem.pathname write-host "Process ID: " $objitem.processid write-host "Service Specific Exit Code: " $objitem.servicespecificexitcode write-host "Service Type: " $objitem.servicetype write-host "Started: " $objitem.started write-host "Start Mode: " $objitem.startmode write-host "Start Name: " $objitem.startname write-host "State: " $objitem.state write-host "Status: " $objitem.status } 24/02/2008 19
.NET Framework 3.5 Language Integrated Query Applications Development tools Windows Communication Foundation.NET 3.5 LINQ WCF WPF CardSpace WF Windows Presentation Foundation.NET 2.0 Windows workflow Foundation Windows Vista, XP, 2008 24/02/2008 20 Hardware
WCF It is a model that unifies: Web services.net Remoting Distributed Transactions Message queues. It is based on SOAP. 24/02/2008 21
WF Expressed in XAML.NET language Supports: Visual Studio editor Runtime execution 24/02/2008 22
Parallel FX Library Parallel FX: PLINQ (Parallel LINQ) Parallel.For(0, 100, delegate(int i) { a[i] = a[i]*a[i]; } ); TPL (Task Parallel Library) IEnumerable<T> data =...; var q = from x in data.asparallel() where p(x) orderby k(x) select f(x); foreach (var e in q) { } 24/02/2008 23
Windows HPC Server 2008 System Management: Restyling of the Admin Interface. Node grouping Multiple head nodes. Power Shell Built-in diagnostic, monitoring, reporting. 24/02/2008 24
Administration Console 24/02/2008 25
Windows HPC Server 2008 Job Scheduling: Integration with WCF (SOA!). Granularity (processor core, processor socket, compute node levels). External database support. Support for Open Grid Forum s HPCbasic Profile Interface 24/02/2008 26
Windows HPC Server 2008 Storage: New parallel file system support. Networking and MPI: Dramatic performance improvements for MPI applications (Network Direct). 24/02/2008 27
MS-MPI Network Direct 24/02/2008 28
Solution Architecture 24/02/2008 29
Ecosystem HPC Profile 24/02/2008 30
WCCS 03 vs WHPCS 08 Feature Operating System Processor Type Node Deployment Head Node Redundancy Network topology Management Windows Server 2003 SP1 x64 (AMD or Intel) RIS WDS N/A Wizard WCCS 2003 Basic nodes and job management Windows Server 2008 x64 (AMD or Intel) WDS WHPCS 2008 Failover Clustering Improved wizard Integrated, node grouping, monitoring, diagnostics. 24/02/2008 31
WCCS 03 vs WHPCS 08 Feature MS-MPI Scheduler Reporting Monitoring Diagnostics WCCS 2003 Winsock Direct-based Command line or GUI N/A Basic service N/A WHPCS 2008 Network Direct-based. New shared memory Integrated, PowerShell, improved speed and scalability, SOA support Integrated, support for SQL analysis Service Heat map, performance overview Verification tests, performance tests, history 24/02/2008 32
Conclusions Windows HPC Server 2008: Easy to deploy and manage Integrated in the Microsoft ecosystem open system 24/02/2008 33
The end 24/02/2008 34