A National Computing Grid: FGI

Transcription

1 A National Computing Grid: FGI Vera Hansper, Ulf Tigerstedt, Kimmo Mattila, Luis Alves 3/10/2012 FGI

2 Grids in Finland : a short history 3/10/2012 FGI

3 In the beginning, we had M-Grid Interest in Grid technology rose in Finland during 2003 A consortium of 7 Universities, HIP and CSC was formed which successfully obtained funding for the FIRST Finnish Computing Grid M-Grid Effort was driven by CSC and Kai Nordlund (HU) M-Grid was operational from 2005 to Sites Theoretical total computing capacity ~ 2.5 TFlops Infrastructure had aged significantly by end 2008

4 Then, FGI is born The second generation M-Grid planned since ~2009 Many discussions about upgrading infrastructure Pekka Lehtovuori (CSC) & Kai Nordlund seek funding Application for funding made in October 2010 FIRI grant approved beginning 2011 Academy funding totals 1.38M Consortium consists of the following: Aalto University, University of Helsinki, Lappeenranta University of Technology, Tampere University of Technology, University of Eastern Finland, University of Jyväskylä, University of Oulu, University of Turku, Åbo Akademi University and CSC CSC coordinates the activity Members host the clusters

5 What was ordered Standard node configuration (408) HP SG7 scaleout dual 6 core 2.67GHz Xeon X GB memory (min.) Big Memory nodes (4) HP Proliant DL 580 G7 server 1 TB memory GPGPU nodes (52) 2 Nvidia Tesla cards in a standard compute node Theoretical peak computing capacity of ~154 Tflops Disk servers: Total storage capacity of about 1 PB QDR InfiniBand & Gigabit ethernet for interconnect and network.

6 Getting the stuff, Installation and Acceptance Delivery started early November and installation at sites was done within one to two days of delivery Operating system is Scientific Linux 6 Scheduler used is SLURM And what there is... Aalto: 112 nodes, 8 GPGPU nodes, two 1TB big memory nodes Lappeenranta: 16 nodes Eastern Finland: 64 nodes Helsinki: 49 nodes, 20 GPGPU nodes, one 1 TB big memory node Jyväskylä: 48 nodes, 8 GPGPU nodes Oulu: 30 nodes Tampere (TUT): 37 nodes, 8 GPGPU nodes, one 1 TB big memory node Turku: 20 nodes Åbo Akademi: 8 GPGPU nodes CSC: 24 nodes (with 96GB memory)

7 Systems on line Local use is open at all sites (since early 2012) Sites maintain their own clusters: Site administrators are encouraged to collaborate and communicate Weekly meetings Providing grid software support for users Becoming part of the FGI community Small team from CSC manage the general administration

8 What FGI can offer you: Hardware resources More resources than a single University can offer Distributed nature means better availability even when the local cluster is full Local account is not required! Software There are a number of software packages already available for use via the grid Runtime environments list (currently 15 and growing) is available at Support CSC provides GRID administrative support, software AND user support send an to : [email protected]

9 Normal clusters Job scheduler (e.g. Slurm, PBS) User X Send job (sbatch, qsub...) User X: Job 1 User X: Job 2 User Y: Job 3 User Z: Job 4 Frontend Storage Network Compute node 1-n

10 Grids Storage Work computer re St o User X da ta Grid interface d Sen j ob Grid tools Lappeenranta cluster job Send Se nd job Grid interface Grid interface CSC cluster 03/10/2012 Helsinki cluster FGI Symposium at Viikki

11 What do you need? Certificate VO membership The ARC client tools Installable on most Linux versions MAC OSX Available on CSC servers: HIPPU, Vuori Also available on your local cluster login node

12 Starting with FGI and follow the links to FGI and FGI user pages Central place for all documentation and information about FGI Getting started Available software, and how to use it Problems? Requests?

13 Software in FGI Some scientific software is pre-installed Primarily open source software You can also run your own programs in FGI If you have suggestions contact us We can help you install YOUR software requirements!

14 FGI and EGI FGI is the Finnish NGI and EGI sees us as NGI_FI CSC is the Operations Center for FGI Uses the monitoring and service tools provided by EGI Follows EGI procedures for operations Manages the Regional Operational on Duty team Sites admins are part of this team!

15 What EGI can offer.. An even larger computational resource than just FGI! Connections with international user groups in your field Some of them have already made tools/software GRID-ready Enables easy sharing of expertise with your collaborators through Virtual Organisations (VOs)