Estonian Scientific Computing Infrastructure (ETAIS)

Transcription

1 Estonian Scientific Computing Infrastructure (ETAIS) Week #7 Hardi Teder University of Tartu March 27th 2013

2 Overview Estonian Scientific Computing Infrastructure Estonian Research infrastructures Roadmap TAAT ETAIS portal 2/29

3 Resources after the course Where can I find the computing and storage resources after the course? For scientific projects and for the theses Estonian Scientific Computing Infrastructure - ETAIS 3/29

4 Estonian Research infrastructures Roadmap In 2010 The Ministry of Education and Research together with the Estonian Academy of Sciences has launched a process of compiling the Estonian roadmap of research infrastructures. 4/29

5 Research Infrastructures Research infrastructures are facilities", "resources" and related "services" that are needed by the scientific community for the development of leading-edge research in the most efficient manner as well as for knowledge transmission, knowledge exchanges and knowledge preservation and cover major equipments, collections, archives and structured information, enabling ICT-based infrastructures, and any other entity of a unique nature used for research. 5/29

6 Estonian Research infrastructures Roadmap Mapping the future needs of Estonian research infrastructures Proceeding from the research development trends in the world and in Estonia. The roadmap will be updated regularly (at an interval of 3 to 5 years) to take into account the changing circumstances and opportunities. a research infrastructure in the roadmap does not mean that it will be funded nor ranked but the roadmap will be used as an input for the investment decisions under preparation. The working group set up by the minister was responsible for compiling the roadmap analysed the submitted proposals and selected 20 infrastructure objects to be included in the roadmap. 6/29

7 The list of Estonian research infrastructures 1. Estonian e-repository and Conservation of Collections 2. Estonian Centre for Genomics 3. Center of Estonian Language Resources 4. Estonian Environmental Observatory Estonian Scientific Computing Infrastructure 12. Estonian Research and Education Optical Backbone Network 20. Plant Biology Infrastructure - from Molecules to Crops 7/29

8 Example Estonian Research and Education Optical Backbone Network Dark fibre rings 10Gbps channel Baltic Ring collaboration Before After 8/29

9 Estonian Scientific Computing Infrastructure Providing computing and storage resources for Estonian scientific community Feasible to gather these resources into scientific computing centres All Estonian science must get access 9/29

10 ETAIS objectives Provide common access to all resources HPC centres + central services Central users and groups database access with home organization credentials Central accounting and monitoring Easy to access SSH logins + LRMS EGI compatible Grid middleware 10/29

11 ETAIS resource providers Estonian HPC centres for science University of Tartu National Institute of Chemical Physics and Biophysics Tallinn Technical University EENet 11/29

12 HPC at University of Tartu The High Performance Computing Center is a consortium of UT and it's purpose is to build and develop the necessary infrastructure for scientific computing. It also manages and coordinates the use of said computing equipment. The computing resource is open for use to any research groups inside the university. Users from other Estonian science- and research institutions are also welcome. 12/29

13 hpc.ut.ee resources Vedur cluster Aurumasin cluster 60 nodes (480 cores; 32GB RAM; 4x DDR Infiniband) Silinder machine 80 nodes (2560 cores; 48GB RAM per node; 4x QDR IB) 512GB RAM (4 cpus - 32 cores) Different storage systems Disks, Tapes (132TB all together) 13/29

14 HPC at NICPB (KBFI) HPC centre at The National Institute of Chemical Physics and Biophysics The biggest HPC centre for science at Estonia (right now) More than 5000 job slots (Hyper threaded cores) More than 2 PB RAW storage 10Gbps interconnect All Virtual Machines Participating at CERN CMS T2_Estonia 14/29

15 HPC centre at TTU Tallinn Technical University is just setting up the HPC centre Server room is prepared Procurement for the equipment is going on Computing resources Storage resources Interconnect Should be operational before the end of /29

16 EENet's computing cluster 37 Computing nodes: 2 * Intel Xeon L5520 or E5-2630L 24GB or 48GB RAM 300GB 15000RPM HDD Nvidia Tesla S1070 GPU computing node (8) 4 Nvidia Tesla T10 GPUs 16GB DDR3 Some Nvidia Tesla K20 GPUs are coming More info: sursid/kobararvuti/ 16/29

17 Access to ETAIS Federated AAI Authentication Authorization Home organization account 17/29

18 TAAT in user point of view 18/29

19 How TAAT works? 19/29

20 Login via TAAT 20/29

21 Why TAAT? Less user accounts Authorization information provided by home organization Single Sign on Access to international services via interfederations EduGAIN Kalmar2 21/29

22 Other AAI federations 22/29

23 ETAIS L&A ETAIS TAAT T A A T EGI GSI 23/29

24 ETAIS portal 24/29

25 Grid Conclusion You should now: What is Grid Computing? Why it is useful/used for? The architecture and components of Computing Grid. How to use Grid? What is ETAIS and how to use its recources? 25/29

26 Following lectures 26/29

27 Grid vs Cloud Rather Rather Science Business Real machines Virtual machines Similar resources (Linux clusters, mostly SLC5) Different resources (Linux, Windows, etc) Many resource providers in the same group One (few) resource providers per cloud Collaboration in big Vos PKI Services for special groups AAI 27/29

28 References More info about ETAIS: ETAIS portal More info about TAAT 28/29

29 Thank you More information from: Hardi Teder 29/29