Romanian Tier-2 Federation

Transcription

1 Sinaia, Romania, October 2006 Grid Activities within Large Scale International Collaboration Romanian Tier-2 Federation Mihnea Dulea,, NIPNE-HH 1

2 Romanian Tier-2 Federation OVERVIEW WLCG and the Memorandum of Understanding (MoU) Federation members Network infrastructure The Center for IT and NIPNE Grid monitoring and accounting Grid ROT2F (MoU) Resource sharing policy Collaboration inside ROT2F 2

3 WLCG and the Memorandum of Understanding (MoU) WLCG = Worldwide Large Hadron Collider Computing Grid Collaboration Purpose: to provide the computing resources needed to process and analyse the data gathered by the Large Hadron Collider experiments. The rules of the game: - WLCG is built around and supports the LCG project; - the agreement to collaborate on the deployment and exploitation of WLCG is made through the conclusion of a MoU between CERN and the Funding Agencies of the institutions or federations of institutions which participate to the collaboration; - smaller Grid centers should form federations in order to jointly comply with the minimal levels-of service criteria for an LCG Tier centre. The Romanian Authority for Scientific Research has signed the MoU in March 2006, as Funding Agency of the Romanian Tier-2 Federation (ROT2F). 3

4 The Members of the Tier-2 Federation National Institute for Physics and Nuclear Engineering Horia Hulubei (NIPNE) RO-02-NIPNE (ATLAS) - in production; NIHAM (ALICE) - in production; RO-07-NIPNE (ALICE, ATLAS, LHCb) - in migration from SEE-GRID to EGEE; RO-11-NIPNE (LHCb) - in tests. Institute for Space Sciences (ISS) ISS (ALICE) - in production; National Institute for R&D of Isotopic and Molecular Technologies (ITIM) Contribution to the RO-02-NIPNE site National Institute for Research and Development in Informatics (ICI) RO-01-ICI (LHCb), in production University Politehnica of Bucharest (UPB) RO-03-UPB, in migration from SEE-GRID to EGEE 4

5 Network Infrastructure 5

6 Network Infrastructure More than 90% of the ROT2F s traffic goes through CITC - NIPNE CITC-UPB connection (12km) - 10 Gbps link dedicated to Grid traffic - layer 3 Nortel switch Mbps link (provider - RDS), for common users Funding stages (10 Gbps link) - purchasing, posing of dark fiber, 1 Gbps equipment, from research CEEX project (Dec Jan. 2006); - 10 Gbps equipment, from structural funds Harvey Newman looking at the Nortel switch while visiting CITC on

7 The Center for IT and Communications (CITC) Basic mission: operate, maintain, and develop the computing and networking infrastructure of the NIPNE, providing the technical support required by the international scientific collaborations. Activities Administration and development of the IT infrastructure Grid computing, databases, algorithms for parallel computing, etc. EU Projects EGEE and SEE-GRID (as third party) Cooperation programme "Hulubei-Meshcheryakov" together with the Laboratory of Information Technologies at JINR - Dubna, that promotes activities in fields of the information technology and computational physics like: Grid technology, Grid software and Grid development; numerical algorithms, methods and tools for the description and modeling of complex physical systems; etc. Members of the group collaborate with the Dept. of Computer Science of UCF, Orlando, directly participate to the ATLAS and DIRAC experiments at CERN and to the research activities at IN2P3 - France. 7

8 High Performance Computing HPC cluster dedicated to the numerical studies in the theoretical physics of complex systems. GigaEthernet technology 32 CPUs, 3GHz. Studies: - nuclear physics models - percolative models of earthquake generation - nanostructures, etc. Currently building and testing a Myrinet micro-cluster, to be used in the investigation of physical models through parallel algorithms 8

9 CITC s Contribution to WLCG 1. The Grid site RO-07-NIPNE ( - started as a SEE-GRID site, certified in March 2006 (6 CPUs); - at present site functional tests for EGEE - capacity: 280 virtual CPUs, 4.8 TB storage (3GHz, 1GB/CPU, 308 ksi2000) - cooling at present: 180 kbtu/hour - by the end of 2006: 380 virtual CPUs - aprox. 1/3 of the capacity planned for SLC glite pbs batch system Site administrators: Mihai Ciubancan, Serban Constantinescu VOs: ALICE, ATLAS, LHCb 9

10 CITC s Contribution to WLCG 2. Providing site consultancy in ROT2F - RO-07 administrators are members in the software team of RO-02-NIPNE (ATLAS) - collaboration with LHCb site group - consultancy on Grid problems for ITIM-Cluj 3. Network support - 10 Gbps FO link - 1 and 2 Gbps FO links inside NIPNE 4. Grid monitoring - MonaLISA monitoring server, in collaboration with the Laboratory of Information Technologies - JINR - Dubna, in the frame of the Hulubei-Meshcheryakov programme (in test) 10

11 Grid monitoring and accounting 11

12 Grid monitoring and accounting 12

13 Grid monitoring and accounting 13

14 Grid monitoring and accounting 14

15 Grid monitoring and accounting 15

16 Grid monitoring and accounting 16

17 Grid ROT2F (MoU) According to the Memorandum of Understanding, the Tier2 centers are expected to be capable of fulfilling at least a few percent of the resource requirements of the experiments Based on the statements the ROT2F sites made during the winter , the following resources were pledged in the MoU that was signed in March 2006 Problems: - the resources pledged in one year should be available each day of that year and not only by the end of the year. - at the time the MoU was signed it was not clear if an LHCb site will exist - the predictions of the sites changed during the 8 months since the MoU was signed. Consequence: the pledges should be modified to take into account the new data 17

18 Resource sharing policy The CITC Grid site RO-07-NIPNE is hosting resources for 3 experiments: ALICE, ATLAS, LHCB. The sharing must be efficient and fair. E = experiment R(E) = resource quota on E = (# members in E) / (total # members) R(E) is (quasi-)constant in time U(E) = used resource quota = (resources used in E) / (total used resources) U(E) could be updated only when a job ends (even aborted) Cases: 1) job started when queued jobs from one experiment E only -> no update of U(E) 2) before a job should start there are queued jobs from more than one experiment -> - compute job priorities according to how much was used on each experiment (compare R with U) - start first queued job with maximum priority Implement in pbs? 18

19 Collaboration inside the Tier-2 Federation In the frame of the Tier-2 Federation CITC intends to: - share its own experience in order to help solving some local technical problems (e.g. wide bandwidth networking, hardware related problems, etc.); - achieve a higher quality of network services; - improve high speed network monitoring and security; - train full-time human resources specialized in grid deployment and maintenance; - organize periodic (videoconference) meetings for the partners - continue to develop and share grid services of general use (e.g. monitoring with MonaLISA, accounting); - improve failure management in order to respond faster in case network or grid problems; - develop and host web tools for collaboration and information dissemination for the Tier-2 Federation partners: the web site of the Tier-2 Federation (in testing); A forum where the users can share information on various subjects: technical (instalations, cooling, storage, hardware, etc); Tier1-Tier2 and Tier2-Tier3 relationships, info for new users, etc. 19

20 Romanian Tier-2 Federation Thank you for your attention! 20