CyGrid Clusters Technical Description

Transcription

1 CyGrid Clusters Technical Descriptin Dcument Filename: Type f dcument: TechnicalDescriptin.pdf Technical Descriptin Versin: 0.2 Dcument classificatin: PUBLIC Abstract: This dcument cntains the technical descriptin fr the infrastructure and hardware specificatin f the Resurce Centers, hsted in the University f Cyprus and in the University f Nicsia.

2 1 DOCUMENT LOG GENERAL DESCRIPTION CYGRID TESTBEDS CY 01 KIMON TESTBED DIAGRAM CY 03 INTERCOLEGE TESTBED DIAGRAM SUPPORTED SERVICES AMGA SERVICE WORKLOAD MANAGEMENT SYSTEM (WMS) INFORMATION SERVICE (BDII) USER INTERFACE (UI) COMPUTING ELEMENT (CE) STORAGE ELEMENT (SE) MONITORING SYSTEM (MON) HARDWARE CY 01 KIMON CY 02 CYGRID CERT HARDWARE...12

3 Cluster technical descriptin 1 Dcument Lg Versi Date Summary f changes Authr n /01/08 Initial Cntributin Andena Balla /01/09 Revisin Niklas Stylianides Versin 0.2 3/13

4 Cluster technical descriptin 1 General descriptin CyGrid was initiated by the High Perfrmance Cmputing systems Labratry (HPCL) at the University f Cyprus during the year The CyGrid initiative, aims at establishing a cntact pint fr lcal scientific cmmunity users wh are interested in Grid cmputing by prmting the technlgy and encuraging bth academic and industrial researchers t becme familiar with it. Once the ptential benefits f the technlgy are realised, academic/industrial researchers can experience the benefits frm deplying their applicatins n the CyGrid testbed and beynd. Cygrid supprt and prvides knwledge t rganizatins that are interested t establish new resurce centers. In 2007, the University f Cyprus and the University f Nicsia tgether with the Cyprus Research & Academic Netwrk CyNET and the Ministry f Health signed a Memrandum f Understanding with the intentin f prviding a framewrk fr research and academic cperatin, aiming at the enhancement f the existing infrastructure in Cyprus. T assist in the enhancement f the lcal infrastructure and enable researchers t safely use the Grid, CyGrid has established tw Resurce Centers, hsted in the University f Cyprus and in the University f Nicsia (frmer Intercllege), and cnnected t the Eurpean Grid Infrastructure f EGEE. Versin 0.2 4/13

5 Cluster technical descriptin b1 Cygrid Testbeds 111 CY 01 KIMON Testbed diagram Versin 0.2 5/13

6 Cluster technical descriptin 111 CY 03 INTERCOLEGE Testbed diagram Versin 0.2 6/13

7 Cluster technical descriptin 1 Supprted Services 1.1 AMGA service AMGA (ARDA Metadata Grid Applicatin) is an interface fr metadata access n the Grid, designed t be scalable and supprt flexible schema management, efficient retrieval f large result sets and t allw a brad range f implementatins. AMGA can be regarded as a simplified database that can be used frm jbs running n the Grid, which ften need t retrieve r stre metadata, in an "attribute-value" way. The AMGA server can use many different database servers fr a backend, s it can answer SQL-like queries cncerning the metadata stred. This makes it a very gd chice fr string and retrieving metadata abut files stred n Grid Strage Elements Wrklad Management System (wms) The WMS (Wrklad Management System) is the glite 3.1 cmpnent that allws users t submit jbs, and perfrms all tasks required t execute them, withut expsing the user t the cmplexity f the Grid. It is the respnsibility f the user t describe his jbs and their requirements, and t retrieve the utput when the jbs are finished Infrmatin service (bdii) The first level f MDS (Mnitring and Discvery Service) infrmatin publicatin is the GRIS, which prvides specific infrmatin fr a particular service. The GRIS Versin 0.2 7/13

8 Cluster technical descriptin nrmally runs n the same nde as the CE, SE r ther service fr which it publishes, althugh it may be n a different nde. The BDII cllects infrmatin abut all resurces present at site where the service is installed (i.e. data frm all GRISes at the site) User Interface (ui) Apart frm registering with EGEE, a user must als have an accunt n a EGEE User Interface in rder t access the Grid. T btain such an accunt, a lcal system administratr must be cntacted, either at the user s wn site r at a central site like CERN Cmputing Element (ce) A CE (Cmputing Element), in Grid terminlgy, is sme set f cmputing resurces lcalized at a site (i.e. a cluster, a cmputing farm). A CE includes a GG1 (Grid Gate), which acts as a generic interface t the cluster; a LRMS (Lcal Resurce Management System), smetimes called batch system, and the cluster itself, a cllectin f WNs (Wrker Ndes), the ndes where the jbs are run Strage Element (se) A SE (Strage Element) prvides unifrm access t data strage resurces. The SE may cntrl simple disk servers, large disk arrays r tape-based MSS (Mass Strage Systems). SE can supprt different data access prtcls and interfaces. Simply speaking, GSIFTP (a GSI-secure FTP) is the prtcl fr whle-file transfers, while lcal and remte file access is perfrmed using RFIO r gsidcap. Mst strage resurces are managed by a SRM (Strage Resurce Manager) a Versin 0.2 8/13

9 Cluster technical descriptin middleware service prviding capabilities like transparent file migratin frm disk t tape, file pinning, space reservatin, etc Mnitring System (mn) The ability t mnitr resurce related parameters is currently cnsidered a necessary functinality in any netwrk. In such a hetergeneus and cmplex system as the Grid, this necessity becmes fundamental. A mnitring system implies the existence f a central repsitry f peratinal infrmatin. The mnitring system shuld be able t cllect data frm the resurces in the system, in rder t analyze the usage, behavir and perfrmance f the Grid, detect and ntify fault cnditins, cntract vilatins and user-defined events. Versin 0.2 9/13

10 Cluster technical descriptin 2 Hardware 1.1 CY 01 KIMON Figure A: the Kimn high-perfrmance cluster 1 Generic Server thales.grid.ucy.ac.cy IBM xseries 335 (2x Intel Xen HT 2.8GHz CPUs, 2GB RAM, 2x200GB HDD) Generic Server euclid.grid.ucy.ac.cy 24GB RAM, 8CPUs each 2.83GHz, 2x500GB HDD Versin /13

11 Cluster technical descriptin 1 Grid Strage Element plethn.grid.ucy.ac.cy EGEE Disk Pl Manager (DPM) 3.8TB in RAID 5 cnfiguratin, giving 3.2TB f strage space 1 IBM DS400 SAN Strage System (14 Hard Disks SCSI 300GB) 1 IBM eserver 326m Machine, DS400 cntrller NFS munt t EGEE cmputing element 2 Reginal Grid Resurce Brkers rb101.grid.ucy.ac.cy (IBM ThinkCentre, 1x Intel Pentium 4 HT 3.6GHz / 1MB L2, 2GB RAM) wmslb101.grid.ucy.ac.cy (SuperMicr server, 2x Intel Xen 2.4GHz CPUs, 4GB RAM) BEST EFFORT SERVICE 1 Reginal Grid Infrmatin Index (BDII) bdii101.grid.ucy.ac.cy IBM ThinkCentre (1x Intel Pentium 4 HT 3.6GHz / 1MB L2, 1GB RAM) 1 Grid Gate (Cmputing Element) ce101.grid.ucy.ac.cy Super Micr (2x Intel Xen 2.4GHz CPUs, 4GB RAM) 35 Grid Wrker Ndes (82 CPUs) wn107 t wn141.grid.ucy.ac.cy 7 IBM eserver 326m Machines (2.0GHz dual AMD Optern 64-bit CPUs, 1GB RAM) 1 IBM SuperMicr Machines (2.4GHz dual Xen CPUs, 1GB RAM) 22 IBM eserver 326m Machines (2.6GHz dual AMD Optern 64-bit CPUs, 2GB RAM) 5 IBM system x3455 Machines (2.6GHz dual AMD Optern dual-cre 64-bit CPUs, 1GB RAM) Versin /13

12 Cluster technical descriptin 1 Grid User Interface ui101.grid.ucy.ac.cy Fujitsu-Siemens (1x Intel Pentium 4 2.0GHz CPU, 1GB RAM) 1 Netwrk Mnitring nde mn101.grid.ucy.ac.cy Fujitsu-Siemens (1x Intel Pentium 4 2.0GHz CPU, 1GB RAM) 1 Micrnet Gigabit Ethernet switch 24 prts 1 CISCO Gigabit Ethernet switch 48 prts (mdule) The cluster is cnnected with GÉANT via an ATM switch at the Netwrk centre f the University f Cyprus ver 155Mbps fiber ptics links. 1.2 CY 02 CYGRID CERT HARDWARE 2 x IBM xseries 335 (2x Intel Xen 2.8GHz CPUs, 1GB RAM, 40GB HDD) VIRTUAL MACHINE HOSTS ce201.grid.ucy.ac.cy wn201.grid.ucy.ac.cy wn202.grid.ucy.ac.cy mn201.grid.ucy.ac.cy wmslb201.grid.ucy.ac.cy bdii201.grid.ucy.ac.cy 1 x Dell PwerEdge (2x Intel P3 800MHz CPUs, 768MB RAM, 2x35GB 1x70GB SCSI HDD) Versin /13

13 Cluster technical descriptin se201.grid.ucy.ac.cy 1 x Dell Precisin 330 (1x Intel P4 1.5GHz, CPU, 512MD RAM, 40GB HDD) ui201.grid.ucy.ac.c 1 x Generic PC (1x Intel P4 1.7GHz, CPU, 256MD RAM, 40GB HDD) amga201.grid.ucy.ac.cy 1 x Generic PC (1x Intel P3 800MHz, CPU, 384MD RAM, 40GB HDD) lfc201.grid.ucy.ac.cy The cluster is cnnected with GÉANT via an ATM switch at the Netwrk centre f the University f Cyprus ver 155Mbps fiber ptics links. Versin /13