Recent grid activities at INFN Catania(*) Roberto Barbera

Size: px
Start display at page:

Download "Recent grid activities at INFN Catania(*) Roberto Barbera"

Transcription

1 RecentgridactivitiesatINFNCatania(*) RobertoBarbera workincollaborationwithnicesrl (*) HEPiX/HEPNT2002,Catania, CHEP2000, RobertoBarbera

2 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Outline GridComputing: why? how? who? where? GENIUS:awebportalforthegrid livedemo! Conclusionsandoutlook. HEPiX/HEPNT2002,Catania, RobertoBarbera

3 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration High Energy Physics LHC 9km SPS CERN HEPiX/HEPNT2002,Catania, RobertoBarbera

4 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration High Energy Physics HEPiX/HEPNT2002,Catania, RobertoBarbera

5 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration High Energy Physics HEPiX/HEPNT2002,Catania, RobertoBarbera

6 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration ATLAS High Energy Physics CMS ~6 8PetaBytes/year ~108events/year ~103batchandinteractiveusers LHCb HEPiX/HEPNT2002,Catania, RobertoBarbera

7 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Computational bio-medicine HEPiX/HEPNT2002,Catania, RobertoBarbera

8 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Computational bio-medicine HEPiX/HEPNT2002,Catania, RobertoBarbera

9 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Computational bio-medicine HEPiX/HEPNT2002,Catania, RobertoBarbera

10 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Earth Observations HEPiX/HEPNT2002,Catania, RobertoBarbera

11 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Earth Observations HEPiX/HEPNT2002,Catania, RobertoBarbera

12 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration HEPiX/HEPNT2002,Catania, RobertoBarbera

13 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration HEPiX/HEPNT2002,Catania, RobertoBarbera

14 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration 14

15 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Middleware has been realeased but EDGsoftware(Globus,UI,JDL,WP2,WP3,etc.)containstensof commands/switcheswhichalsohavetheirownlogicalsequences( B after A, C before D andsoon). BrowsingGridVO directories (users,rc s,db s,etc.)requiresldap speaking andtomorrowcouldrequiresql speaking. Usergridification isatoughtaskfora rookie howdoesthisfitwith theclaimthatweare doinggrids foreverybodyandthatgridcomputing willbeaseasyassurfingtheinternet? Furthermore,allthisholdsforDataGrid.Whatwillhappenwhenother grids software(especiallyui s)willcomeup(ppdg,ivdgl,etc.)?will usershavetolearntensof griddialects? Today gridcomputing isaratherstrugglingexperiencewhichyoucando onlyatselectedmachines(ui s) howdoesthisfitwiththeclaimthatone coulddo gridcomputing evenfromapda? Isthereanywaytoset upa user friendly grid? HEPiX/HEPNT2002,Catania, RobertoBarbera

16 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration A web portal: why and how? Itcanbeaccessedfromeverywhereandby everything (desktop,laptop,pda,wapphone). Itcankeepthesameuserinterfacetoseveral back ends(grid dialects command lineui s). Itmustberedundantly secure atalllevels:1) secureforwebtransactions,2)secureforuser credentials,3)secureforuserauthentication,4) secureatvolevel. Allavailablegridservicesmustbeincorporatedin alogicway,just onemouseclickaway. Itslayoutmustbeeasilyunderstandableanduser friendly. 16 HEPiX/HEPNT2002,Catania, RobertoBarbera

17 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration GENIUS (Grid Enabled web environment for site Independent User job Submission) GENIUSwebportal Applications specific layer ALICE DataGRID architectu re GLOBU S toolkit ATLAS CMS LHCb Other apps High level GRID middleware Basic Services OS & Net services HEPiX/HEPNT2002,Catania, RobertoBarbera

18 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration GENIUS: GENIUS how it works https+java/xml+rfb WEBBrowser L ocal WS EnginFrame Apache ED G UI EDG+GSI thegrid 18 RobertoBarbera

19 UI JDL Input sandbox tu s ExpandedJDL + Jo JobStatus fo In r ke ro B JobSubmission Service Compute Element Publish ox db ox db an n sa s bs ta info ut tp Ou gr id CE t pu In JobQuery JobSubmitEvent Logging& Book keeping Information Service SE& GlobusRSL JobStatus DataSetsinfo Resource Broker Author. &Authen. Replica Catalogue Output sandbox p ro x y in it Job Submission work-flow Storage Element

20 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Present status and perspectives CurrentimplementationofGENIUSalreadyincludes: securewebtransactionsanduserauthenticationand authorization; browsingofremotefilesandcreationofnewones; interfacesforjobsubmission/control(multiplerb s),to VOservers(users andrc s),andtomonitoring systems; persistent(personal)book keepingandspoolersystem interactiveanalysis! Todo: multi jobs(parallelandsequential); interfacetodatamanagementandothergridservices; moreexperiment specificcustomizations; web guidedcreationofjdlscripts. 20 RobertoBarbera

21 DipartimentodiFisicadell UniversitàdiCataniaandINFNCatania Italy ALICECollaboration Conclusions and outlook Computationalgridsare sold astheframework ofthehighlydistributedcomputingmodelsofnext generationhighenergyphysicsexperiments,bio medicsandearthobservations. Gridsarealsopresentedasthesolutiontobring enormouscomputingpowerandmassstorageto theindividualslikethewebdidwithinformation. But,ifwereallywanttoturndreamsinto reality,let smaketheirusesimpleand easyforthenewusers. 21 RobertoBarbera

The GENIUS Grid Portal

The GENIUS Grid Portal The GENIUS Grid Portal (*) work in collaboration with A. Falzone and A. Rodolico EGEE NA4 Workshop, Paris, 18.12.2003 CHEP 2000, 10.02.2000 Outline Introduction Grid portal architecture and requirements

More information

Global Grid User Support - GGUS - in the LCG & EGEE environment

Global Grid User Support - GGUS - in the LCG & EGEE environment Global Grid User Support - GGUS - in the LCG & EGEE environment Torsten Antoni (torsten.antoni@iwr.fzk.de) Why Support? New support groups Network layer Resource centers CIC / GOC / etc. more to come New

More information

Roberto Barbera. Centralized bookkeeping and monitoring in ALICE

Roberto Barbera. Centralized bookkeeping and monitoring in ALICE Centralized bookkeeping and monitoring in ALICE CHEP INFN 2000, GRID 10.02.2000 WP6, 24.07.2001 Roberto 1 Barbera ALICE and the GRID Phase I: AliRoot production The GRID Powered by ROOT 2 How did we get

More information

Grid Computing in Aachen

Grid Computing in Aachen GEFÖRDERT VOM Grid Computing in Aachen III. Physikalisches Institut B Berichtswoche des Graduiertenkollegs Bad Honnef, 05.09.2008 Concept of Grid Computing Computing Grid; like the power grid, but for

More information

Global Grid User Support - GGUS - start up schedule

Global Grid User Support - GGUS - start up schedule Global Grid User Support - GGUS - start up schedule GDB Meeting 2004-07 07-13 Concept Target: 24 7 support via time difference and 3 support teams Currently: GGUS FZK GGUS ASCC Planned: GGUS USA Support

More information

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Global Grid User Support - GGUS - within the LCG & EGEE environment

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Global Grid User Support - GGUS - within the LCG & EGEE environment Global Grid User Support - GGUS - within the LCG & EGEE environment Abstract: For very large projects like the LHC Computing Grid Project (LCG) involving some 8,000 scientists from universities and laboratories

More information

Introduction to Grid computing

Introduction to Grid computing Introduction to Grid computing The INFNGrid Project Team Introduction This tutorial has been implemented considering as starting point the DataGrid (EDG) tutorial Many thanks to the EDG tutorials team!

More information

Welcome to the User Support for EGEE Task Force Meeting

Welcome to the User Support for EGEE Task Force Meeting Welcome to the User Support for EGEE Task Force Meeting The agenda is as follows: Welcome Note & Presentation of the current GGUS Support system Basic Support Model Coffee brake Processes Lunch Break Interfaces

More information

The Grid-it: the Italian Grid Production infrastructure

The Grid-it: the Italian Grid Production infrastructure n 1 Maria Cristina Vistoli INFN CNAF, Bologna Italy The Grid-it: the Italian Grid Production infrastructure INFN-Grid goals!promote computational grid technologies research & development: Middleware and

More information

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Support in EGEE. (SA1 View) Torsten Antoni GGUS, FZK

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Support in EGEE. (SA1 View) Torsten Antoni GGUS, FZK Support in EGEE (SA1 View) Torsten Antoni GGUS, FZK (torsten.antoni@iwr.fzk.de) with input from LCG Operations Workshop, e-irg e Workshop Why is there need for support? New support groups Network layer

More information

glite Job Management

glite Job Management glite Job Management Gilberto Diaz Riccardo Di Meo Job Submission Egee submission Resembles very closely the batch submission in a cluster. Can select resources automatically ( Grid like submission). Resources

More information

CMS Dashboard of Grid Activity

CMS Dashboard of Grid Activity Enabling Grids for E-sciencE CMS Dashboard of Grid Activity Julia Andreeva, Juha Herrala, CERN LCG ARDA Project, EGEE NA4 EGEE User Forum Geneva, Switzerland March 1-3, 2006 http://arda.cern.ch ARDA and

More information

A demonstration of the use of Datagrid testbed and services for the biomedical community

A demonstration of the use of Datagrid testbed and services for the biomedical community A demonstration of the use of Datagrid testbed and services for the biomedical community Biomedical applications work package V. Breton, Y Legré (CNRS/IN2P3) R. Météry (CS) Credits : C. Blanchet, T. Contamine,

More information

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware R. Goranova University of Sofia St. Kliment Ohridski,

More information

Status and Evolution of ATLAS Workload Management System PanDA

Status and Evolution of ATLAS Workload Management System PanDA Status and Evolution of ATLAS Workload Management System PanDA Univ. of Texas at Arlington GRID 2012, Dubna Outline Overview PanDA design PanDA performance Recent Improvements Future Plans Why PanDA The

More information

The CMS analysis chain in a distributed environment

The CMS analysis chain in a distributed environment The CMS analysis chain in a distributed environment on behalf of the CMS collaboration DESY, Zeuthen,, Germany 22 nd 27 th May, 2005 1 The CMS experiment 2 The CMS Computing Model (1) The CMS collaboration

More information

Batch and Cloud overview. Andrew McNab University of Manchester GridPP and LHCb

Batch and Cloud overview. Andrew McNab University of Manchester GridPP and LHCb Batch and Cloud overview Andrew McNab University of Manchester GridPP and LHCb Overview Assumptions Batch systems The Grid Pilot Frameworks DIRAC Virtual Machines Vac Vcycle Tier-2 Evolution Containers

More information

Client/Server Grid applications to manage complex workflows

Client/Server Grid applications to manage complex workflows Client/Server Grid applications to manage complex workflows Filippo Spiga* on behalf of CRAB development team * INFN Milano Bicocca (IT) Outline Science Gateways and Client/Server computing Client/server

More information

EDG Project: Database Management Services

EDG Project: Database Management Services EDG Project: Database Management Services Leanne Guy for the EDG Data Management Work Package EDG::WP2 Leanne.Guy@cern.ch http://cern.ch/leanne 17 April 2002 DAI Workshop Presentation 1 Information in

More information

Database Services for Physics @ CERN

Database Services for Physics @ CERN Database Services for Physics @ CERN Deployment and Monitoring Radovan Chytracek CERN IT Department Outline Database services for physics Status today How we do the services tomorrow? Performance tuning

More information

The glite Workload Management System

The glite Workload Management System Consorzio COMETA - Progetto PI2S2 FESR The glite Workload Management System Annamaria Muoio INFN Catania Italy Annamaria.muoio@ct.infn.it Tutorial per utenti e sviluppo di applicazioni in Grid 16-20 July

More information

Computing at the HL-LHC

Computing at the HL-LHC Computing at the HL-LHC Predrag Buncic on behalf of the Trigger/DAQ/Offline/Computing Preparatory Group ALICE: Pierre Vande Vyvre, Thorsten Kollegger, Predrag Buncic; ATLAS: David Rousseau, Benedetto Gorini,

More information

Betriebssystem-Virtualisierung auf einem Rechencluster am SCC mit heterogenem Anwendungsprofil

Betriebssystem-Virtualisierung auf einem Rechencluster am SCC mit heterogenem Anwendungsprofil Betriebssystem-Virtualisierung auf einem Rechencluster am SCC mit heterogenem Anwendungsprofil Volker Büge 1, Marcel Kunze 2, OIiver Oberst 1,2, Günter Quast 1, Armin Scheurer 1 1) Institut für Experimentelle

More information

Status and Integration of AP2 Monitoring and Online Steering

Status and Integration of AP2 Monitoring and Online Steering Status and Integration of AP2 Monitoring and Online Steering Daniel Lorenz - University of Siegen Stefan Borovac, Markus Mechtel - University of Wuppertal Ralph Müller-Pfefferkorn Technische Universität

More information

Experiences with the GLUE information schema in the LCG/EGEE production Grid

Experiences with the GLUE information schema in the LCG/EGEE production Grid Experiences with the GLUE information schema in the LCG/EGEE production Grid Stephen Burke, Sergio Andreozzi and Laurence Field CHEP07, Victoria, Canada www.eu-egee.org EGEE and glite are registered trademarks

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

SPACI & EGEE LCG on IA64

SPACI & EGEE LCG on IA64 SPACI & EGEE LCG on IA64 Dr. Sandro Fiore, University of Lecce and SPACI December 13 th 2005 www.eu-egee.org Outline EGEE Production Grid SPACI Activity Status of the LCG on IA64 SPACI & EGEE Farm Configuration

More information

Grid, and first level evaluation of EGI Cloud

Grid, and first level evaluation of EGI Cloud FEDERATED COMPUTE RESOURCES Grid, and first level evaluation of EGI Cloud anatoli.danezi@surfsara.nl Kick-off Interest Group Compute Resources for Life Science Research, SURF - DTL - 15 Jan 2015 Scalable

More information

US NSF s Scientific Software Innovation Institutes

US NSF s Scientific Software Innovation Institutes US NSF s Scientific Software Innovation Institutes S 2 I 2 awards invest in long-term projects which will realize sustained software infrastructure that is integral to doing transformative science. (Can

More information

Distributed Database Access in the LHC Computing Grid with CORAL

Distributed Database Access in the LHC Computing Grid with CORAL Distributed Database Access in the LHC Computing Grid with CORAL Dirk Duellmann, CERN IT on behalf of the CORAL team (R. Chytracek, D. Duellmann, G. Govi, I. Papadopoulos, Z. Xie) http://pool.cern.ch &

More information

Big Science and Big Data Dirk Duellmann, CERN Apache Big Data Europe 28 Sep 2015, Budapest, Hungary

Big Science and Big Data Dirk Duellmann, CERN Apache Big Data Europe 28 Sep 2015, Budapest, Hungary Big Science and Big Data Dirk Duellmann, CERN Apache Big Data Europe 28 Sep 2015, Budapest, Hungary 16/02/2015 Real-Time Analytics: Making better and faster business decisions 8 The ATLAS experiment

More information

Cloud Accounting. Laurence Field IT/SDC 22/05/2014

Cloud Accounting. Laurence Field IT/SDC 22/05/2014 Cloud Accounting Laurence Field IT/SDC 22/05/2014 Helix Nebula Pathfinder project Development and exploitation Cloud Computing Infrastructure Divided into supply and demand Three flagship applications

More information

ARDA Experiment Dashboard

ARDA Experiment Dashboard ARDA Experiment Dashboard Ricardo Rocha (ARDA CERN) on behalf of the Dashboard Team www.eu-egee.org egee INFSO-RI-508833 Outline Background Dashboard Framework VO Monitoring Applications Job Monitoring

More information

Support Model for SC4 Pilot WLCG Service

Support Model for SC4 Pilot WLCG Service Model for SC4 Pilot WLCG Flavia Donno CERN www.eu-egee.org Problems reporting SC : what s implied? Deployment and configuration, middleware, external components, mass storage support, etc. (from site admins,

More information

See-GRID Project and Business Model

See-GRID Project and Business Model Improvements of the grid infrastructure and services within SEE-GRID Anastas Misev MARNET/MARGI/UKIM Macedonia Introduction SEE-GRID Project series SEE-GRID establish infrastructure SEE-GRID-2 extend infrastructure,

More information

Instruments in Grid: the New Instrument Element

Instruments in Grid: the New Instrument Element Instruments in Grid: the New Instrument Element C. Vuerli (1,2), G. Taffoni (1,2), I. Coretti (1), F. Pasian (1,2), P. Santin (1), M. Pucillo (1) (1) INAF Astronomical Observatory of Trieste (2) INAF Informative

More information

CERN local High Availability solutions and experiences. Thorsten Kleinwort CERN IT/FIO WLCG Tier 2 workshop CERN 16.06.2006

CERN local High Availability solutions and experiences. Thorsten Kleinwort CERN IT/FIO WLCG Tier 2 workshop CERN 16.06.2006 CERN local High Availability solutions and experiences Thorsten Kleinwort CERN IT/FIO WLCG Tier 2 workshop CERN 16.06.2006 1 Introduction Different h/w used for GRID services Various techniques & First

More information

Distributed Computing for CEPC. YAN Tian On Behalf of Distributed Computing Group, CC, IHEP for 4 th CEPC Collaboration Meeting, Sep.

Distributed Computing for CEPC. YAN Tian On Behalf of Distributed Computing Group, CC, IHEP for 4 th CEPC Collaboration Meeting, Sep. Distributed Computing for CEPC YAN Tian On Behalf of Distributed Computing Group, CC, IHEP for 4 th CEPC Collaboration Meeting, Sep. 12-13, 2014 1 Outline Introduction Experience of BES-DIRAC Distributed

More information

HTCondor within the European Grid & in the Cloud

HTCondor within the European Grid & in the Cloud HTCondor within the European Grid & in the Cloud Andrew Lahiff STFC Rutherford Appleton Laboratory HEPiX 2015 Spring Workshop, Oxford The Grid Introduction Computing element requirements Job submission

More information

Report on WorkLoad Management activities

Report on WorkLoad Management activities APROM CERN, Monday 26 November 2004 Report on WorkLoad Management activities Federica Fanzago, Marco Corvo, Stefano Lacaprara, Nicola de Filippis, Alessandra Fanfani Stefano.Lacaprara@pd.infn.it INFN Padova,

More information

DB2 Web Query Interfaces

DB2 Web Query Interfaces DB2 Web Query Interfaces There are several different access methods within DB2 Web Query and their related products. Here is a brief summary of the various interface and access methods. Method: DB2 Web

More information

Science+ Large Hadron Cancer & Frank Wurthwein Virus Hunting

Science+ Large Hadron Cancer & Frank Wurthwein Virus Hunting Shared Computing Driving Discovery: From the Large Hadron Collider to Virus Hunting Frank Würthwein Professor of Physics University of California San Diego February 14th, 2015 The Science of the LHC The

More information

Dynamic Extension of a Virtualized Cluster by using Cloud Resources CHEP 2012

Dynamic Extension of a Virtualized Cluster by using Cloud Resources CHEP 2012 Dynamic Extension of a Virtualized Cluster by using Cloud Resources CHEP 2012 Thomas Hauth,, Günter Quast IEKP KIT University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz

More information

(Possible) HEP Use Case for NDN. Phil DeMar; Wenji Wu NDNComm (UCLA) Sept. 28, 2015

(Possible) HEP Use Case for NDN. Phil DeMar; Wenji Wu NDNComm (UCLA) Sept. 28, 2015 (Possible) HEP Use Case for NDN Phil DeMar; Wenji Wu NDNComm (UCLA) Sept. 28, 2015 Outline LHC Experiments LHC Computing Models CMS Data Federation & AAA Evolving Computing Models & NDN Summary Phil DeMar:

More information

Integrating a heterogeneous and shared Linux cluster into grids

Integrating a heterogeneous and shared Linux cluster into grids Integrating a heterogeneous and shared Linux cluster into grids 1,2 1 1,2 1 V. Büge, U. Felzmann, C. Jung, U. Kerzel, 1 1 1 M. Kreps, G. Quast, A. Vest 1 2 DPG Frühjahrstagung March 28 31, 2006 Dortmund

More information

CMS Software Deployment on OSG

CMS Software Deployment on OSG CMS Software Deployment on OSG Bockjoo Kim 1, Michael Thomas 2, Paul Avery 1, Frank Wuerthwein 3 1. University of Florida, Gainesville, FL 32611, USA 2. California Institute of Technology, Pasadena, CA

More information

MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper

MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper Migrating Desktop and Roaming Access Whitepaper Poznan Supercomputing and Networking Center Noskowskiego 12/14 61-704 Poznan, POLAND 2004, April white-paper-md-ras.doc 1/11 1 Product overview In this whitepaper

More information

A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources

A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources Davide Salomoni 1, Daniele Andreotti 1, Luca Cestari 2, Guido Potena 2, Peter Solagna 3 1 INFN-CNAF, Bologna, Italy 2 University

More information

XWHEP 5.7.5 : XtremWeb by High Energy Physics

XWHEP 5.7.5 : XtremWeb by High Energy Physics XWHEP 5.7.5 : XtremWeb by High Energy Physics XWHEP Introduction Architecture Rights Objects management Compilation, installation Coordinator service Worker service Client service Benchmark Pilot Jobs

More information

Esqu Science Experiments For Computer Network

Esqu Science Experiments For Computer Network Vangelis Floros, GRNET S.A. 3 rd Open Source Software Conference March 22, 2008 NTUA, Athens Greece Introduction What is a Grid? What is escience? Large Scientific Grids The example of EGEE Building Grid

More information

PHENIX Job Submission/Monitoring in transition to the Grid Infrastructure

PHENIX Job Submission/Monitoring in transition to the Grid Infrastructure PHENIX Job Submission/Monitoring in transition to the Grid Infrastructure Andrey Y. Shevel, Barbara Jacak, Roy Lacey, Dave Morrison, Michael Reuter, Irina Sourikova, Timothy Thomas, Alex Withers 1 Brief

More information

1.- L a m e j o r o p c ió n e s c l o na r e l d i s co ( s e e x p li c a r á d es p u é s ).

1.- L a m e j o r o p c ió n e s c l o na r e l d i s co ( s e e x p li c a r á d es p u é s ). PROCEDIMIENTO DE RECUPERACION Y COPIAS DE SEGURIDAD DEL CORTAFUEGOS LINUX P ar a p od e r re c u p e ra r nu e s t r o c o rt a f u e go s an t e un d es a s t r e ( r ot u r a d e l di s c o o d e l a

More information

Installation der Software des LHC Computing Grid auf einem Institutscluster. Hartmut Stadie, Christopher Jung, Günter Quast, Klaus Rabbertz, Jens Rehn

Installation der Software des LHC Computing Grid auf einem Institutscluster. Hartmut Stadie, Christopher Jung, Günter Quast, Klaus Rabbertz, Jens Rehn Installation der Software des LHC Computing Grid auf einem Institutscluster Hartmut Stadie, Christopher Jung, Günter Quast, Klaus Rabbertz, Jens Rehn Institut für Experimentelle Kernphysik Universität

More information

The Italian Grid Infrastructure (IGI) CGW08 Cracow. Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director

The Italian Grid Infrastructure (IGI) CGW08 Cracow. Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director The Italian Grid Infrastructure (IGI) CGW08 Cracow Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director IGI -> National Grid Initiative Applications: Archeology Astronomy Astrophysics

More information

Tier-1 Services for Tier-2 Regional Centres

Tier-1 Services for Tier-2 Regional Centres Tier-1 Services for Tier-2 Regional Centres The LHC Computing MoU is currently being elaborated by a dedicated Task Force. This will cover at least the services that Tier-0 (T0) and Tier-1 centres (T1)

More information

Building a Volunteer Cloud

Building a Volunteer Cloud Building a Volunteer Cloud Ben Segal, Predrag Buncic, David Garcia Quintas / CERN Daniel Lombrana Gonzalez / University of Extremadura Artem Harutyunyan / Yerevan Physics Institute Jarno Rantala / Tampere

More information

Workload Management Services. Data Management Services. Networking. Information Service. Fabric Management

Workload Management Services. Data Management Services. Networking. Information Service. Fabric Management The EU D a t a G r i d D a t a M a n a g em en t (EDG release 1.4.x) T h e Eu ro p ean Dat agri d P ro j ec t T eam http://www.e u - d a ta g r i d.o r g DataGrid is a p ro j e c t f u n de d b y th e

More information

Testing the In-Memory Column Store for in-database physics analysis. Dr. Maaike Limper

Testing the In-Memory Column Store for in-database physics analysis. Dr. Maaike Limper Testing the In-Memory Column Store for in-database physics analysis Dr. Maaike Limper About CERN CERN - European Laboratory for Particle Physics Support the research activities of 10 000 scientists from

More information

The dcache Storage Element

The dcache Storage Element 16. Juni 2008 Hamburg The dcache Storage Element and it's role in the LHC era for the dcache team Topics for today Storage elements (SEs) in the grid Introduction to the dcache SE Usage of dcache in LCG

More information

ATLAS job monitoring in the Dashboard Framework

ATLAS job monitoring in the Dashboard Framework ATLAS job monitoring in the Dashboard Framework J Andreeva 1, S Campana 1, E Karavakis 1, L Kokoszkiewicz 1, P Saiz 1, L Sargsyan 2, J Schovancova 3, D Tuckett 1 on behalf of the ATLAS Collaboration 1

More information

Chapter 12 Distributed Storage

Chapter 12 Distributed Storage Chapter 12 Distributed Storage 1 2 Files File location and addressing What is a file? Normally we collapse. Concepts: name; contents; gui. What about the backup of this file? How do we distinguish? File

More information

Senior Advisor for EO Applications, ESA-ESRIN

Senior Advisor for EO Applications, ESA-ESRIN Accesso e utilizzo di dati OsservazioneTerra: prospettivegrid Luigi.Fusco@esa.int Senior Advisor for EO Applications, ESA-ESRIN IV Incontro di GARR-B Bologna June 24-26, 2002 Summary ESA and Earth Observation

More information

PoS(EGICF12-EMITC2)110

PoS(EGICF12-EMITC2)110 User-centric monitoring of the analysis and production activities within the ATLAS and CMS Virtual Organisations using the Experiment Dashboard system Julia Andreeva E-mail: Julia.Andreeva@cern.ch Mattia

More information

WM Technical Evolution Group Report

WM Technical Evolution Group Report WM Technical Evolution Group Report Davide Salomoni, INFN for the WM TEG February 7, 2012 The WM TEG, organization Mailing list, wlcg-teg-workload-mgmt@cern.ch 48 people currently subscribed; representation

More information

The NorduGrid architecture and tools

The NorduGrid architecture and tools The NorduGrid architecture and tools P. Eerola, B. Kónya, O. Smirnova Particle Physics, Institute of Physics, Lund University, Box 118, 22100 Lund, Sweden T. Ekelöf, M. Ellert Department of Radiation Sciences,

More information

Werkzeuge zur verteilen Analyse im ATLAS-Experiment

Werkzeuge zur verteilen Analyse im ATLAS-Experiment Werkzeuge zur verteilen Analyse im ATLAS-Experiment Johannes Elmsheuser Ludwig-Maximilians-Universität München, Germany 9 März 27/DPG Tagung Heidelberg ATLAS Grid Infrastructure Heterogeneous grid environment

More information

The dashboard Grid monitoring framework

The dashboard Grid monitoring framework The dashboard Grid monitoring framework Benjamin Gaidioz on behalf of the ARDA dashboard team (CERN/EGEE) ISGC 2007 conference The dashboard Grid monitoring framework p. 1 introduction/outline goals of

More information

EGEE a worldwide Grid infrastructure

EGEE a worldwide Grid infrastructure EGEE a worldwide Grid infrastructure Fabrizio Gagliardi Project Director EGEE CERN, Switzerland IFIC, 6 October 2005 www.eu-egee.org Presentation overview Data intensive science and the rationale for Grid

More information

NT1: An example for future EISCAT_3D data centre and archiving?

NT1: An example for future EISCAT_3D data centre and archiving? March 10, 2015 1 NT1: An example for future EISCAT_3D data centre and archiving? John White NeIC xx March 10, 2015 2 Introduction High Energy Physics and Computing Worldwide LHC Computing Grid Nordic Tier

More information

Deploying a distributed data storage system on the UK National Grid Service using federated SRB

Deploying a distributed data storage system on the UK National Grid Service using federated SRB Deploying a distributed data storage system on the UK National Grid Service using federated SRB Manandhar A.S., Kleese K., Berrisford P., Brown G.D. CCLRC e-science Center Abstract As Grid enabled applications

More information

LHC schedule: what does it imply for SRM deployment? Jamie.Shiers@cern.ch. CERN, July 2007

LHC schedule: what does it imply for SRM deployment? Jamie.Shiers@cern.ch. CERN, July 2007 WLCG Service Schedule LHC schedule: what does it imply for SRM deployment? Jamie.Shiers@cern.ch WLCG Storage Workshop CERN, July 2007 Agenda The machine The experiments The service LHC Schedule Mar. Apr.

More information

Tier0 plans and security and backup policy proposals

Tier0 plans and security and backup policy proposals Tier0 plans and security and backup policy proposals, CERN IT-PSS CERN - IT Outline Service operational aspects Hardware set-up in 2007 Replication set-up Test plan Backup and security policies CERN Oracle

More information

www.eu-egee.org The GILDA Testbed Valeria Ardizzone INFN Catania

www.eu-egee.org The GILDA Testbed Valeria Ardizzone INFN Catania EGEE tutorial, 03.02.2005 Roma www.eu-egee.org The GILDA Testbed Valeria Ardizzone INFN Catania EGEE is a project funded by the European Union under contract IST-2003-508833 Testbed (1/2) CA CA VO CA VO

More information

GRID computing at LHC Science without Borders

GRID computing at LHC Science without Borders GRID computing at LHC Science without Borders Kajari Mazumdar Department of High Energy Physics Tata Institute of Fundamental Research, Mumbai. Disclaimer: I am a physicist whose research field induces

More information

ArcGIS Workflow Manager: An Overview

ArcGIS Workflow Manager: An Overview Federal GIS Conference February 9 10, 2015 Washington, DC ArcGIS Workflow Manager: An Overview Heather Murnane & Elizabeth Wilcox Session Topics Overview Key Features Notification & Reporting Overview

More information

. g .,, . . , Applicability of

More information

Note: This App is under development and available for testing on request. Note: This App is under development and available for testing on request. Note: This App is under development and available for

More information

(RH 7.3, gcc 2.95.2,VDT 1.1.6, EDG 1.4.3, GLUE, RLS) Tokyo BNL TAIWAN RAL 20/03/2003 20/03/2003 CERN 15/03/2003 15/03/2003 FNAL 10/04/2003 CNAF

(RH 7.3, gcc 2.95.2,VDT 1.1.6, EDG 1.4.3, GLUE, RLS) Tokyo BNL TAIWAN RAL 20/03/2003 20/03/2003 CERN 15/03/2003 15/03/2003 FNAL 10/04/2003 CNAF Our a c t i v i t i e s & c o n c e rn s E D G - L C G t r a n s i t i o n / c o n v e r g e n c e p l a n EDG s i d e : i n t e g r a t i o n o f n e w m i d d l e w a r e, t e s t b e d e v a l u a t

More information

Consistency of Replicated Datasets in Grid Computing

Consistency of Replicated Datasets in Grid Computing Consistency of Replicated Datasets in Grid Computing Gianni Pucciani, Flavia Donno CERN, European Organization for Nuclear Research, CH 1211 Geneva 23, Switzerland Andrea Domenici DIIEIT, University of

More information

DSS. High performance storage pools for LHC. Data & Storage Services. Łukasz Janyst. on behalf of the CERN IT-DSS group

DSS. High performance storage pools for LHC. Data & Storage Services. Łukasz Janyst. on behalf of the CERN IT-DSS group DSS High performance storage pools for LHC Łukasz Janyst on behalf of the CERN IT-DSS group CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Introduction The goal of EOS is to provide a

More information

Big Data Processing Experience in the ATLAS Experiment

Big Data Processing Experience in the ATLAS Experiment Big Data Processing Experience in the ATLAS Experiment A. on behalf of the ATLAS Collabora5on Interna5onal Symposium on Grids and Clouds (ISGC) 2014 March 23-28, 2014 Academia Sinica, Taipei, Taiwan Introduction

More information

Monitoring Evolution WLCG collaboration workshop 7 July 2014. Pablo Saiz IT/SDC

Monitoring Evolution WLCG collaboration workshop 7 July 2014. Pablo Saiz IT/SDC Monitoring Evolution WLCG collaboration workshop 7 July 2014 Pablo Saiz IT/SDC Monitoring evolution Past Present Future 2 The past Working monitoring solutions Small overlap in functionality Big diversity

More information

Replication solutions for Oracle database 11g. Zbigniew Baranowski

Replication solutions for Oracle database 11g. Zbigniew Baranowski Replication solutions for Oracle database 11g Zbigniew Baranowski Agenda Testing of replication solutions with real production workload Preparing the environment Comparison of results Conclusions 11g replication

More information

Kubernetes + Google. 5 lessons learned from 8+ years of containers. Victor Marmol (vmarmol@google.com) Tim Hockin (thockin@google.

Kubernetes + Google. 5 lessons learned from 8+ years of containers. Victor Marmol (vmarmol@google.com) Tim Hockin (thockin@google. + Google 5 lessons learned from 8+ years of containers Victor Marmol (vmarmol@google.com) Tim Hockin (thockin@google.com) κυβερνήτης: Greek for pilot or helmsman of a ship the open source cluster workload

More information

Science Gateway Services for NERSC Users

Science Gateway Services for NERSC Users Science Gateway Services for NERSC Users Shreyas Cholia NERSC User Group Meeting October 7, 2009 Science Gateways at NERSC Web access methods to NERSC resources Much is possible beyond yesterday s ssh+pbs

More information

Deploying the Splunk App for Microso> Exchange

Deploying the Splunk App for Microso> Exchange Copyright 2014 Splunk Inc. Deploying the Splunk App for Microso> Exchange Jeff Bernt SDET Disclaimer During the course of this presentahon, we may make forward- looking statements regarding future events

More information

Using the Grid for the interactive workflow management in biomedicine. Andrea Schenone BIOLAB DIST University of Genova

Using the Grid for the interactive workflow management in biomedicine. Andrea Schenone BIOLAB DIST University of Genova Using the Grid for the interactive workflow management in biomedicine Andrea Schenone BIOLAB DIST University of Genova overview background requirements solution case study results background A multilevel

More information

Shibbolized irods (and why it matters)

Shibbolized irods (and why it matters) Shibbolized irods (and why it matters) 3 rd TERENA Storage Meeting, Dublin, February 12 th -13 th 2009 David Corney, for Jens Jensen, e-science centre, Rutherford Appleton Lab, UK Overview Introduction

More information

HISP: a data-driven portal for hadron therapy

HISP: a data-driven portal for hadron therapy HISP: a data-driven portal for hadron therapy Faustin Laurentiu Roman CERN / IFIC Prototype architecture Tools, implementation & services Conclusions (& demo) 1 One slide situation: ereferral and escience

More information

The EDGeS project receives Community research funding

The EDGeS project receives Community research funding Desktop Grids EDGeS project Delegation for access to trusted resources The EDGeS project receives Community research funding 1 DG = Desktop Grid = Loose grid scavenging idle resources Unit of Work = Application

More information

Real Time Monitor of Grid Job Executions. Janusz Martyniak Imperial College London

Real Time Monitor of Grid Job Executions. Janusz Martyniak Imperial College London Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London What is the RTM RTM is a GRID monitoring system which gives on overview of current state of the infrastructure. The RTM's

More information

The ENEA-EGEE site: Access to non-standard platforms

The ENEA-EGEE site: Access to non-standard platforms V INFNGrid Workshop Padova, Italy December 18-20 2006 The ENEA-EGEE site: Access to non-standard platforms C. Sciò**, G. Bracco, P. D'Angelo, L. Giammarino*, S.Migliori, A. Quintiliani, F. Simoni, S. Podda

More information

perfsonar Multi-Domain Monitoring Service Deployment and Support: The LHC-OPN Use Case

perfsonar Multi-Domain Monitoring Service Deployment and Support: The LHC-OPN Use Case perfsonar Multi-Domain Monitoring Service Deployment and Support: The LHC-OPN Use Case Fausto Vetter, Domenico Vicinanza DANTE TNC 2010, Vilnius, 2 June 2010 Agenda Large Hadron Collider Optical Private

More information

AMGA - Official Metadata Service for EGEE

AMGA - Official Metadata Service for EGEE Consorzio COMETA - Progetto PI2S2 FESR AMGA - Official Metadata Service for EGEE Salvatore Scifo INFN Catania Tutorial per utenti e sviluppo di applicazioni in Grid Catania, July 16 th - 20 th 2007 www.consorzio-cometa.it

More information

+ < We call it Integrated Operations Management. Optimized Processes Assured Customer Satisfaction

+ < We call it Integrated Operations Management. Optimized Processes Assured Customer Satisfaction They work in silos We Unify Infrastructure & Application Support + < We call it Management Optimized Processes Assured Customer Satisfaction www.hclisd.com Application Support & Maintenance has traditionally

More information

EGEE is a project funded by the European Union under contract IST-2003-508833

EGEE is a project funded by the European Union under contract IST-2003-508833 www.eu-egee.org NA4 Applications F.Harris(Oxford/CERN) NA4/HEP coordinator EGEE is a project funded by the European Union under contract IST-2003-508833 Talk Outline The basic goals of NA4 The organisation

More information

GRMS Features and Benefits

GRMS Features and Benefits GRMS - The resource management system for Clusterix computational environment Bogdan Ludwiczak bogdanl@man.poznan.pl Poznań Supercomputing and Networking Center Outline: GRMS - what it is? GRMS features

More information

The next generation of ATLAS PanDA Monitoring

The next generation of ATLAS PanDA Monitoring The next generation of ATLAS PanDA Monitoring Jaroslava Schovancová E-mail: jschovan@bnl.gov Kaushik De University of Texas in Arlington, Department of Physics, Arlington TX, United States of America Alexei

More information