The EDGeS project receives Community research funding
|
|
- Dwight Bell
- 8 years ago
- Views:
Transcription
1 Desktop Grids EDGeS project Delegation for access to trusted resources The EDGeS project receives Community research funding 1
2 DG = Desktop Grid = Loose grid scavenging idle resources Unit of Work = Application + Input Data Grid User Submits input data for an application Sends back results Currently, for BOINC, both roles of Application Manager and Grid User are fulfilled by BOINC Project Owners. Requests Unit of Work Grid Server with Sends Unit Application of Work C ti R Repository Certifies Application Sends back results Accepts or Refuses an application on his resource Computing Resource (often Desktop Computer) Owns Resource Resource Owner Application Manager (often volunteer) v1.2 2
3 DG = Desktop Grid = Loose grid scavenging idle resources Computing and Storage Resources are owned by various Owners (it is often volunteer computing), but they are NOT managed and NOT authenticated. Grid Servers are authenticated by a X509 certificate. Users are authenticated by the Grid Servers, but NOT by the Computing and Storage Resources. Executables are certified by managers of the Grid Servers. So : Resource Owners have to trust the Grid Servers, BOINC sends each Work Unit to several Resource Owners, because BOINC does NOT fully trust them. Order of magnitude can be CPUs. Starving Computing Resources pull Work Units from Grid Servers. Examples : BOINC, XtremWeb, xgrid, OurGrid v1.2 3
4 Presentation of the EDGeS project New FP7 project started on 01/01/2008 Integrate Service Grids and Desktop Grids Enable very large number of computing resources (100K-1M 1M processors) Attract new scientific communities Provide a Grid application development environment Provide application repository and bridges for the execution in the SG-DG system glite () Boinc (Berkeley) ARC (NorduGrid) EDGeS Current WLCG (CERN) Future XtremWeb (INRIA/IN2P3) VDT (OSG) Xgrid (Apple) Unicore (DEISA) v1.2 4
5 Now, Interoperation : Specific security needs of Desktop Grids Presentation of the EDGeS project Ad-hoc bridges and interfaces between, BOINC and XtremWeb. A MoU between EDGeS and has been signed on 23 Sept XtremWeb users must have a X509 certificate, be registered in a VO and submit their Jobs with a VOMS proxy. BOINC Project Owners must have a X509 certificate, be registered in a VO and store a medium-term in a MyProxy server. All files must be transferred through the Input and Output sandboxes. In the future : Interoperability using OGF standards, in order to bridge more Grids. Better support of grid file access (ByteIO, GridFTP). v1.2 5
6 Bridge BOINC (WU = Work Unit) Work Unit BOINC Server Submission BOINC Handler 1 for each (BOINC server, BOINC Project Owner, VO) triple BOINC jobwrapper client (simulating a large BOINC computing resource) 3G jobwrapper DN of 3G jobwrapper Config. file Interface Job Handler EDGeS 3G bridge Queue Manager &JobDB WU i+1 Grid Ha andler Interf face Plugin 1 for each (BOINC Project Owner, VO) pair Job i+1 WMS WU i+2 Job i+1 WU i+3 Job i+2 VOMS proxy Retriever VOMS Server VOMS extensions BOINC Project Owner Medium term Short term MyProxy trusting EDGeS 3G bridge v1.2 6
7 Bridge BOINC Solution = Inside EDGeS bridge, marshalling of the BOINC Work Units into Job collections For each (BOINC server, BOINC Project Owner, VO) triple, a separate Job Handler collects the BOINC Work Units and place them in a queue. For each (BOINC Project Owner, VO) pair, a separate plugin : Retrieves a short term X509 Proxy for the BOINC Project Owner from a MyProxy server, and VOMS extensions from a VOMS server, Periodically processes new Work Units found in the queue : It converts each Work Unit into an Job, In order to reduce the usage of the WMS, it uses Collection possibili- ties of to submit many Jobs in one request described using JDL. v1.2 7
8 Bridge XtremWeb X509 proxy XtremWeb User VOMS Server VOMS proxy Submits User Job with VOMS proxy glite WMS Submits mono-user Pilot Job with VOMS proxy Gives Pilot Job Status Pushes Pilot job Gives Pilot Job Status Computing Element Job with VOMS proxy Job Status Mono-user Pilot Job XtremWeb Bridge User Job Requests User Jobs Sends back Job Status and Results Sends User Jobs with VOMS proxy Manages User Job status XtremWeb Server Requests only 1 User Job Sends 1 User Job with same VOMS proxy Sends back results directly v1.2 8
9 Bridge XtremWeb Solution = XtremWeb bridge : Gliding with a mono-user Pilot Job 1. A XtremWeb User submits to the XtremWeb server his User Job with a VOMS proxy. 2. At the request of the XtremWeb bridge, the XtremWeb server sends him the User Job with the VOMS proxy. 3. The XtremWeb bridge submits to a glite WMS a mono-user Pilot Job with this VOMS proxy (job description in a JDL). 4. The glite WMS pushes the Pilot Job to a Computing Element, which executes it. 5. The mono-user Pilot Job requests 1 User Job from the XtremWeb server, and stops itself if it receives none. 6. The XtremWeb server verifies that the requested User Job has a VOMS proxy, and sends the User Job and the VOMS proxy to the Pilot Job. 7. The Pilot Job verifies that the received VOMS proxy is the same as its own VOMS proxy, and executes the User Job. 8. At the end of the User Job, the Pilot Job sends the Job results directly to the XtremWeb server, then stops itself. v1.2 9
10 Bridge Desktop Grids Submits Job glite WMS Gets output User BDII Logs events LB Watches Reports resources and performance Pushes job Sends output Logs events VOMS Gets VOMS proxy Gets EXE Information provider LCG-CE for EDGeS GRAM Job Manager for EDGeS Checks EXE EDGeS Application Repository Adds job Watches job EDGeS 3G bridge Queue Manager & Job DB Generic Job WS Handler Desktop Grid plugin Desktop Grid v1.2 10
11 Bridges BOINC & XtremWeb Solution = Installation of a LCG-CECE sending the Jobs to the EDGeS bridge, which marshals them into Desktop Grid Jobs Information Provider publishes information to the BDII according to GLUE 1.3 Customized GRAM Job Manager ( producer) Gets job information from wrapper Checks if exe is validated in the EDGeS application repository (GEMLCA) Checks if exe is supported by attached BOINC Gets files from WMS Adds job to 3G bridge job Database Polls status of jobs in 3G bridge job Database Gets results from 3G bridge and uploads them to Logging & Bookkeeping EDGeS 3G bridge Manages jobs in the 3G bridge database On events, updates entries in the 3G bridge database Desktop Grid plugins BOINC plugin uses DC-API to generate BOINC Work Units XtremWeb plugin generates XtremWeb Jobs v1.2 11
12 Delegation for access to trusted resources Jobs having to access trusted Resources require delegation (through X509 proxies or SAML assertions) Is it possible to provide delegation to untrusted Computing Resources of Desktop Grids? v1.2 12
13 Delegation Current situation i : NO restriction i Full i Acceptable only with trusted computing resources Grid User Submits Job without Computing Element Full Submits Job without Trusted Worker Node Full Trusted Data Access without Trusted Storage Resource Full NOT acceptable with untrusted (DG) computing resources Grid User Submits Job without Computing Element Full Submits Job without Untrusted Worker Node Full Untrusted Data Access without Trusted Storage Resource Full v1.2 13
14 Delegation Current situation i : NO restriction i Full i By now, WITHOUT restrictions on delegation, X509 proxies permit full. Therefore, when sending jobs, it is acceptable to send along such X509 proxies : only to TRUSTED computing resources (for example Worker Nodes of local or clusters), because the storage resources must trust that the computing resource will only access to data described in the job, but NOT to UNTRUSTED computing resources (for example from a public Desktop Grid), because they could then have access to all user data. v1.2 14
15 Delegation Under development : X509 Proxies with Restrictions i Improved security with trusted computing resources Grid User Submits Job with Computing Element Restricted Submits Job with Trusted Worker Node Restricted Trusted Data Access with Trusted Storage Resource Restricted Could also be acceptable with untrusted computing resources Grid User Submits Job with Computing Element Restricted Submits Job with Untrusted Worker Node Restricted Trusted Data Access with Trusted Storage Resource Restricted v1.2 15
16 Delegation Under development : X509 Proxies with Restrictions i When sending jobs, it could be acceptable to send X509 proxies containing restriction attributes about data access to UNTRUSTED computing resources (for example from a public Desktop Grid), because : In order to get access to data, computing resources have to present to storage resources the full, INCLUDING ALL restriction attributes. Storage resources are then able to refuse data access if restriction attributes forbid it, Data that the jobs have to read are easily protected against corruption or deletion by using restriction attributes setting those data as read-only. Malicious computing resources can always corrupt data on which they have write access, but they can already write false data in the Output Sandbox of jobs anyway. If these restriction attributes are really implemented, enforced and considered secure enough, this would permit computing resources of Desktop Grids to access storage resources of Storage Elements (using SRM, GridFTP, ), with a great impact on EDGeS JRA3. v1.2 16
17 Delegation Access to untrusted Storage Resources of Desktop Grids Could access of trusted t Computing Resources to untrusted Storage Resources of Desktop Grids be acceptable? Grid User Submits Job Submits Job Trusted Untrusted Computing Worker Element NO X509 Node Data Access proxy Untrusted Storage Resource EDGeS is studying the issue. We can get advices from you and Jesus LUNA. v1.2 17
Plateforme de Calcul pour les Sciences du Vivant. SRB & glite. V. Breton. http://clrpcsv.in2p3.fr
SRB & glite V. Breton http://clrpcsv.in2p3.fr Introduction Goal: evaluation of existing technologies for data and tools integration and deployment Data and tools integration should be addressed using web
More informationFile Transfer Software and Service SC3
File Transfer Software and Service SC3 Gavin McCance JRA1 Data Management Cluster Service Challenge Meeting April 26 2005, Taipei www.eu-egee.org Outline Overview of Components Tier-0 / Tier-1 / Tier-2
More informationExperiences with the GLUE information schema in the LCG/EGEE production Grid
Experiences with the GLUE information schema in the LCG/EGEE production Grid Stephen Burke, Sergio Andreozzi and Laurence Field CHEP07, Victoria, Canada www.eu-egee.org EGEE and glite are registered trademarks
More informationThe glite File Transfer Service
Enabling Grids Enabling for E-sciencE Grids for E-sciencE The glite File Transfer Service Paolo Badino On behalf of the JRA1 Data Management team EGEE User Forum - CERN, 2 Mars 2006 www.eu-egee.org Outline
More informationIGI Portal architecture and interaction with a CA- online
IGI Portal architecture and interaction with a CA- online Abstract In the framework of the Italian Grid Infrastructure, we are designing a web portal for the grid and cloud services provisioning. In following
More informationThe Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland
The Lattice Project: A Multi-Model Grid Computing System Center for Bioinformatics and Computational Biology University of Maryland Parallel Computing PARALLEL COMPUTING a form of computation in which
More informationCERN local High Availability solutions and experiences. Thorsten Kleinwort CERN IT/FIO WLCG Tier 2 workshop CERN 16.06.2006
CERN local High Availability solutions and experiences Thorsten Kleinwort CERN IT/FIO WLCG Tier 2 workshop CERN 16.06.2006 1 Introduction Different h/w used for GRID services Various techniques & First
More informationA Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources
A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources Davide Salomoni 1, Daniele Andreotti 1, Luca Cestari 2, Guido Potena 2, Peter Solagna 3 1 INFN-CNAF, Bologna, Italy 2 University
More informationSun Grid Engine, a new scheduler for EGEE
Sun Grid Engine, a new scheduler for EGEE G. Borges, M. David, J. Gomes, J. Lopez, P. Rey, A. Simon, C. Fernandez, D. Kant, K. M. Sephton IBERGRID Conference Santiago de Compostela, Spain 14, 15, 16 May
More informationExtending the EGEE Grid with XtremWeb-HEP Desktop Grids
Extending the EGEE Grid with -HEP Desktop Grids Haiwu He 1, Gilles Fedak 1, Peter Kacsuk 2, Zoltan Farkas 2, Zoltan Balaton 2,Oleg Lodygensky 3, Etienne Urbah 3,Gabriel Caillat 3, Filipe Araujo 4, Ad Emmen
More informationSCI-BUS gateways for grid and cloud infrastructures
SCI-BUS gateways for grid and cloud infrastructures Tamas Kiss University of Westminster Peter Kacsuk, Zoltan Farkas MTA SZTAKI VERCE project meeting 1 st February 2013, Edinburgh SCI-BUS is supported
More informationARC Computing Element
NORDUGRID NORDUGRID-MANUAL-20 15/7/2015 ARC Computing Element System Administrator Guide F. Paganelli, Zs. Nagy, O. Smirnova, and various contributions from all ARC developers Contents 1 Overview 9 1.1
More informationglite Job Management
glite Job Management Gilberto Diaz Riccardo Di Meo Job Submission Egee submission Resembles very closely the batch submission in a cluster. Can select resources automatically ( Grid like submission). Resources
More informationAn approach to grid scheduling by using Condor-G Matchmaking mechanism
An approach to grid scheduling by using Condor-G Matchmaking mechanism E. Imamagic, B. Radic, D. Dobrenic University Computing Centre, University of Zagreb, Croatia {emir.imamagic, branimir.radic, dobrisa.dobrenic}@srce.hr
More informationEMI Storage meets EMI security
EMI Storage meets EMI security Component/ Middleware glite (LFC,FTS,DPM,GFAL) ARC UNICORE StoRM dcache Staff With kind contributions by Oliver Keeble, Jean- Philippe Baud Jon Kerr Nilsen Ralph Müller-
More informationThe Grid-it: the Italian Grid Production infrastructure
n 1 Maria Cristina Vistoli INFN CNAF, Bologna Italy The Grid-it: the Italian Grid Production infrastructure INFN-Grid goals!promote computational grid technologies research & development: Middleware and
More informationSun Grid Engine, a new scheduler for EGEE middleware
Sun Grid Engine, a new scheduler for EGEE middleware G. Borges 1, M. David 1, J. Gomes 1, J. Lopez 2, P. Rey 2, A. Simon 2, C. Fernandez 2, D. Kant 3, K. M. Sephton 4 1 Laboratório de Instrumentação em
More informationBringing Federated Identity to Grid Computing. Dave Dykstra dwd@fnal.gov CISRC16 April 6, 2016
Bringing Federated Identity to Grid Computing Dave Dykstra dwd@fnal.gov CISRC16 April 6, 2016 Outline Introduction & motivation Background Grid security & job management InCommon, CILogon, and SAML ECP
More informationFuture Generation Computer Systems
Future Generation Computer Systems 29 (2013) 1442 1451 Contents lists available at SciVerse ScienceDirect Future Generation Computer Systems journal homepage: www.elsevier.com/locate/fgcs Towards a volunteer
More informationSingle-Sign-On in XtreemOS
Single-Sign-On in XtreemOS Yvon Jégou INRIA 1 Single-Sign-On & Delegation Single-sign-on: avoid asking a user to authenticate each time he invokes a (new) service Security issues User comfort Scripts Delegation:
More informationStatus and Evolution of ATLAS Workload Management System PanDA
Status and Evolution of ATLAS Workload Management System PanDA Univ. of Texas at Arlington GRID 2012, Dubna Outline Overview PanDA design PanDA performance Recent Improvements Future Plans Why PanDA The
More informationA Credential Renewal Service for Long-Running Jobs
A Credential Renewal Service for Long-Running Jobs Daniel Kouřil CESNET z.s.p.o., Zikova 4, 160 00 Praha 6, Czech Republic Email: kouril@ics.muni.cz Jim Basney National Center for Supercomputing Applications
More informationEUROPEAN MIDDLEWARE INITIATIVE
EUROPEAN MIDDLEWARE INITIATIVE GLEXEC SERVICE REFERENCE CARD Document version: 1.0 EMI Component Version: glexec 0.6 0.9 Date: May 24, 2012 GLExec Service Reference Card GLExec on WN, CE and anywhere else
More informationThe GISELA Science Gateway
The GISELA Science Gateway Roberto Barbera (roberto.barbera@ct.infn.it) University of Catania and INFN - Italy TICAL 2012 Lima, 3 July 2012 Introduction and driving considerations The Catania Science Gateway
More informationSee-GRID Project and Business Model
Improvements of the grid infrastructure and services within SEE-GRID Anastas Misev MARNET/MARGI/UKIM Macedonia Introduction SEE-GRID Project series SEE-GRID establish infrastructure SEE-GRID-2 extend infrastructure,
More informationAn objective comparison test of workload management systems
An objective comparison test of workload management systems Igor Sfiligoi 1 and Burt Holzman 1 1 Fermi National Accelerator Laboratory, Batavia, IL 60510, USA E-mail: sfiligoi@fnal.gov Abstract. The Grid
More informationMIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper
Migrating Desktop and Roaming Access Whitepaper Poznan Supercomputing and Networking Center Noskowskiego 12/14 61-704 Poznan, POLAND 2004, April white-paper-md-ras.doc 1/11 1 Product overview In this whitepaper
More informationGlobus Toolkit: Authentication and Credential Translation
Globus Toolkit: Authentication and Credential Translation JET Workshop, April 14, 2004 Frank Siebenlist franks@mcs.anl.gov http://www.globus.org/ Copyright (c) 2002 University of Chicago and The University
More informationQA Metrics Nightly Report
@@BEGINNING OF REPORT@@ QA Metrics Nightly Report European Middleware Initiative Configuration: emi_b_1_rc4 Build started: 19/04/2011 19:00:28 Generated: 20/04/2011 14:53:06 Success rate: 80% (435/542)
More informationCloud Computing. Lecture 5 Grid Case Studies 2014-2015
Cloud Computing Lecture 5 Grid Case Studies 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Case Studies: Monitoring: TeraGRID
More informationWM Technical Evolution Group Report
WM Technical Evolution Group Report Davide Salomoni, INFN for the WM TEG February 7, 2012 The WM TEG, organization Mailing list, wlcg-teg-workload-mgmt@cern.ch 48 people currently subscribed; representation
More informationOn Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments
On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments 18. June 2013 Morris Reidel, Shahbaz Memon, et al. Outline Background Ultrascan Application Ultrascan Software Components
More informationMeasurement of BeStMan Scalability
Measurement of BeStMan Scalability Haifeng Pi, Igor Sfiligoi, Frank Wuerthwein, Abhishek Rana University of California San Diego Tanya Levshina Fermi National Accelerator Laboratory Alexander Sim, Junmin
More informationIntroduction to Programming and Computing for Scientists
Oxana Smirnova (Lund University) Programming for Scientists Tutorial 7b 1 / 48 Introduction to Programming and Computing for Scientists Oxana Smirnova Lund University Tutorial 7b: Grid certificates and
More informationA Uniform Job Monitoring Service in Multiple Job Universes
A Uniform Job Monitoring Service in Multiple Job Universes Aleš Křenek, Miroslav Ruda CESNET, EGEE JRA1 www.eu-egee.org Information Society Grid Monitoring Workshop, June 25, 2007 1 Outline Logging and
More informationProblem Statement. Jonathan Huang Aditya Devarakonda. Overview
Jonathan Huang Aditya Devarakonda Problem Statement Overview Automated job schedulers have been extensively studied and implemented in large clusters and supercomputers. However, many of these clusters
More informationGrids Computing and Collaboration
Grids Computing and Collaboration Arto Teräs CSC, the Finnish IT center for science University of Pune, India, March 12 th 2007 Grids Computing and Collaboration / Arto Teräs 2007-03-12 Slide
More informationE-mail: guido.negri@cern.ch, shank@bu.edu, dario.barberis@cern.ch, kors.bos@cern.ch, alexei.klimentov@cern.ch, massimo.lamanna@cern.
*a, J. Shank b, D. Barberis c, K. Bos d, A. Klimentov e and M. Lamanna a a CERN Switzerland b Boston University c Università & INFN Genova d NIKHEF Amsterdam e BNL Brookhaven National Laboratories E-mail:
More informationProcessing big data by WS- PGRADE/gUSE and Data Avenue
Processing big data by WS- PGRADE/gUSE and Data Avenue http://www.sci-bus.eu Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal, Tamas Pinter MTA SZTAKI SCI-BUS is supported by
More informationCluster, Grid, Cloud Concepts
Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of
More informationAuthorization Strategies for Virtualized Environments in Grid Computing Systems
Authorization Strategies for Virtualized Environments in Grid Computing Systems Xinming Ou Anna Squicciarini Sebastien Goasguen Elisa Bertino Purdue University Abstract The development of adequate security
More informationThe ENEA gateway approach providing EGEE/gLite access to unsupported platforms and operating systems
EU-IndiaGrid Workshop Taipei, November 2nd 2007 The ENEA gateway approach providing EGEE/gLite access to unsupported platforms and operating systems G. Bracco, S.Migliori, A. Quintiliani, A. Santoro, C.
More informationGrid Scheduling Architectures with Globus GridWay and Sun Grid Engine
Grid Scheduling Architectures with and Sun Grid Engine Sun Grid Engine Workshop 2007 Regensburg, Germany September 11, 2007 Ignacio Martin Llorente Javier Fontán Muiños Distributed Systems Architecture
More informationThe GridWay Meta-Scheduler
The GridWay Meta-Scheduler Committers Ignacio M. Llorente Ruben S. Montero Eduardo Huedo Contributors Tino Vazquez Jose Luis Vazquez Javier Fontan Jose Herrera 1 Goals of the Project Goals of the Project
More informationGSI with OpenSSL. Vincenzo Ciaschini. Prague, 4-7/11/08. www.eu-egee.org. EGEE and glite are registered trademarks. egee EGEE-II INFSO-RI-031688
GSI with OpenSSL Vincenzo Ciaschini EGEE-3 All-Hands Prague, 4-7/11/08 www.eu-egee.org egee EGEE and glite are registered trademarks Layout GSI/SSL Differences and Issues VOMS without Globus GSI/SSL Differences
More informationAnalisi di un servizio SRM: StoRM
27 November 2007 General Parallel File System (GPFS) The StoRM service Deployment configuration Authorization and ACLs Conclusions. Definition of terms Definition of terms 1/2 Distributed File System The
More informationDatabase Monitoring Requirements. Salvatore Di Guida (CERN) On behalf of the CMS DB group
Database Monitoring Requirements Salvatore Di Guida (CERN) On behalf of the CMS DB group Outline CMS Database infrastructure and data flow. Data access patterns. Requirements coming from the hardware and
More informationE U F O R I A D S A 3. 1
aidentifier: Date: Activity: Authors: Status: Link: 01-12-2009 SA3 Adrian Jackson Deliverable No link E U F O R I A D S A 3. 1 M A I N T E N A N C E, R U N N I N G, A N D Q U E R Y A N S W E R I N G F
More informationAnwendungsintegration und Workflows mit UNICORE 6
Mitglied der Helmholtz-Gemeinschaft Anwendungsintegration und Workflows mit UNICORE 6 Bernd Schuller und UNICORE-Team Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH 26. November 2009 D-Grid
More informationGrid Engine. The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How)
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) Grid Engine Riccardo Rotondo (riccardo.rotondo@garr.it) Consortium GARR Joint CHAIN/EPIKH School for Application Porting to Science
More informationIntegrating a heterogeneous and shared Linux cluster into grids
Integrating a heterogeneous and shared Linux cluster into grids 1,2 1 1,2 1 V. Büge, U. Felzmann, C. Jung, U. Kerzel, 1 1 1 M. Kreps, G. Quast, A. Vest 1 2 DPG Frühjahrstagung March 28 31, 2006 Dortmund
More informationSecurity in OSG. Tuesday afternoon, 3:15pm. Igor Sfiligoi <isfiligoi@ucsd.edu> Member of the OSG Security team University of California San Diego
Security in OSG Tuesday afternoon, 3:15pm Igor Sfiligoi Member of the OSG Security team University of California San Diego Logistical reminder It is OK to ask questions - During the
More informationGridWay: Open Source Meta-scheduling Technology for Grid Computing
: Open Source Meta-scheduling Technology for Grid Computing Ruben S. Montero dsa-research.org Open Source Grid & Cluster Oakland CA, May 2008 Contents Introduction What is? Architecture & Components Scheduling
More informationCNR-INFM DEMOCRITOS and SISSA elab Trieste
elab and the FVG grid Stefano Cozzini CNR-INFM DEMOCRITOS and SISSA elab Trieste Agenda/Aims Present elab ant its computational infrastructure GRID-FVG structure basic requirements technical choices open
More informationReal Time Monitor of Grid Job Executions. Janusz Martyniak Imperial College London
Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London What is the RTM RTM is a GRID monitoring system which gives on overview of current state of the infrastructure. The RTM's
More informationDirect Issuance of Proxy Certificate on P-GRADE Grid Portal Without Using MyProxy
Direct Issuance of Proxy Certificate on P-GRADE Grid Portal Without Using MyProxy by Ng Kang Siong (ksng@mimos.my) Galoh Rashidah Haron (rashidah@mimos.my) MIMOS Berhad, Malaysia www.eu-egee.org EGEE and
More informationBatch and Cloud overview. Andrew McNab University of Manchester GridPP and LHCb
Batch and Cloud overview Andrew McNab University of Manchester GridPP and LHCb Overview Assumptions Batch systems The Grid Pilot Frameworks DIRAC Virtual Machines Vac Vcycle Tier-2 Evolution Containers
More informationNessus Enterprise Cloud User Guide. October 2, 2014 (Revision 9)
Nessus Enterprise Cloud User Guide October 2, 2014 (Revision 9) Table of Contents Introduction... 3 Nessus Enterprise Cloud... 3 Subscription and Activation... 3 Multi Scanner Support... 4 Customer Scanning
More informationOSG Operational Infrastructure
OSG Operational Infrastructure December 12, 2008 II Brazilian LHC Computing Workshop Rob Quick - Indiana University Open Science Grid Operations Coordinator Contents Introduction to the OSG Operations
More informationXWHEP 5.7.5 : XtremWeb by High Energy Physics
XWHEP 5.7.5 : XtremWeb by High Energy Physics XWHEP Introduction Architecture Rights Objects management Compilation, installation Coordinator service Worker service Client service Benchmark Pilot Jobs
More informationCloud Accounting. Laurence Field IT/SDC 22/05/2014
Cloud Accounting Laurence Field IT/SDC 22/05/2014 Helix Nebula Pathfinder project Development and exploitation Cloud Computing Infrastructure Divided into supply and demand Three flagship applications
More informationTHE CCLRC DATA PORTAL
THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims
More informationGeneric Grid Computing Tools for Resource and Project Management
Generic Grid Computing Tools for and Project Management Erik Elmroth Dept. of Computing Science & HPC2N Umeå University, Sweden Overall objectives Short term: Generic infrastructure components for resource
More informationAnalyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware
Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware R. Goranova University of Sofia St. Kliment Ohridski,
More informationOSG PUBLIC STORAGE. Tanya Levshina
PUBLIC STORAGE Tanya Levshina Motivations for Public Storage 2 data to use sites more easily LHC VOs have solved this problem (FTS, Phedex, LFC) Smaller VOs are still struggling with large data in a distributed
More informationLHC schedule: what does it imply for SRM deployment? Jamie.Shiers@cern.ch. CERN, July 2007
WLCG Service Schedule LHC schedule: what does it imply for SRM deployment? Jamie.Shiers@cern.ch WLCG Storage Workshop CERN, July 2007 Agenda The machine The experiments The service LHC Schedule Mar. Apr.
More informationA Distributed Architecture for Intra- and Inter- Cloud Data Management
A Distributed Architecture for Intra- and Inter- Cloud Data Management Presented by: Ian Kelley Information School University of Washington E-mail: ikelley@uw.edu Introduction Motivation (my) Data Landscape
More informationglibrary: Digital Asset Management System for the Grid
glibrary: Digital Asset Management System for the Grid Antonio Calanducci INFN Catania EGEE User Forum Manchester, 09 th -11 th May 2007 www.eu-egee.org EGEE and glite are registered trademarks Outline
More informationThe Italian Grid Infrastructure (IGI) CGW08 Cracow. Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director
The Italian Grid Infrastructure (IGI) CGW08 Cracow Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director IGI -> National Grid Initiative Applications: Archeology Astronomy Astrophysics
More informationThe ENEA-EGEE site: Access to non-standard platforms
V INFNGrid Workshop Padova, Italy December 18-20 2006 The ENEA-EGEE site: Access to non-standard platforms C. Sciò**, G. Bracco, P. D'Angelo, L. Giammarino*, S.Migliori, A. Quintiliani, F. Simoni, S. Podda
More informationCMS Dashboard of Grid Activity
Enabling Grids for E-sciencE CMS Dashboard of Grid Activity Julia Andreeva, Juha Herrala, CERN LCG ARDA Project, EGEE NA4 EGEE User Forum Geneva, Switzerland March 1-3, 2006 http://arda.cern.ch ARDA and
More informationEsqu Science Experiments For Computer Network
Vangelis Floros, GRNET S.A. 3 rd Open Source Software Conference March 22, 2008 NTUA, Athens Greece Introduction What is a Grid? What is escience? Large Scientific Grids The example of EGEE Building Grid
More informationPolicy on ARCS eresearch Services Firewall Configuration Requests
Policy on ARCS eresearch Services Firewall Configuration Requests (Endorsed by CAUDIT Executive 29 July 2009) Introduction ARCS and CAUDIT have together sought to arrive at an agreed set of firewall configurations
More informationThe glite File Transfer Service
The glite File Transfer Service Peter Kunszt Paolo Badino Ricardo Brito da Rocha James Casey Ákos Frohner Gavin McCance CERN, IT Department 1211 Geneva 23, Switzerland Abstract Transferring data reliably
More informationHAMBURG ZEUTHEN. DESY Tier 2 and NAF. Peter Wegner, Birgit Lewendel for DESY-IT/DV. Tier 2: Status and News NAF: Status, Plans and Questions
DESY Tier 2 and NAF Peter Wegner, Birgit Lewendel for DESY-IT/DV Tier 2: Status and News NAF: Status, Plans and Questions Basics T2: 1.5 average Tier 2 are requested by CMS-groups for Germany Desy commitment:
More informationHTCondor within the European Grid & in the Cloud
HTCondor within the European Grid & in the Cloud Andrew Lahiff STFC Rutherford Appleton Laboratory HEPiX 2015 Spring Workshop, Oxford The Grid Introduction Computing element requirements Job submission
More informationThe glite Workload Management System
Consorzio COMETA - Progetto PI2S2 FESR The glite Workload Management System Annamaria Muoio INFN Catania Italy Annamaria.muoio@ct.infn.it Tutorial per utenti e sviluppo di applicazioni in Grid 16-20 July
More informationGratia: New Challenges in Grid Accounting.
Gratia: New Challenges in Grid Accounting. Philippe Canal Fermilab, Batavia, IL, USA. pcanal@fnal.gov Abstract. Gratia originated as an accounting system for batch systems and Linux process accounting.
More informationManagement. Purdue University. CHEP09 21-27 Mar 2009, Prague, Czech Republic
AW Web bportal for CMS Grid Job Submission and Management David Braun, Norbert Neumeister Purdue University CHEP09 21-27 Mar 2009, Prague, Czech Republic Introduction Investigated possibilities to provide
More informationSEE-GRID-SCI. www.see-grid-sci.eu. SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul 09-10 December, 2009
SEE-GRID-SCI Grid Site Monitoring tools developed and used at SCL www.see-grid-sci.eu SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul 09-10 December, 2009 V. Slavnić, B. Acković, D. Vudragović, A. Balaž,
More informationSecure Federated Light-weight Web Portals for FusionGrid
Secure Federated Light-weight Web Portals for FusionGrid By: D. Aswath, M. Thompson, M. Goode, X. Lee, N. Y. Kim Presented by: Dipti Aswath GCE Workshop 2006 Second International Workshop on Grid Computing
More informationTier 1 Services - CNAF to T1
CDF Report on Tier 1 Usage Donatella Lucchesi for the CDF Italian Computing Group INFN Padova Outline The CDF Computing Model Tier1 resources usage as today CDF portal for European GRID: lcgcaf People
More informationThe GENIUS Grid Portal
The GENIUS Grid Portal (*) work in collaboration with A. Falzone and A. Rodolico EGEE NA4 Workshop, Paris, 18.12.2003 CHEP 2000, 10.02.2000 Outline Introduction Grid portal architecture and requirements
More informationInteroperability in Grid Computing
Anette Weisbecker, Fraunhofer IAO, Stuttgart 18 th April 2007 Special Interest Session III Outline: Interoperability in Grid Computing Grid Computing for Medicine and Life Science Interoperability Architecture
More informationThe dcache Storage Element
16. Juni 2008 Hamburg The dcache Storage Element and it's role in the LHC era for the dcache team Topics for today Storage elements (SEs) in the grid Introduction to the dcache SE Usage of dcache in LCG
More informationRetirement of glite3.1 and unsupported glite 3.2
EGI-InSPIRE Retirement of glite3.1 and unsupported glite 3.2 T. Ferrari/EGI.eu 10/10/2012 1 glite 3.1 glite 3.1 distribution no longer supported end of security support for most of the products in May-Oct
More informationYAN, Tian. On behalf of distributed computing group. Institute of High Energy Physics (IHEP), CAS, China. CHEP-2015, Apr. 13-17th, OIST, Okinawa
YAN, Tian On behalf of distributed computing group Institute of High Energy Physics (IHEP), CAS, China CHEP-2015, Apr. 13-17th, OIST, Okinawa Distributed computing for BESIII Other experiments wish to
More informationSkynax. Mobility Management System. System Manual
Skynax Mobility Management System System Manual Intermec by Honeywell 6001 36th Ave. W. Everett, WA 98203 U.S.A. www.intermec.com The information contained herein is provided solely for the purpose of
More informationStatus and Integration of AP2 Monitoring and Online Steering
Status and Integration of AP2 Monitoring and Online Steering Daniel Lorenz - University of Siegen Stefan Borovac, Markus Mechtel - University of Wuppertal Ralph Müller-Pfefferkorn Technische Universität
More informationA Minimalistic Approach to End-to-End Protection of Grid Job Payloads
A Minimalistic Approach to End-to-End Protection of Grid Job Payloads Igor Sfiligoi Fermilab, Batavia, IL, USA sfiligoi@fnal.gov Don Petravick Fermilab, Batavia, IL, USA petravic@fnal.gov Abstract The
More informationDSA1.4 R EPORT ON IMPLEMENTATION OF MONITORING AND OPERATIONAL SUPPORT SYSTEM. Activity: SA1. Partner(s): EENet, NICPB. Lead Partner: EENet
R EPORT ON IMPLEMENTATION OF MONITORING AND OPERATIONAL SUPPORT SYSTEM Document Filename: Activity: Partner(s): Lead Partner: Document classification: BG-DSA1.4-v1.0-Monitoring-operational-support-.doc
More informationManaging Credentials with
Managing Credentials with MyProxy Jim Basney National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu http://myproxy.ncsa.uiuc.edu/ What is MyProxy? A service for managing
More informationScheduling in SAS 9.4 Second Edition
Scheduling in SAS 9.4 Second Edition SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. Scheduling in SAS 9.4, Second Edition. Cary, NC: SAS Institute
More informationEMI Security Architecture
EUROPEAN MIDDLEWARE INITIATIVE EMI Security Architecture http://openaire.cern.ch/record/5959 10.5281/ZENODO.5959 April 2013 EMI is partially funded by the European Commission under Grant Agreement RI-261611
More informationCost-Benefit Analysis of Cloud Computing versus Desktop Grids. By : Paritosh Heera( MT2011099)
Cost-Benefit Analysis of Cloud Computing versus Desktop Grids By : Paritosh Heera( MT2011099) Abstract and Introduction 2 computing environment mainly for scientific applications i.e cloud and VC Ground
More informationdcache, list of topics
dcache, list of topics EGI Meeting on H2020 Patrick Fuhrmann dcache EIG Meeting Patrick Fuhrmann 22 October 2013 1 Content The project structure Project funding, customers and contacts Current work areas
More informationDesigning a Resource Broker for Heterogeneous Grids
Designing a Resource Broker for Heterogeneous Grids Srikumar Venugopal, Krishna Nadiminti, Hussein Gibbins and Rajkumar Buyya Grid Computing and Distributed Systems Laboratory Dept. of Computer Science
More informationScheduling in SAS 9.3
Scheduling in SAS 9.3 SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc 2011. Scheduling in SAS 9.3. Cary, NC: SAS Institute Inc. Scheduling in SAS 9.3
More informationBuilding a Volunteer Cloud
Building a Volunteer Cloud Ben Segal, Predrag Buncic, David Garcia Quintas / CERN Daniel Lombrana Gonzalez / University of Extremadura Artem Harutyunyan / Yerevan Physics Institute Jarno Rantala / Tampere
More informationDistributed Database Access in the LHC Computing Grid with CORAL
Distributed Database Access in the LHC Computing Grid with CORAL Dirk Duellmann, CERN IT on behalf of the CORAL team (R. Chytracek, D. Duellmann, G. Govi, I. Papadopoulos, Z. Xie) http://pool.cern.ch &
More information