Shibbolized irods (and why it matters)
|
|
|
- Helena Gregory
- 8 years ago
- Views:
Transcription
1 Shibbolized irods (and why it matters) 3 rd TERENA Storage Meeting, Dublin, February 12 th -13 th 2009 David Corney, for Jens Jensen, e-science centre, Rutherford Appleton Lab, UK
2 Overview Introduction A shared e-infrastructure current status One area of development: ASPiS
3 About STFC... The Science and Technology Facilities Council (UK) Created on April 1, 2007 (1 of 7 UK research Councils) Responsible for: fundamental research in particle physics, nuclear physics, astronomy, space major UK facilities for the physical and life sciences synchrotrons, light sources, lasers, neutrons national laboratories at RAL, Daresbury, UKATC international science projects CERN, ESO, ESA, ILL, ESRF Over 2000 staff and an annual budget of over 700M David Corney CISB07 Nov 19th
4 Tier Offline farm Structure Tier 0 CERN computer centre Online system Tier 1 National centres RAL,UK USA Germany Italy France Tier 2 Regional groups ScotGrid NorthGrid SouthGridLondon Useful model for Particle Physics but not necessary for others Institutes Workstations Glasgow EdinburghDurham
5 Tier-1 Hardware CPU Power (Reconstruction, Simulation, User Analysis etc). 600 systems, 1250 cores, 1500 KSI2K Disk Storage (Frequently Accessed) 138 Servers, 3200 drives, 750TB 'Tape' Storage Long Term retention write once read several times a year 1PB in SL8500 robot + 12 drives Currently about 45 racks with a further 25 due to arrive for Xmass
6 Rutherford Appleton Laboratory 6
7 Science driver - enabling better science Neutron diffraction X-ray diffraction NMR High-quality structure refinement EDNS - European Data Infrastructure for Neutron and
8 e-infrastructure Access to Multiple Facilities SNS - ORNL ANSTO - Australia icat ISIS TS1 + 2 CLF DLS
9 Technology Driver integration and interoperation Single Infrastructure Single User Experience Raw Data Data Analysed Publication Different Catalogue Infrastructures Analysi Data Different Data Catalogue User s Catalogue Experiences Publication s Catalogue Raw Data Facility 1 Data Analysi s Analyse d Data Publicatio n Data Publicatio ns Raw Data Facility 2 Data Analysi s Analyse d Data Publicatio n Data Publicatio ns Raw Data Facility 3 Capacity Storage Data Analysi s Software Repositories Analyse d Data Data Repositories Publicatio n Data Publicatio ns Publications Repositories EDNS - European Data Infrastructure for Neutron and
10 Underlying Data Infrastructure Online Proposal System User Office System: User Database Scheduling Health and Safety Proposal Management Single Sign On Account Creation and Management DataAccessPortal Metadata Catalogue Data Acquisition System Storage Management System ICAT Software Suite, providing the crucial integration of key functions.
11 BBSRC Archive system All (12) Institutes of the BBSRC 6000 scientists across the UK 50 TB storage capacity (currently) 10 year SLA agreed David Corney CISB07 Nov 19th
12 Data Archive/Management Services High Energy Physics Experiments (CMS, Atlas, LHcb, Alice, H1,...) ISIS (Neutron Muon Source) Diamond Light Source British Atmospheric Data Centre EISCAT (Radar research) National Earth Observation Data Centre BBSRC archive Solar Physics World Data Centre CICT (Standard IT backups) Central Laser Facility National Crystallography Service, University of Southampton Hartley Library, Southampton University WASP, VIRGO Consortium SOLAR-B (Hinode) David Corney CISB07 Nov 19th
13 Data Policy Data Policy (ISIS) 3 year embargo on data (+1 if requested) Commercial data is never made public Instrument Scientists can access all data from their beamline Calibration data is public Any data that involves IPR (e.g. analysed) is private for perpetuity unless explicitly shared by user Automatic Enforcement of policy A research area
14 EDNP ESRF European Data Infrastructure for Neutron and Photon Sources Combining European Neutron and Synchrotron Facilities Already a common user community Across many disciplines Materials, chemistry, proteomics, pharmaceuticals, nuclear physics, archaeology
15 The ASPiS project Jens Jensen, STFC via David Corney, STFC Terena Storage TF, Dublin February 2009
16 ASPiS: people M Hedges, E Liao, T Blanke, CeRCH KCL A Weise, Reading A Hasan, Liverpool J Jensen, R Downing, STFC
17 ASPiS irods as datastore SSO login via Shibboleth PERMIS access control policy Provenance metadata in PASOA Funded by JISC
18 PERMIS PDP Shib service Apache irods User PASOA Disk
19 Shib login So what does it do? Single password Password managed by home institution S.E.P. Home institution provides attrs ASPiS can use these for access control And for provenance
20 Shibboleth login Home Inst. irods
21 irods Rule Engine to manage data workflow Microservices calling out to ext l services No changes to irods itself Improves maintenance
22 irods Rule Engine Log attrs Access Ctrl Example Rule workflow PERMIS PDP Update metadata Branch on file type Image Document metadata metadata PASOA
23 Two Federations UK Access Managemen t Federation (Shibboleth) ASPiS irods Federation STFC irods King s irods Reading irods
24 Target Users 1. Arts and Humanities 2. STFC facilities Was Diamond Light Source (no IdP) Now ISIS Neutron Source 3. SRB users on the National Grid Service
25 Timescale Project start 01 Apr 2008 Today 31 June 2009
26 Questions Thanks for your attention - and to David for giving the presentation For questions, please contact j dot jensen dot ral at googl dot com
Large scale Data Storage Services for Science at STFC. David Corney
Large scale Data Storage Services for Science at STFC David Corney Deputy Division Head, Data Services Division, e-science centre, Rutherford Lab Science and Technology Facilities Council David Corney
Linking raw data with scientific workflow and software repository: some early
Linking raw data with scientific workflow and software repository: some early experience in PanData-ODI Erica Yang, Brian Matthews Scientific Computing Department (SCD) Rutherford Appleton Laboratory (RAL)
Integrating Research Information: Requirements of Science Research
Integrating Research Information: Requirements of Science Research Brian Matthews Scientific Information Group E-Science Centre STFC Rutherford Appleton Laboratory brian.matthews@stfc.ac.uk The science
Data grid storage for digital libraries and archives using irods
Data grid storage for digital libraries and archives using irods Mark Hedges, Centre for e-research, King s College London eresearch Australasia, Melbourne, 30 th Sept. 2008 Background: Project History
Building an Open Data Infrastructure for Science: Turning Policy into Practice
Building an Open Infrastructure for Science: Turning Policy into Practice Juan Bicarregui Head of Services Division STFC Department of Scientific Computing Franco-British Workshop on Big in Science, November
Computing Strategic Review. December 2015
Computing Strategic Review December 2015 Front cover bottom right image shows a view of dark matter at redshift zero in the Eagle simulation, by the Virgo Consortium using the DiRAC Facility (Durham Data
Nuclear Physics Technology Showcase Event 26 September 2013, IoP London. STFC External Innovations Programme Funding Schemes
Nuclear Physics Technology Showcase Event 26 September 2013, IoP London STFC External Innovations Programme Funding Schemes Dr Vlad Skarda DBA CPhys External Innovations Science and Technology Facilities
INFRASTRUCTURE PROGRAMME
INFRASTRUCTURE PROGRAMME programme remit Infrastructure s remit is to provide researchers in the Engineering and Physical sciences with access to the world class facilities necessary to enable internationally
THE CCLRC DATA PORTAL
THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims
Big Data and Storage Management at the Large Hadron Collider
Big Data and Storage Management at the Large Hadron Collider Dirk Duellmann CERN IT, Data & Storage Services Accelerating Science and Innovation CERN was founded 1954: 12 European States Science for Peace!
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS)
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS) Todd BenDor Associate Professor Dept. of City and Regional Planning UNC-Chapel Hill bendor@unc.edu http://irods.org/ SESYNC Model Integration Workshop Important
Computing Advisory Panel (CAP) Preliminary enquiry in respect of future PRACE membership. Jan- 2014
Computing Advisory Panel (CAP) Preliminary enquiry in respect of future PRACE membership Jan2014 To: STFC supported researchers who depend upon HPC facilities, including Cosmology, Particle Physics, Astrophysics,
Metadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan
Metadata for Data Discovery: The NERC Data Catalogue Service Steve Donegan Introduction NERC, Science and Data Centres NERC Discovery Metadata The Data Catalogue Service NERC Data Services Case study:
Data sharing and Big Data in the physical sciences. 2 October 2015
Data sharing and Big Data in the physical sciences 2 October 2015 Content Digital curation: Data and metadata Why consider the physical sciences? Astronomy: Video Physics: LHC for example. Video The Research
Data Management Plan (DMP) for Particle Physics Experiments prepared for the 2015 Consolidated Grants Round. Detailed Version
Data Management Plan (DMP) for Particle Physics Experiments prepared for the 2015 Consolidated Grants Round. Detailed Version The Particle Physics Experiment Consolidated Grant proposals now being submitted
Status of Grid Activities in Pakistan. FAWAD SAEED National Centre For Physics, Pakistan
Status of Grid Activities in Pakistan FAWAD SAEED National Centre For Physics, Pakistan 1 Introduction of NCP-LCG2 q NCP-LCG2 is the only Tier-2 centre in Pakistan for Worldwide LHC computing Grid (WLCG).
irods at CC-IN2P3: managing petabytes of data
Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules irods at CC-IN2P3: managing petabytes of data Jean-Yves Nief Pascal Calvat Yonny Cardenas Quentin Le Boulc h
(Possible) HEP Use Case for NDN. Phil DeMar; Wenji Wu NDNComm (UCLA) Sept. 28, 2015
(Possible) HEP Use Case for NDN Phil DeMar; Wenji Wu NDNComm (UCLA) Sept. 28, 2015 Outline LHC Experiments LHC Computing Models CMS Data Federation & AAA Evolving Computing Models & NDN Summary Phil DeMar:
Postgraduate Induction in Physics at Royal Holloway, University of London
Postgraduate Induction in Physics at Outline of Talk Induction Training Assessment & Annual Review Research in the Department Academic training in Department Generic Skills Programme GRADnet Postgraduate
Data Management using irods
Data Management using irods Fundamentals of Data Management September 2014 Albert Heyrovsky Applications Developer, EPCC a.heyrovsky@epcc.ed.ac.uk 2 Course outline Why talk about irods? What is irods?
Scientific Cloud Computing Infrastructure for Europe Strategic Plan. Bob Jones,
Scientific Cloud Computing Infrastructure for Europe Strategic Plan Bob Jones, IT department, CERN Origin of the initiative Conceived by ESA as a prospective for providing cloud services to space sector
Big Science and Big Data Dirk Duellmann, CERN Apache Big Data Europe 28 Sep 2015, Budapest, Hungary
Big Science and Big Data Dirk Duellmann, CERN Apache Big Data Europe 28 Sep 2015, Budapest, Hungary 16/02/2015 Real-Time Analytics: Making better and faster business decisions 8 The ATLAS experiment
Tier0 plans and security and backup policy proposals
Tier0 plans and security and backup policy proposals, CERN IT-PSS CERN - IT Outline Service operational aspects Hardware set-up in 2007 Replication set-up Test plan Backup and security policies CERN Oracle
KIT Site Report. Andreas Petzold. www.kit.edu STEINBUCH CENTRE FOR COMPUTING - SCC
KIT Site Report Andreas Petzold STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association www.kit.edu GridKa Tier 1 - Batch
High-Performance Scientific Computing in the UK STFC and the Hartree Centre. Mike Ashworth
High-Performance Scientific Computing in the UK STFC and the Hartree Centre Mike Ashworth Scientific Computing Department and STFC Hartree Centre STFC Daresbury Laboratory mike.ashworth@stfc.ac.uk High
Solution Brief: Creating Avid Project Archives
Solution Brief: Creating Avid Project Archives Marquis Project Parking running on a XenData Archive Server provides Fast and Reliable Archiving to LTO or Sony Optical Disc Archive Cartridges Summary Avid
HTCondor at the RAL Tier-1
HTCondor at the RAL Tier-1 Andrew Lahiff, Alastair Dewhurst, John Kelly, Ian Collier, James Adams STFC Rutherford Appleton Laboratory HTCondor Week 2014 Outline Overview of HTCondor at RAL Monitoring Multi-core
From Consultancy. Projects to Case Studies. Ins2tute Case Studies: 10 September 2012, SSI Fellows Programme Launch Steve Crouch s.crouch@so#ware.ac.
Ins2tute Case Studies: From Consultancy Projects to Case Studies 10 September 2012, SSI Fellows Programme Launch Steve Crouch s.crouch@so#ware.ac.uk In Context Developing the scien/fic compu/ng / so4ware
NERC Data Policy Guidance Notes
NERC Data Policy Guidance Notes Author: Mark Thorley NERC Data Management Coordinator Contents 1. Data covered by the NERC Data Policy 2. Definition of terms a. Environmental data b. Information products
How To Understand And Understand The Science Of Astronomy
Introduction to the VO Christophe.Arviset@esa.int ESAVO ESA/ESAC Madrid, Spain The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments
Report from SARA/NIKHEF T1 and associated T2s
Report from SARA/NIKHEF T1 and associated T2s Ron Trompert SARA About SARA and NIKHEF NIKHEF SARA High Energy Physics Institute High performance computing centre Manages the Surfnet 6 network for the Dutch
Experience of Data Transfer to the Tier-1 from a DIRAC Perspective
Experience of Data Transfer to the Tier-1 from a DIRAC Perspective Lydia Heck Institute for Computational Cosmology Manager of the DiRAC-2 Data Centric Facility COSMA 1 Talk layout Introduction to DiRAC?
STFC s Science and Technology Strategy
STFC s Science and Technology Strategy Director, Science Programmes Nuclear Physics and Particle Physics Town Meetings April 2008 Addressing the challenges of the twenty-first century The twenty-first
Euro-VO DCA. Board Meeting #1 Oct 2-3, 2006. Nic Walton for Mike Watson. CDS Strasbourg
Euro-VO DCA Board Meeting #1 Oct 2-3, 2006 Nic Walton for Mike Watson CDS Strasbourg AstroGrid AstroGrid: UK's Virtual Observatory Empowerment of scientists Improve the quality, ease, speed and cost effectiveness
Betriebssystem-Virtualisierung auf einem Rechencluster am SCC mit heterogenem Anwendungsprofil
Betriebssystem-Virtualisierung auf einem Rechencluster am SCC mit heterogenem Anwendungsprofil Volker Büge 1, Marcel Kunze 2, OIiver Oberst 1,2, Günter Quast 1, Armin Scheurer 1 1) Institut für Experimentelle
Data storage services at CC-IN2P3
Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules Data storage services at CC-IN2P3 Jean-Yves Nief Agenda Hardware: Storage on disk. Storage on tape. Software:
SUPPORT FOR CMS EXPERIMENT AT TIER1 CENTER IN GERMANY
The 5th InternaEonal Conference Distributed CompuEng and Grid technologies in Science and EducaEon SUPPORT FOR CMS EXPERIMENT AT TIER1 CENTER IN GERMANY N. Ratnikova, J. Berger, C. Böser, O. Oberst, G.
The CMS analysis chain in a distributed environment
The CMS analysis chain in a distributed environment on behalf of the CMS collaboration DESY, Zeuthen,, Germany 22 nd 27 th May, 2005 1 The CMS experiment 2 The CMS Computing Model (1) The CMS collaboration
Second EUDAT Conference, October 2013 Data Management Plans and Certification Motivation: increasing importance of Data Management Planning
Second EUDAT Conference, October 2013 Data Management Plans and Certification Motivation: increasing importance of Data Management Planning Simon Lambert Scientific Computing Department STFC Rutherford
MATRIX and H-Net Backup and Archival Storage: Practices and Suggested Improvements. Preservation of the H-Net E-Mail Lists Supplemental Report
MATRIX and H-Net Backup and Archival Storage: Practices and Suggested Improvements Preservation of the H-Net E-Mail Lists Supplemental Report Lisa M. Schmidt MATRIX: Center for Humane Arts, Letters and
Deploying a distributed data storage system on the UK National Grid Service using federated SRB
Deploying a distributed data storage system on the UK National Grid Service using federated SRB Manandhar A.S., Kleese K., Berrisford P., Brown G.D. CCLRC e-science Center Abstract As Grid enabled applications
Unterstützung datenintensiver Forschung am KIT Aktivitäten, Dienste und Erfahrungen
Unterstützung datenintensiver Forschung am KIT Aktivitäten, Dienste und Erfahrungen Achim Streit Steinbuch Centre for Computing (SCC) KIT Universität des Landes Baden-Württemberg und nationales Forschungszentrum
Workshop on Data Visualisation, Reduction and Analysis at Australia s Replacement Research Reactor Workshop Report and Recommendations Background
Workshop on Data Visualisation, Reduction and Analysis at Australia s Replacement Research Reactor Workshop Report and Recommendations Robert McGreevy (ISIS Pulsed Neutron and Muon Source) Ray Osborn (Argonne
House of Lords Science & Technology Committee: Scientific Infrastructure
House of Lords Science & Technology Committee: Scientific Infrastructure Response by the Wellcome Trust 1 Key Points The UK needs a strategic and long-term approach to capital investment if it is to remain
Tier-1 Services for Tier-2 Regional Centres
Tier-1 Services for Tier-2 Regional Centres The LHC Computing MoU is currently being elaborated by a dedicated Task Force. This will cover at least the services that Tier-0 (T0) and Tier-1 centres (T1)
CERN s Scientific Programme and the need for computing resources
This document produced by Members of the Helix Nebula consortium is licensed under a Creative Commons Attribution 3.0 Unported License. Permissions beyond the scope of this license may be available at
Computing at the HL-LHC
Computing at the HL-LHC Predrag Buncic on behalf of the Trigger/DAQ/Offline/Computing Preparatory Group ALICE: Pierre Vande Vyvre, Thorsten Kollegger, Predrag Buncic; ATLAS: David Rousseau, Benedetto Gorini,
CHESS DAQ* Introduction
CHESS DAQ* Introduction Werner Sun (for the CLASSE IT group), Cornell University * DAQ = data acquisition https://en.wikipedia.org/wiki/data_acquisition Big Data @ CHESS Historically, low data volumes:
EUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland EISCAT User Meeting, Uppsala,6 May 2013 2 Exponential growth Data trends Zettabytes
Exploitation of ISS scientific data
Cooperative ISS Research data Conservation and Exploitation Exploitation of ISS scientific data Luigi Carotenuto Telespazio s.p.a. Copernicus Big Data Workshop March 13-14 2014 European Commission Brussels
A Physics Approach to Big Data. Adam Kocoloski, PhD CTO Cloudant
A Physics Approach to Big Data Adam Kocoloski, PhD CTO Cloudant 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 Solenoidal Tracker at RHIC (STAR) The life of LHC data Detected by experiment Online
Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing.
Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing. Dr Liz Lyon, UKOLN, University of Bath Introduction and Objectives UKOLN is undertaking
EGI services for distribution and federation of data and computing
EGI services for distribution and federation of data and computing Tiziana Ferrari Technical Director, EGI.eu tiziana.ferrari@egi.eu March 2014 EGI-InSPIRE RI-261323 1 Accelerating Excellent Science MISSION.
The George E. Brown, Jr. Network for Earthquake Engineering Simulation. NEES Experimental Site Backup Plan at NEES@Lehigh
The George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES Experimental Site Backup Plan at NEES@Lehigh Last Modified November 12, 2012 Acknowledgement: This work was supported primarily
irods in complying with Public Research Policy
irods User Group 2015 irods in complying with Public Research Policy Vic Cornell Senior Storage Consultant Overview Compliance overview UK examples Imperial College MedBio Requirements Architecture irods
Pan-European ESS Data Management and Software Centre Takes Form in Copenhagen
Pan-European ESS Data Management and Software Centre Takes Form in Copenhagen SEPTEMBER 15, 2015 The Experiment Data. The ESS Data Management and Software Centre is an integrated part of the design and
Data Storage and Data Transfer. Dan Hitchcock Acting Associate Director, Advanced Scientific Computing Research
Data Storage and Data Transfer Dan Hitchcock Acting Associate Director, Advanced Scientific Computing Research Office of Science Organization 2 Data to Enable Scientific Discovery DOE SC Investments in
Big Data and the Earth Observation and Climate Modelling Communities: JASMIN and CEMS
Big Data and the Earth Observation and Climate Modelling Communities: JASMIN and CEMS Workshop on the Future of Big Data Management 27-28 June 2013 Philip Kershaw Centre for Environmental Data Archival
Deposition and use of raw diffraction images
Deposition and use of raw diffraction images By John.R. Helliwell Crystallographic Information and Data Management A Satellite Symposium to the 28th European Crystallographic Meeting University of Warwick,
Authentication Methods
Authentication Methods Overview In addition to the OU Campus-managed authentication system, OU Campus supports LDAP, CAS, and Shibboleth authentication methods. LDAP users can be configured through the
The challenges of digital preservation to support research in the digital age
DRAFT FOR DISCUSSION WITH ADVISORY COUNCIL MEMBERS ONLY The challenges of digital preservation to support research in the digital age Lynne Brindley CEO, The British Library November 2005 Agenda UK developments
Forschungszentrum Karlsruhe in der Helmholtz - Gemeinschaft. Holger Marten. Holger. Marten at iwr. fzk. de www.gridka.de
Tier-2 cloud Holger Marten Holger. Marten at iwr. fzk. de www.gridka.de 1 GridKa associated Tier-2 sites spread over 3 EGEE regions. (4 LHC Experiments, 5 (soon: 6) countries, >20 T2 sites) 2 region DECH
Identity and Access Management for LIGO: International Challenges
Identity and Access Management for LIGO: International Challenges Scott Koranda for LIGO and CTSC University of Wisconsin-Milwaukee November 14, 2012 LIGO-XXXXXXXX-v1 1 / 26 LIGO Science Mission LIGO,
Policy Policy--driven Distributed driven Distributed Data Management (irods) Richard M arciano Marciano marciano@un marciano @un.
Policy-driven Distributed Data Management (irods) Richard Marciano marciano@unc.edu Professor @ SILS / Chief Scientist for Persistent Archives and Digital Preservation @ RENCI Director of the Sustainable
Federated Identity Management for the EUDAT Data e-infrastructure
Federated Identity Management for the EUDAT Data e-infrastructure Principled promoting of persistent personal principals: particular practical perspectives Jens Jensen, STFC EUDAT AAI TF DPConline workshop
Long term data Archive Study on new Technologies. GMV, 2011 Property of GMV All rights reserved
Long term data Archive Study on new Technologies Property of GMV All rights reserved Index Introduction Mission & Objectives Survey Results Technological Evaluation Conclusions & Future Work LTDP Page
Digital Preservation: Legal Issues
Digital Preservation: Legal Issues Chinese National Academy of Sciences July04 Neil Beagrie, BL/JISC Partnership Manager Supporting further and higher education Warnings! This does not constitute legal
Simon Miles King s College London Architecture Tutorial
Common provenance questions across e-science experiments Simon Miles King s College London Outline Gathering Provenance Use Cases Our View of Provenance Sample Case Studies Generalised Questions about
US NSF s Scientific Software Innovation Institutes
US NSF s Scientific Software Innovation Institutes S 2 I 2 awards invest in long-term projects which will realize sustained software infrastructure that is integral to doing transformative science. (Can
Monitoring the Grid at local, national, and global levels
Home Search Collections Journals About Contact us My IOPscience Monitoring the Grid at local, national, and global levels This content has been downloaded from IOPscience. Please scroll down to see the
Technical. Overview. ~ a ~ irods version 4.x
Technical Overview ~ a ~ irods version 4.x The integrated Ru e-oriented DATA System irods is open-source, data management software that lets users: access, manage, and share data across any type or number
Australian Synchrotron, Storage Gateway
Australian Synchrotron, Storage Gateway User Help Manual Version 1.2 Storage Gateway User Help Manual 2 REVISION HISTORY Date Version Description Author 2 May 2008 1.0 Document creation Chris Myers 13
CEDA Storage. Dr Matt Pritchard. Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk
CEDA Storage Dr Matt Pritchard Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk How we store our data NAS Technology Backup JASMIN/CEMS CEDA Storage Data stored as files on disk. Data is migrated
Evolution of the Italian Tier1 (INFN-T1) Umea, May 2009 Felice.Rosso@cnaf.infn.it
Evolution of the Italian Tier1 (INFN-T1) Umea, May 2009 Felice.Rosso@cnaf.infn.it 1 In 2001 the project of the Italian Tier1 in Bologna at CNAF was born. First computers were based on Intel Pentium III
THE RESEARCH INFRASTRUCTURES IN FP7
29 October 2004 Working Document on THE RESEARCH INFRASTRUCTURES IN FP7 Introduction In the Commission s communication on the financial perspectives of the European Union for the period 2007-2013 1, the
The Hartree Centre helps businesses unlock the potential of HPC
The Hartree Centre helps businesses unlock the potential of HPC Fostering collaboration and innovation across UK industry with help from IBM Overview The need The Hartree Centre needs leading-edge computing
Trials community. Yannick Legré. yannick.legre@egi.eu. www.egi.eu. EGI InSPIRE RI 261323
EGI InSPIRE InSPIRE EGI Federated cloud for the Clinical Trials community Yannick Legré yannick.legre@egi.eu ECRIN Workshop EGI European Grid Infrastructure Distributed, federated storage and compute facilities
Federated Identity & Access Mgmt for Higher Education
Federated Identity & Access Mgmt for Higher Education Dr. Erik Vullings Program Manager Macquarie University s s E-Learning E Centre of Excellence (MELCOE) Erik.Vullings@melcoe.mq.edu.au 1/23/2006 1 Backing
Computing Model for SuperBelle
Computing Model for SuperBelle Outline Scale and Motivation Definitions of Computing Model Interplay between Analysis Model and Computing Model Options for the Computing Model Strategy to choose the Model
Research Data Management Policy. Glasgow School of Art
Research Data Management Policy Glasgow School of Art Version 1.4 Last revision April 2013 Responsibility Research Information Manager Department Learning Resources Relevant legislation Data Protection
e-infrastucture services for R&E and beyond
e-infrastucture services for R&E and beyond Imre Szeberényi BME IK 1 Outline e-infrastructures in R&E Components and environment SOA and virtualization Traditional and federated services Beyond R&E Conclusions
Cloud Accounting. Laurence Field IT/SDC 22/05/2014
Cloud Accounting Laurence Field IT/SDC 22/05/2014 Helix Nebula Pathfinder project Development and exploitation Cloud Computing Infrastructure Divided into supply and demand Three flagship applications
Storage Techniques for RHIC Accelerator Data*
10th ICALEPCS Int. Conf. on Accelerator & Large Expt. Physics Control Systems. Geneva, 10-14 Oct 2005, PO1.074-7 (2005) Storage Techniques for RHIC Accelerator Data* J.T. Morris, S. Binello, T.S. Clifford,
Integrated Rule-based Data Management System for Genome Sequencing Data
Integrated Rule-based Data Management System for Genome Sequencing Data A Research Data Management (RDM) Green Shoots Pilots Project Report by Michael Mueller, Simon Burbidge, Steven Lawlor and Jorge Ferrer
Oxford Digital Asset Management System (DAMS) Update
Oxford Digital Asset Management System (DAMS) Update Neil Jefferies R&D Project Manager Systems & eresearch Services (SERS) Oxford University Library Services (OULS) Agenda Overview Fedora-Commons Honeycomb/ST5800
The APS and synchrotron facilities in the US and worldwide: a network perspective
The APS and synchrotron facilities in the US and worldwide: a network perspective J. Murray Gibson Director, Advanced Photon Source Associate Laboratory Director, ANL for Photon Sciences Presented at the
Luc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department
Luc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department What is cyberinfrastructure? Outline Examples of cyberinfrastructure t Why is this relevant to Libraries?
IT-INFN-CNAF Status Update
IT-INFN-CNAF Status Update LHC-OPN Meeting INFN CNAF, 10-11 December 2009 Stefano Zani 10/11/2009 Stefano Zani INFN CNAF (TIER1 Staff) 1 INFN CNAF CNAF is the main computing facility of the INFN Core business:
Scalable Services for Digital Preservation
Scalable Services for Digital Preservation A Perspective on Cloud Computing Rainer Schmidt, Christian Sadilek, and Ross King Digital Preservation (DP) Providing long-term access to growing collections
Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk
Grids, e-business and e-utilities Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk The Grid as an Enabler for Virtual Organisations Ian Foster, Carl Kesselman and
Working with the British Library and DataCite Institutional Case Studies
Working with the British Library and DataCite Institutional Case Studies Contents The Archaeology Data Service Working with the British Library and DataCite: Institutional Case Studies The following case
Using S3 cloud storage with ROOT and CernVMFS. Maria Arsuaga-Rios Seppo Heikkila Dirk Duellmann Rene Meusel Jakob Blomer Ben Couturier
Using S3 cloud storage with ROOT and CernVMFS Maria Arsuaga-Rios Seppo Heikkila Dirk Duellmann Rene Meusel Jakob Blomer Ben Couturier INDEX Huawei cloud storages at CERN Old vs. new Huawei UDS comparative
Migrating NASA Archives to Disk: Challenges and Opportunities. NASA Langley Research Center Chris Harris June 2, 2015
Migrating NASA Archives to Disk: Challenges and Opportunities NASA Langley Research Center Chris Harris June 2, 2015 MSST 2015 Topics ASDC Who we are? What we do? Evolution of storage technologies Why
How To Understand The Strategic Importance Of Archive Solutions
Archive Solutions Strategy Brought to you by Sun and HMK Joel Kimball VP WW Archive Solutions Sales 11 Agenda Archive facts & figures Strategic importance of archive A solutions approach Customer success
The data landscape lessons from UK
The data landscape lessons from UK Veerle Van den Eynden UK Data Archive University of Essex Faculty of Psychology and Educational Sciences University of Ghent, Belgium 23 October 2014 UK data landscape
Open access to data and analysis tools from the CMS experiment at the LHC
Open access to data and analysis tools from the CMS experiment at the LHC Thomas McCauley (for the CMS Collaboration and QuarkNet) University of Notre Dame, USA thomas.mccauley@cern.ch! 5 Feb 2015 Outline
Research Data Understanding your choice for data placement
Research Data Understanding your choice for data placement V1.4 Draft Aslam Ghumra 30 October 2014 Executive Summary This document is an overview of the technical infrastructure and supporting processes
DataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure. Arcot (RAJA) Rajasekar DICE/SDSC/UCSD
DataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure Arcot (RAJA) Rajasekar DICE/SDSC/UCSD What is SRB? First Generation Data Grid middleware developed at the San Diego Supercomputer Center
Storage Considerations for Database Archiving. Julie Lockner, Vice President Solix Technologies, Inc.
Storage Considerations for Database Archiving Julie Lockner, Vice President Solix Technologies, Inc. SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies
ATLAS Cloud Computing and Computational Science Center at Fresno State
ATLAS Cloud Computing and Computational Science Center at Fresno State Cui Lin and (CS/Physics Departments, Fresno State) 2/24/2012 at CSU Chancellor s Office LHC ATLAS Tier 3 at CSUF Tier 1 France ~PByte/sec