Data grid storage for digital libraries and archives using irods
|
|
- Frederica Day
- 8 years ago
- Views:
Transcription
1 Data grid storage for digital libraries and archives using irods Mark Hedges, Centre for e-research, King s College London eresearch Australasia, Melbourne, 30 th Sept Background: Project History Data grid project at AHDS and STFC ended at demise of AHDS Used SRB (Storage Resource Broker) AHDS Executive -> Centre for e- Research at King s College London Centre incorporates staff and expertise of AHDS and other groups Continuity, but some change of focus New data grid project (using irods) 1
2 Background: Data Challenge History Ongoing growth of corpora due to major digitisation projects Highly diverse in type and Visual size: Arts images, text, music, video, database, Performing multi-media Arts Archaeology Require specialised knowledge Literature/Linguistics Highly complex, contextual, fuzzy, uncertain, inconsistent, incomplete Rapid expansion: AHDS data size increased 20-fold between 2005 & 2008 Increasing number of large objects (e.g. video, archaeology scans) Data Grids Storage Resource Broker (SRB), a widely-used data grid technology developed by the San Diego Super Computer Center Addresses storage issues for digital repository and preservation environments Provides uniform, searchable access to virtualised, distributed resources, so DL is insulated from: physical location of data types of storage migrating to new hardware Scalable as library grows, new resources can be added dynamically Auditing facilities 2
3 SRB Storage client application (e.g. digital repository) SRB storage datastream1 object1 client request client response datastream2 datastream3 disseminator disseminator impl (web service) get Entire object retrieved object2 object3 object1 object2 distributed / virtualised Issues Not open source Very effective for storage management, but not integrated with wider infrastructure. Not easy to integrate application-specific requirements (either change the core code, or implement in client, or use proxy commands) some examples in later slides. No built-in implementation of workflow (have to script this outside SRB, whether server or client side), or of asynchronous processing. Requires choreography between SRB admin and person running workflow. Relatively restricted support for metadata extension 3
4 irods The open source successor to SRB Provides similar data virtualisation Rule-Oriented Data management System Rule Engine allows data management policies to defined and realised as rules Rules are sets of operations that you want to impose on an object (e.g. file, user, resource, ). Rules allow virtualisation of policies the digital library is insulated from how these policies are implemented. What are rules? Rules built up cumulatively from atomic operations called micro-services Micro-services and rules can be added and modified to meet local needs Triggered by certain events: Eventcondition-action model Great potential to hide processing from application layer Create server-side workflows 4
5 Definition of rules The components of a rule definition are as follows: actiondef condition workflowchain recoverychain Where: actiondef identifies the action to be carried out condition is necessary condition for execution workflowchain is sequence of actions to be executed recoverychain is corresponding sequence of recovery actions (to ensure consistent state). Rule can be built up cumulatively from other rules. Data passed into/within rules (via parameters/context). Examples of rule use Some examples of using rules: Digital preservation Processing digital material on ingest Fedora disseminators -> rules/microservices Shibboleth integration Integration with provenance systems 5
6 Example: digital preservation Execution triggered when an object has been ingested acpostprocforput accheckobjectintegrity## acanalyseobject## acnormaliseobject## msisysrepldataobj(presrescgrp,all) nop##nop##nop##msicleanupreplicas Example Rule processing text objects on ingest Processing depends on type of object. acpostprocforput $format == "application/msword" && $objectcategory= textcategoryx" acvalidateobjfortextprocessingx## acexecutetextprocessingx## acvalidatetextprocessingx nop##msicleanuptextprocx## nop 6
7 Example: data-side processing Fedora retrieves entire objects for processing Inefficient, and not always necessary Implement processing close to the data Fedora disseminators -> irods rules Client-side workflows -> irods rules irods Storage & Rules Client application (e.g. digital repository) irods storage layer + rule execution datastream1 object1 client request client response datastream2 datastream3 disseminator iget / irule rule triggers executes object2 object3 Rule Engine distributed / virtualised rule definition processing impl 7
8 irods Access Management: Shibboleth Apache access request PIP irods+re Capture & store attributes mod_ shib admin attributes Rule response PDP -service -service -service PEP client Client stores data in irods Provenance & irods Rule causes microservice to access external system External Provenance System IRODS + icat + RE Update icat file metadata IRODS + RE Update icat file metadata IRODS System IRODS +RE Rule engine runs, manipulations recorded Internal Provenance System 8
9 More prototyping Next steps Developing more comprehensive set of rules for curation and preservation Finish Shibboleth & provenance integration Dynamic deployment of rules Prototypes -> production Acknowledgements Thanks for contributions from: Tobias Blanke, King s College London Adil Hasan, University of Liverpool Jens Jensen, Science & Technology Facilities Council Andrea Weise, Science & Technology Facilities Council Also, thanks to the JISC which funded part of the work. 9
10 Contacts mark.hedges at kcl.ac.uk 10
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS)
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS) Todd BenDor Associate Professor Dept. of City and Regional Planning UNC-Chapel Hill bendor@unc.edu http://irods.org/ SESYNC Model Integration Workshop Important
More informationShibbolized irods (and why it matters)
Shibbolized irods (and why it matters) 3 rd TERENA Storage Meeting, Dublin, February 12 th -13 th 2009 David Corney, for Jens Jensen, e-science centre, Rutherford Appleton Lab, UK Overview Introduction
More informationirods and Metadata survey Version 0.1 Date March Abhijeet Kodgire akodgire@indiana.edu 25th
irods and Metadata survey Version 0.1 Date 25th March Purpose Survey of Status Complete Author Abhijeet Kodgire akodgire@indiana.edu Table of Contents 1 Abstract... 3 2 Categories and Subject Descriptors...
More informationPolicy Policy--driven Distributed driven Distributed Data Management (irods) Richard M arciano Marciano marciano@un marciano @un.
Policy-driven Distributed Data Management (irods) Richard Marciano marciano@unc.edu Professor @ SILS / Chief Scientist for Persistent Archives and Digital Preservation @ RENCI Director of the Sustainable
More informationConceptualizing Policy-Driven Repository Interoperability (PoDRI) Using irods and Fedora
Conceptualizing Policy-Driven Repository Interoperability (PoDRI) Using irods and Fedora David Pcolar Carolina Digital Repository (CDR) david_pcolar@unc.edu Alexandra Chassanoff School of Information &
More informationDataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure. Arcot (RAJA) Rajasekar DICE/SDSC/UCSD
DataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure Arcot (RAJA) Rajasekar DICE/SDSC/UCSD What is SRB? First Generation Data Grid middleware developed at the San Diego Supercomputer Center
More informationirods Overview Intro to Data Grids and Policy-Driven Data Management!!Leesa Brieger, RENCI! Reagan Moore, DICE & RENCI!
irods Overview Intro to Data Grids and Policy-Driven Data Management!!Leesa Brieger, RENCI! Reagan Moore, DICE & RENCI! Renaissance Computing Institute (RENCI) A research unit of UNC Chapel Hill Current
More informationIntegrated Rule-based Data Management System for Genome Sequencing Data
Integrated Rule-based Data Management System for Genome Sequencing Data A Research Data Management (RDM) Green Shoots Pilots Project Report by Michael Mueller, Simon Burbidge, Steven Lawlor and Jorge Ferrer
More informationOxford Digital Asset Management System (DAMS) Update
Oxford Digital Asset Management System (DAMS) Update Neil Jefferies R&D Project Manager Systems & eresearch Services (SERS) Oxford University Library Services (OULS) Agenda Overview Fedora-Commons Honeycomb/ST5800
More informationPreservation in the Cloud: Three Ways. Michele Kimpton CEO, DuraSpace Richard Rodgers, Mark Leggo>, & Simon Waddington
Preservation in the Cloud: Three Ways Michele Kimpton CEO, DuraSpace Richard Rodgers, Mark Leggo>, & Simon Waddington Open Repositories 2012 Edinburgh, Scotland July 12, 2012 What is DuraCloud? Open technology
More informationTechnical. Overview. ~ a ~ irods version 4.x
Technical Overview ~ a ~ irods version 4.x The integrated Ru e-oriented DATA System irods is open-source, data management software that lets users: access, manage, and share data across any type or number
More informationDigital Preservation Lifecycle Management
Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar San Diego Supercomputer Center, University of California,
More informationAutomated and Scalable Data Management System for Genome Sequencing Data
Automated and Scalable Data Management System for Genome Sequencing Data Michael Mueller NIHR Imperial BRC Informatics Facility Faculty of Medicine Hammersmith Hospital Campus Continuously falling costs
More informationintegrated Rule-Oriented Data System Reference
i integrated Rule-Oriented Data System Reference Arcot Rajasekar 1 Michael Wan 2 Reagan Moore 1 Wayne Schroeder 2 Sheau-Yen Chen 2 Lucas Gilbert 2 Chien-Yi Hou Richard Marciano 1 Paul Tooby 2 Antoine de
More informationirods Policy-Driven Data Preservation Integrating Cloud Storage and Institutional Repositories
irods Policy-Driven Data Preservation Integrating Cloud Storage and Institutional Repositories Reagan W. Moore Arcot Rajasekar Mike Wan {moore,sekar,mwan}@diceresearch.org h;p://irods.diceresearch.org
More informationLuc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department
Luc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department What is cyberinfrastructure? Outline Examples of cyberinfrastructure t Why is this relevant to Libraries?
More informationData Management in an International Data Grid Project. Timur Chabuk 04/09/2007
Data Management in an International Data Grid Project Timur Chabuk 04/09/2007 Intro LHC opened in 2005 several Petabytes of data per year data created at CERN distributed to Regional Centers all over the
More informationAssessment of RLG Trusted Digital Repository Requirements
Assessment of RLG Trusted Digital Repository Requirements Reagan W. Moore San Diego Supercomputer Center 9500 Gilman Drive La Jolla, CA 92093-0505 01 858 534 5073 moore@sdsc.edu ABSTRACT The RLG/NARA trusted
More informationDA-NRW: a distributed architecture for long-term preservation
DA-NRW: a distributed architecture for long-term preservation Manfred Thaller manfred.thaller@uni-koeln.de, Sebastian Cuy sebastian.cuy@uni-koeln.de, Jens Peters jens.peters@uni-koeln.de, Daniel de Oliveira
More informationAdding Robust Digital Asset Management to Oracle s Storage Archive Manager (SAM)
Adding Robust Digital Asset Management to Oracle s Storage Archive Manager (SAM) Oracle's Sun Storage Archive Manager (SAM) self-protecting file system software reduces operating costs by providing data
More informationColumbia University Libraries / Information Services
Stephen Davis, October 28, 2010 Columbia University Libraries / Information Services Digital Asset Management Digital Preservation Digital Publishing Introductions Stephen Paul Davis Director, Libraries
More informationBuilding Semantic Content Management Framework
Building Semantic Content Management Framework Eric Yen Computing Centre, Academia Sinica Outline What is CMS Related Work CMS Evaluation, Selection, and Metrics CMS Applications in Academia Sinica Concluding
More informationPoS(ISGC 2013)021. SCALA: A Framework for Graphical Operations for irods. Wataru Takase KEK E-mail: wataru.takase@kek.jp
SCALA: A Framework for Graphical Operations for irods KEK E-mail: wataru.takase@kek.jp Adil Hasan University of Liverpool E-mail: adilhasan2@gmail.com Yoshimi Iida KEK E-mail: yoshimi.iida@kek.jp Francesca
More informationirods Overview Introduction to Data Grids, Policy-Driven Data Management, and Enterprise irods
irods Overview Introduction to Data Grids, Policy-Driven Data Management, and Enterprise irods Renaissance Computing Institute (RENCI) A research unit of UNC Chapel Hill Directed by Stan Ahalt, formerly
More informationDigital Assets Repository 3.0. PASIG User Group Conference Noha Adly Bibliotheca Alexandrina
Digital Assets Repository 3.0 PASIG User Group Conference Noha Adly Bibliotheca Alexandrina DAR 3.0 DAR manages the full lifecycle of a digital asset: its creation, ingestion, metadata management, storage,
More informationResearch Data Management Policy. Glasgow School of Art
Research Data Management Policy Glasgow School of Art Version 1.4 Last revision April 2013 Responsibility Research Information Manager Department Learning Resources Relevant legislation Data Protection
More informationConsiderations for Research Data Management
Considerations for Research Data Management Andrew Dean - OCF adean@ocf.co.uk - 07508 033894 Wednesday 3 rd December 2014 What is an RDM solution? Research Data Management A method of effectively managing
More informationAbstract. 1. Introduction. irods White Paper 1
irods: integrated Rule Oriented Data System White Paper Data Intensive Cyber Environments Group University of North Carolina at Chapel Hill University of California at San Diego September 2008 Abstract
More informationData Grid Landscape And Searching
Or What is SRB Matrix? Data Grid Automation Arun Jagatheesan et al., University of California, San Diego VLDB Workshop on Data Management in Grids Trondheim, Norway, 2-3 September 2005 SDSC Storage Resource
More informationFederated Identity & Access Mgmt for Higher Education
Federated Identity & Access Mgmt for Higher Education Dr. Erik Vullings Program Manager Macquarie University s s E-Learning E Centre of Excellence (MELCOE) Erik.Vullings@melcoe.mq.edu.au 1/23/2006 1 Backing
More information<Insert Picture Here> Solution Direction for Long-Term Archive
1 Solution Direction for Long-Term Archive Donna Harland Oracle Optimized Solutions: Solutions Architect Program Agenda Archive Layers SAM QFS connectivity for
More informationThe RECOVER Cloud-Based Data Server
2013 Intermountain GIS Conference - Boise, ID - March 11-13, 2013 The RECOVER Cloud-Based Data Server John Schnase, Roger Gill, Mark Carroll, Akiko Elders, and Molly Brown Keith Weber, George Haskett,
More informationPASIG May 12, 2012. Jacob Farmer, CTO Cambridge Computer
Adding Intelligence to Conventional NAS and File Systems: Metadata, Backups, and Data Life Cycle Management PASIG May 12, 2012 Presented by: Jacob Farmer, CTO Cambridge Computer Copyright 2009-2011, Cambridge
More informationThe Australian War Memorial s Digital Asset Management System
The Australian War Memorial s Digital Asset Management System Abstract The Memorial is currently developing an Enterprise Content Management System (ECM) of which a Digital Asset Management System (DAMS)
More informationOSG PUBLIC STORAGE. Tanya Levshina
PUBLIC STORAGE Tanya Levshina Motivations for Public Storage 2 data to use sites more easily LHC VOs have solved this problem (FTS, Phedex, LFC) Smaller VOs are still struggling with large data in a distributed
More informationDigital libraries of the future and the role of libraries
Digital libraries of the future and the role of libraries Donatella Castelli ISTI-CNR, Pisa, Italy Abstract Purpose: To introduce the digital libraries of the future, their enabling technologies and their
More informationMATRIX and H-Net Backup and Archival Storage: Practices and Suggested Improvements. Preservation of the H-Net E-Mail Lists Supplemental Report
MATRIX and H-Net Backup and Archival Storage: Practices and Suggested Improvements Preservation of the H-Net E-Mail Lists Supplemental Report Lisa M. Schmidt MATRIX: Center for Humane Arts, Letters and
More informationTHE BRITISH LIBRARY. Unlocking The Value. The British Library s Collection Metadata Strategy 2015-2018. Page 1 of 8
THE BRITISH LIBRARY Unlocking The Value The British Library s Collection Metadata Strategy 2015-2018 Page 1 of 8 Summary Our vision is that by 2020 the Library s collection metadata assets will be comprehensive,
More informationNick Gold Director of Business Development Chesapeake Systems. www.chesa.com itunes: The Workflow Show
Nick Gold Director of Business Development Chesapeake Systems www.chesa.com itunes: The Workflow Show MAM 101 A Primer on Media Asset Management What is MAM? Let s talk terminology: MAM - Media Asset
More informationThe cross-disciplinary Roots of the British collaboration between scholars in humanities and
HALOGEN RESEARCH DATA MANAGEMENT BENEFITS CASE STUDY 1. BACKGROUND The cross-disciplinary Roots of the British collaboration between scholars in humanities and genetics at the University of Leicester (Wellcome
More informationirods at CC-IN2P3: managing petabytes of data
Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules irods at CC-IN2P3: managing petabytes of data Jean-Yves Nief Pascal Calvat Yonny Cardenas Quentin Le Boulc h
More informationLong-term archiving and preservation planning
Long-term archiving and preservation planning Workflow in digital preservation Hilde van Wijngaarden Head, Digital Preservation Department National Library of the Netherlands The Challenge: Long-term Preservation
More informationColumbia University Digital Library Architecture. Robert Cartolano, Director Library Information Technology Office October, 2009
Columbia University Digital Library Architecture Robert Cartolano, Director Library Information Technology Office October, 2009 Agenda Technology Architecture Off-site NYSERNet Facility Ingest, curation
More informationCambridge University Library. Working together: a strategic framework 2010 2013
1 Cambridge University Library Working together: a strategic framework 2010 2013 2 W o r k i n g to g e t h e r : a s t r at e g i c f r a m e w o r k 2010 2013 Vision Cambridge University Library will
More informationSecond EUDAT Conference, October 2013 Data Management Plans and Certification Motivation: increasing importance of Data Management Planning
Second EUDAT Conference, October 2013 Data Management Plans and Certification Motivation: increasing importance of Data Management Planning Simon Lambert Scientific Computing Department STFC Rutherford
More informationHow To Use Open Source Software For Library Work
USE OF OPEN SOURCE SOFTWARE AT THE NATIONAL LIBRARY OF AUSTRALIA Reports on Special Subjects ABSTRACT The National Library of Australia has been a long-term user of open source software to support generic
More informationAppendix A. Functional Requirements: Document Management
Appendix A. Functional Requirements: Document Management Document Management technology helps organizations better manage the creation, revision, and approval of electronic documents. It provides key features
More informationWorkforce Demand and Career Opportunities in University and Research Libraries
Workforce Demand and Career Opportunities in University and Research Libraries NAS Symposium on Digital Curation Anne R. Kenney July 19, 2012 WHAT I LL COVER Work in the research library community Requisite
More informationHow to avoid building a data swamp
How to avoid building a data swamp Case studies in Hadoop data management and governance Mark Donsky, Product Management, Cloudera Naren Korenu, Engineering, Cloudera 1 Abstract DELETE How can you make
More informationData Management using irods
Data Management using irods Fundamentals of Data Management September 2014 Albert Heyrovsky Applications Developer, EPCC a.heyrovsky@epcc.ed.ac.uk 2 Course outline Why talk about irods? What is irods?
More informationImplementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context
Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager paul.bevan@llgc.org.uk Structure! Background and overview! OAIS Model! Why
More informationThe ADS and SWORD-ARM: Deposit charges, costing tools and e-repository sustainability
The ADS and SWORD-ARM: Deposit charges, costing tools and e-repository sustainability Julian Richards, Catherine Hardman, Michael Charno, Ray Moore, & Lei Zia - Archaeology Data Service 25 th October 2012
More informationDirection des Technologies de l Information
Content Strategy Vision, Approach & Roadmap As at 14/09/09 Direction des Technologies de l Information 1 Overview In May 2009, Albistur Consulting was engaged to provide services to assist in the creation
More informationWHY DIGITAL ASSET MANAGEMENT? WHY ISLANDORA?
WHY DIGITAL ASSET MANAGEMENT? WHY ISLANDORA? Digital asset management gives you full access to and control of to the true value hidden within your data: Stories. Digital asset management allows you to
More informationArchiving, Indexing and Accessing Web Materials: Solutions for large amounts of data
Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data David Minor 1, Reagan Moore 2, Bing Zhu, Charles Cowart 4 1. (88)4-104 minor@sdsc.edu San Diego Supercomputer Center
More informationFilestor Digital Asset Management. The way it works
Filestor Digital Asset Management The way it works Filestor is an Advanced Digital Asset Management System Filestor is far more than a Digital Asset Management System as it has been designed to be flexible
More informationLet s Talk Digital An Approach to Managing, Storing, and Preserving Time-Based Media Art Works. DAMS Branch Manager Smithsonian Institution, OCIO
Let s Talk Digital An Approach to Managing, Storing, and Preserving Time-Based Media Art Works DAMS Branch Manager Smithsonian Institution, OCIO 1 Love and Marriage Digital Asset Management?? Digital Diamonds
More informationResponse to Invitation to Tender: requirements and feasibility study on preservation of e-prints
Response to Invitation to Tender: requirements and feasibility study on preservation of e-prints A proposal to the JISC from the Arts and Humanities Data Service and the University of Nottingham, Project
More informationProviding an Effective Intranet Knowledge Base Using Linux and Open Source Software
Providing an Effective Intranet Knowledge Base Using Linux and Open Source Software Presenters https://www.kbcasestudy.info Clay Wells :: Systems Programmer Sr., University of Pennsylvania Lance Barbour
More informationTools and Services for the Long Term Preservation and Access of Digital Archives
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer Studies Department of Electrical and Computer
More informationNorth Carolina Digital Preservation Policy. April 2014
North Carolina Digital Preservation Policy April 2014 North Carolina Digital Preservation Policy Page 1 Executive Summary The North Carolina Digital Preservation Policy (Policy) governs the operation,
More informationDA-NRW: A distributed architecture for longterm preservation
DA-NRW: A distributed architecture for longterm preservation Manfred Thaller, Sebastian Cuy, Jens Peters, Daniel de Oliveira, Martin Fischer Universität zu Köln International Workshop on Semantic Digital
More informationLaserfiche. and SharePoint Integration. Your potential, realized. Learn More Inside. Include imaged documents in collaborative processes.
Laserfiche and SharePoint Integration Your potential, realized. With the Laserfiche and SharePoint Integration components included with Laserfiche Web Access, Laserfiche s industry-leading document imaging
More information120 60 Students must take and pass120 credits of taught modules 4. Exit awards. ECTS equivalent
PROGRAMME APPROVAL FORM SECTION 1 THE PROGRAMME SPECIFICATION 1. Programme title and designation Digital Asset Management For undergraduate programmes only Single honours Joint Major/minor 2. Final award
More informationEntitlements Access Management for Software Developers
Entitlements Access Management for Software Developers Market Environment The use of fine grained entitlements and obligations control for access to sensitive information and services in software applications
More informationFedora Distributed data management (SI1)
Fedora Distributed data management (SI1) Mohamed Rafi DART UQ Outline of Work Package To enable Fedora to natively handle large datasets. Explore SRB integration at the storage level of the repository
More informationMercy Baggot Street Canopy Intranet
Mercy Baggot Street Canopy Intranet www.appnovation.com Mercy Baggot Street Canopy Intranet Contents 1.0 Background P. 3 2.0 Project Overview P. 4 3.0 Modules P. 7 4.0 Other Technologies P. 9 * This project
More informationDataShare & Data Audit. Lessons Learned. Robin Rice. Digital Curation Practice, Promise and Prospects
DataShare & Data Audit Framework 2007-09: 09: Lessons Learned Robin Rice University of Edinburgh, Scotland Digital Curation Practice, Promise and Prospects Chapel Hill, NC USA April 1-3 2009 A forum for
More informationnorthplains Whitepaper Differentiating DAM from ECM What Do You Really Need? Connecting your world. Visually.
Whitepaper Differentiating DAM from ECM What Do You Really Need? Both analysts and organizations can agree on one thing - the recent and unprecedented rise in demand for multi-media assets has driven the
More informationDigital Repository Initiative
Digital Repository Initiative 01 April 2014 Ray Frohlich Director, Enterprise Systems and Infrastructure with Euan Cochrane Digital Preservation Manager, Preservation Michael Friscia Manager of Digital
More informationPresentation Pathway. About Pacific Lutheran University. A Sense of Urgency. General Criteria & Goals. Environmental Scanning
1 Presentation Pathway : Enabling Access to Digital Archives Using Open Source Tools Layne Nordgren Director of Instructional Techlogies/Library Systems Jeffery D. Hauger Digital Media Developer Compelling
More informationArchiving Systems. Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie. uwe.borghoff@unibw.
Archiving Systems Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie uwe.borghoff@unibw.de Decision Process Reference Models Technologies Use Cases
More informationBRITISH LIBRARY BOARD. Tuesday, 9 February 2016. F.O.I. Publication Status: OPEN - to be released without redaction IT STRATEGY
BRITISH LIBRARY BOARD Tuesday, 9 February 2016 Paper No: BLB 16/07 F.O.I. Publication Status: OPEN - to be released without redaction IT STRATEGY PURPOSE OF THE PAPER This summary paper provides the Board
More informationA Service for Data-Intensive Computations on Virtual Clusters
A Service for Data-Intensive Computations on Virtual Clusters Executing Preservation Strategies at Scale Rainer Schmidt, Christian Sadilek, and Ross King rainer.schmidt@arcs.ac.at Planets Project Permanent
More informationTechnical concepts of kopal. Tobias Steinke, Deutsche Nationalbibliothek June 11, 2007, Berlin
Technical concepts of kopal Tobias Steinke, Deutsche Nationalbibliothek June 11, 2007, Berlin 1 Overview Project kopal Ideas Organisation Results Technical concepts DIAS kolibri Models of reusability 2
More informationSolution Brief: Archiving Avid Interplay Projects using NLT and XenData
Solution Brief: Archiving Avid Interplay Projects using NLT and XenData Contents 1. Introduction to the Open Interplay Archive 2. Solution Benefits 3. System Architecture 4. How to Archive and Restore
More informationManaging the Unmanageable: A Better Way to Manage Storage
Managing the Unmanageable: A Better Way to Manage Storage Storage growth is unending, but there is a way to meet the challenge, without worries about scalability or availability. October 2010 ISILON SYSTEMS
More informationJames Hardiman Library. Digital Scholarship Enablement Strategy
James Hardiman Library Digital Scholarship Enablement Strategy This document outlines the James Hardiman Library s strategy to enable digital scholarship at NUI Galway. The strategy envisages the development
More informationDeveloping JISC Open. Alan Robiette, JISC Development Group <a.robiette@jisc.ac.uk> Supporting education and research
Developing JISC Open Source Policy and Practice Alan Robiette, JISC Development Group Supporting education and research What are policies for? A policy is a high-level statement
More informationThe aim of this lecture is to: Sum up some main issues that you have heard today Explain the research into the digital preservation issues Present
The aim of this lecture is to: Sum up some main issues that you have heard today Explain the research into the digital preservation issues Present some ideas from one recent and one on- going research
More informationirods Technologies at UNC
irods Technologies at UNC E-iRODS: Enterprise irods at RENCI Presenter: Leesa Brieger leesa@renci.org SC12 irods Informational Reception 1! UNC Chapel Hill Investment in irods DICE and RENCI: research
More informationWOS for Research. ddn.com. DDN Whitepaper. Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved.
DDN Whitepaper WOS for Research Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved. irods and the DDN Web Object Scalar (WOS) Integration irods, an open source
More informationQuestionnaire for the Request for Assistance for an Application. Software
Questionnaire for the Request for Assistance for an Application Software vember 2008 The questionnaire aims to help OMSAR in evaluating the requirements of your request for software application in order
More informationweb archives & research collections
forging the future, preserving the past: web archives & research collections Geoff Harder, Archive-it Partner Meetings BPE 2012, The task is to extract information out of noisy data, Knox says. It is a
More informationChronopolis: A Partnership. The Chronopolis: Digital Preservation Archive Development and Demonstration Program
The Chronopolis: Digital Preservation Archive Development and Demonstration Program Robert H. McDonald Indiana University Ardys Kozbial UC San Diego Libraries David Minor San Diego Supercomputer Center
More informationHow To Build A Map Library On A Computer Or Computer (For A Museum)
Russ Hunt OCLC Tools Managing & Preserving Digitised Map Libraries Keywords: Digital collection management; digital collection access; digital preservation; long term preservation. Summary This paper explains
More informationThe Rutgers Workflow Management System. Workflow Management System Defined. The New Jersey Digital Highway
The Rutgers Workflow Management System Mary Beth Weber Cataloging and Metadata Services Rutgers University Libraries Presented at the 2007 LITA National Forum Denver, Colorado Workflow Management System
More informationFacing the Hydra alone
Facing the Hydra alone Three case studies Richard Green, University of Hull Chris Awre, University of Hull Simon Lamb, University of Hull Steven Ng, Temple University Adam Wead, Penn State University What
More informationArchiving A Dell Point of View
Archiving A Dell Point of View Dell Product Group 1 THIS POINT OF VIEW PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED
More informationA Selection of Questions from the. Stewardship of Digital Assets Workshop Questionnaire
A Selection of Questions from the Stewardship of Digital Assets Workshop Questionnaire SECTION A: Institution Information What year did your institution begin creating digital resources? What year did
More information- a Humanities Asset Management System. Georg Vogeler & Martina Semlak
- a Humanities Asset Management System Georg Vogeler & Martina Semlak Infrastructure to store and publish digital data from the humanities (e.g. digital scholarly editions): Technically: FEDORA repository
More informationManaging Physical and Digital Assets for Unified Distribution Workflows
Managing Physical and Digital Assets for Unified Distribution Workflows Ron Peeters, Executive Vice President Xytech Systems Corporation rpeeters@xytechsystems.com Tuesday, February 11, 2008 Abstract Production
More informationAustralian Research Collaboration Service (ARCS) & Grid Activities in Australia
Australian Research Collaboration Service (ARCS) & Grid Activities in Australia Prof Anthony Williams Executive Director Supported by: ARCS Mission The ARCS Mission is to enable and enhance research through
More informationEMAIL ARCHIVING SERVICES SERVICE DEFINITION
Complete IT Support for Business Westgate IT Email Archiving Services: Service Definition Service Name Email Archiving Services Overview of Service Westgate IT s Email Archiving Services provide a reliable
More informatione-infrastucture services for R&E and beyond
e-infrastucture services for R&E and beyond Imre Szeberényi BME IK 1 Outline e-infrastructures in R&E Components and environment SOA and virtualization Traditional and federated services Beyond R&E Conclusions
More informationPlanning and Infrastructure for Analog to Digital Preservation Projects
Planning and Infrastructure for Analog to Digital Preservation Projects Linda Tadic Director of Operations ARTstor lt@artstor.org Why digitize? To preserve and provide access to content : Content that
More informationRunning Hydra in a small shop
Running Hydra in a small shop Three case studies Richard Green, University of Hull Adam Wead, Penn State University with help from Chris Awre, University of Hull Simon Lamb, University of Hull Steven Ng,
More informationOptimising Data Management: full listing of deliverables. College storage approach
Appendix 4: Optimising Data Management: full listing of deliverables Description Deliverables Notes Principles for data quality and re-use Identification of accountable person for key systems Establishment
More informationDigital Preservation. OAIS Reference Model
Digital Preservation OAIS Reference Model Stephan Strodl, Andreas Rauber Institut für Softwaretechnik und Interaktive Systeme TU Wien http://www.ifs.tuwien.ac.at/dp Aim OAIS model Understanding the functionality
More informationSecond EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data
Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data Simon Lambert Scientific Computing Department STFC UK Types of
More information