Preserving digital data - risk assessment and digital preservation strategies
|
|
|
- Cameron Gallagher
- 10 years ago
- Views:
Transcription
1 Preserving digital data - risk assessment and digital preservation strategies Martin Iordanidis, M.A. epublishing systems
2 Exponential growth of digital data
3 Exponential growth of digital data tenfold growth in 5 years*
4 Exponential growth of digital data tenfold growth in 5 years* *Gantz (2008) "The Diverse And Exploding Digital Universe"
5 ...such as digital library holdings
6 ...such as digital library holdings rapid growth of
7 ...such as digital library holdings rapid growth of scholarly publications
8 ...such as digital library holdings rapid growth of scholarly publications e-books / e-journals
9 ...such as digital library holdings rapid growth of scholarly publications e-books / e-journals output of digitization projects
10 ...such as digital library holdings rapid growth of scholarly publications e-books / e-journals output of digitization projects research data
11 ...such as digital library holdings rapid growth of scholarly publications e-books / e-journals output of digitization projects research data websites, databases, audiovisual data, blogs, (...)
12 ...such as digital library holdings rapid growth of scholarly publications e-books / e-journals output of digitization projects research data websites, databases, audiovisual data, blogs, (...) * EPrints.org (2010): "Registry of Open Access Repositories"
13 Presenting the problem
14 Presenting the problem digital data is extremely fragile example: bit rot
15 Presenting the problem digital data is extremely fragile example: bit rot
16 Presenting the problem digital data is extremely fragile example: bit rot
17 Presenting the problem digital data is extremely fragile example: bit rot
18 Presenting the problem digital data is extremely fragile example: bit rot
19 Presenting the problem digital data is extremely fragile example: bit rot
20 Presenting the problem digital data is extremely fragile example: bit rot
21 Presenting the problem digital data is extremely fragile example: bit rot
22 Presenting the problem digital data is extremely fragile example: short-lived storage media
23 Presenting the problem digital data is extremely fragile example: short-lived storage media
24 Storage at risk
25 Storage at risk Storage media do not last forever! Hard drive (in service): Hard drive (stock only): Flash memory: Magnetic tape: CDs/DVDs: 2-10 years years years > 30 years years* * Haltbarkeit_der_Tr.C3.A4germedien
26 Digital data - risk levels
27 Digital data - risk levels bit rot
28 Digital data - risk levels hardware failure bit rot
29 Digital data - risk levels obsolete formats hardware failure bit rot
30 Digital data - risk levels vulnerable infrastructure obsolete formats hardware failure bit rot
31 Digital data - risk levels lack of education vulnerable infrastructure obsolete formats hardware failure bit rot
32 Digital data - risk levels lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot
33 Digital data - risk levels legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot
34 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot
35 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot bitstream preservation
36 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot distributed storage bitstream preservation
37 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot format migration/emulation distributed storage bitstream preservation
38 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot redundant networks format migration/emulation distributed storage bitstream preservation
39 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot research and teaching redundant networks format migration/emulation distributed storage bitstream preservation
40 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot lobbying services and marketing research and teaching redundant networks format migration/emulation distributed storage bitstream preservation
41 Digital preservation strategies legal gaps lack of funding lack of education vulnerable infrastructure obsolete formats hardware failure bit rot legal mandates lobbying services and marketing research and teaching redundant networks format migration/emulation distributed storage bitstream preservation
42 Digital preservation strategies
43 Digital preservation strategies emphasis on research & development
44 Digital preservation strategies emphasis on research & development digital preservation strategy (2009)
45 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011)
46 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012)
47 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012) PDF-to-PDF/A migration service (2010)
48 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012) PDF-to-PDF/A migration service (2010) Website archiving solution edoweb (2003/2004)
49 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012) PDF-to-PDF/A migration service (2010) Website archiving solution edoweb (2003/2004) Technical metadata development
50 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012) PDF-to-PDF/A migration service (2010) Website archiving solution edoweb (2003/2004) Technical metadata development several national/international working groups
51 Digital preservation strategies emphasis on research & development digital preservation strategy (2009) LOCKSS networks = Lots Of Copies Keep Stuff Safe (2011) Digital Archive NRW (2012) PDF-to-PDF/A migration service (2010) Website archiving solution edoweb (2003/2004) Technical metadata development several national/international working groups (nestor, PLANETS, Digital Preservation Coalition,...)
52 Thank You : ) [email protected] Martin Iordanidis, M.A. epublishing systems
Why archiving erecords influences the creation of erecords. Martin Stürzlinger scopepartner Vienna, Austria
Why archiving erecords influences the creation of erecords Martin Stürzlinger scopepartner Vienna, Austria Electronic Records In a Productive System Created Used Changed Deleted In an Archival System No
Technical concepts of kopal. Tobias Steinke, Deutsche Nationalbibliothek June 11, 2007, Berlin
Technical concepts of kopal Tobias Steinke, Deutsche Nationalbibliothek June 11, 2007, Berlin 1 Overview Project kopal Ideas Organisation Results Technical concepts DIAS kolibri Models of reusability 2
PRESERVATION NEEDS ASSESSMENT PRESERVATION 101
Digital Assets If this section is not applicable to the collection(s) being surveyed, please note that here and move to the next section. Digital collections may include born-digital material and digital
Digital Preservation Strategy, 2012-2015
Digital Preservation Strategy, 2012-2015 Preface This digital preservation strategy sets out what the National Library of Wales (NLW) intends to do to preserve digital materials over the next three years.
An Overview of Content Archiving Services in Scholarly Publishing
By Daniela Bone and Peter Burns, Allen Press, Inc. An Overview of Content Archiving Services in Scholarly Publishing Digital versions of scholarly publications have become established as valued complements
A Selection of Questions from the. Stewardship of Digital Assets Workshop Questionnaire
A Selection of Questions from the Stewardship of Digital Assets Workshop Questionnaire SECTION A: Institution Information What year did your institution begin creating digital resources? What year did
Bradford Scholars Digital Preservation Policy
DIGITAL PRESERVATION The value of the research outputs produced by staff and research students at the University of Bradford cannot be over emphasised in demonstrating the scientific, societal and economic
Optical Storage The Future of Long Term Data Preservation
Optical Storage The Future of Long Term Data Preservation Doug Ferguson, Senior Solution Consultant Hitachi Data Systems Federal Corporation 1 Today s topics for discussion Digital Preservation Tier Archive
Long-term preservation activities of the Bavarian State Library
Long-term preservation activities of the Bavarian State Library Latest challenges and developments aêk=qüçã~ë=tçäñjhäçëíéêã~åå=== aáöáí~ä=iáäê~êó=aéé~êíãéåí g~åì~êó OSI=OMNM The Bavarian State Library
ejournal Archiving: Status and Trends Tyler O. Walters
ejournal Archiving: Status and Trends Tyler O. Walters Associate Director, Technology & Resource Services Georgia Tech Library & Information Center ER&L Feb. 22, 2007 Status of ejournal Management One
Digital preservation a European perspective
Digital preservation a European perspective Pat Manson Head of Unit European Commission DG Information Society and Media Cultural Heritage and Technology Enhanced Learning Outline The digital preservation
Chapter 434-662 WAC PRESERVATION OF ELECTRONIC PUBLIC RECORDS
Chapter 434-662 WAC PRESERVATION OF ELECTRONIC PUBLIC RECORDS WAC 434-662-010 Purpose. Pursuant to the provisions of chapters 40.14 and 42.56 RCW, and RCW 43.105.250, the rules contained in this chapter
STEPPING UP TO THE ELECTRONIC ARCHIVING CHALLENGE: OCLC S ROLE. Andrea Keyhani Director, Licensing & Publisher Relations
STEPPING UP TO THE ELECTRONIC ARCHIVING CHALLENGE: OCLC S ROLE Andrea Keyhani Director, Licensing & Publisher Relations OCLC.org Nonprofit, membership organization 36,000 libraries in 76 countries Mission:
The management of the collections is led by LAS staff and requires input from academic staff in order to be successful.
Library & Archives Service Collection Management Policy 1 Overview 1.1 Purpose of the policy This policy provides a framework for developing and managing the materials held by the Library & Archives Service
Evaluating File Formats for Long-term Preservation
Evaluating File Formats for Long-term Preservation Abstract Judith Rog, Caroline van Wijk National Library of the Netherlands; The Hague, The Netherlands [email protected], [email protected] National
Books Print journals CONTENT CREATOR (authors) PUBLISHERS STM Commercial DISTRIBUTION Physical STORAGE & ACCESS Libraries Secondary Info Providers Bookshops USER CONTENT CREATOR (authors) PUBLISHERS DISTRIBUTION
Local Loading. The OCUL, Scholars Portal, and Publisher Relationship
Local Loading Scholars)Portal)has)successfully)maintained)relationships)with)publishers)for)over)a)decade)and)continues) to)attract)new)publishers)that)recognize)both)the)competitive)advantage)of)perpetual)access)through)
Understanding Records Management in the Non-Profit World
Understanding Records Management in the Non-Profit World Susan Williams IS 564 Archives and Records Management Kris Bronstad November 27, 2011 Introduction Overview of Records Management Organizing a Records
Digital Preservation: the need for an open source digital archival and preservation system for small to medium sized collections,
Digital Preservation: the need for an open source digital archival and preservation system for small to medium sized collections, Kevin Bradley ABSTRACT: Though the solution to all of the problems of digital
Index. Registry Report
2013.1-12 Registry Report 01 02 03 06 19 21 22 23 24 25 26 27 28 29 31 34 35 Index Registry Report 02 Registry Report Registry Report 03 04 Registry Report Registry Report 05 06 Registry Report Registry
Larry Patterson, City Manager
Administrative Policy 2-13 August 20, 2008 DATA MIGRATION POLICY PURPOSE To preserve electronic data as required by Oregon Public Records and Archiving statutes. (ORS 192.050) APPLICABILITY This policy
A Service for Data-Intensive Computations on Virtual Clusters
A Service for Data-Intensive Computations on Virtual Clusters Executing Preservation Strategies at Scale Rainer Schmidt, Christian Sadilek, and Ross King [email protected] Planets Project Permanent
Response to Invitation to Tender: requirements and feasibility study on preservation of e-prints
Response to Invitation to Tender: requirements and feasibility study on preservation of e-prints A proposal to the JISC from the Arts and Humanities Data Service and the University of Nottingham, Project
Utrecht University Library as Open Access Publisher The Igitur experience. Saskia Franken, Utrecht University Library
Utrecht University Library as Open Access Publisher The Igitur experience Saskia Franken, Utrecht University Library Saskia Franken managing director Igitur, Utrecht Publishing & Archiving Services Contents
Digital Collecting Strategy
Digital Collecting Strategy 2014-15 and 2015-2016 Version: 1.0 Approved by: Executive Owner/sponsor: Director, Library Services Contact Officer: Manager, Collection Strategy and Development Date approved:
Questionnaire on Digital Preservation in Local Authority Archive Services
Questionnaire on Digital Preservation in Local Authority Archive Services A - Digital Preservation Planning 1. Would you describe your Archive Service as: Actively seeking digital material Reacting to
OVERVIEW OF NTU LIBRARIES 南 洋 理 工 大 学 图 书 馆 简 介
OVERVIEW OF NTU LIBRARIES 南 洋 理 工 大 学 图 书 馆 简 介 4 AREAS OF FOCUS 4 大 工 作 重 点 Supporting scholarly communication & research 为 教 学 科 研 提 供 文 献 信 息 保 障 Preparing students for the knowledge economy 协 助 学 生
eifl-ip Handbook on Copyright and Related Issues for Libraries LEGAL DEPOSIT
LEGAL DEPOSIT Legal deposit is a legal obligation that requires publishers to deposit a copy (or copies) of their publications within a specified period of time in a designated national institution. The
DSpace: An Institutional Repository from the MIT Libraries and Hewlett Packard Laboratories
DSpace: An Institutional Repository from the MIT Libraries and Hewlett Packard Laboratories MacKenzie Smith, Associate Director for Technology Massachusetts Institute of Technology Libraries, Cambridge,
Introduction. 1. Name of your organisation: 2. Country (of your organisation): Page 2
Introduction 1. Name of your organisation: 2. Country (of your organisation): 6 Page 2 Policies and Procedures The following questions address the policies and procedures regarding data management (acquisition,
DA-NRW: A distributed architecture for longterm preservation
DA-NRW: A distributed architecture for longterm preservation Manfred Thaller, Sebastian Cuy, Jens Peters, Daniel de Oliveira, Martin Fischer Universität zu Köln International Workshop on Semantic Digital
Archiving the Web: the mass preservation challenge
Archiving the Web: the mass preservation challenge Catherine Lupovici Chargée de Mission auprès du Directeur des Services et des Réseaux Bibliothèque nationale de France 1-, Koninklijke Bibliotheek, Den
Preservation Action: What, how and when? Hilde van Wijngaarden Head, Digital Preservation Department National Library of the Netherlands
: What, how and when? Hilde van Wijngaarden Head, Digital Preservation Department National Library of the Netherlands What is preservation action? Execution of a strategy to regain or improve access to
The challenges of digital preservation to support research in the digital age
DRAFT FOR DISCUSSION WITH ADVISORY COUNCIL MEMBERS ONLY The challenges of digital preservation to support research in the digital age Lynne Brindley CEO, The British Library November 2005 Agenda UK developments
British Library Digital Preservation Strategy 2013-2016
` British Library Digital Preservation Strategy 2013-2016 Contents Executive Summary... 3 1 Introduction... 5 2 Background... 5 3 Vision... 7 4 Purpose... 7 5 Strategic Fit... 7 6 Digital Preservation
[STORAGE SOLUTIONS: FILM INDUSTRY]
![[STORAGE SOLUTIONS: FILM INDUSTRY]](/thumbs/25/6357293.jpg "[STORAGE SOLUTIONS: FILM INDUSTRY]")
2012 Hie Electronics TeraStack Solution [STORAGE SOLUTIONS: FILM INDUSTRY] The film industry and video management companies across the country hold the art and culture of the nation. However, are they
Achieving a Step Change in Digital Preservation Capability
Essential Guide Achieving a Step Change in Digital Preservation Capability An assessment of Preservica using the Digital Preservation Capability Maturity Model (DPCMM) Executive Summary Nearly every organization
File Management : Guidelines & Policies
File Management : Guidelines & Policies Which files are considered records? Files created or received pursuant to the transaction of University business or in the fulfillment of its educational, administrative,
DIGITAL ARCHIVES & PRESERVATION SYSTEMS
DIGITAL ARCHIVES & PRESERVATION SYSTEMS Part 1 Overview (part 1 of 7) Kari R. Smith, MIT Institute Archives Session Overview Digital archives and digital preservation systems. These open source tools are
Vilas Wuwongse, Thiti Vacharasintopchai, Neelawat Intaraksa Asian Institute of Technology www.ait.asia
A Common Infrastructure for Digital Contents Vilas Wuwongse, Thiti Vacharasintopchai, Neelawat Intaraksa Asian Institute of Technology www.ait.asia Outline Introduction Issues Proposed Approach A Common
Digital Heritage Preservation - Economic Realities and Options
Digital Heritage Preservation - Economic Realities and Options Ronald Walker Executive Director, Canadiana.org Abstract The demand for digital heritage preservation is increasing, particularly in response
Fixity Checks: Checksums, Message Digests and Digital Signatures Audrey Novak, ILTS Digital Preservation Committee November 2006
Fixity Checks: Checksums, Message Digests and Digital Signatures Audrey Novak, ILTS Digital Preservation Committee November 2006 Introduction: Fixity, in preservation terms, means that the digital object
How To Useuk Data Service
Publishing and citing research data Research Data Management Support Services UK Data Service University of Essex April 2014 Overview While research data is often exchanged in informal ways with collaborators
SEVENTH FRAMEWORK PROGRAMME THEME ICT -1-4.1 Digital libraries and technology-enhanced learning
Briefing paper: Value of software agents in digital preservation Ver 1.0 Dissemination Level: Public Lead Editor: NAE 2010-08-10 Status: Draft SEVENTH FRAMEWORK PROGRAMME THEME ICT -1-4.1 Digital libraries
The Australian War Memorial s Digital Asset Management System
The Australian War Memorial s Digital Asset Management System Abstract The Memorial is currently developing an Enterprise Content Management System (ECM) of which a Digital Asset Management System (DAMS)
<Insert Picture Here> Solution Direction for Long-Term Archive
1 Solution Direction for Long-Term Archive Donna Harland Oracle Optimized Solutions: Solutions Architect Program Agenda Archive Layers SAM QFS connectivity for
Contact Information. 1. Institution Name. 2. City and State: 3. Prepared by (name): 4. Title: 5. Email address: Page 1
"Preservation Statistics: A Survey for U.S. Libraries is an effort coordinated by the Preservation and Reformatting Section (PARS) of the American Library Association (ALA) and the Association of Library
Long-term archiving and preservation planning
Long-term archiving and preservation planning Workflow in digital preservation Hilde van Wijngaarden Head, Digital Preservation Department National Library of the Netherlands The Challenge: Long-term Preservation
Digital Preservation. Guidance Note: Selecting Storage Media for Long-Term Preservation
Digital Preservation 2 Guidance Note: Selecting Storage Media for Long-Term Preservation Document Control Author: Adrian Brown, Head of Digital Preservation Research Document Reference: DPGN-02 Issue:
Digital Repository Initiative
Digital Repository Initiative 01 April 2014 Ray Frohlich Director, Enterprise Systems and Infrastructure with Euan Cochrane Digital Preservation Manager, Preservation Michael Friscia Manager of Digital
A DIGITAL PRESERVATION STRATEGY FOR PARLIAMENT
Parliamentary Archives Houses of Parliament London SW1A 0PW Telephone: +44(0) 20 7219 3074 Fax: +44(0) 20 7219 2570 E-mail: [email protected] Web: www.parliament.uk/archives Online catalogue: www.portcullis.parliament.uk
Data Management Plans & the DMPTool. IAP: January 26, 2016
Data Management Plans & the DMPTool IAP: January 26, 2016 Data Management Services @ MIT Libraries Workshops/Webinars Web guide: http://libraries.mit.edu/data-management Individual consultations includes
Cyber Security: Guidelines for Backing Up Information. A Non-Technical Guide
Cyber Security: Guidelines for Backing Up Information A Non-Technical Guide Essential for Executives, Business Managers Administrative & Operations Managers This appendix is a supplement to the Cyber Security:
College Archives Digital Preservation Policy. Created: October 2007 Last Updated: December 2012
College Archives Digital Preservation Policy Created: October 2007 Last Updated: December 2012 Introduction The Columbia College Chicago Archives Digital Preservation Policy establishes a framework to
Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS.
National Digital Stewardship Residency - Boston Project Summaries 2015-16 Residency Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS. Harvard Library s Digital
How To Use A Court Record Electronically In Idaho
Idaho Judicial Branch Scanning and Imaging Guidelines DRAFT - October 25, 2013 A. Introduction Many of Idaho s courts have considered or implemented the use of digital imaging systems to scan court documents
Research Data Management Guide
Research Data Management Guide Research Data Management at Imperial WHAT IS RESEARCH DATA MANAGEMENT (RDM)? Research data management is the planning, organisation and preservation of the evidence that
ARCHIVING YOUR DATA: PLANNING AND MANAGING THE PROCESS
ARCHIVING YOUR DATA: PLANNING AND MANAGING THE PROCESS LIBBY BISHOP. RESEARCHER LIAISON UNIVERSITY OF ESSEX TCRU/NOVELLA SPECIAL SEMINAR - LONDON 29 MAY 2012 THE & ESDS QUALIDATA forty years experience
Harnessing Media Micro-Services for Stewardship of Digital Assets at CUNY TV. NDSR Project:
NDSR Project: Harnessing Media Micro-Services for Stewardship of Digital Assets at CUNY TV Goal Summary This project is designed to assess the developing state of archival procedures of the CUNY TV Library,
Local Government Cyber Security:
Local Government Cyber Security: Guidelines for Backing Up Information A Non-Technical Guide Essential for Elected Officials Administrative Officials Business Managers Multi-State Information Sharing and
Queensland Government Digital Continuity Strategy
Queensland Government Digital Continuity Strategy Future proofing the critical digital records of government business September 2012 Queensland State Archives Department of Science, Information Technology,
Public Record Office Standard PROS 99/007. Public Record Office Victoria. Management of Electronic Records
Public Record Office Standard PROS 99/007 Public Record Office Victoria Management of Electronic Records Version 1.0 April 2000 PROS 99/007: Management of Electronic Records 1 Table of Contents 1.0 Introduction...
Data Warehouses in the Path from Databases to Archives
Data Warehouses in the Path from Databases to Archives Gabriel David FEUP / INESC-Porto This position paper describes a research idea submitted for funding at the Portuguese Research Agency. Introduction