Smart Storage and Preservation: How Digital Repositories Can Participate

Transcription

1 Smart Storage and Preservation: How Digital Repositories Can Participate Sally Rumsey: University of Oxford Steve Hitchcock: University of Southampton Neil Jefferies: University of Oxford Adrian Brown: The National Archives DLF Forum: November 2008

2 Jeffrey Keefer CC licence: Attribution-Non-Commercial-Share Alike 2.0 Generic

3

4 Crystal ball by Hamachi! CC license. Attribution-Non-Commercial-No Derivative Works 2.0 Generic Available at

5

6

7

8

9

10

11 TNA s Seamless flow approach to preservation 1 Format identification and characterisation 2 Preservation planning and technology watch 3 Preservation Action

12 Reliable Resilient Long Term Storage Large scale Simple & Expandable Open Thanks to Dave Tarrant Southampton University

13 Address object Repository layer Built-in preservation support Open Storage 1 Open Storage 2 Open Storage n Address object Digital object Digital object Digital object Digital object Digital object

14 Smart storage combines an underlying standard storage approach with intelligence provided through services

15 Smart storage for preservation in action: Format identification and characterisation using DROID-PRONOM Locate new object for classificaton Preserv2 Wrapper Communication Service: DROID File format & version identification Reports PRONOM File registry Format risk Preserv2 Plug-in Open storage Repository Fedora/ePrints Imports DROID classification into metadata OAI-PMH Web Server (open or restricted) Outputs/results (XML docs) DROID

16 Calendar Service eg ical/outlook Managing; notification Schedules events/monitors incoming info Action Eg planning Notifies Reports Darwin Calendar Server Set schedules Trigger events History/provenance Record of event & location of results posted in calendar Trigger invokes DROID action Preserv2 Wrapper Communication Service: DROID File format & version Reports identification PRONOM File registry Format risk Plug-in aware of event occurance Preserv2 Plug-in Open storage Imports DROID classification into metadata OAI-PMH Locate new object for classificaton Web Server (open or restricted) Outputs/results (XML docs) from calendar and DROID Action Eg migrate; no action Repository Fedora/ePrints Adding the scheduler

17 Continuum of provision of repository preservation services Preservation services all in-house Some preservation services supplied in-house, others outsourced Preservation services all provided by external suppliers

18

19 Interoperability in Action OAI-ORE EPrints & Fedora Which is which?

20 Preserv2 Project Structure Content Policy Services EPrints Fedora DSpace EPrints Fedora Local Disk Remote Server Cloud Service Honeycomb EPrints Fedora Repository Software Storage Controller Physical Storage TNA API - PRONOM File Format Identification Significant Properties Migration Tools (Performance Metrics) Scheduler (Oxford) Services & Invocation API Interoperability OAI-ORE Specification & Mapping Application Program Interface (API) + XML Relation Exclusivity (1 to 1, 1 to Many)

21 Three fundamental preservation actions on data Copy Monitor Move

22 Calendar Service eg ical/outlook Managing; notification Schedules events/monitors incoming info Action Eg planning Policy Notifies Reports Darwin Calendar Server Set schedules Trigger events History/provenance Record of event & location of results posted in calendar Trigger invokes DROID action Preserv2 Wrapper Communication Service: DROID File format & version identification PRONOM File registry Format risk Reports Plug-in aware of event occurance Preserv2 Plug-in Open storage Imports DROID classification into metadata OAI-PMH Locate new object for classificaton Web Server (open or restricted) Outputs/results (XML docs) from calendar and DROID Action Eg migrate; no action Policy Repository Fedora/ePrints Policy-driven actions

23

24 PRESERV website Sally Rumsey PRESERV Project Manager: Steve Hitchcock Bigger plan needed