Smart Storage and Preservation: How Digital Repositories Can Participate Sally Rumsey: University of Oxford Steve Hitchcock: University of Southampton Neil Jefferies: University of Oxford Adrian Brown: The National Archives DLF Forum: November 2008
Jeffrey Keefer http://www.flickr.com/photos/jeffreykeefer/773540725/ CC licence: Attribution-Non-Commercial-Share Alike 2.0 Generic
Crystal ball by Hamachi! CC license. Attribution-Non-Commercial-No Derivative Works 2.0 Generic Available at http://www.flickr.com/photos/mawari/2091456761/
TNA s Seamless flow approach to preservation 1 Format identification and characterisation 2 Preservation planning and technology watch 3 Preservation Action
Reliable Resilient Long Term Storage Large scale Simple & Expandable Open Thanks to Dave Tarrant Southampton University
Address object Repository layer Built-in preservation support Open Storage 1 Open Storage 2 Open Storage n Address object Digital object Digital object Digital object Digital object Digital object
Smart storage combines an underlying standard storage approach with intelligence provided through services
Smart storage for preservation in action: Format identification and characterisation using DROID-PRONOM Locate new object for classificaton Preserv2 Wrapper Communication Service: DROID File format & version identification Reports PRONOM File registry Format risk Preserv2 Plug-in Open storage Repository Fedora/ePrints Imports DROID classification into metadata OAI-PMH Web Server (open or restricted) Outputs/results (XML docs) DROID
Calendar Service eg ical/outlook Managing; notification Schedules events/monitors incoming info Action Eg planning Notifies Reports Darwin Calendar Server Set schedules Trigger events History/provenance Record of event & location of results posted in calendar Trigger invokes DROID action Preserv2 Wrapper Communication Service: DROID File format & version Reports identification PRONOM File registry Format risk Plug-in aware of event occurance Preserv2 Plug-in Open storage Imports DROID classification into metadata OAI-PMH Locate new object for classificaton Web Server (open or restricted) Outputs/results (XML docs) from calendar and DROID Action Eg migrate; no action Repository Fedora/ePrints Adding the scheduler
Continuum of provision of repository preservation services Preservation services all in-house Some preservation services supplied in-house, others outsourced Preservation services all provided by external suppliers
Interoperability in Action OAI-ORE EPrints & Fedora Which is which?
Preserv2 Project Structure Content Policy Services EPrints Fedora DSpace EPrints Fedora Local Disk Remote Server Cloud Service Honeycomb EPrints Fedora Repository Software Storage Controller Physical Storage TNA API - PRONOM File Format Identification Significant Properties Migration Tools (Performance Metrics) Scheduler (Oxford) Services & Invocation API Interoperability OAI-ORE Specification & Mapping Application Program Interface (API) + XML Relation Exclusivity (1 to 1, 1 to Many)
Three fundamental preservation actions on data Copy Monitor Move
Calendar Service eg ical/outlook Managing; notification Schedules events/monitors incoming info Action Eg planning Policy Notifies Reports Darwin Calendar Server Set schedules Trigger events History/provenance Record of event & location of results posted in calendar Trigger invokes DROID action Preserv2 Wrapper Communication Service: DROID File format & version identification PRONOM File registry Format risk Reports Plug-in aware of event occurance Preserv2 Plug-in Open storage Imports DROID classification into metadata OAI-PMH Locate new object for classificaton Web Server (open or restricted) Outputs/results (XML docs) from calendar and DROID Action Eg migrate; no action Policy Repository Fedora/ePrints Policy-driven actions
PRESERV website http://preserv.eprints.org/ Sally Rumsey sally.rumsey@ouls.ox.ac.uk PRESERV Project Manager: Steve Hitchcock sh94r@ecs.soton.ac.uk Bigger plan needed