SETTING UP A DATA SERVICE: AN OVERVIEW

Transcription

1 SETTING UP A DATA SERVICE: AN OVERVIEW.... MATTHEW WOOLLARD.. DIRECTOR UK DATA SERVICE UNIVERSITY OF ESSEX. MELANIE WRIGHT.... ASSOCIATE DIRECTOR UNIVERSITY OF ESSEX HOW TO SET UP A DATA SERVICE, 8-9 NOVEMBER 2012

2 WHO WE ARE Based at the University of Essex - established in 1968 as a Data Bank 45 years of selecting, ingesting, curating and providing access to social science data Data and data support services for higher and further education for research, teaching and learning Have been registered to ISO (information security standard) since June designated as Place of Deposit by The National Archives

3 HISTORY AND OVERVIEW funded by (then) SSRC to provide a service to UK HE sector initial focus on academic surveys then government survey data new distributed service established 1 January 2003 as the Economic and Social Data Service (ESDS) new five-year UK Data Service from 2012 UK Data Archive still a department of the University, as well as an umbrella organisation for the provision of integrated data services in the social sciences

4 , University of Essex The Archive

5 WEB PRESENCE

6 SISTER DATA ARCHIVES ICPSR (USA) Inter-University Consortium for Political and Social Research Council of European Social Science Data Archives (CESSDA ) ADA Australian Social Science Data Archive

7 FAMILY OF SERVICES UK Data Service UK Data Service ELSST UK Data Service Digital Futures Economic and Social Data Service (ESDS) Census Registration Service and Census Portal Secure Data Service Survey Question Bank As of 5 November staff work across these areas

8 PLUS R&D PROJECTS

9 WHERE DO OUR DATA COME FROM official agencies - mainly central government international statistical time series individual academics - research grants market research agencies public records/historical sources access to international data via links with other data archives worldwide 6,000 datasets in the collection 230 new datasets added each year over 25,000 registered users approximately 65,000 downloads worldwide p.a. 2,500+ user support queries

10 SPECIAL ATTRIBUTES short-term, unsustained funding currently until 2017 new, purpose-built building after 40 years income approx 3.6m p.a.

11 THE ARCHIVE S MISSION Promoting best practice in data curation Raise standards in data management Raise standards in data security Drive archival innovation Advance professionalization of data service infrastructures (leadership within the profession) Integrate these activities into the UK Data Service Attracting, developing and maintaining excellent staff

12 HOW TO RUN A DATA SERVICE Open Archival Information System (OAIS) Relationship of staff to OAIS function OAIS functional entities Trust Skills

13 OAIS FUNCTIONAL MODEL (ISO 14721)

14 ADAPTED: OAIS FUNCTIONAL MODEL Pre-Ingest Access (Data) (Support)

15 STAFFING currently 54 staff the majority supported by ESRC for UK Data Service main teams: Resources and Management Services Administration Management (and Management Information) Ingest and Access Services Ingest Access (registration, user accounts and user support and training) Technical Services Application Development and Maintenance Access (web) Digital Preservation and Security Data Management, Archival Storage and Preservation Planning, Access (secure) Collections Development and Producer Support Producer Support Access (producer and user support) and Pre-Ingest Collections Development Management Communications Administrative and Management

16 PRE-INGEST (aka ACQUISITIONS) selection process a clear statement of intent documentation (independently-understandable) legal issues rights, ethics, governance clearance legislation file formats for ingest processing and ultimate preservation metadata trust

17 INGEST processes for processing fit for purpose explicit (i.e., documented) public? / Open anonymisation / redaction (data subject rights) integrity documentation of changes authenticity metadata for access (resource discovery)

18 DATA MANAGEMENT / ARCHIVAL STORAGE documented processes and procedures for managing data storage appropriate attributes robust extensible secure well-managed fail-safe (risk management, backups, etc.)

19 PRESERVATION PLANNING mission statement written policy (revisions) holistic standards adherence informative conforming auditing and registration business continuity Records Management trustworthiness

20 ACCESS (AND AUTHENTICATION) preservation is ultimately about long-term access appropriate for audience (usability) must meet data creators / funders requirements licensing registration authentication maintaining underlying registration databases for reporting and management information often under-resourced user support

21 ADMINISTRATION (AND MANAGEMENT) Virtually everything else... Management Information Systems Records Management service level reporting (and servicing ) cross-sectional coordination impact measures Human Resources finance outreach, training, consultation, networks

22 NETWORK OF TRUST

23 SKILLS BASE Multiplicity of skills needed in Archive traditional archiving and librarianship skills data handling/manipulation immersion in research based on quantitative and qualitative data (i.e., be part of the designated user community.) metadata (controlled vocabularies, cataloguing standards) data management (not in the current sense, but IT/systems based) programming and real development legal, ethical, security, etc. governance background financial, funding experience service champions and best practice in digital preservation

24 PROFESSIONALISATION individuals resources issue networks of organisations (CESSDA, IASSIST) think of continuous development as well as training professional qualifications? Formal training / skills update / syllabus issues organisations standards adherence, etc. governance audit, assessment, certification

25 QUESTIONS