The challenge of managing research data. Axel Berg

Transcription

1 The challenge of managing research data Axel Berg

2 Context The data deluge cannot be stopped Without adequate data management: - the ever-growing amounts and complexity of data will be non-controllable and unusable - the value of research data will be limited to the its source - others will not profit from the value of research data

3 The world of research data is complex Many different users (well organised (international) user communities, research groups, universities, research institutes, individual researchers, etc.) Many different use cases (central data, distributed data, small files, large files, static data, dynamic data, etc.) Many different user requirements (storage, meta data, data searching, persistent identifiers, long-term preservation, privacy, visualisation, data analytics, data sharing, data re-use, semantic annotation, work flows etc. etc. etc. etc.) Many different V s of data (varieties, volumes, velocities, veracities, validities, volatilities) (Big Data)

4 Data Life Cycle by Research Data Alliance Research Data Alliance: Common Infrastructure, Policy and Practice Drives Data Sharing and Exchange throughout the Data Life Cycle RDA 4 th Plenary Amsterdam September 22-24, 2014 From Prof. Fran Berman and Prof. John Wood, Members of the RDA Council

5 Concept of Collaborative Data Infrastructure from Riding the Wave Data Generators Users Data Curation Trust Community Support Services Common Data Services

6

7 Consortium 7

8 Six research communities on Board EPOS: European Plate Observatory System CLARIN: Common Language Resources and Technology Infrastructure ENES: Service for Climate Modelling in Europe LifeWatch: Biodiversity Data and Observatories VPH: The Virtual Physiological Human INCF: International Neuroinformatics Coordinating Facility All share common challenges: - Reference models and architectures - Persistent data identifiers - Metadata management - Distributed data sources - Data interoperability 8

9 EUDAT Selected Services EUDAT Box Semantic Anno Generic Workflow Dynamic Data dropbox-like service easy sharing local synching checking, referencing and annotating automating data processing immediate handling 9 B2DROP B2NOTE

10 What is important for common data services: User communities must be in the driving seat to select high-priority services and their major functional characteristics. Close collaboration with senior technologists from different backgrounds is essential to guarantee the openness, technology independence and flexibility required. The establishment of trust is key for acceptance of data services and trust has many dimensions including irrational ones. Furthermore establishing trust require considerable time investment. Persistence of data and sustainability of the service framework are key aspects of trust establishment. Ref: A recipe for data: lessons from EUDAT

11 SURF strategic plan SURF role and mission SURF is the collaborative ICT organisation for Dutch higher education and research. SURF offers students, lecturers and scientists in the Netherlands access to the best possible internet and ICT facilities. New challenges, 5 themes Universities are not anymore in full control on ICT touches core processes of research and education Excellence in e-infrastructure the value of connecting Data explosion lack of knowledge how to take maximum advantage Closed community open environment Increasing dependency of ICT and so vulnerability is increasing too Pressure on funding value of collaboration

12 Value of Data Drill-Down Knowledge & Expertise Reliable and sustainable environment Education Research Knowlegde & Creation Connecting Data Data Life- Cycle & Ways of working Services e-infrastructure (XaaS) Value Added Services E-Infra Research & Education SURF facilities Storage network storage computing visualisation big data collaboration infrastructure Market

13 Data Life Cycle as point of reference Ref: UK Data Archive:

14 SURF ambition on data SURF facilitates the value creation of research- and education data by supporting the complete data life cycle and to offer a scalable and reliable data services environment Collaboration with DANS, 3TU.datacenter, research communities & -infra s, universities, etc

15 SURF Portfolio on Data Expertise - Data standards - Data management Services - One-Stop-Shop ( entry point for all questions ) - Community Cloud - Data storage and data repositories - National Datacenter - Visualisation - Big Data Analytics - HPC

16 Ambitions for an Innovation agenda SURF offers a data environment that optimally supports top research and education in the Netherlands SURF facilitates the development of Data-as-a- Service (cloud)services that support the complete data life cycle for all researchers (individual scientists, smaller and medium research groups, large research communities and research infrastructures) SURF supports the development of new business models for the exploitation of data

17 Who will pay for public access to research data? F Berman, and V Cerf Science 2013;341: : Who will pay for public access to research data? Published by AAAS

18 - Public access presupposes that the research data supported by public funding will be available when they are sought. - Such availability is dependent on the existence of effective data infrastructure, i.e. to access data they must be hosted somewhere, and someone must fund the human and technological infrastructure that hosts the data. - Without viable economic models for this infrastructure, valuable research data may disappear, making it accessible to no one and deterring us from making the most of our research investments. F Berman, and V Cerf Science 2013;341: : Who will pay for public access to research data? Published by AAAS

19 IS DATA THE NEW OIL?

20 IS DATA THE NEW SOIL?

21 Panel questions Q1: Is our national e-infrastructure adequate to meet your research ambitions? Q2: Research has a stakeholders issue. How should research communities be involved in the investments and evolution of the national e-infrastructure, and who will pay the bill? Q3: In research data management, what should be the role of the research community and what should be the role of SURF? Q4: Should all research data be open and stored in public clouds, or should competitive data be protected and stored in community clouds?

22 Panel question 1 Is our national e-infrastructure adequate to meet your research ambitions?

23 Panel question 2 Research has a stakeholders issue. How should research communities be involved in the investments and evolution of the national e-infrastructure, and who will pay the bill?

24 Panel question 3 In research data management, what should be the role of the research community and what should be the role of SURF?

25 Panel question 4 Should all research data be open and stored in public clouds, or should competitive data be protected and stored in community clouds?