Open Access, Open Data, Open Science Martin Vetterli, President of the National Research Council

Transcription

1 Open Access, Open Data, Open Science Martin Vetterli, President of the National Research Council Lausanne,

2 Outline 1. An anecdote Collaboration in science is key 3. Open access to open data 4. Reproducibility is necessary 5. An example from my lab 6. and open access 7. Conclusions

3 Research is about creating and sharing knowledge 3

4 Research is about creating and sharing knowledge, or is it? 4

5 Evolution of journal prices... PhDcomics / Periodical Pricing Survey 2012, Forschung Association schafft of Research Wissen. Libraries

6 6

7 Collaborations gain importance 7 Comparative Benchmarking of European Forschung and US schafft Research, Wissen. 2013

8 Collaborations gain importance The fourth age Forschung of research, schafft nature, Wissen. 2013

9 Collaborations in very large problems CERN ATLAS Project Citizen Science

10 Collaborations in very hard problems Polymath Case Gowers, Timothy, and Michael Nielsen. "Massively collaborative mathematics." Nature (2009):

11 Collaboration in interdisciplinary problems Biomedical Image Processing Spike Sorting

12 Open Science

13 Open Science Reproducibility Scientific research has changed the world. Now it needs to change itself 13 Forschung , schafft The Economist Wissen.

14 Reproducibility: Different levels for different domains

15 Mathematics Clear theorems Complete proofs

16 Computational Sciences Clear theorems Complete proofs Algorithm Code

17 Life Sciences Detailed method Lab Protocols Code Data

18 But: It is not happening! In 2012, a survey done for Nature found that 47 out of 53 medical research papers were irreproducible Begley, C. G.; Ellis, L. M. (2012). "Drug development: Raise standards for preclinical cancer research". Nature 483 (7391):

19 But: It is not happening! In another study in 2009, 10(+6) out of 18 bioinformatic papers could not be reproduced completely Ioannidis JPA, Allison DB, Ball CA, et al. Repeatability of published microarray gene expression analyses. Nat Genet 2009;41(2):149 55

20 But: It is not happening! In a study on the 134 papers of "IEEE Transactions on Image Processing" in 2004, it was found that Less than 9% of papers share their code Vandewalle, Patrick, Jelena Kovacevic, and Martin Vetterli. "Reproducible research in signal processing." Signal Processing Magazine, IEEE 26.3 (2009):

21 So what can we do? 21 Ioannidis JP, PLoS Forschung Medicine, schafft October Wissen. 2014

22 So what can we do? 22 Ioannidis JP, PLoS Forschung Medicine, schafft October Wissen. 2014

23 SNSF Séance de Réflexion 2013 Prof. J.P. Ioannidis Funding research: Impact, Conformity and Reproducibility 23

24 Some initiatives 24

25 A changing trend More and more journals require availability of data/code A recent study shows an increase of 16% in the number of data policies 30% increase in code policies Stodden, V. et al., "Toward reproducible computational research: an empirical analysis of data and code policy adoption by journals." PloS one 8.6 (2013): e67111.

26 A changing trend A journal for sharing data

27 Reproducibility involves some effort but it increases visibility In a study in 2007 on microarray DNA research publications, papers with shared data were cited about 70% more frequently. Piwowar, H. a et al. Sharing detailed research data is associated with increased citation rate. PloS one. 2, (2007), 308.

28 Reproducibility at my lab

29 Papers + Project Papers Lab Projects Papers PDF Code Data Demo

30 Open Access Policy of the SNSF General policy: SNSF requires grantees to make their research results available in an open access publication Free to choose between best suited format («Green Route» or «Gold Route») Specific policy for financial support by SNSF: Papers must be published via «Gold Route» Books must be available open accessible after maximum 24 months

31 Publication funding of the SNSF Publication grants Publication funding in SNSF grants Book publication Since 1 July 2014: Contributions towards the production costs of digital book publications Open access after 24 months at the latest Journal article Since October 2013: Funding of publications in pure OA journals (Gold Road) All academic disciplines, limited to project funding Grant of max. CHF 3,000 per publication

32 Summary: Reproducibility and Open Science at SNSF