Scientific Journals: Challenges & Trends

Transcription

1 Scientific Journals: Challenges & Trends

2 JASIST & ARIST Editor-in-Chief: Journal of the American Society for Information Science and Technology Editor: Annual Review of Information Science and Technology

3 Subscribers (Libraries) Authors Readers Editorial Board JASIST Editor-in-Chief Reviewers ASIS&T (The Society) Managing Editors, Production Editor, Copy Editors & Proofreaders Infrastructure Provider (Scholar One) Wiley- Blackwell (The Publisher)

4 Slow Publishing Policing to prevent salami-slicing/lpu/ self-plagiarism Plagiarism fraud, error detection retraction

5 Peer Review Expertise mapping, referee fatigue, system stress Single vs. double blind vs. open vs. hybrid Bias?

6 Language Linguistic hegemony Vernacular vs. vehicular language Effort-cost of maintaining standards

7 Data Accessibility of data for checking, replication, re-use, exploitation Accessibility of instruments, protocols, software, primary data

8 How to cite data How to reward data creators How to peer review data sets Need for sharing of data management plans How to reward secondary analysis of data

9

10 Journal Impact Factor high IF journals are losing their stronghold as the sole repositories of high-quality papers, so there is no legitimate basis for extending the IF of a journal to its papers, much less to individual researchers. Lozano, Lariviere & Gingras, JASIST (2012)

11 Coercive Citation Editors force authors to cite articles from their journal

12 Big Business (~US$15billion)

13 arxiv: From Strength to Strength

14 Proportion of WoS papers on arxiv, by specialty ( ). Inset: Proportion of WoS papers on arxiv, by specialty, Larivière, Macaluso, Sugimoto, Milojevic, Cronin, & Thelwall (2013) Astronomy & Astrophysics Nuclear & Particle Physics General Physics General Mathematics Solid State Physics Miscellaneous Mathematics Miscellaneous Physics Probability & Statistics Applied Mathematics Fluids & Plasmas Chemical Physics Acoustics Computers Applied Physics Optics Percentage of articles 80% 70% 60% 50% 40% 30% 20% 10% 0% Nuclear & Particle Physics Astronomy & Astrophysics % 10% 20% 30% 40% 50% 60% 70% Percentage of WoS-papers ( )

15 Accés Obert Removal of tolls & filters Bibliodiversity APCs: cost shifting Open peer review/ wisdom of the crowds Visible impact measures

16 Open Access (humanly readable PDFs) Open Data (machine readable, mineable, reusable, licensable)

17 Workers Revolt? 600,000 authors,~ $1 billion profits ~13,000 signatures

18 Article Processing Charges (APCs) I think publishing is a cost of research in the same way as buying a centrifuge is a cost of research Sir Mark Wolpert (WT) April 2012

19 Perceptions & Reality Dallmeier-Tiessen et al., 2011 About 2/3 of (~9,000) OA journals do not charge APCs. Medical sciences highest; A & H lowest. M. Kozak

20 OA Journal Publishing, (M. Laasko et al., 2011:

21

22 $9 million start-up support 7 Gold OA journals Efficiencies of scale Costs down, charges up? PLoS One revenues provide cross-subsidy (cash cow?)

23 PLoS: A Publishing Phenomenon ~2,000 papers per month APC = $1,350 Peer reviewed mega journal 3% of STM literature 65% acceptance rate

24 STM publisher of 220 OA, online, peer-reviewed journals. Acquired by Springer. Revenues = $20M (?) Authors pay APC, retain copyright and license work under CC-BY Membership options

25 From hybrid (2004) to fully OA (2007) APCs range from $0 -> $1, peer reviewed journals Institutional membership Rejection rate ~60% 10% no APCs Accelerated peer review (4-8 weeks)

26 Hindawi Revenues Source: R. Poynter (2012)

27 Sage Open Peer-review Gold OA journal covering social & behavioral sciences and the humanities Discounted APC ==> $99 70% of authors pay APC personally

28 Howard Hughes + Welcome + Max Planck Senior scientists on editorial board Free for now Seeks out high quality/impact papers

29 F1000Research is an original open access publishing program for life scientists, offering immediate publication, transparent peer review (post-publication) and full data deposition and sharing. All scientifically sound articles are accepted, including single findings, case reports, protocols, replications, null/negative results and more traditional articles.

30 Predatory Journals Low quality journals Dubious editorial practices Scholarly vanity presses ~4,000?

31 Accés Obert -- Libres OA book publisher Not for profit Rigorous peer review Free online Small PDF charge

32

33

34 Elsevier s Article of the Future

35 PLOS One

36

37

38 Make tables, graphs, stats interactive Make code, data etc. reader-verifiable From (fixed) paper to (dynamic) process to (multiple) products

39 Identifying great research in biology and medicine F1000 is an in-depth directory to the top articles in biology and medicine, as recommended by our Faculty of over 5,000 expert scientists and clinical researchers, assisted by 5,000 associates. Post-publication review & ratings

40 Liquid Publications blogs, scientific experiments, comments on somebody else s paper, reviews, slides, videos, demos, even data evolutionary, collaborative Baez & Casati, n.d.

41 Force 11 Manifesto We see a future in which every claim, hypothesis, argument every significant element of the discourse can be explicitly represented, along with supporting data, software, workflows, multimedia, external commentary, and information about provenance.

42 What is a Nanopub? A nanopublication is the smallest unit of publishable information: an assertion about anything that can be uniquely identified and attributed to its author. Find, connect, aggregate, curate

43 Nano Publication

44 Status Quo Mons et al. 2011

45 Nano-centric Publication Mons et al. (2011)

46 An Open Access Evidence Rack (Peter Suber, December 2012) 1. Identify basic propositions in a paper/subfield/field 2. Create separate OA webpage for each proposition 3. Fill each webpage with evidence supporting the proposition

47 Force 11 Manifesto Notions such as journal impact factor are poor surrogates for measuring the true impact of scholarship we need to derive new mechanisms that will allow us more accurately to measure true contributions.

48 Assessing Research Quality Impact is defined as an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia

49 Beyond Bibliometrics Citations miss important traces are lagged reference managers, blogs, bookmarking, slide-sharing services and social media are real-time

50 Scholars read, use and then cite Non-scholars read and use, but don t cite Citations measure a particular kind of use; they only partially capture impact.

51 Invoked on the Web (Cronin et al., 1998) genres of invocation polymorphous mentioning presence density diverse ways in which academic influence is exercised and acknowledged

52 Acknowledgments Data citation counts Micro-attributions for data curation Social media mentions Recommendations Downloads Links/hits/click-throughs Mentions in extrascientific texts Press coverage Alternative Metrics

53

54

55 Alt.metrics Priem (2011)

56 Elsevier s Scopus

57 Platforms Transparency? Usability? Persistence? Cost?

58 Complements or Correlatives? Citations in Wikipedia correlate with JCR data (Nielsen, 2007) Articles in the top quartile of tweets were 11 times more likely to be in top quartile of citations 2 years later (Eysenback, 2012) High positive correlation between F1000 score and JIF (Nature Neuroscience, 2005) Positive correlations between inclusion in reference managers and citation counts (Bar-Ilan, 2012; Li etal. 2011; Priem et al., 2012) Downloads predict /correlate with subsequent citation (Brody et al., 2006).

59 Downloads vs. Citations in Science Direct (source: Elsevier)

60 Quantified Control Lock & Martins, 2011 an Orwellian surveillance net Sosteric, 1999 contemporary metricization of the academy Burrows, 2012

61 The data speak for themselves. Or do they?

62 Manipulating Google Scholar Citations and Google Scholar Metrics: simple, easy and tempting Emilio Delgado López-Cózar, Nicolás Robinson-García, Daniel Torres-Salinas arxiv.org, Submitted on 4 Dec 2012 We created six documents authored by a faked author and we uploaded them to a researcher s personal website under the University of Granada s domain. The result of the experiment meant an increase of 774 citations in 129 papers (six citations per paper) increasing the authors and journals H index.

63 The Holy Grail of Holism Multidimensional indicators of impact, influence, worth and trends A matrix of established & alternative metrics A unified measure/composite score?

64 Trends Liberation theology Incremental, interactive, evolutionary products Atomization of effort, outputs Multiple impact measures Fetishization of metrics Transparency vs. triviality