Shannon Rauch. Summer ESIP July 2015

Transcription

1 Supporting Citation of Subsetted Data: A Data Center s Perspective Shannon Rauch Summer ESIP July 2015

2 Why Cite Data? "Data citation is intended to help guard the integrity of scholarly conclusions" (Starr et al. 2015) Transparency Verification and reproducibility of results Attribution Discovery Improved re-use of scholarly data

3 The Value of Data Citation is Well Known... As evidenced by the number of working groups, guidelines, best practices, etc.

4 8 Core Principals of Data Citation Joint Declaration of Data Citation Principals (JDDCP), Force 11

5 8 Core Principals of Data Citation Joint Declaration of Data Citation Principals (JDDCP), Force 11

6 How? Most guidelines suggest something like this at a minimum: Creator (Year). Title. Provider. Identif ier. Also recommended: URL, version/edition, date accessed, description of subset used. Adapted from:

7 Zwally, H., R. Schutz, C. Bentley, J. Bufton, T. Herring, J. Minster, J. Spinhirne, and R. Thomas GLAS/ICESat L1A Global Altimetry Data. Version 33. Boulder, Colorado USA: NASA National Snow and Ice Data Center Distributed Active Archive Center. DOI: /ICESAT/GLAS/DATA121 Siegel, David A VERTIGO project Niskin bottle sample data from KM0414 and RR_K2 cruises. Biological and Chemical Oceanography Data System. BCO-DMO, WHOI. Accessed: 13 July DOI: /1912/4199 Thurnherr, Andreas Raw CTD Data from the East Pacific Rise at 9N acquired during the Atlantis expedition AT15-12 (2006). IEDA. Accessed 13 January 2015 from

8 Easier SAID than DONE? Data repository mentioned in text and supplemental materials...

9 Easier SAID than DONE?...or in table and figure captions...

10 Easier SAID than DONE?... or in Acknowledgements.

11 On the right track Wait... Is that really sufficient?

12 Data Are Not Static (usually)

13 Two Flavors of Dynamic: Versioning & Subsetting Versioning: Datasets change (additions, deletions, edits/corrections) Subsetting: Datasets are sub-selected/filtered in various ways (locally, by the end user, or at the data repository using tools, workbenches, and other black boxes)

14 A Case for Versioning A (Recent) Real from a Researcher Ideally, can we keep the same URL for the dataset that it already has? It s been disseminated pretty widely by now, and it would be tough at this stage to change it in our upcoming pub. Which brings up another question is there a way to put this dataset in version control? Our next paper will build on it and probably expand it would be convenient to keep all versions of the dataset in the same box so searchers can find the exact version used for a particular analysis, but can also see the latest version if they re interested in using it for their own purposes. Sorry if my Github-iness is tough for BCO-DMO. If we can t keep the same URL, can we at least keep the old version up and include a link to the new and improved dataset?

15 Subsetting "Deep Citation" Deep citation refers to citation of subsets of datasets (like referencing page numbers in a book) Subsets by row, column, or both (e.g. time period, location, species, cruises, parameter values, etc.) Subsets used by researchers are often described in text in their paper's Methods section, or Supplemental Material......but subsets can be cited more formally.

16 Approaches to Citing Subsets 1. Save each subset associated with a study/publication as a data object with unique identifier. redundant? scalability issues? 2. Cite entire dataset, provide text description of subset used. specific enough to enable reproducibility? 3. Assign unique, citable identifier to query used to produce the subset. Things to consider: Level of granularity needed Human needs vs machine needs

17 Approaches to Citing Subsets Example format suggested by NSIDC: Author's Name. Year of Publication. Title of Data Set and Version Number, [indicate subset used]. Boulder, Colorado USA: National Snow and Ice Data Center. DOI. Njoku, Eni. 2004, updated daily. AMSR-E/Aqua L2B Surface Soil Moisture, Ancillary Parms, & QC EASE-Grids V002, March to June Boulder, Colorado USA: National Snow and Ice Data Center. Other groups/authors recommend assigning unique persistent identifiers (PIDs) (DOI, URI, ARK, etc.) to the subset and/or query used to generate the subset...

18 RDA Working Group on Data Citation (WGDC) Recommends: (1) Store data in a versioned, time-stamped manner. (2) Assign persistent identifiers (PIDs) to time-stamped queries that can be re-executed. "It allows identifying, retrieving and citing the precise data set with minimal storage overhead by only storing the versioned data and the queries used for creating the data set... Data sets can be recreated on demand."

19 The BCO-DMO Use Case The Two Challenges: Support citation of versioned and subsetted data

20 The Biological and Chemical Oceanography Data Management Office (BCO-DMO) works with investigators to serve data online from research projects funded by the National Science Foundation's (NSF) Biological and Chemical Oceanography Sections (OCE) and the Division of Polar Programs Antarctic Organisms & Ecosystems Program (PLR), and to support other NSF-funded marine ecosystems researchers.

21 BCO-DMO Data Holdings BCO-DMO serves: 7,500+ datasets from 500+ projects involving 1,800+ researchers Current versioning and subsetting practices: Only the most current version of each dataset is available online (though previous versions are retained on BCO-DMO servers) Simple subsetting tools are available to end-users (though most users download the full dataset and work with the data locally)

22 Previous Data Citation Work Cookbook written for data managers and librarians who are interested in assigning a permanent identifier to a dataset for the purposes of publishing that dataset online and for the citation of that dataset within the scientific literature. Leadbetter, A., Raymond, L., Chandler, C., Pikula, L., Pissierssens, P., Urban, E. (2013) Ocean Data Publication Cookbook. Paris: UNESCO, 41 pp. & annexes. (Manuals and Guides. Intergovernmental Oceanographic Commission, 64), (IOC/MG/64)

23 Currently, We can suggest citation in this format: Buesseler, K VERTIGO RR_K2 Cruise Event Log. Biological and Chemical Oceanography Data System. BCO-DMO, WHOI. Accessed: 14 February Maas, Amy E., Pteropod respiration rates from NW Atlantic and NE Pacific; OC473 (2011) and NH1208 (2012). Biological and Chemical Oceanography Data System. BCO-DMO, WHOI. DOI: /1912/6421 Can we / should we accommodate citation of versions and subsets?

24 One Example of Versioning

25 One Example of Versioning Links to previous versions provided in dataset header/metadata

26 One Example of Versioning Previous versions link back to newer versions.

27 Citation examples: Is this sufficient? Morris, J.J OA Literature Review; Literature review of Ocean Acidification (OA) effects on phytoplankton. Biological and Chemical Oceanography Data Management Office (BCO-DMO). Version date 07 July URL: Note: these 2 URLs are the same (metadata landing page) Morris, J.J OA Literature Review; Literature review of Ocean Acidification (OA) effects on phytoplankton. Biological and Chemical Oceanography Data Management Office (BCO-DMO). Version date 26 March URL: Morris, J.J OA Literature Review; Literature review of Ocean Acidification (OA) effects on phytoplankton. Biological and Chemical Oceanography Data Management Office (BCO-DMO). Version date 26 March URL: ExpEv/OA_Lit_Review_ html0 Note: this URL goes to specific data version rather than landing page. --> not ideal So does each version need its own landing page?

28 One Example of Subsetting Full dataset URL: Subsetted URL: Is this URL citeable? Maybe. But disconnected from metadata landing page. This could be given a PID and cited with the landing page URL. But is there a need? Ultimately, most researchers are still subsetting data locally on their own machines.

29 The Future? Maas, Amy E., Pteropod respiration rates from NW Atlantic and NE Pacific; OC473 (2011) and NH1208 (2012). Biological and Chemical Oceanography Data System. BCO-DMO, WHOI. Version 1.0. PID: DOI: /1912/6421. Is this the type of citation BCO-DMO should be moving toward enabling?

30 Bringing it all together... We (data managers, repositories, librarians, etc.) understand the importance of data citation and there is general consensus about how to do so. Versioning should be accounted for, though many repositories have traditionally provided online access to only most current version. Citation of data subsets is complex. No one-size-fits-all solution. Different approaches for different communities of researchers?

31 Changing the Culture (1) Information managers recognize the importance of data citation and have developed many recommendations. But are those being put to use by researchers? (2) If we are not seeing basic citation of datasets in a standard format, how can we encourage citation of versioned and subsetted data?

32 References Altman, et al. (2007) A proposed standard for the scholarly citation of quantitative data. D-Lib Magazine 13(3/4). doi: /march2007-altman Data Citation Synthesis Group: Joint Declaration of Data Citation Principles. Martone M. (ed.) San Diego CA: FORCE11; 2014 [ ]. Rauber, A. et al. June 9th (2015) Data Citation of Evolving Data, Recommendations of the Working Group on Data Citation (WGDC). Recommendations_ pdf Starr, J. et al. (2015) Achieving human and machine accessibility of cited data in scholarly publications. PeerJ Comp Sci 1:e1 Tilmes, C. (2011) Data Identifiers and Citations Enable Reproducible Science. AGU Fall Meeting

33 Black Boxes Do we cite the bread? The toast? The toaster? What about the toaster settings?