RELATED WORK DATANET FEDERATION CONSORTIUM, IRODS,
|
|
|
- Malcolm McKenzie
- 8 years ago
- Views:
Transcription
1 REAGAN W. MOORE DIRECTOR DATA INTENSIVE CYBER ENVIRONMENTS CENTER UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL PRIMARY RESEARCH OR PRACTICE AREA(S): POLICY-BASED DATA MANAGEMENT PREVIOUS EXPERIENCE SAN DIEGO SUPERCOMPUTER CENTER RELATED WORK DATANET FEDERATION CONSORTIUM, IRODS, CONTACT INFORMATION: RENCI 100 Europa Drive, Suite 540 Chapel Hill, NC SURVEY OF COMMONALITY WITH OTHER DISCIPLINES WORKSHOP 2 JULY 25, 2013 INDIANAPOLIS, INDIANA
2 Examples of Data Management Systems q Data Grids Babar High Energy Physics data grid Broad Ins5tute genomics data grid (data sharing) Na5onal Op5cal Astronomy Observatory data grid Ocean Observatories Ini5a5ve data grid The iplant Collabora5ve data grid WellCome Trust Sanger Ins5tute genomics data grid q Digital Libraries French Na5onal Library Texas Digital Library UNC- CH SILS LifeTime Library (data publica>on) q Repositories / Archives (data preserva>on) Carolina Digital Repository NASA Center for Climate Simula5on NOAA Na5onal Clima5c Data Center Processing Pipelines (Reproducible data- driven research)
3 irods Distributed Data Management
4 - Based Data Management (irods) q Purpose Reason a data collec5on is created q Proper)es AJributes needed to ensure the purpose q Policies Controls for enforcing desired proper)es Mapped to computer ac>onable rules q Procedures Func5ons that implement the policies Mapped to computer executable workflows q Persistent state informa)on Results of applying the procedures Mapped to system metadata q Property verifica)on Valida5on that state informa)on conforms to the desired purpose Mapped to periodically executed policies
5 Preservation Concepts (data, information, knowledge) q Preservation is communication with the future Provide a context for explaining relevance of records to a future archivist Manage context as information associated with each record Descriptive, provenance, and system metadata q Preservation is management of communication from the past Verify that assertions made by prior archivists are true Encapsulate knowledge of preservation actions in procedures Authenticity, integrity, chain of custody, arrangement Verify application of preservation policies and procedures Encapsulate assessment knowledge in procedures Trustworthiness assessment criteria
6 Capturing Knowledge for Reproducible Data Driven Science q Knowledge required to interact with a remote resource for record ingestion Protocol, semantics, formats Capture in micro-services q Knowledge embedded in analysis workflows Processing steps, input files Register and share workflows q Knowledge associated with managing data Management policies, assessment criteria enforcement points
7 Eco-Hydrology Slope Aspect Streams (NHD) Roads (DOT) Choose gauge or outlet (HIS) Extract drainage area (NHDPlus) Digital Elevation Model (DEM) Nested watershed structure Strata Patch Hillslope RHESSys workflow to develop a nested watershed parameter file (worldfile) containing a nested ecogeomorphic object framework, and full, initial system state. Soil and vegetation parameter files Land Use NLCD (EPA) Basin Stream network Leaf Area Index Landsat TM Flowtable Worldfile Phenology MODIS RHESSys Soil Data USDA
8 Workflow Management Reproducible Research ecwkflow.mss /earthcube/ecwkflow ecwkflow.run ecwkflow2.run ecwkflow.mpf ecwkflow2.mpf /earthcube/ecwkflow/ecwkflow.rundir0 Outfile /earthcube/ecwkflow/ecwkflow2.rundir0 Workflow file Directory holding all input and output files associated with workflow file (mounted collection that is linked to the workflow file) Automatically generated run file for Executing each input file Input parameter file, lists parameters and input and output file names Directory holding all output files generated for invocation of ecwkflow.run, the version number is incremented Output file created for ecwkflow.mpf Newfile Output file created for ecwkflow2.mpf
9 -based Data Management Purpose Defines Collection DATA_ID DATA_REPL_NUM DATA_CHECKSUM Integrity Authenticity Access control Completeness Defines HasFeature Correctness Consensus HasFeature Consistency HasFeature Has Has Property Defines Controls Procedure (11 default) HasFeature Replication Checksum Quota Data Type Enforcement Point (70) Invokes Has Client (50) Has SubType Periodic Assessment Criteria Digital Object Updates Workflow Chains Micro-service (317) Operation Has Updates Attribute (metadata) Persistent State Information (338) msigetuseracl msisetdatatype msisetquota msidataobjrepl msisyschksumdataobj
10 Technology q irods integrated Rule Oriented Data System Open source software, source distribution q E-iRODS Enterprise irods Open source software, binary distribution q NSF OCI DataNet Federation Consortium q NSF OCI Improvement of irods for Multi- Disciplinary Applications q NSF OCI NARA Transcontinental Persistent Archives Prototype q NSF SDCI Data Grids for Community Driven Applications
Integrating Data Life Cycle into Mission Life Cycle. Arcot Rajasekar rajasekar@unc.edu sekar@diceresearch.org
Integrating Data Life Cycle into Mission Life Cycle Arcot Rajasekar rajasekar@unc.edu sekar@diceresearch.org 1 Technology of Interest Provide an end-to-end capability for Exa-scale data orchestration From
irods Policy-Driven Data Preservation Integrating Cloud Storage and Institutional Repositories
irods Policy-Driven Data Preservation Integrating Cloud Storage and Institutional Repositories Reagan W. Moore Arcot Rajasekar Mike Wan {moore,sekar,mwan}@diceresearch.org h;p://irods.diceresearch.org
irods for Big Data Management in Research Driven Organizations Charles Schmitt CTO & Director of Informatics RENCI
irods for Big Data Management in Research Driven Organizations Charles Schmitt CTO & Director of Informatics RENCI Acknowledgements Presented work funded in part by grants from NIH, NSF, NARA, DHS, as
The National Consortium for Data Science (NCDS)
The National Consortium for Data Science (NCDS) A Public-Private Partnership to Advance Data Science Ashok Krishnamurthy PhD Deputy Director, RENCI University of North Carolina, Chapel Hill What is NCDS?
Data Management using irods
Data Management using irods Fundamentals of Data Management September 2014 Albert Heyrovsky Applications Developer, EPCC a.heyrovsky@epcc.ed.ac.uk 2 Course outline Why talk about irods? What is irods?
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS)
INTEGRATED RULE ORIENTED DATA SYSTEM (IRODS) Todd BenDor Associate Professor Dept. of City and Regional Planning UNC-Chapel Hill bendor@unc.edu http://irods.org/ SESYNC Model Integration Workshop Important
Policy Policy--driven Distributed driven Distributed Data Management (irods) Richard M arciano Marciano marciano@un marciano @un.
Policy-driven Distributed Data Management (irods) Richard Marciano marciano@unc.edu Professor @ SILS / Chief Scientist for Persistent Archives and Digital Preservation @ RENCI Director of the Sustainable
Concepts in Distributed Data Management or History of the DICE Group
Concepts in Distributed Data Management or History of the DICE Group Reagan W. Moore 1, Arcot Rajasekar 1, Michael Wan 3, Wayne Schroeder 2, Antoine de Torcy 1, Sheau- Yen Chen 2, Mike Conway 1, Hao Xu
DataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure. Arcot (RAJA) Rajasekar DICE/SDSC/UCSD
DataGrids 2.0 irods - A Second Generation Data Cyberinfrastructure Arcot (RAJA) Rajasekar DICE/SDSC/UCSD What is SRB? First Generation Data Grid middleware developed at the San Diego Supercomputer Center
irods Overview Intro to Data Grids and Policy-Driven Data Management!!Leesa Brieger, RENCI! Reagan Moore, DICE & RENCI!
irods Overview Intro to Data Grids and Policy-Driven Data Management!!Leesa Brieger, RENCI! Reagan Moore, DICE & RENCI! Renaissance Computing Institute (RENCI) A research unit of UNC Chapel Hill Current
Managing Next Generation Sequencing Data with irods
Managing Next Generation Sequencing Data with irods Presented by Dan Bedard // danb@renci.org at the 9 th International Conference on Genomics Shenzhen, China September 12, 2014 Managing NGS Data with
integrated Rule-Oriented Data System Reference
i integrated Rule-Oriented Data System Reference Arcot Rajasekar 1 Michael Wan 2 Reagan Moore 1 Wayne Schroeder 2 Sheau-Yen Chen 2 Lucas Gilbert 2 Chien-Yi Hou Richard Marciano 1 Paul Tooby 2 Antoine de
Assessment of RLG Trusted Digital Repository Requirements
Assessment of RLG Trusted Digital Repository Requirements Reagan W. Moore San Diego Supercomputer Center 9500 Gilman Drive La Jolla, CA 92093-0505 01 858 534 5073 moore@sdsc.edu ABSTRACT The RLG/NARA trusted
irods Overview Introduction to Data Grids, Policy-Driven Data Management, and Enterprise irods
irods Overview Introduction to Data Grids, Policy-Driven Data Management, and Enterprise irods Renaissance Computing Institute (RENCI) A research unit of UNC Chapel Hill Directed by Stan Ahalt, formerly
Conceptualizing Policy-Driven Repository Interoperability (PoDRI) Using irods and Fedora
Conceptualizing Policy-Driven Repository Interoperability (PoDRI) Using irods and Fedora David Pcolar Carolina Digital Repository (CDR) david_pcolar@unc.edu Alexandra Chassanoff School of Information &
irods and Metadata survey Version 0.1 Date March Abhijeet Kodgire akodgire@indiana.edu 25th
irods and Metadata survey Version 0.1 Date 25th March Purpose Survey of Status Complete Author Abhijeet Kodgire akodgire@indiana.edu Table of Contents 1 Abstract... 3 2 Categories and Subject Descriptors...
Data Management Resources at UNC: The Carolina Digital Repository and Dataverse Network
Data Management Resources at UNC: The Carolina Digital Repository and Dataverse Network November 16, 2010 Data Management Short Course Series Sponsored by the Odum Institute and the UNC Libraries Campus
Data Intensive Cyber Environments Center University of North Carolina at Chapel Hill
Data Intensive Cyber Environments Center University of North Carolina at Chapel Hill DataNet Federation Consortium NSF Award OCI-0940841 Period of Performance: 09/01/2011 8/31/2016 Project funding $7,999,998:
Automated and Scalable Data Management System for Genome Sequencing Data
Automated and Scalable Data Management System for Genome Sequencing Data Michael Mueller NIHR Imperial BRC Informatics Facility Faculty of Medicine Hammersmith Hospital Campus Continuously falling costs
irods Technologies at UNC
irods Technologies at UNC E-iRODS: Enterprise irods at RENCI Presenter: Leesa Brieger leesa@renci.org SC12 irods Informational Reception 1! UNC Chapel Hill Investment in irods DICE and RENCI: research
WOS for Research. ddn.com. DDN Whitepaper. Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved.
DDN Whitepaper WOS for Research Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved. irods and the DDN Web Object Scalar (WOS) Integration irods, an open source
Digital Preservation Lifecycle Management
Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar San Diego Supercomputer Center, University of California,
The RECOVER Cloud-Based Data Server
2013 Intermountain GIS Conference - Boise, ID - March 11-13, 2013 The RECOVER Cloud-Based Data Server John Schnase, Roger Gill, Mark Carroll, Akiko Elders, and Molly Brown Keith Weber, George Haskett,
Integrated Rule-based Data Management System for Genome Sequencing Data
Integrated Rule-based Data Management System for Genome Sequencing Data A Research Data Management (RDM) Green Shoots Pilots Project Report by Michael Mueller, Simon Burbidge, Steven Lawlor and Jorge Ferrer
OSG PUBLIC STORAGE. Tanya Levshina
PUBLIC STORAGE Tanya Levshina Motivations for Public Storage 2 data to use sites more easily LHC VOs have solved this problem (FTS, Phedex, LFC) Smaller VOs are still struggling with large data in a distributed
Abstract. 1. Introduction. irods White Paper 1
irods: integrated Rule Oriented Data System White Paper Data Intensive Cyber Environments Group University of North Carolina at Chapel Hill University of California at San Diego September 2008 Abstract
PASIG May 12, 2012. Jacob Farmer, CTO Cambridge Computer
Adding Intelligence to Conventional NAS and File Systems: Metadata, Backups, and Data Life Cycle Management PASIG May 12, 2012 Presented by: Jacob Farmer, CTO Cambridge Computer Copyright 2009-2011, Cambridge
ODUM INSTITUTE ARCHIVE SERVICES OVERVIEW IASSIST 2015
ODUM INSTITUTE ARCHIVE SERVICES OVERVIEW IASSIST 2015 JONATHAN CRABTREE Assistant Director of Computing and Archival Research The Odum Institute for Research in Social Science Davis Library, 2nd Floor,
Data Management Framework for the North American Carbon Program
Data Management Framework for the North American Carbon Program Bob Cook, Peter Thornton, and the Steering Committee Image courtesy of NASA/GSFC NACP Data Management Planning Workshop New Orleans, LA January
Policy-based Distributed Data Management Systems
Policy-based Distributed Data Management Systems Arcot Rajasekar Reagan Moore University of North Carolina at Chapel Hill Mike Wan Wayne Schroeder University of California, San Diego Abstract Scientific
Technical. Overview. ~ a ~ irods version 4.x
Technical Overview ~ a ~ irods version 4.x The integrated Ru e-oriented DATA System irods is open-source, data management software that lets users: access, manage, and share data across any type or number
Luc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department
Luc Declerck AUL, Technology Services Declan Fleming Director, Information Technology Department What is cyberinfrastructure? Outline Examples of cyberinfrastructure t Why is this relevant to Libraries?
How To Write An Nccwsc/Csc Data Management Plan
Guidance and Requirements for NCCWSC/CSC Plans (Required for NCCWSC and CSC Proposals and Funded Projects) Prepared by the CSC/NCCWSC Working Group Emily Fort, Data and IT Manager for the National Climate
IT S ABOUT TIME. Sponsored by. The National Science Foundation. Digital Government Program and Digital Libraries Program
IT S ABOUT TIME RESEARCH CHALLENGES IN DIGITAL ARCHIVING AND LONG-TERM PRESERVATION Sponsored by The National Science Foundation Digital Government Program and Digital Libraries Program Directorate for
Preservation Environments
Preservation Environments Reagan W. Moore San Diego Supercomputer Center University of California, San Diego 9500 Gilman Drive, MC-0505 La Jolla, CA 92093-0505 moore@sdsc.edu tel: +1-858-534-5073 fax:
How To Understand The Nature Of Big Data
Big Data is Coming for You W. Christopher Lenhardt RENCI DAARWG, Chair Outline A few words about RENCI Introduction: On the Nature of BIG Big Challenges Big Science Questions Big Data Other Big Trends
Using Databases to Manage State Information for. Globally Distributed Data
Storage Resource Broker Using Databases to Manage State Information for Globally Distributed Data Reagan W. Moore San Diego Supercomputer Center moore@sdsc.edu http://www.sdsc sdsc.edu/srb Abstract The
Overview. Council Secretariat P4 and beyond Logistics WG Updates The Organizational Assembly
RDA Business Overview 2 Council Secretariat P4 and beyond Logistics WG Updates The Organizational Assembly Council 3 John Wood Patrick Cocquet P4 and Beyond P4 and Beyond 5 It s my pleasure to present
Archive I. Metadata. 26. May 2015
Archive I Metadata 26. May 2015 2 Norstore Data Management Plan To successfully execute your research project you want to ensure the following three criteria are met over its entire lifecycle: You are
Technology solutions for managing and computing on largescale biomedical data
Technology solutions for managing and computing on largescale biomedical data Charles Schmitt CTO & Director of Informatics RENCI Brand Fortner Executive Director, irods Consortium Jason Coposky Chief
NSF South Big Data Hub
NSF South Big Data Hub Key People Stephen E. Cross Executive Vice President for Research, Georgia Tech Stanley Ahalt Director, Renaissance Computing Institute (RENCI) Lead PI at UNC- CH site Fen Zhao Directorate
Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing.
Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing. Dr Liz Lyon, UKOLN, University of Bath Introduction and Objectives UKOLN is undertaking
Data Management Plans - How to Treat Digital Sources
1 Data Management Plans - How to Treat Digital Sources The imminent future for repositories and their management Paolo Budroni Library and Archive Services, University of Vienna Tomasz Miksa Secure Business
INTRODUCTION TO THE DATAVERSE NETWORK
INTRODUCTION TO THE DATAVERSE NETWORK JANUARY 7, 2015 Jonathan Crabtree Assistant Director of Computing and Archival Research THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE 228 DAVIS LIBRARY, CB# 3355
Interagency Science Working Group. National Archives and Records Administration
Interagency Science Working Group 1 National Archives and Records Administration Establishing Trustworthy Digital Repositories: A Discussion Guide Based on the ISO Open Archival Information System (OAIS)
Building Preservation Environments with Data Grid Technology
SOAA_SP09 23/5/06 3:32 PM Page 139 Building Preservation Environments with Data Grid Technology Reagan W. Moore Abstract Preservation environments for digital records are successful when they can separate
Data Grid Landscape And Searching
Or What is SRB Matrix? Data Grid Automation Arun Jagatheesan et al., University of California, San Diego VLDB Workshop on Data Management in Grids Trondheim, Norway, 2-3 September 2005 SDSC Storage Resource
Reagan Moore, PI Mary Whitton, Project Manager. National Science Foundation Cooperative Agreement: OCI 0940841
Reagan Moore, PI Mary Whitton, Project Manager National Science Foundation Cooperative Agreement: OCI 0940841 DFC to Support Hydrologic Modeling Jon Goodall and Bakinam Essawy University of Virginia DFC
DuraCloud Direct To Researcher Easy Data Management in the Cloud for Researchers and Scientists
DuraCloud Direct To Researcher Easy Data Management in the Cloud for Researchers and Scientists 1. What is the main issue, problem or subject and why is it important? The significant increase in the production
Digital Preservation Workshop
Digital Preservation Workshop 1 Sept 2010 Simon Fraser University Burnaby, BC. Presenters: Glenn Dingwall City of Vancouver Archives Peter Van Garderen, Artefactual Systems Evelyn McLellan, Artefactual
Intro to Data Management. Chris Jordan Data Management and Collections Group Texas Advanced Computing Center
Intro to Data Management Chris Jordan Data Management and Collections Group Texas Advanced Computing Center Why Data Management? Digital research, above all, creates files Lots of files Without a plan,
Data-Intensive Science and Scientific Data Infrastructure
Data-Intensive Science and Scientific Data Infrastructure Russ Rew, UCAR Unidata ICTP Advanced School on High Performance and Grid Computing 13 April 2011 Overview Data-intensive science Publishing scientific
Spartan Archive: An Electronic Records Archive at Michigan State University NHPRC Project #RE-10025-10
Spartan Archive: An Electronic Records Archive at Michigan State University NHPRC Project #RE-10025-10 NHPRC Interim Narrative Progress Report, April 1, 2010 September 30, 2010 In late 2009, the Michigan
Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data
Archiving, Indexing and Accessing Web Materials: Solutions for large amounts of data David Minor 1, Reagan Moore 2, Bing Zhu, Charles Cowart 4 1. (88)4-104 minor@sdsc.edu San Diego Supercomputer Center
Web-based GIS Application of the WEPP Model
Web-based GIS Application of the WEPP Model Dennis C. Flanagan Research Agricultural Engineer USDA - Agricultural Research Service National Soil Erosion Research Laboratory West Lafayette, Indiana, USA
Large Scale Coastal Modeling on the Grid
Large Scale Coastal Modeling on the Grid Lavanya Ramakrishnan lavanya@renci.org Renaissance Computing Institute Duke University North Carolina State University University of North Carolina - Chapel Hill
NC Geographic Information Coordinating Council Acronym List - By Category
NC Geographic Information Coordinating Council Acronym List - By Category Acronym Full Name GICC Committees and Working Groups A Team LGC GIS Advisory Team BGN NC Board on Geographic Names LGC Local Government
The MODIS online archive and on-demand processing
The MODIS online archive and on-demand processing Edward Masuoka NASA Goddard Space Flight Center, Greenbelt, MD, USA Production Driven by Science Over the Terra and Aqua mission lifetimes, better calibration
Chronopolis: A Partnership. The Chronopolis: Digital Preservation Archive Development and Demonstration Program
The Chronopolis: Digital Preservation Archive Development and Demonstration Program Robert H. McDonald Indiana University Ardys Kozbial UC San Diego Libraries David Minor San Diego Supercomputer Center
Why are data sharing and reuse so difficult?
Why are data sharing and reuse so difficult? Chris9ne L. Borgman Professor and Presiden9al Chair in Informa9on Studies University of California, Los Angeles hmp://chris9neborgman.info and UCLA Knowledge
Organization of VizieR's Catalogs Archival
Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3
irods Consortium Customer Support Plan
irods Consortium Customer Support Plan This Agreement is made between the University of North Carolina at Chapel Hill, on behalf of the irods Consortium at the Renaissance Computing Institute (hereinafter
System Requirement Specification for A Distributed Desktop Search and Document Sharing Tool for Local Area Networks
System Requirement Specification for A Distributed Desktop Search and Document Sharing Tool for Local Area Networks OnurSoft Onur Tolga Şehitoğlu November 10, 2012 v1.0 Contents 1 Introduction 3 1.1 Purpose..............................
Data Sharing with irods (integrated Rule-oriented Data System)
Data Sharing with irods (integrated Rule-oriented Data System) Richard Marciano Arcot Rajasekar Reagan Moore Lead Scientist Sustainable Archives & Library Technologies (SALT) lab director Data Intensive
Canadian National Research Data Repository Service. CC and CARL Partnership for a national platform for Research Data Management
Research Data Management Canadian National Research Data Repository Service Progress Report, June 2016 As their digital datasets grow, researchers across all fields of inquiry are struggling to manage
Big process for big data
Big process for big data Process automa9on for data- driven science Ian Foster Computa9on Ins9tute Argonne Na9onal Laboratory & The University of Chicago Talk at Astroinforma9cs 2012, Redmond, September
Tools and Services for the Long Term Preservation and Access of Digital Archives
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer Studies Department of Electrical and Computer
Data grid storage for digital libraries and archives using irods
Data grid storage for digital libraries and archives using irods Mark Hedges, Centre for e-research, King s College London eresearch Australasia, Melbourne, 30 th Sept. 2008 Background: Project History
Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS.
National Digital Stewardship Residency - Boston Project Summaries 2015-16 Residency Harvard Library Preparing for a Trustworthy Repository Certification of Harvard Library s DRS. Harvard Library s Digital
DIGITAL ARCHIVES & PRESERVATION SYSTEMS
DIGITAL ARCHIVES & PRESERVATION SYSTEMS Part 1 Overview (part 1 of 7) Kari R. Smith, MIT Institute Archives Session Overview Digital archives and digital preservation systems. These open source tools are
PoS(ISGC 2013)021. SCALA: A Framework for Graphical Operations for irods. Wataru Takase KEK E-mail: wataru.takase@kek.jp
SCALA: A Framework for Graphical Operations for irods KEK E-mail: wataru.takase@kek.jp Adil Hasan University of Liverpool E-mail: adilhasan2@gmail.com Yoshimi Iida KEK E-mail: yoshimi.iida@kek.jp Francesca
OpenAIRE Research Data Management Briefing paper
OpenAIRE Research Data Management Briefing paper Understanding Research Data Management February 2016 H2020-EINFRA-2014-1 Topic: e-infrastructure for Open Access Research & Innovation action Grant Agreement
Data Management in an International Data Grid Project. Timur Chabuk 04/09/2007
Data Management in an International Data Grid Project Timur Chabuk 04/09/2007 Intro LHC opened in 2005 several Petabytes of data per year data created at CERN distributed to Regional Centers all over the
Science Gateways What are they and why are they having such a tremendous impact on science? Nancy Wilkins- Diehr wilkinsn@sdsc.edu
Science Gateways What are they and why are they having such a tremendous impact on science? Nancy Wilkins- Diehr wilkinsn@sdsc.edu What is a science gateway? science gateway /sī əәns gāt wā / n. 1. an
Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data
Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data Simon Lambert Scientific Computing Department STFC UK Types of
Open Science, Big Data and Research Reproducibility. Tony Hey Senior Data Science Fellow escience Ins>tute University of Washington tony.hey@live.
Open Science, Big Data and Research Reproducibility Tony Hey Senior Data Science Fellow escience Ins>tute University of Washington tony.hey@live.com The Vision of Open Science Vision for a New Era of Research
Big Data R&D Initiative
Big Data R&D Initiative Howard Wactlar CISE Directorate National Science Foundation NIST Big Data Meeting June, 2012 Image Credit: Exploratorium. The Landscape: Smart Sensing, Reasoning and Decision Environment
Digital Preservation. OAIS Reference Model
Digital Preservation OAIS Reference Model Stephan Strodl, Andreas Rauber Institut für Softwaretechnik und Interaktive Systeme TU Wien http://www.ifs.tuwien.ac.at/dp Aim OAIS model Understanding the functionality
The THREDDS Data Repository: for Long Term Data Storage and Access
8B.7 The THREDDS Data Repository: for Long Term Data Storage and Access Anne Wilson, Thomas Baltzer, John Caron Unidata Program Center, UCAR, Boulder, CO 1 INTRODUCTION In order to better manage ever increasing
Using Open Source Digital Forensics Software for Digital Archives Workshop
Using Open Source Digital Forensics Software for Digital Archives Workshop Mark A. Matienzo 04 Manuscripts and Archives, Yale University Library Society of American Archivists University of Michigan School
A DICOM-based Software Infrastructure for Data Archiving
A DICOM-based Software Infrastructure for Data Archiving Dhaval Dalal, Julien Jomier, and Stephen R. Aylward Computer-Aided Diagnosis and Display Lab The University of North Carolina at Chapel Hill, Department
Big Data Operations: Basis for Benchmarking Big Data Systems
Big Data Operations: Basis for Benchmarking Big Data Systems Justin Zhan North Carolina State A&U University, Greensboro Arcot Rajasekar Reagan Moore Shu Huang Yufeng Xin University of North Carolina at
Archiving Systems. Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie. uwe.borghoff@unibw.
Archiving Systems Uwe M. Borghoff Universität der Bundeswehr München Fakultät für Informatik Institut für Softwaretechnologie uwe.borghoff@unibw.de Decision Process Reference Models Technologies Use Cases
Report of the DTL focus meeting on Life Science Data Repositories
Report of the DTL focus meeting on Life Science Data Repositories Goal The goal of the meeting was to inform and discuss research data repositories for life sciences. The big data era adds to the complexity
How To Retire A Legacy System From Healthcare With A Flatirons Eas Application Retirement Solution
EAS Application Retirement Case Study: Health Insurance Introduction A major health insurance organization contracted with Flatirons Solutions to assist them in retiring a number of aged applications that
Digital Preservation and Digital Library Development at the London School of Economics
Digital Preservation and Digital Library Development at the London School of Economics Ed Fay, Digital Library Manager e.fay@lse.ac.uk @digitalfay LSE Library Mission Strategy Build and preserve dis8nc8ve
Long Term Preservation of Earth Observation Data
Long Term Preservation of Earth Observation Data QA4EO Workshop RAL, October 18-20 th 2011 Mirko Albani and Bojan Bojkov* (ESA/ESRIN) Page 1 Outline Earth Observation data preservation: the need and the
Environmental Data Management:
Environmental Data Management: Challenges & Opportunities Mohan Ramamurthy, Unidata University Corporation for Atmospheric Research Boulder CO 25 May 2010 Environmental Data Management Workshop Silver
EDUCATING THE CURATOR: DIGITAL CURATION EDUCATION IN THE UNITED STATES
EDUCATING THE CURATOR: DIGITAL CURATION EDUCATION IN THE UNITED STATES Helen R. Tibbo Alumni Distinguished Professor School of Information and Library Science University of North Carolina, Chapel Hill
Why archiving erecords influences the creation of erecords. Martin Stürzlinger scopepartner Vienna, Austria
Why archiving erecords influences the creation of erecords Martin Stürzlinger scopepartner Vienna, Austria Electronic Records In a Productive System Created Used Changed Deleted In an Archival System No
The LCC Network Integrated Data Management Network GREAT NORTHERN LCC STEERING COMMITTEE MEETING MORAN, WY 25 SEPTEMBER 2011
The LCC Network Integrated Management Network GREAT NORTHERN LCC STEERING COMMITTEE MEETING MORAN, WY 25 SEPTEMBER 2011 Analysis A Common Challenge Work Environments Tools Ques&ons Needs Decision Tools
Cloud Data Management System (CDMS)
Cloud Management System (CMS) Wiqar Chaudry Solu9ons Engineer Senior Advisor CMS Overview he OpenStack cloud data management system features a canonical data modeling framework designed to broker context
Balancing Big Data for Security, Collaboration and Performance
Balancing Big Data for Security, Collaboration and Performance Sai Balu Lineberger Cancer Center UNC Chapel Hill Oct 14, 2014 About UNC Oldest Public University -1793 Top 5 Public University. 46th World
The World Agroforestry centre Policy Series. Research Data Management Policy
The World Agroforestry centre Policy Series Research Data Management Policy November 2012 World Agroforestry centre Research Data Management Policy Mission and Research Data Management (RDM) The centre
Cloud Computing @ JPL Science Data Systems
Cloud Computing @ JPL Science Data Systems Emily Law, GSAW 2011 Outline Science Data Systems (SDS) Space & Earth SDSs SDS Common Architecture Components Key Components using Cloud Computing Use Case 1:
Open Access to Manuscripts, Open Science, and Big Data
Open Access to Manuscripts, Open Science, and Big Data Progress, and the Elsevier Perspective in 2013 Presented by: Dan Morgan Title: Senior Manager Access Relations, Global Academic Relations Company
UNINETT Sigma2 AS: architecture and functionality of the future national data infrastructure
UNINETT Sigma2 AS: architecture and functionality of the future national data infrastructure Authors: A O Jaunsen, G S Dahiya, H A Eide, E Midttun Date: Dec 15, 2015 Summary Uninett Sigma2 provides High
Figure 1.1 The Sandveld area and the Verlorenvlei Catchment - 2 -
Figure 1.1 The Sandveld area and the Verlorenvlei Catchment - 2 - Figure 1.2 Homogenous farming areas in the Verlorenvlei catchment - 3 - - 18 - CHAPTER 3: METHODS 3.1. STUDY AREA The study area, namely
The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team
The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team Photo courtesy Andrew Mahoney NSF Vision What is AON? a
DIGITAL PRESERVATION AT THE U.S. GOVERNMENT PRINTING OFFICE: WHITE PAPER. Version 2.0. 9 July 2008 UNITED STATES GOVERNMENT PRINTING OFFICE
DIGITAL PRESERVATION AT THE U.S. GOVERNMENT PRINTING OFFICE: WHITE PAPER Version 2.0 9 July 2008 Record of Changes Version Description Of Change Revision Date Author Number 1.0 Baseline Document July 12,