ARM Data Center Experience in Linking Big Data
|
|
|
- Kelley Dalton
- 8 years ago
- Views:
Transcription
1 ARM Data Center Experience in Linking Big Data Giri Palanisamy ARM Climate Change Science Institute Oak Ridge National Laboratory, USA Presented at: CENDI-NFAIS December 11, 2012
2 Climate Change Science Institute Data Centers at a Glance ARM Archive ESGF* CDIAC DAAC Sponsor DOE DOE DOE NASA Type of data Atmospheric processes, cloud dynamics Climate model datasets, climate observations for intercomparision Atmospheric gases, emissions data, AmeriFlux Biogeochemical dynamics, carbon cycle, FLUXNET Products > Archive Size > 300 TB 850 TB ~ 400 GB ~ 1 TB + 60 TB of MODIS data Users/year ~1,500 ~25,000 ~300,000 ~10,000 Year Started * - Federated data archived at ORNL, PCMDI, BADC, NCI, NERSC, WDCC and JPL Gateways, ORNL numbers are displayed inside the parenthesis Broad range of users: modelers, field scientists, educators, NGO s, general public Broad range of atmospheric, land process, and ocean data Additional projects within and between data centers 2
3 ARM permanent sites provides long-term data. Mobile sites and aircraft increase diversity. Southern Great Plains (1993) North Slope of Alaska: Barrow (1998) and Atqasuk (1999) Tropical Western Pacific: Manus (1996), Nauru (1998), and Darwin (2002) First ARM Mobile Facility (2005); Second ARM Mobile Facility (2010) ARM Aerial Facility (2007) 3
4 Atmospheric Radiation Measurement(ARM) - Data Archive DOE national user facility for global climate change research Data from routine operations and field experiments are stored and distributed through the Archive ARM Measurements Advanced Visualizations using ARM Cluster 4
5 ARM Data Citation Service Goal Allow users to cite the exact ARM data used in their research/publication Allows future data users and the project to easily track the data used in various articles 5
6 ARM Data Citation Service The Challenge Millions of data files from over 3000 data products Most of them are continuous data products Large user community and complex use of data Data is also published via other portals 6
7 ARM Data Citation Service Using DOE Office of Scientific and Technical Information (OSTI) DOI service (Mark Martin) DOIs are assigned at the data collection level 7
8 ARM - Recommended Citation Format Several citation formats are possible using DOIs. ARM encourages users to include the following information when citing ARM data: Author Original publication date Update period, if applicable (daily, monthly, quarterly, yearly, etc.) Dataset name Dates used* Locations* (latitude/longitude, site name, and facility identifier) Editor(s) or compiler(s) Place of publication Publisher Date accessed* * Needed for future replication of data requests DOI* More Information: 8
9 ARM - Citation Format Example Atmospheric Radiation Measurement (ARM) Climate Research Facility. 1994, updated daily. SONDEWNPN. Oct March 2011, 36 36' 18.0" N, 97 29' 6.0" W: Southern Great Plains Central Facility (C1). Compiled by R Coulter, J Prell, M Ritsche, and D Holdridge. Oak Ridge, Tennessee, USA: ARM Data Archive. Data set accessed at More Information: 9
10 ARM - Citation Resolver Service 10
11 ARM - Citation Resolver Service 11
12 ARM - Citation Resolver Service 12
13 Showing potential users where data have been cited 13
14 Example of Scientific Impact Data Products used in literature Number Source: Bob Cook, ORNL 14
15 Data specific DOI Documents ers.html 15
16 Challenges and next Steps - DOI strategy for data processed using ARM Big Data Clusters - Work with publishers to link the DOI/data, register the visualization widget? - Get metrics for citations and references from the publishers 16
17 ARM Computing Cluster a community resource for ARM data visualization and analysis User VM MatLab, IDL, TITAN, Perl APIs, Python APIs, ANDERS, NCVWeb ISDE SSH /usr/home /data-in/usr NeatX /data-out/usr ARM Archive Data Storage (HPSS) ARM Archive Servers Incoming Radar Data 17
18 Next Steps - Work with publishers to link the DOI/data, register the visualization widget? - Get metrics for citations and references from the publishers Comments/Questions? Giri Palanisamy palanisamyg@ornl.gov 18
Linked Science as a producer and consumer of big data in the Earth Sciences
Linked Science as a producer and consumer of big data in the Earth Sciences Line C. Pouchard,* Robert B. Cook,* Jim Green,* Natasha Noy,** Giri Palanisamy* Oak Ridge National Laboratory* Stanford Center
Data Management Facility Operations Plan
DOE/SC-ARM-14-008 Data Management Facility Operations Plan NN Keck January 2014 DISCLAIMER This report was prepared as an account of work sponsored by the U.S. Government. Neither the United States nor
AmeriFlux Site and Data Exploration System
AmeriFlux Site and Data Exploration System Misha Krassovski, Tom Boden, Bai Yang, Barbara Jackson CDIAC: Carbon Dioxide Information and Analysis Center CDIAC: Carbon Dioxide Information Analysis Center
NASA Earth System Science: Structure and data centers
SUPPLEMENT MATERIALS NASA Earth System Science: Structure and data centers NASA http://nasa.gov/ NASA Mission Directorates Aeronautics Research Exploration Systems Science http://nasascience.nasa.gov/
CMIP5 Data Management CAS2K13
CMIP5 Data Management CAS2K13 08. 12. September 2013, Annecy Michael Lautenschlager (DKRZ) With Contributions from ESGF CMIP5 Core Data Centres PCMDI, BADC and DKRZ Status DKRZ Data Archive HLRE-2 archive
Thoughts on Mobile Instrument Facilities/ Logistics of Remote Data Collection
Thoughts on Mobile Instrument Facilities/ Logistics of Remote Data Collection Douglas Sisterson ARM Climate Research Facility Operations Manager DOE Permafrost Workshop February 14-15, 2011 ARM Facilities
Data dissemination best practice and STAR experience
Data dissemination best practice and STAR experience Jacky Chaplow Informatics liaison image courtesy of strategicphilanthropyinc.com Why disseminate data? Comply with current legislation and government
How To Write An Nccwsc/Csc Data Management Plan
Guidance and Requirements for NCCWSC/CSC Plans (Required for NCCWSC and CSC Proposals and Funded Projects) Prepared by the CSC/NCCWSC Working Group Emily Fort, Data and IT Manager for the National Climate
Integrated Global Carbon Observations. Beverly Law Prof. Global Change Forest Science Science Chair, AmeriFlux Network Oregon State University
Integrated Global Carbon Observations Beverly Law Prof. Global Change Forest Science Science Chair, AmeriFlux Network Oregon State University Total Anthropogenic Emissions 2008 Total Anthropogenic CO 2
CrIS L1B Project Status
CrIS L1B Project Status Graeme Martin 1, Hank Revercomb 1, Larrabee Strow 2, Dave Tobin 1, Howard Moteller 2, Liam Gumley 1, Ray Garcia 1, Greg Quinn 1, Joe Taylor 1, Coda Phillips 1, Bob Knuteson 1, Jessica
Enabling Science in the Cloud: A Remote Sensing Data Processing Service for Environmental Science Analysis
Enabling Science in the Cloud: A Remote Sensing Data Processing Service for Environmental Science Analysis Catharine van Ingen 1, Jie Li 2, Youngryel Ryu 3, Marty Humphrey 2, Deb Agarwal 4, Keith Jackson
ABoVE Science Cloud: An orientation for the ABoVE Science Team
ABoVE Science Cloud: An orientation for the ABoVE Science Team Peter Griffith Chief Support Scientist Liz Hoy Support Scientist Carbon Cycle & Ecosystems Office @NASA_ABoVE Mark McInerney Dan Duffy Data
Driving Earth Systems Collaboration across the Pacific
Driving Earth Systems Collaboration across the Pacific Tim F. Pugh Centre for Australian Weather and Climate Research Australian Bureau of Meteorology What s our business? Earth System Science Study of
NOAA Environmental Data Management Update for Unidata SAC 2014-10-08
NOAA Environmental Management Update for Unidata SAC 2014-10-08 Jeff de La Beaujardière, PhD NOAA Management Architect +1 301-713-7175 NOAA data are unique, valuable, and irreplaceable Many observing systems:
Data Management Framework for the North American Carbon Program
Data Management Framework for the North American Carbon Program Bob Cook, Peter Thornton, and the Steering Committee Image courtesy of NASA/GSFC NACP Data Management Planning Workshop New Orleans, LA January
Satellite'&'NASA'Data'Intro'
Satellite'&'NASA'Data'Intro' Research'vs.'Opera8ons' NASA':'Research'satellites' ' ' NOAA/DoD:'Opera8onal'Satellites' NOAA'Polar'Program:'NOAA>16,17,18,19,NPP' Geosta8onary:'GOES>east,'GOES>West' DMSP'series:'SSM/I,'SSMIS'
NATIONAL CLIMATE CHANGE & WILDLIFE SCIENCE CENTER & CLIMATE SCIENCE CENTERS DATA MANAGEMENT PLAN GUIDANCE
NATIONAL CLIMATE CHANGE & WILDLIFE SCIENCE CENTER & CLIMATE SCIENCE CENTERS DATA MANAGEMENT PLAN GUIDANCE Prepared by: NCCWSC/CSC Data Management Working Group US Geological Survey February 26, 2013 Version
NCI ESG install in the cloud
NCI ESG install in the cloud Ben Evans 11 December 2014 @NCInews Installation ESGF installation in the OpenStack cloud. Mix of puppet, esg-install, snapshot, config Production: IDP+portal 4x international
Data archiving and data policies
WWW.BJERKNES.UIB.NO Data archiving and data policies Benjamin Pfeil, Stephane Pesant, Michael Diepenbroek, Hannes Grobe Bjerknes Centre for Climate Research/ University of Bergen, Norway EPOCA-BIOACID-CalMarO-OCB
Big Data and Cloud Computing for GHRSST
Big Data and Cloud Computing for GHRSST Jean-Francois Piollé (jfpiolle@ifremer.fr) Frédéric Paul, Olivier Archer CERSAT / Institut Français de Recherche pour l Exploitation de la Mer Facing data deluge
Land Use/Land Cover Map of the Central Facility of ARM in the Southern Great Plains Site Using DOE s Multi-Spectral Thermal Imager Satellite Images
Land Use/Land Cover Map of the Central Facility of ARM in the Southern Great Plains Site Using DOE s Multi-Spectral Thermal Imager Satellite Images S. E. Báez Cazull Pre-Service Teacher Program University
Big Data Services at DKRZ
Big Data Services at DKRZ Michael Lautenschlager and Colleagues from DKRZ and Scientific Computing Research Group MPI-M Seminar Hamburg, March 31st, 2015 Big Data in Climate Research Big data is an all-encompassing
DOE/SC-ARM-14-022. Site Data System Engineering Roles and Responsibilities Version: 1.2
DOE/SC-ARM-14-022 Site Data System Engineering Roles and Responsibilities Version: 1.2 July 2014 DISCLAIMER This report was prepared as an account of work sponsored by the U.S. Government. Neither the
NASA's Strategy and Activities in Server Side Analytics
NASA's Strategy and Activities in Server Side Analytics Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at the ESGF/UVCDAT Conference Lawrence Livermore National Laboratory
Report to the NOAA Science Advisory Board
Report to the NOAA Science Advisory Board from the Data Access and Archiving Requirements Working Group March 2011 The SAB s Data Access and Archiving Requirements Working Group (DAARWG) met in December
Exploration of adaptive network transfer for 100 Gbps networks Climate100: Scaling the Earth System Grid to 100Gbps Network
Exploration of adaptive network transfer for 100 Gbps networks Climate100: Scaling the Earth System Grid to 100Gbps Network February 1, 2012 Project period of April 1, 2011 through December 31, 2011 Principal
CEOS Water Portal Status Update
CEOS Water Portal Status Update WGISS-33 Tokyo, Japan April 23-27, 2012 JAXA/Mission Operations System Office Satoko Miura/ Atsushi Kawai Update since WGISS-32 New features Compare service for MOLTS data
Big Data at ECMWF Providing access to multi-petabyte datasets Past, present and future
Big Data at ECMWF Providing access to multi-petabyte datasets Past, present and future Baudouin Raoult Principal Software Strategist ECMWF Slide 1 ECMWF An independent intergovernmental organisation established
Climatology of aerosol and cloud properties at the ARM sites:
Climatology of aerosol and cloud properties at the ARM sites: MFRSR combined with other measurements Qilong Min ASRC, SUNY at Albany MFRSR: Spectral irradiances at 6 six wavelength passbands: 415, 500,
High Performance Science Cloud! Meeting the Big Data Challenges of Climate Science!
! High Performance Science Cloud! Meeting the Big Data Challenges of Climate Science!! Presentation at the 16 th Workshop on High Performance Computing in Meteorology!! Daniel Duffy 1, John Schnase 2,
NIST Big Data PWG & RDA Big Data Infrastructure WG: Implementation Strategy: Best Practice Guideline for Big Data Application Development
NIST Big Data PWG & RDA Big Data Infrastructure WG: Implementation Strategy: Best Practice Guideline for Big Data Application Development Wo Chang wchang@nist.gov National Institute of Standards and Technology
Science Gateway Services for NERSC Users
Science Gateway Services for NERSC Users Shreyas Cholia NERSC User Group Meeting October 7, 2009 Science Gateways at NERSC Web access methods to NERSC resources Much is possible beyond yesterday s ssh+pbs
Data management and archiving
Data management and archiving for COP / GOP / D_PHASE 4 th COPS Workshop 25./26.09. 2006 Stuttgart Claudia Wunram Hannes Thiemann 25.-26.09.06 / 1 Data archive Long term data archive for COPS, GOP and
EARTH SYSTEM SCIENCE ORGANIZATION Ministry of Earth Sciences, Government of India
EARTH SYSTEM SCIENCE ORGANIZATION Ministry of Earth Sciences, Government of India INDIAN INSTITUTE OF TROPICAL METEOROLOGY, PUNE-411008 Advertisement No. PER/03/2012 Opportunities for Talented Young Scientists
MAGIC: Marine ARM GPCI Investigations of Clouds
MAGIC: Marine ARM GPCI Investigations of Clouds Principal Investigators Ernie R. Lewis (Brookhaven National Laboratory) elewis@bnl.gov Warren J. Wiscombe (NASA Goddard Space Flight Center) Co-Investigators
Bathymetric Attributed Grids (BAGs): Discovery of Marine Datasets and Geospatial Metadata Visualization
University of New Hampshire University of New Hampshire Scholars' Repository Center for Coastal and Ocean Mapping Center for Coastal and Ocean Mapping 2010 Bathymetric Attributed Grids (BAGs): Discovery
Cloud-based Geospatial Data services and analysis
Cloud-based Geospatial Data services and analysis Xuezhi Wang Scientific Data Center Computer Network Information Center Chinese Academy of Sciences 2014-08-25 Outlines 1 Introduction of Geospatial Data
JASMIN Cloud ESGF and UV- CDAT Conference 09-11 December 2014 STFC / Stephen Kill
JASMIN Cloud ESGF and UV- CDAT Conference 09-11 December 2014 STFC / Stephen Kill Philip Kershaw (1, 2), Jonathan Churchill (5), Bryan Lawrence (1, 3, 4), Stephen Pascoe (1, 4) and MaE Pritchard (1) Centre
ESnet Energy Sciences Network
Biological and Environmental Research Network Requirements BER Network Requirements Review Final Report Conducted November 29-30, 2012 ESnet Energy Sciences Network DISCLAIMER This document was prepared
NASA s Big Data Challenges in Climate Science
NASA s Big Data Challenges in Climate Science Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at IEEE Big Data 2014 Workshop October 29, 2014 1 2 7-km GEOS-5 Nature Run
Roy W. Spencer 1. Search and Discovery Article #110117 (2009) Posted September 8, 2009. Abstract
AV Satellite Evidence against Global Warming Being Caused by Increasing CO 2 * Roy W. Spencer 1 Search and Discovery Article #110117 (2009) Posted September 8, 2009 *Adapted from oral presentation at AAPG
The MODIS online archive and on-demand processing
The MODIS online archive and on-demand processing Edward Masuoka NASA Goddard Space Flight Center, Greenbelt, MD, USA Production Driven by Science Over the Terra and Aqua mission lifetimes, better calibration
globus online Cloud-based services for (reproducible) science Ian Foster Computation Institute University of Chicago and Argonne National Laboratory
globus online Cloud-based services for (reproducible) science Ian Foster Computation Institute University of Chicago and Argonne National Laboratory Computation Institute (CI) Apply to challenging problems
Asynchronous Data Mining Tools at the GES-DISC
Asynchronous Data Mining Tools at the GES-DISC Long B. Pham, Stephen W. Berrick, Christopher S. Lynnes and Eunice K. Eng NASA Goddard Space Flight Center Distributed Active Archive Center Introduction
Data Management for the North American Carbon Program
Image courtesy of NASA/GSFC Data Management for the North American Carbon Program Bob Cook, Eric Sundquist, Tom Boden,, and Peter Thornton RS in NACP Workshop Missoula, MT August 20, 2004 NACP Data and
ARM-UAV Mission Gateway System
ARM-UAV Mission Gateway System S. T. Moore and S. Bottone Mission Research Corporation Santa Barbara, California Introduction The Atmospheric Radiation Measurement-unmanned aerospace vehicle (ARM-UAV)
How To Understand Cloud Radiative Effects
A Climatology of Surface Radiation, Cloud Cover, and Cloud Radiative Effects for the ARM Tropical Western Pacific Sites. Chuck Long, Casey Burleyson, Jennifer Comstock, Zhe Feng September 11, 2014 Presented
Data Management and Analysis in Support of DOE Climate Science
Data Management and Analysis in Support of DOE Climate Science August 7 th, 2013 Dean Williams, Galen Shipman Presented to: Processing and Analysis of Very Large Data Sets Workshop The Climate Data Challenge
ACRF Data Collection and Processing Infrastructure
DOE/SC-ARM/TR-046 ACRF Data Collection and Processing Infrastructure December 2004 M.C. Macduff, Pacific Northwest National Laboratory R.C. Eagan Argonne National Laboratory Work supported by the U.S.
Monitoring Tools for Large Scale Systems
Monitoring Tools for Large Scale Systems Ross Miller, Jason Hill, David A. Dillow, Raghul Gunasekaran, Galen Shipman, Don Maxwell Oak Ridge Leadership Computing Facility, Oak Ridge National Laboratory
Nevada NSF EPSCoR Track 1 Data Management Plan
Nevada NSF EPSCoR Track 1 Data Management Plan August 1, 2011 INTRODUCTION Our data management plan is driven by the overall project goals and aims to ensure that the following are achieved: Assure that
Archival of raw and analysed radar data at EISCAT and worldwide
Archival of raw and analysed radar data at EISCAT and worldwide Carl-Fredrik Enell, EISCAT Scientific Association COOPEUS workshop and EGI-CC kickoff, 11 March 2015 C-F Enell, EISCAT Radar data archival
Research Data Collection Data Management Plan
Research Data Collection Data Management Plan This document records the whole process of the data collections, including pre- preparation data,
1. Simulation 2. Archive and distribute 3. Analysis 4. Understanding
1. Simulation 2. Archive and distribute 3. Analysis 4. Understanding Problem Space Heterogeneous HPC environments Large community SSH is king No global view Very complex workflow etc, etc, etc TGCC in
CMIP6 Data Management at DKRZ
CMIP6 Data Management at DKRZ icas2015 Annecy, France on 13 17 September 2015 Michael Lautenschlager Deutsches Klimarechenzentrum (DKRZ) With contributions from ESGF Executive Committee and WGCM Infrastructure
California Standards Grades 9 12 Boardworks 2009 Science Contents Standards Mapping
California Standards Grades 912 Boardworks 2009 Science Contents Standards Mapping Earth Sciences Earth s Place in the Universe 1. Astronomy and planetary exploration reveal the solar system s structure,
globus online Reliable, high-performance file transfer as a service
globus online Reliable, high-performance file transfer as a service Steve Tuecke Computation Institute University of Chicago and Argonne National Laboratory The Challenge: Moving Big Data Easily What should
Cloud Computing @ JPL Science Data Systems
Cloud Computing @ JPL Science Data Systems Emily Law, GSAW 2011 Outline Science Data Systems (SDS) Space & Earth SDSs SDS Common Architecture Components Key Components using Cloud Computing Use Case 1:
Berkeley Research Computing. Town Hall Meeting Savio Overview
Berkeley Research Computing Town Hall Meeting Savio Overview SAVIO - The Need Has Been Stated Inception and design was based on a specific need articulated by Eliot Quataert and nine other faculty: Dear
Climate Change on the Prairie:
Climate Change on the Prairie: A Basic Guide to Climate Change in the High Plains Region - UPDATE Global Climate Change Why does the climate change? The Earth s climate has changed throughout history and
What is a GEIA Foundation?
Federation of Earth Science Information Partners Partnership Application Please complete all sections to the fullest extent possible and forward completed application to: Carol Meyer, carol.meyer@earthsciencefoundation.org.
Euro-BioImaging European Research Infrastructure for Imaging Technologies in Biological and Biomedical Sciences
Euro-BioImaging European Research Infrastructure for Imaging Technologies in Biological and Biomedical Sciences WP11 Data Storage and Analysis Task 11.1 Coordination Deliverable 11.2 Community Needs of
LabArchives Electronic Lab Notebook:
Electronic Lab Notebook: Cloud platform to manage research workflow & data Support Data Management Plans Annotate and prove discovery Secure compliance Improve compliance with your data management plans,
Software challenges in the implementation of large surveys: the case of J-PAS
Software challenges in the implementation of large surveys: the case of J-PAS 1/21 Paulo Penteado - IAG/USP pp.penteado@gmail.com http://www.ppenteado.net/ast/pp_lsst_201204.pdf (K. Taylor) (A. Fernández-Soto)
Concept of long term data archive
Concept of long term data archive for COP / GOP / DPHASE 1 st MAP DPHASE scientific meeting 6.-8. November 2006, Vienna Claudia Wunram Hannes Thiemann cops@zmaw.de 6.-8. Nov 06 / 1 Data archive Long term
e-infrastructure of DIAS
e-infrastructure of DIAS Toshihiro Nemoto 1 Masaru Kitsuregawa 2 1 Earth Observation Data Integration and Fusion Initiative, The Univ. of Tokyo 2 Director General of National Institute of Informatics(NII)
Critical Strategies for Improving the Code Quality and Cross-Disciplinary Impact of the Computational Earth Sciences
Critical Strategies for Improving the Code Quality and Cross-Disciplinary Impact of the Computational Earth Sciences Johnny Wei-Bing Lin (Physics Department, North Park University) Tyler A. Erickson (MTRI
Data Analytics at NERSC. Joaquin Correa JoaquinCorrea@lbl.gov NERSC Data and Analytics Services
Data Analytics at NERSC Joaquin Correa JoaquinCorrea@lbl.gov NERSC Data and Analytics Services NERSC User Meeting August, 2015 Data analytics at NERSC Science Applications Climate, Cosmology, Kbase, Materials,
Big Data Research at DKRZ
Big Data Research at DKRZ Michael Lautenschlager and Colleagues from DKRZ and Scien:fic Compu:ng Research Group Symposium Big Data in Science Karlsruhe October 7th, 2014 Big Data in Climate Research Big
Description of Scatterometer Data Products
Scatterometer Data:// Description of Scatterometer Data Products QuikScat is no longer operational - last data recorded: 2009-Nov-23 REMSS QuikScat data set currently ends on 2009-11-19; data after that
Globus Research Data Management: Introduction and Service Overview. Steve Tuecke Vas Vasiliadis
Globus Research Data Management: Introduction and Service Overview Steve Tuecke Vas Vasiliadis Presentations and other useful information available at globus.org/events/xsede15/tutorial 2 Thank you to
An update on the WGNE/WGCM Climate Model Metrics Panel
An update on the WGNE/WGCM Climate Model Metrics Panel Members selected by relevant and diverse experience, and potential to liaison with key WCRP activities: Beth Ebert (BMRC) JWGV/WWRP, WMO forecast
The New ADS Search Interface and API
The New ADS Search Interface and API Alberto Accomazzi - @aaccomazzi for the ADS team - @adsabs 28 September 2013 IVOA Kona Saturday, September 28, 13 The ADS Classic System No frameworks available in
Considering the Way Forward for Data Science and International Climate Science
Considering the Way Forward for Data Science and International Climate Science Improving Data Mobility and Management for International Climate Science July 14-16, 2014 Boulder, CO Sara J. Graves, Ph.D.
CHAPTER 2 Energy and Earth
CHAPTER 2 Energy and Earth This chapter is concerned with the nature of energy and how it interacts with Earth. At this stage we are looking at energy in an abstract form though relate it to how it affect
The U.S. Department of
Clouds and more ARM Climate Modeling Best Estimate Data A New Data Product for Climate Studies by Sh a o c h e n g Xie, Re n ata B. McCo y, St e p h e n A. Klein, Ri c h ar d T. Ce d e r w a l l, Wa r
Open Data and Big Data at NOAA
Open and Big at NOAA Derek Hanson International Relations Specialist on behalf of Jeff de La Beaujardière, PhD NOAA Management Architect NOAA has "Big " 10 satellites 120+ weather radars 3 buoy networks
THE STATE OF DATA MANAGEMENT IN THE DOE RESEARCH AND DEVELOPMENT COMPLEX
THE STATE OF DATA MANAGEMENT IN THE DOE RESEARCH AND DEVELOPMENT COMPLEX Report of the Meeting DOE Data Centers: Preparing for the Future Held July 14-15, 2004 Oak Ridge, Tennessee November 5, 2004 Prepared
DATA AND INFORMATICS WORKING GROUP ON VIRTUAL DATA INTEGRATION WORKSHOP REPORT
LLNL-TR-678127 DATA AND INFORMATICS WORKING GROUP ON VIRTUAL DATA INTEGRATION WORKSHOP REPORT D. N. Williams, G. Palanisamy, K. Kleese-Van Dam October 13, 2015 Disclaimer This document was prepared as
CLOUD API DOCUMENTATION v2.0. Get list of cloud servers in account
Get list of cloud servers in account https://my.quickservers.com/api/cloud/?action=list&username=username&password=password ACTION Required API action list 1640 mail.quickservers.com
FREE computing using Amazon EC2
FREE computing using Amazon EC2 Seong-Hwan Jun 1 1 Department of Statistics Univ of British Columbia Nov 1st, 2012 / Student seminar Outline Basics of servers Amazon EC2 Setup R on an EC2 instance Stat
Clean Energy Solutions Center IEA Technology Roadmap: Energy Efficient Building Envelopes Launch
Clean Energy Solutions Center IEA Technology Roadmap: Energy Efficient Building Envelopes Launch Didier Houssin and Marc LaFrance International Energy Agency 18 December 2013 Paris IEA/SPT Flagship Publication,
globus online Globus Online for Research Data Management Rachana Ananthakrishnan Great Plains Network Annual Meeting 2013
globus online Globus Online for Research Data Management Rachana Ananthakrishnan Great Plains Network Annual Meeting 2013 We started with technology proven in many large-scale grids GridFTP GRAM MyProxy
Copyright 2012 California Institute of Technology. Government sponsorship acknowledged. ( )
Design and Implementation of a in the Cloud George Chang NASA/Jet Propulsion Laboratory 1 Use Cases Hybrid Cloud Design for a Portal Hadoop and Cloud Computing for Image Tiling 2 LMMP Lunar Mapping and
Data Management/Visualization on the Grid at PPPL. Scott A. Klasky Stephane Ethier Ravi Samtaney
Data Management/Visualization on the Grid at PPPL Scott A. Klasky Stephane Ethier Ravi Samtaney The Problem Simulations at NERSC generate GB s TB s of data. The transfer time for practical visualization
The Mantid Project. The challenges of delivering flexible HPC for novice end users. Nicholas Draper SOS18
The Mantid Project The challenges of delivering flexible HPC for novice end users Nicholas Draper SOS18 What Is Mantid A framework that supports high-performance computing and visualisation of scientific
Evolution of Chinese Research Data Policy
Bilateral US-China CODATA Workshop 2014 Evolution of Chinese Research Data Policy Jianhui Li(lijh@cnic.cn) Computer Network Information Center, CAS CODATA-China 25 Aug 2014 Outline Scientific Data Sharing
PIT adoption for Climate Data Management
PIT adoption for Climate Management The German Climate Computing Center (DKRZ) 5th RDA Plenary Stephan Kindermann Overview DKRZ: A climate science service provider services for the international climate
Data Management Plan (DMP) for Princeton Plasma Physics Laboratory (PPPL) February 2015, Revision 0
Data Management Plan (DMP) for Princeton Plasma Physics Laboratory (PPPL) February 2015, Revision 0 Reviewed by: SIGNATURES ON FILE R. Hawryluk (ITER & Tokamaks) M. Ono (NSTX-U) A. Bhattacharjee (Theory)
Earth Sciences -- Grades 9, 10, 11, and 12. California State Science Content Standards. Mobile Climate Science Labs
Earth Sciences -- Grades 9, 10, 11, and 12 California State Science Content Standards Covered in: Hands-on science labs, demonstrations, & activities. Investigation and Experimentation. Lesson Plans. Presented
Comparing Properties of Cirrus Clouds in the Tropics and Mid-latitudes
Comparing Properties of Cirrus Clouds in the Tropics and Mid-latitudes Segayle C. Walford Academic Affiliation, fall 2001: Senior, The Pennsylvania State University SOARS summer 2001 Science Research Mentor:
The NERC Data Policy. http://www.nerc.ac.uk/research/sites/data/documents/d atapolicy-guidance.pdf
Data Providers The NERC Data Policy Introduces a formal requirement for all applications for NERC funding to include outline data management plans (ODMP), which will be evaluated as part of the standard
Australia s National Carbon Accounting System. Dr Gary Richards Director and Principal Scientist
Australia s National Carbon Accounting System Dr Gary Richards Director and Principal Scientist Government Commitment The Australian Government has committed to a 10 year, 3 phase, ~$35M program for a
wu.cloud: Insights Gained from Operating a Private Cloud System
wu.cloud: Insights Gained from Operating a Private Cloud System Stefan Theußl, Institute for Statistics and Mathematics WU Wirtschaftsuniversität Wien March 23, 2011 1 / 14 Introduction In statistics we
CEDA Storage. Dr Matt Pritchard. Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk
CEDA Storage Dr Matt Pritchard Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk How we store our data NAS Technology Backup JASMIN/CEMS CEDA Storage Data stored as files on disk. Data is migrated
Basic Climatological Station Metadata Current status. Metadata compiled: 30 JAN 2008. Synoptic Network, Reference Climate Stations
Station: CAPE OTWAY LIGHTHOUSE Bureau of Meteorology station number: Bureau of Meteorology district name: West Coast State: VIC World Meteorological Organization number: Identification: YCTY Basic Climatological
UK Global Forest Monitoring Network: Forest Carbon Tracking
UK Global Forest Monitoring Network: Forest Carbon Tracking Andy Shaw Director, Knowledge Exchange, NCEO Head of Strategic Business Development, ISIC GMES/GEO Forum, ISIC, 2011 What is happening to the
Clouds and the Energy Cycle
August 1999 NF-207 The Earth Science Enterprise Series These articles discuss Earth's many dynamic processes and their interactions Clouds and the Energy Cycle he study of clouds, where they occur, and
Forecast-Informed Reservoir Operations: A Concept Supporting Water Supply and Flood Control
16 inches of rain in 1 day in Central California Forecast-Informed Reservoir Operations: A Concept Supporting Water Supply and Flood Control Developed by the Center for Western Weather and Water Extremes
3rd Annual Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools Face-to-Face Meeting Report December 2013
3rd Annual Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools Face-to-Face Meeting Report December 2013 A global consortium of government agencies, educational institutions,