HYCOM Data Management -- opportunities & planning --

Size: px

Start display at page:

Download "HYCOM Data Management -- opportunities & planning --"

Christal Parsons
10 years ago
Views:

1 HYCOM Data Management -- opportunities & planning -- Steve Hankin (NOAA/PMEL) Ashwanth Srinivasan, (RSMAS) Peter Cornillon, OPeNDAP PI (URI) Mike Clancy, US GODAE Server (FNMOC) Jon Callahan, Kevin O Brien (U.Washington/JISAO) Roland Schweitzer (Weathertop Consulting), Ansley Manke (NOAA/PMEL) The OPeNDAP developers Phil Sharfstein, Dave Dimitriou (FNMOC) Dec. 05 HYCOM National Meeting December, 2005 Steve Hankin

2 Live Access Server (LAS) a configurable server

6 Desktop: Matlab, IDL, IDV, Ferret, GrADS, Information Products netcdf, HYCOM binary, ASCII, GIS layers

8 Compare fields

9 On-the-fly regridding from curvilinear to rectilinear coordinates

10 Similarly from hybrid-z to rectilinear

11 Simple analysis capabilities

12 HYCOM data at the desktop (for Matlab, IDL, Ferret, GrADS, ) The remote dataset is just a filename FDS is an OPeNDAP server standardizes datasets can perform analyses Vertical average of variable TEMP

an OPeNDAP server standardizes datasets can perform analyses Vertical

13 FDS Delayed evaluation The whole domain appears to be transformed Calculations are on-demand, surgical Can greatly reduce network data volumes Can provide regridding on-the-fly

14 Ocean obs via LAS (incl. custom constraints )

15 GTS Ocean obs on US GODAE Server

16 OPeNDAP: network access to data and semantic metadata

17 Demanding (large) products may be created in batch mode

18 Scripted access to LAS Query available data sets: >lasls Query variables in data set model_1 : >lasls model_1 Query space-time domain: >lasls model_1 sst Request a subset of data as a file: ( asc for ASCII format) >lasget -x x 20:60 -y y 20:60 -t t 11-Dec Dec f asc model_1 sst

domain: >lasls http://cpu/las model_1 sst Request a subset of data as a file: ( asc

19 LAS -- an Information Product Server LAS UI Browser NetScape Internet 1 2 LAS UI server (java) LAS product server (perl) Java Metadata Internet (OPenDAP) 3 Depth 4 e.g. work CDAT (Python/LLNL), application HYCOM viz, Local Data Remote Data Temp XML Metadata contains the intelligence Back end applications do the real work OPeNDAP provides remote data access New: Back end application via SOAP Web Service

work CDAT (Python/LLNL), application HYCOM viz, Local Data Remote Data Temp XML Metadata contains the

20 HYCOM is ready for integration with other data serving activities

21 Outreach example: PRIDE Pacific Regional Integrated Data Environment

22 HYCOM information & data portal Information access Uniform data access home Area 1 Area 2 Area 3 Project 1 Project 2 Project 3 Project 4 Exp 1 Exp 1 Exp 2 Exp 2 Live Access Server

23 Collaborating sister servers site 1 site 2 LAS Meta LAS Meta Data Data LAS UI NetScape LAS user interface Meta Meta Meta Meta VIRTUAL server LAS Meta LAS Meta Data Data site 3 site 4 Comparison between datasets becomes straightforward: Servers request regridded data from one another via FDS.

24 for breakout: next steps Two categories of data management service: 1. Inward: for HYCOM Consortium members: provide forcing fields for "downscaling" intra-consortium collaboration & interaction tools access to validation data satellite fields, climatologies, other models, in-situ 2. Outward: for others the research community the "IOOS" (end user) community potential new HYCOM modelers

25 to think about: How to make "downscaling" simpler New products or services to add e.g. standard HYCOM viz New data to add validation friendly (regridded) fields Places we should advertise our data Potential users we should contact Systematic archive strategy e.g. High performance access to surface fields (Breakout discussions to follow )

26 Discussion? Questions?

27 Some areas to think about: How to make "downscaling" simpler New products or services to ad GIS layers HYCOM viz. New data to add validation friendly (regridded) fields Places we should advertise ourselves Potential users we should contact Systematic archive strategy -- especially easy access to HYCOM surface fields Reduced suite of variables (u,v,t,s,layer thickness) canonical vertical sections GUIs for Matlab & IDL Collaborative framework for assimilation investigations (mini-godae) Web site, including model descriptions Ability to compare results How to create a controlled environment for assimilation data Other metadata to add for on-line access (model configurations) Data retention periods for forecasts? (N. Atlantic, Pacific, global)

HYCOM Meeting. Tallahassee, FL

HYCOM Meeting. Tallahassee, FL HYCOM Data Service An overview of the current status and new developments in Data management, software and hardware Ashwanth Srinivasan & Jon Callahan COAPS FSU & PMEL HYCOM Meeting Nov 7-9, 7 2006 Tallahassee,