Data Centre for French Coastal Operational Oceanography (CDOCO) M. Fichaut (IFREMER France) A. Bonnat, T. Carval, F. Lecornu, JF. Le Roux, E. Moussat, L. Nonnotte, S. Tarot
Context PREVIMER : the French coastal operational forecasting system since 2006 To provide synoptic observations and 48 hours to 6 days forecasts on the French marine coastal areas From regional areas (the Channel, the Bay of Biscay and NW Mediterranean) to local sectors For the following parameters: direction and intensity of currents, sea-surface and bottom temperature, salinity, sea level, waves: frequency, direction and height, nutrients and phytoplankton concentration, water quality
PREVIMER models Temperature, currents, sea level and waves in the Iroise Sea (D1)
PREVIMER models Temperature, currents, sea level and waves in the Iroise sea (D1) Primary production over the bay of Biscay (D3)
PREVIMER models Temperature, currents, sea level and waves in the Iroise sea (D1) Primary production over the bay of Biscay (D3) Turbidity in the Bay of Vilaine and Southern Brittany (D4)
PREVIMER models Temperature, currents, sea level and waves in the Iroise sea (D1) Primary production over the bay of Biscay (D3) Turbidity in the Bay of Vilaine and Southern Brittany (D4) Primary production, nutrients and plankton over Brittany (D6)
PREVIMER models Temperature, currents, sea level and waves in the Iroise sea (D1) Primary production over the bay of Biscay (D3) Turbidity in the Bay of Vilaine and Southern Brittany (D4) Primary production, nutrients and plankton over Brittany (D6) Temperature, salinity, currents and seal level along the French coastlines (F1-F2)
Goals of the data centre To provide operational data delivering services to the actors and users of coastal operational oceanography (PREVIMER) To develop partnerships with the data producers and the data users To develop the operational structure for data management : monitoring of the system, catalogs of data and products, definition of format, automatic and manual data collection, quality checks, archiving and distribution
Tasks of the data centre to organise the collection of real time or delayed mode data to quality check the collected data (in situ data) to archive the collected data to deliver data to the models to archive models results to deliver models results to PREVIMER Web site to make in-situ data available to the different users of the coastal oceanography
Setting up the data center 4 stages : Definition of the lists of data needed by PREVIMER demonstrators Development of partnerships and agreements with data providers Software development and implementation of hardware infrastructure (discs for data archiving) Set up of the operational data management structure based on existing Coriolis system.
Data inventory: forcing data Limit conditions at open boundaries Mercator forecasts and hindcasts Swell fields WW3/REFDIF Initial conditions Climatologies Levitus, Bobyclim, Medar/Medatlas Mercator outputs Sea water/atmosphere interface Wind and thermal fluxes Météo-France, NCEP, MM5 Spatial winds CERSAT Fresh water input River flow rate SPDIREN/COLIANE, IAV (Vilaine), CNR (Rhône) Precipitation rate Météo-France
Data inventory : reference data Coastline 0 isobath Bathymetry DTM Bay of Brest at 100 m DTM Bay of Biscay Channel and South of North Sea at 1km and 500 m DTM French coastlines at 100 m from Spain to North Sea
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA
RECOPESCA Network of VOS (Voluntary Observing Fishing Ships) 25 ships data-recording network of fishing activity routine acquisition of environmental data: temperature, salinity by CTD sensors on trawls and traps data are transferred to the data centre by GPRS in near real time
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy
MAREL network MOLIT buoy MAREL buoy Automated acquisition and transmission of data related to the water quality, with measurements of: temperature, salinity, dissolved oxygen, ph, turbidity, chlorophyll, sea level, nutrients MOLIT buoy
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy Islands network
Islands network Temperature and salinity measurements on 4 islands of the northern bay of Biscay Island are located at a distance from the large local gradients linked to local inputs (Loire, Gironde) Data transmitted in delayed mode
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy Islands network Drifting buoys
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy Islands network Drifting buoys Sea level data (French hydrographic office tide gauges)
SHOM tide gauges from RONIM and SONEL networks Real time access to sea level data collected by 5 stations : Brest, Cherbourg, Le Conquet, Saint-Nazaire and La Réunion And delayed mode access to 30 other stations around France and overseas French territories
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy Islands network Drifting buoys Sea level data (French hydrographic office tide gauges) Wave height and direction SHOM High frequency radar CETMEF swell buoys
Photo Guy Amis CETMEF OBSERVATIONS CETMEF swell buoys At present, 5 buoys : Minquiers, Pierres-noires, Cap-Ferret, Porquerolles, Cap Corse. In the future, 20 buoys. Data transmitted in real-time to CDOCO.
Data inventory: in situ data Temperature and salinity measurements (vertical profiles, underway data, time series) RECOPESCA MAREL network, MOLIT buoy Islands network Drifting buoys Sea level data (French hydrographic office tide gauges) Wave height and direction SHOM High frequency radar CETMEF swell buoys Meteorological buoys from Météo-France and Met-Office (UK)
Around 20 meteorogical buoys From the BDM : meteorological database of Météo- France.
Data inventory : satellite data Data not collected by the CDOCO, managed in CERSAT (Centre for Satellite Exploitation and Research) used for validation and assimilation Sea surface temperature (SST) Ocean colour Wind Altimetry SST : 09/08/2006 CHLOROPHYLLE A : 09/08/20060
Quality assurance Quality checks of in situ-data performed by the data provider or done by CDOCO, following international recommendations (IOC, ICES ) Automatic/objective checks Visual/subjective checks Outliers Vertical instability Global range On land location
Data archiving For both observed data collected for the models model results (hindcasts, nowcast analyses and forecasts) A specific server, dedicated to the data centre 32 Terabytes 24 Gigabytes of model results each day
Data access (1) 2 formats available CSV format mainly used for in-situ data NetCDF format compliant with CF-1 metadata convention mainly used for gridded data (model results) Several ways of distributing data for different types of user External models results (MERCATOR, Météo-France, MFS) available as soon as collected by CDOCO for PREVIMER For PREVIMER, in situ data distributed every ¼ hour, one file per platform containing the last 30 days of measurements every day with data from month M-1 and Month M
Data access (2) Several ways of distributing data for different types of user on ftp site, only accessible to authorized users some models outputs (D1, F1) available on OpenDAP through a TDS server Eulerian in situ data available on the Web at : http://www.coriolis.eu.org/cdc/euleriannetworks/cdcalleuleriannetworks.asp public access for public data (CETMEF swell buoys, MAREL network ) Authorized users only for rainfall, river outflows and tide-gauges data
Monitoring of the system Web based interface to monitor all the processes run in the data centre (more than 40 data collection and distribution). Monitoring board with a synthetic view of the performance of the processes for the 4 last days. Displays coloured faces to see at a glance whether a process has succeeded or not. Displays also monthly and yearly graphs on the duration of data collection, and on the number of data collected
Spatial data SST, Ocean colour PREVIMER Models 7 models, 1 run per day 1 waves model, 2 runs per day Reference data Bathymetry (SHOM, IFREMER), coastline CDOCO Monitoring of the system Model results = NetCDF files (24 Gigabytes per day) Delayed mode Forcing data River flow, rainfall and evapotranspiration, atmospheric data, model results (MERCATOR, WW3, ), climatologies Real time Quality checks PREVIMER Web site Forecasts on currents, waves, sea level, temperature and salinity on the French coastline at different scales. In situ data Vessel data (CTD,TSG, ADCP, ) T,S (Recopesca, island Network) Tide Gauge (SHOM) Swell buoys (CETMEF, Météo-France) Turbidity buoy (MOLIT) Marel Buoys (Roslit, Gironde) Radars (VIGICOTE) Archive RDBMS + hard disk Data users Access through FTP, OpenDap, Thredds, http
Future developments (1) After 3 years, the Coastal Operational Oceanography data centre (CDOCO) fulfilled its objectives with regards to data management activities but it can be improved, with new developments like : OpenDAP access to more model results, with a better integration of these sub setting services into PREVIMER website Synchronisation of all the automatic procedures and particularly communication between the data collection routines and the run of the models Monitoring of the model runs and report about these runs included in the monitoring board Define and set up the downstream services for the products
Future developments (2) Catalogue of products, developed in ISO-19115 in cooperation with other major projects on operational oceanography like MerSea, MyOcean and ECOOP Operate the model and the data centre based on the ITIL approach (Information Technology Infrastructure Library) with definition of good practices and associated tools to produce indicators on service levels Set up a centralised management of all the requests concerning PREVIMER (PREVIMER user desk): data request, questions and remarks of users, comments on the Web site, particular product needs