The MONGOOS Data portal EMODNET ROOS meeting, Brussels, 18 November 2013 Leonidas Perivoliotis Hellenic Center for Marine Research, Greece
The MONGOOS Data Portal Collects and process data from Insitu platforms in the Mediterranean Sea The regional node for the Insitu component of Marine Core Service (MCS) Single point access for data provision to Med Marine Forecasting Center (MFC) Distributes added value (quality controlled) data in a unique format Built through MyOcean I&II, but it supports the Mediterranean observing component of major EU projects in Operational Oceanography (Jerico, Perseus, FixO3). Continuous expansion in terms of capacity in order to become the Regional Insitu MONGOOS Data Center.
Main functions The MONGOOS Data Portal o Data acquistion: Data are collected through direct links with the Production Units Data are converted in a unique format (Oceansites netcdf v1.1 compatible) Extended guidance for new partners in order to provide all the necessary information o Quality control: Apply automatic quality control procedures on each parameter, elaborated in coherence with international agreement (in particular SeaDataNet). Procedures applied after agreement with the data originators in order to avoid conflicts and effort duplications. o Validation/Assessment : Assess the consistency of the data over a period of time in an area. The aim is to detect possible incoherencies with nearby data that could not be detected by automatic QC. o Distribution: Disseminates the data through MyOcean/EMODET to the external users
The MONGOOS Data Portal Real Time QC Function : Quality Control procedures are applied in: Temperature and Salinity Sea Level Current from drifters or Current from moorings Bio-geochemical Still under development Implementation automated procedure that should avoid flagging good data applied through an agreement with the primary Production Unit In most cases minor corrections are applied to the flags that have already been assigned by the Production Unit
Automatic QC for Argo, gliders, CTDs and XBTs The MONGOOS Data Portal Real-time quality control on temperature and salinity data Meta data-implementation and/or verification: Position, Date, Method, Specification, PI, Processing, Comments Automatic QC for time series QC Flag Scale Visual QC Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Pressure Increasing Test Test 9: Spike Test Test 10: Top and Bottom Spike Test Test 11: Gradient Test Test 12: Digit Rollover Test Test 13: Stuck Value Test Test 14: Density Inversion Test 15: Grey List (Argo, Glider) Test 16: Gross salinity or temperature sensor drift (Argo, Glider) Test 18: Frozen Profile Test Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Spike Test Test 9: Climatology Test 11: Instrument range Test 12: Rate of change in time Test 13: Stationary Test code Meaning 0 no QC was performed 1 good data 2 probably good data 3 bad data, but correctable 4 bad data 5 value changed 6 below detection limit 7 in excess of quoted value 8 interpolated value 9 missing value A Incomplete information mandatory for automated QC display Meta data display the profiles T/S diagrams time/depth plots scatter plots maps displaying location control of spikes and other irregularities control of density profile if extended QC is included, visual QC can be reduced to be only applied on alerted profiles Extended QC: Comparison to a climatology and the surrounding measurements: objective mapping or local interpolation method. Other comparisons.
The MONGOOS Data Portal RT FILES Mooring Data Validation of Temperature and Salinity data DM FILES HCMR Data Base Vessel Data Glider Data VALIDATION Cross-Validation of T, S ftp Serv. HCMR Data Base Float Data In-Situ Product Validation procedure: Cross-validation of the physical variables (T, S) as derived from VOS, moorings, floats and gliders. The estimated differences will be analyzed as a function of the spatial and temporal distances between the measurements
The MONGOOS Data Portal The portal structure is in compliance with MyOcean standards
HCMR Moorings (M3A, Poseidon network) MONGOOS Insitu TAC Production Line Daily files GDAC The Med portal contains data beyond the MyOcean portfolio by hosting all the available data from the different platforms (meteo & wave data, additional marine parameters) ENEA CTDs/XBTs OGS Drifters ARGO DM IFREMER Gliders ARGO RT GTS PdE Mooring + tide gauges Additional Providers (CNR, OC-UCY, ISPRA, NIB, OGS, ) T S B i o c h e m I c a l Real Time QC ftp Serv. MFC s HCMR MONGOOS Regional DU Mediterranean In Situ TAC EMODNET PP External Users (RIU, EIA) -Public, -Standard, -Specific -Privileged (Downstream)
The MONGOOS Data Portal Monitoring performance Daily recording of several indicators regarding data capacity, quality of information and timely update of the portal from the data originators
The MONGOOS Data Portal Data availability on 15th of November 2013 (1990-now) 126 profilers 42 active 27 Gliders 3 active 95 moorings 66 active 341 drifters 6 active 123 XBTs 72 CTDs 82 Thermosalinographs 6 active 2168 unique platforms 30258 total files
The MONGOOS Data Portal Data aggregation from SeaDataNet 1600 cruises (1990-2012) from SeaDataNet : 35332 T&S casts Assessment of historical data set
The MONGOOS data portal Expansion the data capacity Engage more partners Data Aggregation through Jerico Project CNR - ISMAR Expecting 7 mooring stations Currently receiving data from 5 moorings NADR-SNG, Data from: 01/01/2013 Parameters: DRYT, WSPD, WDIR, TEMP, PRES Molo-Bandiera, Data from: 05/07/2013 Parameters: DRYT, WSPD, GSPD, WDIR, TEMP Molo-Sartorio, Data from: 05/07/2013 Parameters: SLEV ISMAR-Head-Office, Data from: 05/07/2013 Parameters: ATMS, PRRT PALOMA, Data from: 05/07/2013 Parameters: TEMP, DRYT OGS Expecting 9 mooring stations Currently receiving data from 2 moorings ADN-MAMBO1 Parameters: WSPD, WDIR, RELH, ATMS ADN-MAMBO4 Parameters: WSPD, WDIR, RELH, ATMS Currently only latest data available. Expecting monthly files along with the other moorings ISPRA Expecting 15 mooring stations Data from 12 moorings available in monthly directory. Daily transmission from 9 moorings. ANCONA-61218 Starting date of data: 01/06/2013 CATANIA-61207 Starting date of data: 01/06/2013 CETRARO-61211 Starting date of data: 01/06/2013 CIVITAVECCHIA-61216 Starting date of data: 01/06/2013 CROTONE-61210 Starting date of data: 01/06/2013 LASPEZIA-61219 Starting date of data: 01/06/2013 MONOPOLI-61215 Starting date of data: 01/06/2013 PALERMO-61209 Starting date of data: 01/06/2013 PONZA-61214 Starting date of data: 01/06/2013 VANEZIA-61220 Starting date of data: 01/06/2013 CAGLIARI-61221 Starting date of data: 12/08/2013 MAZARA-61208 Starting date of data: 29/08/2013 Parameters: RELH, TEMP, VDIR, VSMC, VTDH, VTPK, WDIR, WSPD NIB-MBSS 1 mooring station VIDA Parameters: EWCT, NSCT, WSPD, WDIR, DRYT, RELH, TEMP, PSAL Data from: 17/06/2013 Further expansion expected through PERSEUS project
The MONGOOS data portal EMED is clearly Under Sampling (at least in real time) Data availability on 14/11/13
View on the data - Gliders: Levantine Sea, April 2012 Start End Start End Start End Temperature and Salinity data collected through a glider mission in Levantine Sea during April 2012. The presence of the newly formed Levantine Intermediate Water (LIW) with salinity values higher than 39.1 psu is clearly identified between 100-300m. Moreover, as the glider is moving northwards, enters in a area of anticyclonic movement, as it can be seen by the deepening of the temperature and salinity contour lines.
View on the data - Moorings: Long time series data, Pylos, Ionian Sea Three years T&S data between 0-500m from the POSEIDON buoy in Pylos. The LIW signal, between 150-400m, is clearly stronger in 2010 with higher values both in salinity (>39 spu) and temperature.
View on the data - Drifters: Ligurian and Balearic Seas, April 2012 Start End The well known westwards surface flow along the Italian and French coasts towards the Gibraltar straits has been verified by the drifters trajectories released in the area during April 2012. Surface waters are 2-3 o C warmer in the Ligurian Sea compared with those observed around the Gulf of Lions. None of the drifters released in the Ligurian Sea entered the Gulf of Lions. It seems that the presence of an anticyclonic movement inside the gulf does not allow the entrance of the drifters and push them more westwards. The trajectory of the only drifter released inside the gulf verifies the existence of this anticyclone.
The MONGOOS Data Portal Known gaps in spatial coverage Adriatic Sea Data from the Eastern part (Slovenia, Croatia, Albania, Monte Negro) Data from ISPRA (Italy) are partly included Expecting more through EMODNET E2M3A buoy operated by OGS is still missing Corsica/Sicily Data from offshore platforms operated by CNR-ISMAR is missing Malta Coastal stations are missing (T&S, sea level) Cyprus Missing coastal stations (T&S, sea level) Data from glider missions is included Turkey Data from Mediterranean platforms is missing Israel Coastal stations (T&S, sea level) are missing Northern African coast No data is available Limited knowledge about capacity
The MONGOOS Data Portal Future plans - Evolution through EMODNET funding Data capacity Engage more partners to contribute their data in the portal Filling the known gaps. EMODENT Adriatic meeting (EMODENT, EuroGOOS, HCMR and Adriatic countries) scheduled for 3 & 4 of December is the first coordinated action to gather and disseminate the missing data to the marine community. Building stronger connections with Northern African countries. Development Complete support for the data conversion from any kind of input to OceanSites Netcdf format. Data base support for the whole extend of the data Enhance QC system Compile the validation/assessment results in an easy to process way in order the data originator to be efficiently informed for the discrepancies found (pilot implementation through the data exchange with SeadataNet) Full integration with EMODENT Possible development of a regional data visualization and downloading system
http://www.mongoos.eu All stations T & S
http://www.mongoos.eu Meteo Waves
http://www.mongoos.eu Currents Sea level