Data Integration and long-term planning of the Observing Systems as a cross-cutting process in a NMS

Size: px

Start display at page:

Download "Data Integration and long-term planning of the Observing Systems as a cross-cutting process in a NMS"

Aubrey Goodwin
8 years ago
Views:

1 Data Integration and long-term planning of the Observing Systems as a cross-cutting process in a NMS ECAC Zurich, Setpember Ch. Häberli Deputy Head Climate Division/Head Meteorological Data Coordination & E. Grüter, M. Brändli, M. Musa, M. Kube and L. von Dach Contributions from: Ch. Appenzeller, Ch. Frei, R. Erdin, U. Germann

Häberli Deputy Head Climate Division/Head Meteorological Data Coordination & E.

2 Agenda Challenges Basic Strategy, Concepts and Blueprints An Example: Improving the precipitation picture Consequences Summary

3 The Seamless Time Dimension winter summer

4 Data Procurement Strategy MeteoSwiss operates the backbone of the monitoring systems in Switzerland and the nationwide data integration platform for measurements in the atmosphere The data procurement and data processing strategy of MeteoSwiss is an integration strategy. Aspects of integration various observing technologies and platforms observing systems outside MeteoSwiss data und meta data comprises all aspects of Enterprise Data Integration

processing strategy of MeteoSwiss is an integration strategy.

5 Data Procurement Strategy archive assimilation transfer standards continuity nationwide integration platform for meteorological&climate data meta data quality control analysis communication dissemination access

platform for meteorological&climate data meta data

6 2000 Surface weather stations in Switzerland public sector: MeteoSwiss: other: 983 private sector: 267

7 Metadata Management tools Metadata Repository data analysis Climate Services Model Validation Eidgenössisches Departement des Innern EDI Research Data for the Public Internet Durable data archive Weather Forecast Data delivery and products (on-/offline) Data extraction & interfaces (API, DB Tools, Web access, GIS, R ) Data Mart.. Database for the analysis of point data NinJo point data servers Database for gridded data QC Tools T Database for the processing of point data (incl. Raw data Repository) T L L Warnings/ Alarms data sources staging area data storage Calc, Check, Data transformation & integration Partner Observ. systems Observ. systems Aviation data Upper Air data Lightning data NWP VERA Radar CAT CM SAF INCA

. Database for the analysis of point data NinJo point data servers Database for gridded data QC Tools T Database for the processing of point data (incl.

8 number of gauges by creating Ex 1: Combination Radar surface in situ precipitation Gauges Here, we artificially double the for each existing automatic raingauge a hypothetic random daughter-station some km to the east and to the north. Red hues >40mm/h 1 Radar

for each existing automatic raingauge a hypothetic random

9 Ex: Combination Radar surface in situ precipitation station data + accurate values at stations - coarse resolution (15km, 24h) - uncertainty between the stations radar data + high spatial and temporal resolution (1km, 5min) - uncertainty in absolute values, often bias

uncertainty between the stations radar data + high spatial and

10 prediction error predicted values Eidgenössisches Departement des Innern EDI Ex: Combination Radar surface in situ precipitation stations combination radar

11 Consequence monitorig systems seamless time dimension: lasting operation keep the system adaptive (to new technologies, monitoring needs...) multifunctional systems automation and modernization various platforms (in situ and remote sensing) syntactic and semantic interoperability

12 Consequence data integration keep the integration platform adaptive (allow analyses with data from 1755 till now) but keep 1 data source for all applications allow permanently editing of the data set give highest importance to meta data data owner product owner world wide data exchange data stewardship/quality? permanent increase of data volume real-time, 24h/365d, max downtime: 15 continuous new requirements, technologies, regulations (WMO, ICAO) but no classical requirement life cycle automation and modernization

owner world wide data exchange data stewardship/quality?

13 Consequence Organisation

14 Consequence Organisation Main tasks of the cross cutting unit Long-term (strategic) planning of the data procurement chains architecture blueprints and standards for projects Support for projects: fitting the projects into the overall architecture; change management for the architecture Support in daily operations: operations coordination of the data warehouse system

for projects: fitting the projects into the overall architecture; change management for the

15 Conclusion Maintaining a monitoring system for the atmosphere is a permanent process and challenging cross-cutting process with a strong Integration aspect. The main challenge is to establish a rigorous evolution process by: 1. regular analysis of the requirements (comprehensive!) 2. regular review of observation capabilities 3. gap identification and budget review 4. implementation and operation for all parts of any data chain

The main challenge is to establish a rigorous evolution process by: 1.

16 We have achieved a balanced mix of observing technologies and platforms - including the access to weather data from sources outside the national service a balanced mix between advanced, state-ofthe-art and conventional technologies a highly integrated data management system

outside the national service a balanced mix between advanced,

17 Thank you for your attention

Data Management in support of Climate Services @ MeteoSwiss

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Data Management in support of Climate Services @ MeteoSwiss Estelle Grueter, Heike Kunz (MeteoSwiss)