07/11/2013 VITO Centre of Image Processing Towards an Improved Scientific Exploitation of EO Data Sources in Support of Vegetation Monitoring Erwin Goor, VITO nv
Outline» Introduction» The role & and objectives of VITO in scientific exploitation of EO data» Production, Archiving and Distribution» Processing on demand & user-oriented data analysis/dashboards 07/11/2013 2
07/11/2013 3
VITO (be) Flemish Institute for Technological Research VITO Remote Sensing Unit Geo Data Applications Technology platform satellites airplanes UAS instruments cameras sensors raw data pixel value digital image orthophoto 07/11/2013 4 information time series analysis land use change service delivery decisions end user client
The role of VITO in scientific exploitation of EO data Production, archiving and distribution SPOT-VEGETATION missions (till medio 2014) PROBA-V mission (from 2013: commissioning ongoing) Metop-AVHRR S10, ENVISAT-MERIS S10 Bio-geophysical products in GIO Global Land MARS for JRC 07/11/2013 5
The PROBA-V User Segment at VITO http://proba-v.vgt.vito.be/ Kiruna (Comm.) Redu Data Ingestion (Decoding Raw Data) Image Quality Calibration Instrument Programming Processing Data (Generate Images) Product Distribution 07/11/2013 6
The PROBA-V User Segment at VITO http://proba-v.vgt.vito.be/ Kiruna Redu Data Ingestion (Decoding Raw Data) Image Quality Calibration Instrument Programming Processing Data (Generate Images) Product Distribution 07/11/2013 7
Product Distribution Facility» Web based portal: http://www.vito-eodata.be more data coming!» Integration within GSCDA (Discovery & Ordering)» Connected to multiple processing facilities & Long-term Archive HMA product discovery HMA ordering Subscription Reporting 07/11/2013 8
Long Term Archive Data Access & Preservation» Independent Archiving Facility developed according to the OAIS principles» Integrated with PDF via the CDB» 2 main functionalities: LTDA» Data Access: ingestion and retrieval of heterogeneous EO data» Metadata is stored in a queryable metadata repository» Data Preservation: configurable lifecycle mgt» Long Term Storage: 2 LTO tape copies Ingestion Retrieval Heterogeneous data with corresponding metadata Long Term Archive Storage Management Heterogeneous data 07/11/2013 9
The role of VITO in scientific exploitation of EO data Production, archiving and distribution Remote Sensing applications research topics Agriculture Crop Monitoring, Early Warning & Food security Crop Mapping Index-based insurance Water Water quality (SPM, Chlorophyl) Environment Drought monitoring Desert Locust monitoring Ecosystem mapping Habitat quality mapping Growing towards Research platform & Information dashboards on BIG DATA Heterogeneous EO data is used: multi-mission applications 07/11/2013 10
ESE project Building towards» ESA/GSTP project» Project partners: VITO (BE), Spacebel (BE)» Key objectives: Phase 1: Nov 12 Feb 14 Requirements & Design Prototyping Phase 2: Mar 14 Sep 15 Implementation & Validation 3 Pilot projects Building an on-demand image processing and information extraction system allowing to generate user-tailored information on vegetation with the final aim to build a platform for the vegetation research to foster open innovation, suitable for rapid realization of Web accessible processing on demand services. Analyse time series of data: BIG Data Prototyping & Benchmarking of algorithms Multi-mission applications, with minimal data transfer: cloud-based solutions Using widely accepted open standards: WPS, WCPS and CSW/WMS/WCS/ EO data Expert users (data) & End users (visualise information) 07/11/2013 11
ESE system context GSCDA, ngeo, FTP WPS-G WCPS Authentication & authorisation Processing on private & public cloud 07/11/2013 12
Hadoop based Processing Engine» Use of Cloudera Hadoop distribution for distributed EO-data processing: data locality» WPS-G (reused from SSE-Grid) encapsulated Oozie workflows Workflows Oozie WPS-G client WPS-G WPS-G BPEL workflows Distributed processing mapreduce Distributed storage HDFS Data Manager Data Distribution Facilities 07/11/2013 13
Rasdaman for raster data analysis» Use of Rasdaman for fast raster data queries on 3D data cube (x/y/t)» Fast analysis of time series user-tailored information» Prototyping of vegetation parameters (i.e. image processing)» Use of WCPS as a standardised language to query raster data WCPS / WCS client On demand processing Rasdaman Petascope WCPS / WCS Web service Rasdaman Server Relational DBMS Flexible access to raster data OLAP cube Information dashboards (Interactive) Reports Database Database 07/11/2013 14
Towards User tailored Information Dashboards Demo Rasdaman petascope PostGIS OLAP Cube 07/11/2013 15
Roadmap: R&D and operationalisation Distribution Data from Sentinel s on-demand processing User tailored dashboards Cloud-based platform for researchers Federated authentication Collaboration 07/11/2013 16
Thank you Erwin Goor VITO Flemish Institute for Technological Research Belgium erwin.goor@vito.be +32.14.336725 07/11/2013 17