Big Data Processing and Apps for Citizens' Observatories - The CITI-SENSE Approach VGI and Crowdsourcing session, Lisbon, Portugal Thursday May 28 th, 2015, 1100-1120 Arne J. Berre, Arne.J.Berre@sintef.no
5 Citizen Observatory projects
Crowdsourcing workshop: Citizens Observatories Infrastructures for Citizen Science and Crowd Sourcing - concepts, methodologies, apps and sensors with INSPIRE in mind, Friday May 29 th, 1100-1700
Dates: 01/10/2012-30/09/2016 Duration: 48 months Budget:12M Partners: 28 partner organisations from Europe, Israel, South Korea and Australia Grant agreement nº: 308524 Project web portal: http://www.citi-sense.eu Citizens observatory central web portal: http://co.citi-sense.eu CITI-SENSE Project data
CITI-SENSE partners
CITI-SENSE Development of sensor-based Citizens Observatory Community for improving quality of life in cities Citizens observatories communities that share technological solutions, information products and services and community participatory methods. Complementing established environmental data and information systems, improving local environmental decision making. Nine cities (Barcelona, Belgrade, Edinburgh, Haifa, Ljubljana, Oslo, Ostrava, Vienna, Vitoria) use sensors to gather data on outdoor urban spaces and indoor school environments.
www.citi-sense.eu CITI-SENSE Mobile Sensors
CITI-SENSE Sensor platforms for Air Quality Sensors Mobile Personal Sensor Package (PSP) Solution/apps Ateknea with Sensing&Control (In Crowdsourcing workshop, Outdoor session in Lisbon on Friday May 29th, 1100-1700) Atmospheric sensors Atmospheric Geotech/EnviroLogger Geotech Radon sensor OBEO SenseItNow Spanish Vittoria app with SensApp/WFS NILU, Tecnalia, (SINTEF) DUNAVNET platform Dunavnet VESNA platform JSI
Personal Sensor Pack (PSP) The Personal Sensor Pack developed by Ateknea is equipped with the following sensors: NO 2, O 3, CO (ppb) Temperature ( C) Relative Humidity (%) USB connectivity Bluetooth 2.0 New version released May 2015
In situ sensors
SenseItNow app
VESNA App This project has received funding from the European Union s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 308524 12 of 21
CITI-SENSE Platform Human Sensor Data Service MANAGE OBSERVE -Static --Mobile --Questions PUBLISH DISCOVER COMPOSE VISUALISE ANALYSE ACT NOTIFY Sensor Application Platforms VESNA Dunavnet. GEOSS Common Infrastructure(GCI) Discovery& Access Broker (DAB) Component& Service Registry (CSR)
XYZ Sensor package NN App SenseItNow App SensApp Log SensApp Android XYZ portal CivicFlow portal CITI- SENSE portal XYZ Server CivicFlow Server SensApp Server GEOSS, GMES, Copernicus GNSS INSPIRE, Spatial and Environmental Data Services Platform (SEDS) WFS-T interface Sensor Registration Service Sensor Data Ingest Service Data Storage and Processing Service Data Publication Service Event Notification (optional future) Linked Data Platform (optional future)
CITI-SENSE Platform Data flow dfd Data Flow Diagram GEOSS SensApp Platform Sensor Data Provider Data Ingestion Services Data Validation Spatial & Environmental Data Platform Data Publication Services Data Consumers Sensor Data Provider Authentication Linked Data Platform Authentication Sensor Data Provider
CITI-SENSE and GEOSS
GEOSS and Community portals GEOSS User Resources Providers Discovery & Access GEOSS Registries: Standards & Interoperability User Requirements Best Prac ces Wiki Register * Prototype capabili es Service Monitoring GCI Architecture Component & Service Registry (CSR) GEOSS Resources GEO Web Portal Discovery and Access Broker (DAB) Clearinghouse (CH) Services and SW Applica ons e.g. So ware, Data Access, Processing, Community Portals, Documents harvest GEOSS GEOSS Common Infrastructure Seman c Component* Integrated/Federated EO Discovery/Access Systems e.g. GENESI, CWIC, FedEO* real- me search data data EO data Catalogues & Repositories e.g. IDN, INSPIRE, geo.data.gov Link from GEOSS Portal Community View of GEOSS Resources GCI Access to Community Infrastructure Enables Integration of GEOSS and non-geoss Registered Resources Community Infrastructure Community Catalogue Community Portals Community Broker Helper Application s Community Data, Information, Services and Applications Citizens Observatory Portals Register Community Resources as Appropriate
Human Sensor Data Service MANAGE OBSERVE PUBLISH DISCOVER COMPOSE DISCUSS ANALYSE ACT NOTIFY GEOSS/INSPIRE/Member State Common Infrastructures Registries Components & Services GEO Portals Discovery Service Citizen Participation CITI-SENSE Observatory User Empowerment Social media Protocol for Citizen Empowerment Web Apps, Mobile Apps, GEO-PORTALS, REPORTING Standards & Interoperability Discovery & View Application CITI-SENSE Products and Services Best Practices Metadata editor Business Process Tier User Requirements Vocabularies GEOSS Clearinghouse Registers: Ontologies App Schemas.. User & Rights Management Workflow Management & Orchestration (Service Chaining) Uncertainty Handling & Provenance Semantic Annotation, Mediation & Discovery Data Composition & Fusion Services Visualisation & Portrayal Services Model Transformation & Model-as-a Service Smart Phone Mobile Sensors Sensor Platform Tier In situ/mobile Sensors Data Access Tier Mobile Devices, Apps, VGI Bluetooth Low Energy (BLE) Wi-Fi Intelligent Gateways Adaptive Sensors (ThingML, Contiki, TinyOS, ) OGC Web Services (WFS, WCS, SOS) Event Services (WS-N, SAS, SES) Linked Data Services Download Services
The Big Data V's Volume Velocity Variety Veracity Value Data at Rest Terabytes to exabytes of existing data to process Data in Motion Streaming data, requiring msecondsto respond Data in Many Forms Structured, unstructured, text, multimedia, Data in Doubt Uncertainty due to data inconsistency & incompleteness, ambiguities, latency, deception Data into Money Business models can be associated to the data Operational, Archive Big Data Processing WFS, Linked Data 9-6-2015 www.bdva.eu 19
http://www.proasense.eu Big Data stream processing with predictions and detection of events
ProaSense Big Data Event architecture Storm MongoDB Kafka
Apache Storm Bolts and spouts Stream-based communication Polling input, push-based internals Distributed and resilient 23
Extending CITI-SENSE with Linked Data http://project.dapaas.eu This project has received funding from the European Union s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 308524 24 of 21
http://dapaas.eu How can we simplify Linked Open Data publication and consumption?
DaPaaS Enablers Grafter Grafterizer (Graphical Tool & DSL) DaPaaS platform RDF database-as-a-service RDF DDP PLUQI Open Data Visualizationas-a-service
Citizens Observatories Web Portals
Thank you for your attention! Find us on CITI-SENSE CO s central web portal: http://co.citi-sense.eu Common CO project s web site: http://www.citizen-obs.eu/ LinkedIn: https://www.linkedin.com/groups/citizens-observatories-5164755 Facebook: https://www.facebook.com/int.cit.obs Twitter: https://twitter.com/citizensobs Email: Arne.J.Berre@sintef.no CITI-SENSE web site: http://citi-sense.nilu.no/