istsos: latest developments and first steps into the OSGeo incubation process Massimiliano Cannata, Milan P. Antonovic, Mirko Cardoso FREE AND OPEN SOURCE SOFTWARE FOR GEOSPATIAL: TOWARD DIVERSITY! SEPTEMBER 14TH - 19TH 2015, SEOUL
2 istsos @ FOSS4G2015 September 14, Monday - WS02 09:00-13:00 - Exploring the Sensor Observation Service Standard Enhanced by istsos Special Features
3 September 14, Monday - WS02 istsos @ FOSS4G2015
4 Management of the hydro-meteorological monitoring network of Canton Ticino, Switzerland
Real time data collection In 2010, switch from analogue modem (collection every 4 hours) to GPRS sensor data transmission (real time) Needs for smarter system for collecting and dispatch measurements
6 Looking for a solution... Python Simple Standard Open
7 The Sensor Observation Service standard From http://www.opengeospatial.org/standards/sos The Sensor Observation Service standard is applicable to use cases in which sensor data needs to be managed in an interoperable way. This standard defines a Web service interface which allows querying observations, sensor metadata, as well as representations of observed features. Further, this standard defines means to register new sensors and to remove existing ones. Also, it defines operations to insert new sensor observations. This standard defines this functionality in a binding independent way; two bindings are specified in this document: a KVP binding and a SOAP binding (in version 2.0).
8 SOS User types
9 istsos one enabler of the IOT The Internet of Things (IoT) is the collection of billions of end devices intelligently connected and interoperating with servers and services. Combine Things like Lego blocks to create applications, services, values. How to chose the blocks? what are they? how do they fits together? We need well known language: standards for machine machine interaction! SOS is an OGC standard to: register new sensor (THING) to the Web, storing new observations retrieving desired data
10 The software Open Source Software (GPL v2)
11 Suported system types (up-to-now) in-situ - fixed - point in-situ - mobile - points
12 Supported version (up-to-now) SOS v1.0.0
13 The istsos software mod_wsgi isodate psycopg2 pytz
14 Some of the special features...
15 Easy installation and initialization and management using GUI (WebAdmin Interface)
16 Output formats from GetObservation request XML CSV - JSON
17 Aggregation on-the-fly with GetObservation request AVG, SUM, MAX, MIN Extra parameters: aggregateinterval = PT1H & aggregatefunction = AVG
18 Real Time Quality Check Configuration of quality index on the observed property level or sensor specific. Automatically data quality check assigning quality index on each observation based on specific constraints
19 Quality index example Raw data Assignment of quality indices during insertion: Meaningful data (Leve 1) Raw data Statistically sound (Level 1 + 2)
20 Time-Zone support eventtime 2013-01-01T01:00:00+01 / 2013-01-07T01:00:00+01 eventtime 2013-01-01T02:00:00+02 / 2013-01-07T02:00:00+02
21 Virtual procedures (EVAPOTRANSPIRATION) Real Sensor GRABOW Air Temperature Relative humidity Wind velocity Solar radiation FAO56 Calculation V_GRABOW Reference evapotranspiration Virtual procedure
22 Status Page (New) Sensor status at a glance taking in account acquisition delay and inserting errors NO ERRORS OR DELAY AKNOWLEDGED BY ADMINISTATOR PENDING ERRORS OR DELAY
23 Acquisition Job Scheduler (New) With Advanced Python Scheduler (APScheduler, embedded in istsos) you can schedule sensor data to be inserted at times of your choosing Sensor File Transfer of Raw Data Server Scheduler Data acquisition istsos
24 istsos Web Notification Service (New)
25 Incubating in OSGeo for quality software
26 Steps to start the process 1. Proposal submission to the Incubation Committee (IC) [doc, ticket, etc.] 2. IC review documentation and vote 3. Find a mentor 4. IC chair makes a motion to the Board to approve the entering in incubation 5. The Board vote 6. If motion is passed comunication is given and the project is in incubation
27 Requirements: BE OPEN Copyright and License Documentation Release Procedure Processes Active and healthy community
28 Copyright and License - Code Provenance http://sourceforge.net/p/istsos/wiki/code_provenance_review/
29 Documentation - Website http://istsos.org/
30 Documentation - Resources http://istsos.org/
31 Documentation Users & Devel (sphinx)
32 Release Procedure DEB package creation
33 Next steps into incubation Finalize the Code Provenance Complete Developers docs Set-up gevernance RFC 1: Project Steering Committee Guidelines RFC 2: Legal aspects of code contributions RFC 3: PSC Voting Procedures RFC 4: Release Procedure
34 Next steps for development istsos meet pgpool to add reliability and scalability istsos already implements a sort of SOS-P (P=processing) trough VirtualProcedures. Now we will add several time-series processing power collaborating with freewat H2020.
Thanks http://istsos.org