istsos: latest developments and first steps into the OSGeo incubation process

Transcription

1 istsos: latest developments and first steps into the OSGeo incubation process Massimiliano Cannata, Milan P. Antonovic, Mirko Cardoso FREE AND OPEN SOURCE SOFTWARE FOR GEOSPATIAL: TOWARD DIVERSITY! SEPTEMBER 14TH - 19TH 2015, SEOUL

2 2 FOSS4G2015 September 14, Monday - WS02 09:00-13:00 - Exploring the Sensor Observation Service Standard Enhanced by istsos Special Features

3 3 September 14, Monday - WS02 FOSS4G2015

4 4 Management of the hydro-meteorological monitoring network of Canton Ticino, Switzerland

5 Real time data collection In 2010, switch from analogue modem (collection every 4 hours) to GPRS sensor data transmission (real time) Needs for smarter system for collecting and dispatch measurements

6 6 Looking for a solution... Python Simple Standard Open

7 7 The Sensor Observation Service standard From The Sensor Observation Service standard is applicable to use cases in which sensor data needs to be managed in an interoperable way. This standard defines a Web service interface which allows querying observations, sensor metadata, as well as representations of observed features. Further, this standard defines means to register new sensors and to remove existing ones. Also, it defines operations to insert new sensor observations. This standard defines this functionality in a binding independent way; two bindings are specified in this document: a KVP binding and a SOAP binding (in version 2.0).

8 8 SOS User types

9 9 istsos one enabler of the IOT The Internet of Things (IoT) is the collection of billions of end devices intelligently connected and interoperating with servers and services. Combine Things like Lego blocks to create applications, services, values. How to chose the blocks? what are they? how do they fits together? We need well known language: standards for machine machine interaction! SOS is an OGC standard to: register new sensor (THING) to the Web, storing new observations retrieving desired data

10 10 The software Open Source Software (GPL v2)

11 11 Suported system types (up-to-now) in-situ - fixed - point in-situ - mobile - points

12 12 Supported version (up-to-now) SOS v1.0.0

13 13 The istsos software mod_wsgi isodate psycopg2 pytz

14 14 Some of the special features...

15 15 Easy installation and initialization and management using GUI (WebAdmin Interface)

16 16 Output formats from GetObservation request XML CSV - JSON

17 17 Aggregation on-the-fly with GetObservation request AVG, SUM, MAX, MIN Extra parameters: aggregateinterval = PT1H & aggregatefunction = AVG

18 18 Real Time Quality Check Configuration of quality index on the observed property level or sensor specific. Automatically data quality check assigning quality index on each observation based on specific constraints

19 19 Quality index example Raw data Assignment of quality indices during insertion: Meaningful data (Leve 1) Raw data Statistically sound (Level 1 + 2)

20 20 Time-Zone support eventtime T01:00:00+01 / T01:00:00+01 eventtime T02:00:00+02 / T02:00:00+02

21 21 Virtual procedures (EVAPOTRANSPIRATION) Real Sensor GRABOW Air Temperature Relative humidity Wind velocity Solar radiation FAO56 Calculation V_GRABOW Reference evapotranspiration Virtual procedure

22 22 Status Page (New) Sensor status at a glance taking in account acquisition delay and inserting errors NO ERRORS OR DELAY AKNOWLEDGED BY ADMINISTATOR PENDING ERRORS OR DELAY

23 23 Acquisition Job Scheduler (New) With Advanced Python Scheduler (APScheduler, embedded in istsos) you can schedule sensor data to be inserted at times of your choosing Sensor File Transfer of Raw Data Server Scheduler Data acquisition istsos

24 24 istsos Web Notification Service (New)

25 25 Incubating in OSGeo for quality software

26 26 Steps to start the process 1. Proposal submission to the Incubation Committee (IC) [doc, ticket, etc.] 2. IC review documentation and vote 3. Find a mentor 4. IC chair makes a motion to the Board to approve the entering in incubation 5. The Board vote 6. If motion is passed comunication is given and the project is in incubation

27 27 Requirements: BE OPEN Copyright and License Documentation Release Procedure Processes Active and healthy community

28 28 Copyright and License - Code Provenance

29 29 Documentation - Website

30 30 Documentation - Resources

31 31 Documentation Users & Devel (sphinx)

32 32 Release Procedure DEB package creation

33 33 Next steps into incubation Finalize the Code Provenance Complete Developers docs Set-up gevernance RFC 1: Project Steering Committee Guidelines RFC 2: Legal aspects of code contributions RFC 3: PSC Voting Procedures RFC 4: Release Procedure

34 34 Next steps for development istsos meet pgpool to add reliability and scalability istsos already implements a sort of SOS-P (P=processing) trough VirtualProcedures. Now we will add several time-series processing power collaborating with freewat H2020.

35 Thanks