ArcGIS GeoEvent Extension for Server: Working with Community Connectors and Processors

Transcription

1 ArcGIS GeoEvent Extension for Server: Working with Community Connectors and Processors Greg Tieman Patrick Hill

2 Real-Time GIS Integration and exploitation of streaming data Web Device Desktop Integrates real-time streaming data into ArcGIS Performs continuous processing and real-time analytics Sends updates and alerts to those who need it where they need it GeoEvent Extension ArcGIS Server

3 Community Connectors

4 Receiving Real-Time Data Easily integrate real-time streaming data into ArcGIS using an Input Connector GeoEvent Extension Inputs GeoEvent Services Outputs You can create your own connectors. Poll an ArcGIS Server for Features ActiveMQ CompassLDE Out of the Box HTTP REST WS WS Poll an external website for GeoJSON, JSON, or XML Receive Features, GeoJSON, JSON, or XML on a REST endpoint Receive GeoJSON or JSON on a WebSocket Receive RSS Receive Text from a TCP or UDP Socket Subscribe to an external WebSocket for GeoJSON or JSON Esri Gallery CAP Cursor-on-Target Exploitation Support Data Instagram KML Kafka * Partner Gallery envirocar exactearth AIS FAA (ASDI) GNIP Networkfleet * * * OSIsoft *.csv Watch a Folder for new CSV, GeoJSON, or JSON Files MQTT Valarm NMEA 0183 RabbitMQ Sierra Wireless (RAP) Zonar * Trimble (TAIP) Twitter

5 Sending Real-Time Data Easily disseminate notifications, alerts, and updates using an Output Connector GeoEvent Extension Inputs GeoEvent Services Outputs You can create your own connectors. Add or Update a feature ActiveMQ Out of the Box HTTP WS im Publish Text to a UDP Socket Push GeoJSON or JSON to an external Website Push GeoJSON or JSON to an external WebSocket Push Text to an external TCP Socket Send a Text Message Send an Send an Instant Message Esri Gallery Cursor-on-Target Hadoop Kafka MongoDB RabbitMQ Twitter *.csv Send Features to a Stream Service Write to a CSV or JSON File Partner CESIUM *

6 Demo Using a Community Connector Instagram Connector

7 What is a Connector?

8 Connectors What is a connector? Connectors made up of two customizable components transport and adapter Types of transports and adapters: - Inbound transport connects to and gets raw bytestream - Inbound adapter converts raw bytestream into a GeoEvent - Outbound adapter converts GeoEvent into a byte array, formatted to an output type - Outbound transport accepts arrays of bytes from the adapter and transmits them

9 Receiving Real-Time Data Input Connector = Transport + Adapter GeoEvent Extension GeoEvent Services Inputs Outputs WS Connectors Transport Adapter Receive JSON on a WebSocket WebSocket JSON REST Receive XML on a REST endpoint HTTP XML Transports Adapters Esri Gallery ActiveMQ Kafka RabbitMQ Twitter * * Feature Service File HTTP HTTP+BasicAuth HTTP+OAuth JSON JSON (Feature) RSS Text XML Esri Gallery CAP Cursor-on-Target GeoMessage Instagram NMEA TCP Sierra Wireless (RAP) UDP Trimble (TAIP) WebSocket Twitter VMF

10 Sending Real-Time Data Output Connector = Adapter + Transport GeoEvent Extension GeoEvent Services Inputs Outputs Send an Connectors Send Features to a Stream Service Adapter MessageFormatter JSON-Feature Transport SMTP StreamService Adapters Transports Partner CESIUM Cache JSON JSON (Feature) Message Formatter RSS Text Feature Service File HTTP HTTP+BasicAuth HTTP+OAuth SMS SMTP Stream Service TCP UDP WebSocket XMPP Esri Gallery ActiveMQ Hadoop Kafka MongoDB RabbitMQ Twitter * * WebSocket

11 Building Community Connectors & Processors What you will need Java 6 or 7 GeoEvent SDK

12 Demo Building and Using a Connector Common Alerting Protocol (CAP) Connector

13 Community Processors

14 Applying real-time analytics GeoEvent Processing You can perform continuous analytics on GeoEvents as they are received using a processor. GeoEvent Extension Inputs GeoEvent Services Outputs You can create your own processors. Buffer Creator Geotagger Add XYZ Range Fan Out of the Box Convex Hull Creator Difference Creator Envelope Creator Field Calculator Field Enricher Field Mapper Incident Detector Intersector Projector Simplifier Symmetric Difference Track Gap Detector Esri Gallery Bearing Ellipse Event Volume Control Extent Enricher Field Grouper GeoNames Lookup Reverse Geocoder Service Area Creator Track Idle Detector Query Report Visibility Unit Converter Field Reducer Union Creator Motion Calculator Spatial Query

15 Processors What is a processor? Processors perform some action on each GeoEvent passed to it Processors can be used to: - Modify existing fields or the geometry - Add new fields - Filter - Create new GeoEvent(s) GeoEvent Extension GeoEvent Services Inputs Outputs Processors

16 GeoEvent Processing Calculate new fields on a GeoEvent A Field Calculator processor uses an expression to - calculate a new field or update an existing field. - Expressions can be mathematical expressions, string operations, or regular expressions. SuspectID V10987 SuspectID V10987 Date Date BatteryLevel Low Distance Event Expression Enriched Event BatteryLevel Low Distance 0.02 Speed 1.2 Course geometry , Convert from Feet to Miles Expression: Speed 1.2 Course geometry , Distance / 5280

17 GeoEvent Processing Enrich the geometry of a GeoEvent A Buffer Creator processor - applies a buffer to a geometry field on the incoming GeoEvent - and either: - enriches the GeoEvent with a new geometry field representing the buffered result - or replaces the geometry of the incoming GeoEvent with the buffered result SuspectID S90909 SuspectID S90909 Date Date BatteryLevel High Distance 0.2 Event Enriched Event BatteryLevel High Distance 0.2 geometry , geometry , buffer rings" : [ [ [ , ],[ , ] ]]

18 Demo Working with a Community Processor Spatial Query & Query Report Processors

19 Demo Summary GeoEvent Extension Java SDK - Java 6 or 7 Building Maven - Modern IDE s can import and build the project Source Control GitHub - A Git client is required

20 Get involved!

21 GeoEvent Communities Contribute and use the community connectors and processors esri.github.io/#geoevent links.esri.com/geoevent

22 How can you get involved? GeoEvent GitHub projects Access GeoEvent esri.github.io/#geoevent Update connectors/processors Create a pull request and/or submit issues Changes are reviewed and committed as appropriate

23 How can you get involved? GeoEvent Galleries links.esri.com/geoevent-partner-gallery Invite only join by ing links.esri.com/geoevent-community-gallery Sign in to ArcGIS Online Browse to the link above Click

24 Other GeoEvent Extension Sessions The Road Ahead: ArcGIS for Server and Portal for ArcGIS - Fri 8:30-9:30am, Primrose C/D

25 Where to learn more? Resources To learn more, visit the Get Started area of the GeoEvent Extension product page: Introduction - Notifications - Stream Services - RSS, HTTP, Files - REST Admin API - Clustering Ask questions on the GeoEvent Forum: -

26 Thank you! Please fill out the session survey at: RateMyDevSummitSession

27 Questions / Feedback? To learn more: