Leveraging Cloud-Based Mapping Solutions GeoAlberta October 28, 2014 Laura Kerssens Safe Software
Agenda To the Cloud Using Basic Services Cloud Applications Web Services Cloud-Hosted Databases Real-time
So Much is Moving to the Cloud
It s a Big World Cloud computing How to define it?
Advantages Lower cost Scalable Reliable Accessible
Making the Most of the Cloud Infrastructure as a Service
Making the Most of the Cloud Platform as a Service Infrastructure as a Service
Making the Most of the Cloud Software as a Service Platform as a Service Infrastructure as a Service
Making the Most of the Cloud Software as a Service Platform as a Service Infrastructure as a Service
Data in the Cloud Cloud Data Services Geocoding Mapping services Routing Online Data Portals Socrata Google Maps Engine ArcGIS Online Cloud Data Storage Amazon RDS SQLAzure Google Fusion Tables
Online Data Portals Socrata Google Maps Engine ArcGIS Online And more
Socrata Open data platform Data upload and updating Share publically or create privately View tables and maps directly in the browser
Open Data Portal
City of Edmonton s Data Portal
Socrata: The Basics Publish Update View Query Visualize Demo
City of San Francisco 311 Data
Demo Directly import data into Socrata Create new datasets Update existing
Questions?
What is Google Maps Engine? Upload data to the cloud to create custom web maps Share spatial data (publically or internally) Make data findable within the Google universe #GMEandFME
Google Drive for maps. Google Maps Engine is Google Drive for maps Allows for document sharing #GMEandFME
Historical and educational maps from around the world WHAT IS GOOGLE MAPS GALLERY
Map Gallery: San Jose
The Basics
Demo GME Vector Writing
Demo GME Raster Writing
San Jose Workflow Update Google Maps Engine tables
Demo Updating
City of Edmonton: Part Two Socrata to Google Maps Engine synchronization
Workflow
Workflow
Automating the updates
Questions?
What is ArcGIS Online? Cloud based platform for creating and sharing data Upload and publish data layers Create and style web maps Incorporate Spatial Analysis tools into maps and custom applications
ArcGIS Online Gallery
Map Portals Iowa Department of Transportation
ArcGIS Online: The Basics
Demo AGOL Feature Service Writing
Demo AGOL Feature Service Reading
Live Data Tracking
Demo AGOL Updating
Creating Apps
ArcGIS Online App for Airports
Architecture
Open Data Bridge Combining Technologies ArcGIS Online FME Server CKAN
Workflow. ArcMap AGOL FME Desktop FME Server map.apps service definition REST Service Shape to Json Scheduled Job customized App data processing ETL data update (scheduled job) User friendly data access Cartography Cloud data storage
Data Source Open Data Portal.
Step 1: ArcMap Initial ArcGIS Online Service Definition
Step 2: ArcMap Creating an ArcGIS Online REST service
Step 3: FME Desktop Update Process (Shape to JSON)
Step 4: Automated Data update based on FME Server
Goal: Get Easy Access to Open Data (map.apps)
ArcGIS Online App
CKAN City of Surrey
Others St Louis County Writing to Socrata and GitHub IDE Rioja Oracle to GitHub
Why GitHub GitHub is a web-based Version Control System (VCS) which records changes to a file or set of files over time. Allows: commit files to a public repository revert files back to a previous state review changes made over time see who last modified something, and more...
Sharing Public Data
Workflow
The Beauty of GeoJSON in GitHub GitHub supports automatic rendering of GeoJSON repositories using Leaflet.js Looking ahead geojson.io a Chrome extension for editing IDE Rioja plans open collaboration on spatial data with GitHub FME can include links to image data when writing GeoJSON (automatic download service)
Things to know Some APIs services have limits Maximum time to be connected Maximum features to load
Cloud Services for Spatial Data REST JSON Standards for communication
Online Mapping Services What does this mean? Google maps Bing maps Arcgis maps
Online Mapping Services In web applications Desktop applications
Demo Data Validation
Background Maps.
OGC Web Services WMS, WFS, etc OGC standards
Other Web Services Directions via mapping services Geocoding services Geoprocessing services
ArcGIS Online Web Services Accessed via REST Results as JSON http://route.arcgis.com/arcg is/rest/services/world/servi ceareas/naserver/servicearea _World/solveServiceArea?toke n=<yourtoken>&facilities=- 122.253,37.757&outSR=102100& f=json { "sapolygons": { "spatialreference": { <spatialreference> }, "features": [ { "attributes": { "<field1>": <value11>, "<field2>": <value12> }, "geometry": { <polygon1> } }, { "attributes": { "<field1>": <value21>, "<field2>": <value22>
ArcGIS Online Web Services Geocoding GeoEnrichment Directions and Routing
AGOL Services (Geocoding, Routing, and Drive Time)
AGOL Services (GeoEnrichment)
Geocoding Tools ArcGIS Online Google Microsoft Geocode Dataflow API BatchGeo And more
Demo Work with spatial data using cloud-based GIS services
Using REST to easily combine technologies. map.apps ArcGIS Plattform REST FME Plattform
Web app integration map.apps FME ArcGIS Online
Workspace.
ArcGIS Online REST request.
Calculate bush fire risk before construction Barrett Higman, GIS Officer of Alpine Shire Council
Cloud-Hosted Databases storage and software included easy to share data many have extra tools to get more from your data offload work to external servers built to handle it
Amazon Web Services Amazon RDS Dynamo DB Redshift
RDS Relational Database Service Scalable database in the cloud PostGres/PostGIS Oracle MySQL SQLServer
Demo Read and write to database the same as you would with a local database
NoSQL SSD-based database service No limit on size of Database Specify the needed performance Autoscale through Dynamic DynamoDB
MarkLogic NoSQL database XML optimized Powerful search and analysis Native Spatial Support XML based data model (GML, XML, etc.)
Example Use REST to upload XML to MarkLogic HTTP PUT http://localhost:8003/v1/documents?uri=/docs/myxml_078f8c67- e696-43c9-b7a9-fa510e368824.xml XML <xml> <docid>{fme:get-attribute("_uuid")}</docid> <docauthor>{fme:get-attribute("user")}</docauthor> <modtype>{fme:get-attribute("updatetype")}</modtype> <UpdateDate>{fme:get-attribute("_timestamp")}</UpdateDate> <filepath>{fme:get-attribute("filepath")}</filepath> <comment>{fme:get-attribute("comment")}</comment> <doc_xml>{fme:get-xml-attribute("_file_contents")}</doc_xml> </xml>
Google Fusion Tables Support for large tables Create charts, maps, and graphs Save and share through Google Drive
Others SQLAzure: Microsoft Azure hosted SQL Server database Google Cloud SQL: MySQL database in the Google Cloud platform
Bringing Cloud Technologies Together Create complete solutions using a combination of tools
Internet of things Sensor data Asset tracking Databases that can handle the data
Real-Time Building an event driven architecture
Live Data Weather Network lightning alerts
ipaas Cloud integration platforms Zapier IFTTT FME Cloud
Zapier
Database Triggers When database is modified, send REST request to a Cloud service
All of the Above Iowa DoT
Automatic Vehicle Location Invisible to driver Real-time flow of data position, status, material usage, conditions Data uploading to Amazon cloud FME moves data to Oracle Spatial for internal usage, then to AGOL for public viewing
Dashcams Dash-mounted iphones send image stream when vehicle is in motion FME handles KML generation and upload to Windows Azure
AGOL Public Data Access ArcGIS Online keeps public informed with current plow status and conditions
Dashcam Feeds Public can also see what the driver is seeing for better awareness of road and weather conditions making winter driving safer.
Wrap Up Advantages of the Cloud Web based data portals Cloud services Cloud-hosted databases Integrating systems
Thank You Laura Kerssens Product Support Specialist Safe Software laura.kerssens@safe.com www.safe.com