Leveraging Cloud-Based Mapping Solutions

Transcription

1 Leveraging Cloud-Based Mapping Solutions GeoAlberta October 28, 2014 Laura Kerssens Safe Software

2 Agenda To the Cloud Using Basic Services Cloud Applications Web Services Cloud-Hosted Databases Real-time

3 So Much is Moving to the Cloud

4 It s a Big World Cloud computing How to define it?

5 Advantages Lower cost Scalable Reliable Accessible

6 Making the Most of the Cloud Infrastructure as a Service

7 Making the Most of the Cloud Platform as a Service Infrastructure as a Service

8 Making the Most of the Cloud Software as a Service Platform as a Service Infrastructure as a Service

9 Making the Most of the Cloud Software as a Service Platform as a Service Infrastructure as a Service

10 Data in the Cloud Cloud Data Services Geocoding Mapping services Routing Online Data Portals Socrata Google Maps Engine ArcGIS Online Cloud Data Storage Amazon RDS SQLAzure Google Fusion Tables

11 Online Data Portals Socrata Google Maps Engine ArcGIS Online And more

12 Socrata Open data platform Data upload and updating Share publically or create privately View tables and maps directly in the browser

13 Open Data Portal

14 City of Edmonton s Data Portal

15 Socrata: The Basics Publish Update View Query Visualize Demo

16 City of San Francisco 311 Data

17 Demo Directly import data into Socrata Create new datasets Update existing

18 Questions?

19 What is Google Maps Engine? Upload data to the cloud to create custom web maps Share spatial data (publically or internally) Make data findable within the Google universe #GMEandFME

20 Google Drive for maps. Google Maps Engine is Google Drive for maps Allows for document sharing #GMEandFME

21 Historical and educational maps from around the world WHAT IS GOOGLE MAPS GALLERY

22 Map Gallery: San Jose

23 The Basics

24 Demo GME Vector Writing

25 Demo GME Raster Writing

26 San Jose Workflow Update Google Maps Engine tables

27 Demo Updating

28 City of Edmonton: Part Two Socrata to Google Maps Engine synchronization

29 Workflow

30 Workflow

31 Automating the updates

32 Questions?

33 What is ArcGIS Online? Cloud based platform for creating and sharing data Upload and publish data layers Create and style web maps Incorporate Spatial Analysis tools into maps and custom applications

34 ArcGIS Online Gallery

35 Map Portals Iowa Department of Transportation

36 ArcGIS Online: The Basics

37 Demo AGOL Feature Service Writing

38 Demo AGOL Feature Service Reading

39 Live Data Tracking

40 Demo AGOL Updating

41 Creating Apps

42 ArcGIS Online App for Airports

43 Architecture

44 Open Data Bridge Combining Technologies ArcGIS Online FME Server CKAN

45 Workflow. ArcMap AGOL FME Desktop FME Server map.apps service definition REST Service Shape to Json Scheduled Job customized App data processing ETL data update (scheduled job) User friendly data access Cartography Cloud data storage

46 Data Source Open Data Portal.

47 Step 1: ArcMap Initial ArcGIS Online Service Definition

48 Step 2: ArcMap Creating an ArcGIS Online REST service

49 Step 3: FME Desktop Update Process (Shape to JSON)

50 Step 4: Automated Data update based on FME Server

51 Goal: Get Easy Access to Open Data (map.apps)

52

53 ArcGIS Online App

54 CKAN City of Surrey

55 Others St Louis County Writing to Socrata and GitHub IDE Rioja Oracle to GitHub

56 Why GitHub GitHub is a web-based Version Control System (VCS) which records changes to a file or set of files over time. Allows: commit files to a public repository revert files back to a previous state review changes made over time see who last modified something, and more...

57 Sharing Public Data

58 Workflow

59 The Beauty of GeoJSON in GitHub GitHub supports automatic rendering of GeoJSON repositories using Leaflet.js Looking ahead geojson.io a Chrome extension for editing IDE Rioja plans open collaboration on spatial data with GitHub FME can include links to image data when writing GeoJSON (automatic download service)

60 Things to know Some APIs services have limits Maximum time to be connected Maximum features to load

61 Cloud Services for Spatial Data REST JSON Standards for communication

62 Online Mapping Services What does this mean? Google maps Bing maps Arcgis maps

63 Online Mapping Services In web applications Desktop applications

64 Demo Data Validation

65 Background Maps.

66 OGC Web Services WMS, WFS, etc OGC standards

67 Other Web Services Directions via mapping services Geocoding services Geoprocessing services

68 ArcGIS Online Web Services Accessed via REST Results as JSON is/rest/services/world/servi ceareas/naserver/servicearea _World/solveServiceArea?toke n=<yourtoken>&facilities= ,37.757&outSR=102100& f=json { "sapolygons": { "spatialreference": { <spatialreference> }, "features": [ { "attributes": { "<field1>": <value11>, "<field2>": <value12> }, "geometry": { <polygon1> } }, { "attributes": { "<field1>": <value21>, "<field2>": <value22>

69 ArcGIS Online Web Services Geocoding GeoEnrichment Directions and Routing

70 AGOL Services (Geocoding, Routing, and Drive Time)

71 AGOL Services (GeoEnrichment)

72 Geocoding Tools ArcGIS Online Google Microsoft Geocode Dataflow API BatchGeo And more

73 Demo Work with spatial data using cloud-based GIS services

74 Using REST to easily combine technologies. map.apps ArcGIS Plattform REST FME Plattform

75 Web app integration map.apps FME ArcGIS Online

76 Workspace.

77 ArcGIS Online REST request.

78 Calculate bush fire risk before construction Barrett Higman, GIS Officer of Alpine Shire Council

79 Cloud-Hosted Databases storage and software included easy to share data many have extra tools to get more from your data offload work to external servers built to handle it

80 Amazon Web Services Amazon RDS Dynamo DB Redshift

81 RDS Relational Database Service Scalable database in the cloud PostGres/PostGIS Oracle MySQL SQLServer

82 Demo Read and write to database the same as you would with a local database

83 NoSQL SSD-based database service No limit on size of Database Specify the needed performance Autoscale through Dynamic DynamoDB

84 MarkLogic NoSQL database XML optimized Powerful search and analysis Native Spatial Support XML based data model (GML, XML, etc.)

85 Example Use REST to upload XML to MarkLogic HTTP PUT e696-43c9-b7a9-fa510e xml XML <xml> <docid>{fme:get-attribute("_uuid")}</docid> <docauthor>{fme:get-attribute("user")}</docauthor> <modtype>{fme:get-attribute("updatetype")}</modtype> <UpdateDate>{fme:get-attribute("_timestamp")}</UpdateDate> <filepath>{fme:get-attribute("filepath")}</filepath> <comment>{fme:get-attribute("comment")}</comment> <doc_xml>{fme:get-xml-attribute("_file_contents")}</doc_xml> </xml>

86 Google Fusion Tables Support for large tables Create charts, maps, and graphs Save and share through Google Drive

87 Others SQLAzure: Microsoft Azure hosted SQL Server database Google Cloud SQL: MySQL database in the Google Cloud platform

88 Bringing Cloud Technologies Together Create complete solutions using a combination of tools

89 Internet of things Sensor data Asset tracking Databases that can handle the data

90 Real-Time Building an event driven architecture

91 Live Data Weather Network lightning alerts

92

93 ipaas Cloud integration platforms Zapier IFTTT FME Cloud

94 Zapier

95 Database Triggers When database is modified, send REST request to a Cloud service

96 All of the Above Iowa DoT

97 Automatic Vehicle Location Invisible to driver Real-time flow of data position, status, material usage, conditions Data uploading to Amazon cloud FME moves data to Oracle Spatial for internal usage, then to AGOL for public viewing

98 Dashcams Dash-mounted iphones send image stream when vehicle is in motion FME handles KML generation and upload to Windows Azure

99 AGOL Public Data Access ArcGIS Online keeps public informed with current plow status and conditions

100 Dashcam Feeds Public can also see what the driver is seeing for better awareness of road and weather conditions making winter driving safer.

101 Wrap Up Advantages of the Cloud Web based data portals Cloud services Cloud-hosted databases Integrating systems

102 Thank You Laura Kerssens Product Support Specialist Safe Software