Manitoba Dutch Elm Disease (DED) Field Data Capture using Collector for ArcGIS and ArcGIS Online ESRI Regional User Conference Winnipeg, Manitoba April 21, 2015 1
Presentation Outline Business Problem by Newton Philis, Forestry DED Program Collector Pilot Pilot Results Benefits DED Next Steps Technical Solution by Shawn Cruise, BTT Collector Setup & Testing Online/Offline Use Tile Packages ArcGIS Server Next Steps by Tony Viveiros, GeoManitoba FireSmart Environmental Incidents Perm. Sample Plots (PSP s) Collector and AGOL 2
DED Management Program CWS delivers DED management program within 40 communities Annual surveys during summer to identify and mark diseased elm trees Removal operations carried out throughout the year Approx. 5,000 6,000 trees/year 3
Paper tally sheets DED Surveys Record information (tree, property and ownership) Sketch maps with location of diseased trees on each property Data entry and digitizing in office throughout fall/ winter (approx. 9 months) 4
ArcGIS Online Collector Application ESRI Software - available through MB ELA Install on mobile hardware with IOS or Android Mobile collection of field data using Cloud services Online and offline capability Fairly easy and quick to customize 5
ArcGIS Online Collector 6
Collector App Pilot Project Explore ArcGIS online Collector application CWS executive endorsement DED surveys during July-Aug 2014 six communities Application developed to mimic program geodatabase (compatibility) Compare online and offline functionality 7
Pilot Project-Equipment Initial testing done on cell phones (iphones and Android) Hardware purchased through APL (ipad air and ipad mini) Ruggedized case and protective screen (field environment rain, bug screen, sun glare) Easy to handle Wireless connectivity Built-in GPS receiver 8
Minimal effort to develop Pilot Project Base Features: Roads Ortho imagery Property lines Use for navigation and collection of survey information Touch screen to add attributes Data stored within MB ArcGIS online secured account and then exported to internal geodatabase 9
Outdoor Issues Sun glare on the screen. Mitigated by newer models of ipads Switching between low & high contrast basemaps (street & satellite view) Protection against field elements Lifeproof cases protect against rain, drops, glare. Lifeproof screen protects against marking paint and bugspray. www.lifeproof.com 10
Performance GPS: accurate to an average of 5-6m (or 7-8m under canopy) 11
Mobile data collection for 300 trees Faster than paper tallies Results Improved navigation (eliminates need for paper based maps of work areas) Immediate data capture improves planning of removal operations Data export compatible with geodatabase Hardware performed well with protective equipment 12
Results Working online - credit consumption minimal BUT slower Faster to work offline (tiled map caches needs ipads with expanded storage space of 128GB), and synchronize periodically throughout work day. However, switching between basemaps is cumbersome Share data with stakeholders Cost avoidance eliminates cumbersome data entry (9 months) Allows branch to accommodate other work assignments and focus on priority projects 13
AGOL Credit Consumption This pilot project used approx. 150 credits/mo. That is $15 MB account has 22,000 credits. 14
ArcGIS online Collector App Benefits Better than other mobile solutions Inexpensive hardware Software provided under the ESRI Licence Agreement (ELA) Ease of use/ minimal effort to develop and link with internal geodatabases (similar to other ESRI products) Does not require technical capacity within departments to develop and maintain mobile systems 15
Next Steps Implementation for 2015 DED survey season Purchase additional 18 handheld units Collaborate with BTT and GeoManitoba to fine-tune the new AGOL Governance policies and procedures Test newest functionality: like picture/video/sound attachments and user tracking. 16
Environment Setup Four simple steps to start using Collector: 1. Create operational and reference feature classes. 2. Create operational and reference map documents representing the feature services to be published. 3. Publish the feature services to AGOL. 4. Configure the AGOL webmaps containing the new feature services for use in Collector. 17
Initial Testing Launch Collector and sign in as the same AGOL account used to publish features services and create the webmaps. Webmaps will display as tile icons in Collector. Online / offline capabilities for each webmap is shown. Restart Collector to see new items. 18
Offline map that has not been downloaded. Click cloud icon to download and set up synchronization before taking offline. Offline map that been downloaded and ready to take offline. Offline map with updates to be synchronized. Online map that is not offline capable. By design, or could be issues with sync settings. 19
Setting Security To allow others AGOL users to update the webmaps in Collector: Create a group (DEV/UAT/PROD, version #, etc) Invite users to the group Share the webmaps and feature service dependencies to the group. 20
AGOL Groups in Collector Collector displays the groups and allows filtering. 21
Online Online / Offline Requires Internet to collect. AGOL updated when updates occur. Offline Does not require Internet to collect. Updates stored locally and manually synchronized with AGOL when Internet available. 22
Offline Use Dutch Elm Disease surveyors work exclusively in offline mode. Each ipad loaded with ~100 GB of custom tile packages containing 50 CM imagery at 1:2000 resolution. Tile packages for all working areas loaded on every ipad. Online maps available just in case. 23
Tile Packages Create a map document in ArcMap to create tile packages. Vector feature classes for reference layers. Mosaic dataset for imagery. Create copy of original for every package. Named it appropriately. Fixed the data frame. Use dockable windows to control aspect. 24
Use the dockable windows in ArcMap to shape the data frame extent to exclude unnecessary areas. Example: TPK with extent shown is 9 GB. Square TPK would be 18 GB and contain would contain 50% unnecessary information. 25
Tile Packages Create the schema file to specify projection and scale levels Specify the largest scale and start doubling 1:2000, 1:4000, 1:8000,..., 1:16M. The largest scale makes up 75% of the total tile package size. Ex. If a 1:2000, 1:4000, 1:8000,..., 1:16M tile package is 1 GB, then adding 1:1000 will result in a 4 GB tile package. 26
Tile Packages Use ArcCatalog to create the TPKs. TPK files are transferred onto each ipad using itunes. Default TPK files used in field have 50CM imagery and reference vectors. Can be difficult to see in sunlight so a second High Contrast set was developed White background, reference layer styles updated for visibility 27
Tile package with 50CM RGB imagery. 1:2000 maximum resolution. 3.1 GB on disk. 28
Tile package without imagery. 1:2000 maximum resolution. 55 MB on disk Size is ~2% of same tile package with imagery. 29
Collecting Photos and Video Collector can attach photos and video to the features being captured. Create attachment on the feature class in ArcGIS Desktop before publishing. Collector will detect and present ability to attach photos or video. 30
Create attachments to allow storage of photos and video when using Collector. 31
32
33
Offline Attribute Query Currently experimenting with new options with Collector 10.3 that allows mixing feature services with different edit capabilities within a webmap Read Only Add Only Edit Attributes Only Add, Edit, and Delete. 34
Enable Tracking Webmaps can be configured to record points on set intervals showing location and user info. Points get uploaded through regular update process. Does not impact user. 35
Collector and ArcGIS Server AGOL webmap can be configured to contain feature services hosted on an ArcGIS Server (AGS). AGS feature service secured with token authentication and SSL. Authentication information for AGS feature service stored in AGOL webmap. AGOL acts as a proxy between Collector and AGS feature service. 36
Collector and ArcGIS Server 37
Collector and FireSmart Background: The FireSmart Program operates in Wildland/Urban Interface (WUI) areas The Office of the Fire Commissioner s (OFC) goal is to reduce personal and property losses that result from wildfires in the WUI. Values-At-Risk (VAR) Inventories since 2010 38
Collector and FireSmart Background: 39
Collector and FireSmart Objective: Develop a comprehensive database of VAR s in WUI areas throughout the province Requirements: mobile data collection using modern technology (smartphones or tablets) configurable and easy to use pictures linked to VAR data dynamic data collection and sharing offline data collection 40
Collector and FireSmart Solution: Collector for ArcGIS to be trialed using an ipad for this year s FireSmart field season starting in June Two file geodatabases created for testing one without related tables and second with 4 related tables Two web maps created in AGOL and FireSmart AGOL group created 41
Collector and FireSmart File Geodatabase Schema 42
Collector and FireSmart Web Map 43
Collector and FireSmart Anticipated Benefits: VAR data collection by many, not just summer students (easy to use app) Cost savings Better inventory of VAR s could save big $$ spent on aerial VAR searches during a fire incident Reduce or eliminate data processing after field work Broaden access to VAR maps facilitating inter-agency collaboration of pre-response plans Online access to data using mobile devices during an emergency 44
Collector and Emergency Response Background: Mandatory reporting of environmental accidents in Manitoba is required by regulation. Manitoba Conservation is the lead provincial agency for dangerous goods incidents. The Emergency Response Team (ERT) responds to releases or potential releases of contaminants that may have a detrimental effect on the physical environment or public health. 45
Collector and Emergency Response Objective: Develop a mobile application to manage (record, report and map) environmental incident/emergency response activities Requirements: Mobile collector application; single point of entry Collect all data related to environmental incidents including geospatial and pictures Offline capabilities with data syncing when online Maps with real time data 46
Collector and Emergency Response Solution: Collector for ArcGIS geodatabase schema drafted To be reviewed by ERT 47
Collector and Emergency Response Anticipated Benefits: Streamline the current information management system enhance communication and distribution of information to internal and external clients 48
Collector and Permanent Sample Plots Background: (PSP s) The PSP Program is a long-term monitoring network of field plots that are established, measured and re-measured every 5 years. PSP information is used to determine how provincial forests change over time. 49
Collector and Permanent Sample Plots Objective: (PSP s) Explore the option of using Collector for ArcGIS to improve PSP data collection Requirements: mobile data collection using modern technology configurable and easy to use pictures linked to PSP data Offline data collection 50
Collector and Permanent Sample Plots Solution: (PSP s) Collector for ArcGIS geodatabase schema drafted 51
Collector and AGOL AGOL Privilege (Non-Administrative) Viewer/ Approver (Level 1) Manitoba ArcGIS Online for Organization Non-Administrator Roles Basic (Level 2) Contributor Standard (Level 3) Advanced (Level 4) Publisher (Level 5) 1. Content Create, update and delete content x x x x Publish hosted features x x x Publish hosted tiles x 2. Groups Create, update, and delete groups x x x Join organizational groups x x x x x Join external groups x x x x x 3. Sharing Share with groups x x x x Share with organization x x x Share with public x Make groups visible to organization x x Make groups visible to public x 4. GeoServices Geocoding x x Network analysis x x Spatial analysis x x x x GeoEnrichment x x Demographics x x Elevation Analysis x x x 5. Features Edit features x x x x 52
THANK YOU 53