Enabling Effective Workflow and Data Quality Management Tope Bello, Jay Cary, Javier Gutierrez April 11, 2012
Workshop Agenda Overview of ArcGIS Workflow Manager Overview of ArcGIS Data Reviewer Demonstration: Enabling Data Quality-focused Workflows Resources Questions
Overview of ArcGIS Workflow Manager
Section Topics Business Problem ArcGIS Workflow Manager overview System architecture Extending Workflow Manager
Common Business Problems Why is managing work important? - Optimize data production time - Improve data quality and accuracy - Reduce production cost - Resource allocation - Simplify processes
What is ArcGIS Workflow Manager Right work completed the right way, at the right time, by the right person Allows users to: Standardize workflows quickly Standardize Utilize workflows efficiently Improve performance continuously Improve Utilize
Key Features and Capabilities
Anatomy of a Job Descriptive Information Activity Log Resource Workflow Geographical Area of Interest Geospatial data
Job Workflow Ensure that work is done the right way! Start other processes Concurrent Steps Looping Workflows Decision Points Email Stakeholders
Real-world Workflow
Notifications Email notifications on - Job action - Workflow step - GIS data edits Fully configurable GIS Analysts Data Collection Data Processing Edit Data and Map Manager Perform Quality Check Create the Final Output
Provide Project Status How long does the average project take to complete? What jobs are overdue? What areas needs more resources dedicated to them?
Tracking and Reporting Enforces Accountability What happened on this job? - Who did what? - When did it happen? Central information repository
Process Improvement Automate bottlenecks Reallocate resources Improve QA process
System Architecture
Workflow Manager System Framework Server Web applications SOAP/REST API Desktop Administrator Application Workflow Manager Geodatabase Standard edition or higher Windows only
Why ArcGIS Workflow Manager Server? Stakeholders GIS Department Business Systems Non-GIS Users Customers Admin staff GIS Users GIS analyst QA Data stewards Applications Maximo, SAP In-house apps SOA
ArcGIS Workflow Manager Server Types of Services - Feature service - Geocode service - Geoprocessing service - Workflow Manager service - Etc.
ArcGIS Workflow Manager Services SOAP - WSDL is available at REST - http://<webserver>:6080/<arcgis Instance>/services/<ServiceName>/WMServer?wsdl - ArcGIS Server : http://<webserver>:6080/<arcgis Instance>/rest/services/<ServiceName>/WMServer
ArcGIS Workflow Manager Server Architecture ArcGIS Server Workflow Manager Server Applications Workflow Manager Server SOAP REST
Extending Workflow Manager
How can I extend Workflow Manager? Desktop Server Workflows and External system integration Commands Toolbars Tabs Views Applications Web Apps
Supported Development Platforms Custom Steps -.NET (C##, VB.NET) - C++ - Java Web Application - Flex, JavaScript, Silverlight, ASP.NET
Overview of ArcGIS Data Reviewer
Section Topics Importance of Data Quality What is ArcGIS Data Reviewer ArcGIS Data Reviewer for Server Enabling Data Quality-focused Workflows
Data Quality Matters Do you publish a doc without spell checking? Do you operate a PC without a virus scanner? Cost of poor quality can be extreme - $$ to fix - Impacts users - Reputation
What is ArcGIS Data Reviewer? Data quality management for ArcGIS Provides - Rule based workflows - Interactive tools - Track errors Review For individuals and enterprise - Saves time/money - Less rework Enterprise Workflow Standard extension to ArcGIS - Desktop extension since 8.0 Verify Correct - Server extension since 10.1 Trusted data through improved quality management
Managing Quality Control Framework for managing QC lifecycle REVIEW CORRECT VERIFY (optional) Find & Record Errors Perform Edits or Note Exceptions Acceptable or Unacceptable A
Support for the Complete System Make quality automatic and transparent Flexible automation of quality control for the organization Enable quality review and feedback from web clients Provide open access to data quality information Mobile Web ArcGIS Data Reviewer Cloud Enterprise Desktop Local
ArcGIS Data Reviewer Overview QC Workflows at 10.1 Visual QC Server-based Adhoc/Scheduled Automated Validation Automated Validation Connected Users DQ Reporting DQ Reporting Dashboard Reporting Data Workspace(s) Reviewer Workspace A
ArcGIS Data Reviewer for Server Capabilities
Rule-based Automated Data Review Over 40 data checks Grouped into 11 categories Configurable Additive/Scriptable www.esri.com/datareviewer
Batch Validation via the Web Leveraging servers for automated validation Automated quality control for the organization - Scheduled and on-demand data validation - Frees data editors from running checks - Utilize servers for faster validation processing
Quality Feedback via the Web Expanding the dialog on quality data management Extending quality control workflows into other communities - QC review across ArcGIS platform - Simple to use tools for error identification - Deployed via intranet or Internet
Manual quality control Expanding the dialog on data quality Internal Feedback External Feedback Data Maintainers Consumers Stakeholders Volunteers A
Dashboard Reporting Enabling transparency in data quality Better decision making by communicating data quality across stakeholders - Open quality reporting - Shared across ArcGIS system - New tools and methods to communicate quality
DRS System Architecture Server Components - Server Object Extensions (SOE) - Geoprocessing (GP) Server - Accessible through REST API Web Components - Flex API Dashboard Batch Validation REST API Workspace Browser - JavaScript API - Flex/JS Web applications Flex/JS API Custom Flex/JS Flex/JS Flex Applications Web Flex Web Apps Web App App Custom Applications A
Enabling Data Quality-focused Workflows
Linking workflows with validation ArcGIS Data Reviewer for Desktop Integration Create Reviewer Session - Reviewer Workspace Execute Batch Job - Reviewer Batch Job - Validation Area - Data Workspace - Reviewer Workspace - Reviewer Session Name Launch ArcMap - Reviewer Session
Linking workflows with validation ArcGIS Data Reviewer for Server Integration Server-based workflow integration emerging Future integration options: - Server-compatible WMX custom steps - Geoprocessing models/scripts - WMX Execute URL step
Demonstration: Enabling Data Quality-focused Workflows
Scenario As a Contracting Officer I need to assess the quality of city-provided data before I can provide it to outside consultants for construction estimates. Acceptance Criteria: - Enable non-gis user to identify areas where data is required to support contractor bids - Automate independent review of data quality - Report errors detected in area of interest
Resources & Training Resource Center (resourcesbeta.arcgis.com) - Help and Documentation - Gallery (samples, tutorials, templates) - Forums - Blog Training (training.esri.com) - Instructor Led Training - Web Courses - Training Seminars
Questions?
Please fill out the surveys on your way out.