Enabling Effective Workflow and Data Quality Management. Tope Bello, Jay Cary, Javier Gutierrez April 11, 2012

Transcription

1 Enabling Effective Workflow and Data Quality Management Tope Bello, Jay Cary, Javier Gutierrez April 11, 2012

2 Workshop Agenda Overview of ArcGIS Workflow Manager Overview of ArcGIS Data Reviewer Demonstration: Enabling Data Quality-focused Workflows Resources Questions

3 Overview of ArcGIS Workflow Manager

4 Section Topics Business Problem ArcGIS Workflow Manager overview System architecture Extending Workflow Manager

5 Common Business Problems Why is managing work important? - Optimize data production time - Improve data quality and accuracy - Reduce production cost - Resource allocation - Simplify processes

6 What is ArcGIS Workflow Manager Right work completed the right way, at the right time, by the right person Allows users to: Standardize workflows quickly Standardize Utilize workflows efficiently Improve performance continuously Improve Utilize

7 Key Features and Capabilities

8 Anatomy of a Job Descriptive Information Activity Log Resource Workflow Geographical Area of Interest Geospatial data

9 Job Workflow Ensure that work is done the right way! Start other processes Concurrent Steps Looping Workflows Decision Points Stakeholders

10 Real-world Workflow

11 Notifications notifications on - Job action - Workflow step - GIS data edits Fully configurable GIS Analysts Data Collection Data Processing Edit Data and Map Manager Perform Quality Check Create the Final Output

12 Provide Project Status How long does the average project take to complete? What jobs are overdue? What areas needs more resources dedicated to them?

13 Tracking and Reporting Enforces Accountability What happened on this job? - Who did what? - When did it happen? Central information repository

14 Process Improvement Automate bottlenecks Reallocate resources Improve QA process

15 System Architecture

16 Workflow Manager System Framework Server Web applications SOAP/REST API Desktop Administrator Application Workflow Manager Geodatabase Standard edition or higher Windows only

17 Why ArcGIS Workflow Manager Server? Stakeholders GIS Department Business Systems Non-GIS Users Customers Admin staff GIS Users GIS analyst QA Data stewards Applications Maximo, SAP In-house apps SOA

18 ArcGIS Workflow Manager Server Types of Services - Feature service - Geocode service - Geoprocessing service - Workflow Manager service - Etc.

19 ArcGIS Workflow Manager Services SOAP - WSDL is available at REST - Instance>/services/<ServiceName>/WMServer?wsdl - ArcGIS Server : Instance>/rest/services/<ServiceName>/WMServer

20 ArcGIS Workflow Manager Server Architecture ArcGIS Server Workflow Manager Server Applications Workflow Manager Server SOAP REST

21 Extending Workflow Manager

22 How can I extend Workflow Manager? Desktop Server Workflows and External system integration Commands Toolbars Tabs Views Applications Web Apps

23 Supported Development Platforms Custom Steps -.NET (C##, VB.NET) - C++ - Java Web Application - Flex, JavaScript, Silverlight, ASP.NET

24 Overview of ArcGIS Data Reviewer

25 Section Topics Importance of Data Quality What is ArcGIS Data Reviewer ArcGIS Data Reviewer for Server Enabling Data Quality-focused Workflows

26 Data Quality Matters Do you publish a doc without spell checking? Do you operate a PC without a virus scanner? Cost of poor quality can be extreme - $$ to fix - Impacts users - Reputation

27 What is ArcGIS Data Reviewer? Data quality management for ArcGIS Provides - Rule based workflows - Interactive tools - Track errors Review For individuals and enterprise - Saves time/money - Less rework Enterprise Workflow Standard extension to ArcGIS - Desktop extension since 8.0 Verify Correct - Server extension since 10.1 Trusted data through improved quality management

28 Managing Quality Control Framework for managing QC lifecycle REVIEW CORRECT VERIFY (optional) Find & Record Errors Perform Edits or Note Exceptions Acceptable or Unacceptable A

29 Support for the Complete System Make quality automatic and transparent Flexible automation of quality control for the organization Enable quality review and feedback from web clients Provide open access to data quality information Mobile Web ArcGIS Data Reviewer Cloud Enterprise Desktop Local

30 ArcGIS Data Reviewer Overview QC Workflows at 10.1 Visual QC Server-based Adhoc/Scheduled Automated Validation Automated Validation Connected Users DQ Reporting DQ Reporting Dashboard Reporting Data Workspace(s) Reviewer Workspace A

31 ArcGIS Data Reviewer for Server Capabilities

32 Rule-based Automated Data Review Over 40 data checks Grouped into 11 categories Configurable Additive/Scriptable

33 Batch Validation via the Web Leveraging servers for automated validation Automated quality control for the organization - Scheduled and on-demand data validation - Frees data editors from running checks - Utilize servers for faster validation processing

34 Quality Feedback via the Web Expanding the dialog on quality data management Extending quality control workflows into other communities - QC review across ArcGIS platform - Simple to use tools for error identification - Deployed via intranet or Internet

35 Manual quality control Expanding the dialog on data quality Internal Feedback External Feedback Data Maintainers Consumers Stakeholders Volunteers A

36 Dashboard Reporting Enabling transparency in data quality Better decision making by communicating data quality across stakeholders - Open quality reporting - Shared across ArcGIS system - New tools and methods to communicate quality

37 DRS System Architecture Server Components - Server Object Extensions (SOE) - Geoprocessing (GP) Server - Accessible through REST API Web Components - Flex API Dashboard Batch Validation REST API Workspace Browser - JavaScript API - Flex/JS Web applications Flex/JS API Custom Flex/JS Flex/JS Flex Applications Web Flex Web Apps Web App App Custom Applications A

38 Enabling Data Quality-focused Workflows

39 Linking workflows with validation ArcGIS Data Reviewer for Desktop Integration Create Reviewer Session - Reviewer Workspace Execute Batch Job - Reviewer Batch Job - Validation Area - Data Workspace - Reviewer Workspace - Reviewer Session Name Launch ArcMap - Reviewer Session

40 Linking workflows with validation ArcGIS Data Reviewer for Server Integration Server-based workflow integration emerging Future integration options: - Server-compatible WMX custom steps - Geoprocessing models/scripts - WMX Execute URL step

41 Demonstration: Enabling Data Quality-focused Workflows

42 Scenario As a Contracting Officer I need to assess the quality of city-provided data before I can provide it to outside consultants for construction estimates. Acceptance Criteria: - Enable non-gis user to identify areas where data is required to support contractor bids - Automate independent review of data quality - Report errors detected in area of interest

43 Resources & Training Resource Center (resourcesbeta.arcgis.com) - Help and Documentation - Gallery (samples, tutorials, templates) - Forums - Blog Training (training.esri.com) - Instructor Led Training - Web Courses - Training Seminars

44 Questions?

45 Please fill out the surveys on your way out.