Dealing with Map Shift and Getting Out the Other Side Relatively Intact 11 th May 2016 Northern Ireland Water Sean O Boyle, Andrew Murphy & Michelle Cassidy Version 1.0
Introductions Sean O Boyle Asset Information Development Manager Michelle Cassidy Asset Data Analyst Andrew Murphy Asset Data Analyst 2
Agenda Introductions Background The Journey : Pre-Contract Contract Current Position 3
Background 4
GIS Asset Data Hierarchy Ellipse NIW s Corporate Asset Register (CAR) Components Assets E.g. Motor E.g. Telemetry, Pump, Macerator Units Processes E.g. Grit Removal, Pump Set, Storage E.g. Primary Treatment, Inlet Works Facilities Sites WwTW Above Ground Assets Water mains, Sewers Below Ground Assets Fixtures, Fittings
Taking the real world
and modelling it in the digital world (GIS)
NIW s GIS Metrics Infrastructure 26,995km water mains, 15,328km sewers, 469,739 manholes, 166,912 valves, 64,385 hydrants, 37,962 air valves Non-Infrastructure 648 WWTW, 1,273 SPS, 786 CSO, 19 WTW, 340 SR, 361 WPS Boundaries >5,500 Sites 1,384 DMAs, 2,415 SDACs 68 Field Manager Boundaries >5 million records Users 1,000 from across the business and beyond >67,000 logins in the past 12 months
Use of NIW s GI Data Asset Management Customer Service Delivery Mobile Work Management Major Incident Planning Finance & Regulation Engineering Procurement Third Party Contractors Utilities Local Government
Early Map Shift Discovery ( Hopkins Shift) 10
Pre-Contract Journey 12
Why Positionally Improve? DARD Invest to Save bid Modern surveying techniques Governing Legislation Regulatory Implications Health & Safety Implications Commitment to Data Quality Investment for the future
Pre-Contract Journey Initial map shift discovered, Hopkins shift OSNI complete full PI Legacy issues relating to Hopkins map shift resolved Tender documents released Project Commencement 2001-2004 2008-2009 2010-2013 2011-2013 2013 2013 April 2014 June 2014 July 2014 OSNI pilot PI in 2 areas Rosslea, Ballywalter Market Research performed by Asset Information PI Business Case Approval Contract Award 14
Preparatory Work 15
Addressing Hopkins Map Shift
Addressing Hopkins Map Shift Hopkins map shift affected > 2,000 map tiles 92% contained water infrastructure 30% contained wastewater infrastructure Addressed in 2 stages: Flagging Editing Building in business data rules In-House Resource 477km Water mains corrected 84km sewers corrected 17
Market Research Vendor Research Company background Positional Improvement Experience Positional Improvement Methodology/Software Water Utilities GB Experiences Methodology/Software Used 18
Building the Business Case Feasibility Study Requirements Specification Lobbying Senior Management Communications to the Business 19
The Journey Continued.. The Contract 20
Data Analysis and Planning 21
Data Analysis and Planning Why? Validation of NIW Data Data being transformed Validation of LPS Data Link Files Large Scale Vector Mapping Transformation Method 22
Validation of NIW Data Geometry errors Validating Data Duplicate vertices Self-Intersections Features not snapped
Validation of LPS Data 1. Link files Can they be used to transform our data? Issues highlighted: Links not properly representing the change. Angle / Direction of Links. Density of Links Increased processing time.
Validation of LPS Data 2. Vectors Issues Highlighted Real World Change Vertices shifted cosmetically
Data Analysis and Planning 26
Developing NIW Data Rules
Developing NIW Data Rules
Developing NIW Data Rules Business Rules: 1. Data relates to Large Scale Vectors Crossing Within Deviation 2. How data relates to other datasets Geometrically Snapping tolerances 3. Data rules for individual datasets GPS Number of vertices.
Rehearsal 1 Data Analysis and Planning 30
Rehearsals
Rehearsals Ensuring a successful Live Performance NIW Database 2. Export Data NIW Envitia 6. Export Data Envitia NIW Envitia Database 3. Import Data 7. Import Data 4. Transform Data 5. Confidence Scoring and Commit Business Rules 1. Configure Business Rules and Tolerances
Rehearsals NIW Asset Data NIW Business Rules Confidence Grading Low Confidence Partial Confidence High Confidence LPS Data Exceptions Business Rules Data Checks Confidence Scores Changes
Rehearsal 2 Rehearsal 1 Data Analysis and Planning 34
Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 35
Final Transformation Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 36
Final Transformation Live Performance Data Freeze 3,833,515 Features Exported 37
Final Transformation Exception Checking Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 38
Net Result of Transformation (PI) 3,833,515 features NIW Database? 316,486 features (8%) 3,517,029 features (92%) Review Exceptions Edit Exceptions 85,141 (2%)
Current Position Move to new data model Use of full suite of products Benefits to business processes e.g. Contractors Corporate GIS 40
Any Questions?