Dealing with Map Shift and Getting Out the Other Side Relatively Intact

Size: px

Start display at page:

Download "Dealing with Map Shift and Getting Out the Other Side Relatively Intact"

Katrina Houston
7 years ago
Views:

1 Dealing with Map Shift and Getting Out the Other Side Relatively Intact 11 th May 2016 Northern Ireland Water Sean O Boyle, Andrew Murphy & Michelle Cassidy Version 1.0

2 Introductions Sean O Boyle Asset Information Development Manager Michelle Cassidy Asset Data Analyst Andrew Murphy Asset Data Analyst 2

3 Agenda Introductions Background The Journey : Pre-Contract Contract Current Position 3

4 Background 4

5 GIS Asset Data Hierarchy Ellipse NIW s Corporate Asset Register (CAR) Components Assets E.g. Motor E.g. Telemetry, Pump, Macerator Units Processes E.g. Grit Removal, Pump Set, Storage E.g. Primary Treatment, Inlet Works Facilities Sites WwTW Above Ground Assets Water mains, Sewers Below Ground Assets Fixtures, Fittings

6 Taking the real world

7 and modelling it in the digital world (GIS)

NIW s GIS Metrics Infrastructure 26,995km water mains, 15,328km sewers, 469,739 manholes, 166,912 valves, 64,385 hydrants, 37,962 air valves Non-Infrastructure 648 WWTW, 1,273 SPS, 786 CSO, 19

8 NIW s GIS Metrics Infrastructure 26,995km water mains, 15,328km sewers, 469,739 manholes, 166,912 valves, 64,385 hydrants, 37,962 air valves Non-Infrastructure 648 WWTW, 1,273 SPS, 786 CSO, 19 WTW, 340 SR, 361 WPS Boundaries >5,500 Sites 1,384 DMAs, 2,415 SDACs 68 Field Manager Boundaries >5 million records Users 1,000 from across the business and beyond >67,000 logins in the past 12 months

9 Use of NIW s GI Data Asset Management Customer Service Delivery Mobile Work Management Major Incident Planning Finance & Regulation Engineering Procurement Third Party Contractors Utilities Local Government

10 Early Map Shift Discovery ( Hopkins Shift) 10

12 Pre-Contract Journey 12

13 Why Positionally Improve? DARD Invest to Save bid Modern surveying techniques Governing Legislation Regulatory Implications Health & Safety Implications Commitment to Data Quality Investment for the future

14 Pre-Contract Journey Initial map shift discovered, Hopkins shift OSNI complete full PI Legacy issues relating to Hopkins map shift resolved Tender documents released Project Commencement April 2014 June 2014 July 2014 OSNI pilot PI in 2 areas Rosslea, Ballywalter Market Research performed by Asset Information PI Business Case Approval Contract Award 14

15 Preparatory Work 15

16 Addressing Hopkins Map Shift

17 Addressing Hopkins Map Shift Hopkins map shift affected > 2,000 map tiles 92% contained water infrastructure 30% contained wastewater infrastructure Addressed in 2 stages: Flagging Editing Building in business data rules In-House Resource 477km Water mains corrected 84km sewers corrected 17

18 Market Research Vendor Research Company background Positional Improvement Experience Positional Improvement Methodology/Software Water Utilities GB Experiences Methodology/Software Used 18

19 Building the Business Case Feasibility Study Requirements Specification Lobbying Senior Management Communications to the Business 19

20 The Journey Continued.. The Contract 20

21 Data Analysis and Planning 21

22 Data Analysis and Planning Why? Validation of NIW Data Data being transformed Validation of LPS Data Link Files Large Scale Vector Mapping Transformation Method 22

23 Validation of NIW Data Geometry errors Validating Data Duplicate vertices Self-Intersections Features not snapped

24 Validation of LPS Data 1. Link files Can they be used to transform our data? Issues highlighted: Links not properly representing the change. Angle / Direction of Links. Density of Links Increased processing time.

25 Validation of LPS Data 2. Vectors Issues Highlighted Real World Change Vertices shifted cosmetically

26 Data Analysis and Planning 26

27 Developing NIW Data Rules

28 Developing NIW Data Rules

29 Developing NIW Data Rules Business Rules: 1. Data relates to Large Scale Vectors Crossing Within Deviation 2. How data relates to other datasets Geometrically Snapping tolerances 3. Data rules for individual datasets GPS Number of vertices.

30 Rehearsal 1 Data Analysis and Planning 30

31 Rehearsals

32 Rehearsals Ensuring a successful Live Performance NIW Database 2. Export Data NIW Envitia 6. Export Data Envitia NIW Envitia Database 3. Import Data 7. Import Data 4. Transform Data 5. Confidence Scoring and Commit Business Rules 1. Configure Business Rules and Tolerances

33 Rehearsals NIW Asset Data NIW Business Rules Confidence Grading Low Confidence Partial Confidence High Confidence LPS Data Exceptions Business Rules Data Checks Confidence Scores Changes

34 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 34

35 Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 35

36 Final Transformation Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 36

37 Final Transformation Live Performance Data Freeze 3,833,515 Features Exported 37

38 Final Transformation Exception Checking Rehearsal 3 Rehearsal 2 Rehearsal 1 Data Analysis and Planning 38

39 Net Result of Transformation (PI) 3,833,515 features NIW Database? 316,486 features (8%) 3,517,029 features (92%) Review Exceptions Edit Exceptions 85,141 (2%)

40 Current Position Move to new data model Use of full suite of products Benefits to business processes e.g. Contractors Corporate GIS 40

41 Any Questions?

Daniel Millls daniel.mills@wrcplc.co.uk Senior GIS Consultant Liberation of spatial data within NI Water

Daniel Millls daniel.mills@wrcplc.co.uk Senior GIS Consultant Liberation of spatial data within NI Water Agenda Examine the business requirements to move towards a spatial data warehouse Implemented solution