Daniel Millls daniel.mills@wrcplc.co.uk Senior GIS Consultant Liberation of spatial data within NI Water
Agenda Examine the business requirements to move towards a spatial data warehouse Implemented solution Solution restrictions Why Oracle? Locator or Spatial Current solution Closer examination of two areas Data integration GIS visualisation to the masses Conclusions Questions
Business requirements
NI Water GIS Metrics Infrastructure 26,435km water mains, 14,420km sewers, 476,204 manholes, 146,368 valves, 56,331 hydrants, 35,439 air valves Non-Infrastructure 5,180 Sites Facilities; 1,119 WWTW, 1,318 SPS, 735 CSO, 45 WTW, 429 SR, 231 WPS, 160 WBS Boundaries 1,271 DMAs, 2,059 DACs, 13,500 square km 4.8 million asset records Users 800 from across the business and beyond >10,000 hits per month
Business requirement Corporate Asset Register (CAR) Geospatially enabled Below ground; network assets. Mastered by GIS Above ground; sites, facilities Data centric solution Centralised storage of spatial data Data integration Update of legacy network maintenance tool (NIMS) Liberate!!
Migration restrictions Severe cost and time restrictions Limited data model changes permitted Most NIW resources taken up by above ground asset register implementation Make use of existing software licenses (PBBI MapInfo Professional) NIW must maintain IPR on new application NIW to control data model and not be restricted on access to underlying data
Implemented solution
Why Oracle? NIW already used Oracle for a number of systems Oracle SDO_GEOMETRY interoperable with all leading desktop GIS, including PBBI MapInfo Professional Other solutions where explored but rejected due to: Product infancy Lack of support Cost Speed of development and implementation
Locator or Spatial Locator Comes with Oracle Express or Standard at no extra cost Uses SDO_GEOMETRY Limited number of functions available Spatial Additional cost Upgrade to Oracle Enterprise In hindsight Locator would have done. There is no additional spatial functionality used in the implementation. However Spatial has enabled NI Water to embark on a number of integration and data quality improvement initiatives
Current components Cost to Serve
Liberation NI Water can modify data model as business requirements change Spatial data warehouse allows unrestricted access by NI Water to data AID staff have full ownership of database Create or amend table definitions Create triggers and stored procedures Create scheduled jobs Create user and defined privileges DBA provides technical advice and moral support!
Closer look: Ellipse Integration
Update schedules Real-Time Telemetry Real- Time/Snapshot Monthly snapshot Scheduled (nightly) Real-Time
Server side processing CARID is maintained by Oracle sequence prefixed with asset type Scheduled jobs allow intensive spatial processing to be conducted during periods of low use Triggers provide hidden population of fields On before insert of facilities spatial processing updates financial fields based on boundaries On before insert triggers populates calculated fields On before update of geometries causes geometry validation check and update of attributes Triggers validate geometries Triggers update audit tables used during integration processes
Geocoding Methodology Confidence Description Example Previous % of dataset Current % of dataset A Street Number, Street Name, City & 1st part of Postcode 12 Glebe Cottages, Ahoghill, BT42 0.01 81.69 B Street Number & Full Postcode 12, BT42 2PZ 75.57 2.11 C Street Number, Street Name & 1st part of Postcode 12 Glebe Cottages, BT42 2.79 0.25 D Street Name and City Glebe Cottages, Ahoghill 5.62 8.56 E Full Postcode BT42 2PZ 12.48 4.70 F 1swt part of Postcode BT42 4.32 2.53 X Not geocoded Ahoghill Coumminty C, Culleybecky Road 0.2 0.16
GIS visualisation: CARtomap
CARtomap Web GIS Interface
Data Updates: DG3 Property Interruptions
GIS visualisation: Situational Awareness
Situational Awareness Ability to provide information that quickly highlights key Operational Customer issues Tool to be used for Major Incident Planning management Tool to provide a level of on-going improvement analysis Aid to co-ordinate resources Near real time update of mapping with work request information XML retrieved by database Currently 20 minute interval using Oracle scheduled jobs. Can be adjusted by NI Water
GIS visualisation: New Customer Connections
New connections Requirement to reduce time taken to turn around application for a new connection. Real time update of Rapid dashboard required. Auto population of connection attributes Height data for meter, property and connection point taken from DEM stored as SDO_GEORASTER. Network attributes passed Users required to verify updates Updated connection details passed back to Rapid
Conclusions
The future Migration of all background data to Oracle Spatial OSNI vector background GeoRaster DEM data already in database Bypass upgrade to 11g Plans to move directly to 12c? Further integration with key systems Continue to promote spatial data warehouse within business Clustering solution required if current growth continues Develop internal systems using APEX installation imminent
If you build it, they will come (to misquote Field of Dreams).. and they have!