Challenges Managing ILI Data in an Enterprise Environment using PODS 6.0 Relational. Bruce Dupuis John Spurlock Alejandro Reyes



Similar documents
Managing the integrity of pipeline assets

In-line inspection (intelligent pigging) of offshore pipeline. Birger Etterdal

PIPELINE INTEGRITY SOFTWARE By Valery V. Kotov, Weatherford P&SS, Lukhovitsy, Russia

Pipeline External Corrosion Analysis Using a 3D Laser Scanner

April 15, 2011 VIA ELECTRONIC TRANSMISSION

INLINE INSPECTION OF PIPELINES CRITICAL FACTORS IN STRUCTURAL DESIGN, TESTING AND MANUFACTURING

Managing Linear Assets with Ventyx Ellipse

INLINE INSPECTION OF PIPELINES CRITICAL FACTORS IN STRUCTURAL DESIGN, TESTING AND MANUFACTURING

What is a life cycle model?

The Data Standards for New Pipeline Construction. Joint PODS and IPLOCA Workgroup

The Cost of a Pipeline Failure. Presented by Penn West

Information Systems Analysis and Design CSC John Mylopoulos. Software Architectures Information Systems Analysis and Design CSC340

A Process for ATLAS Software Development

A Solution to MOP/MAOP Data Management in PODS

Outlook. Corporate Research and Technologies, Munich, Germany. 20 th May 2010

Solutions for Gas Distribution & Pipeline Infrastructure Management

Analysis of the Specifics for a Business Rules Engine Based Projects

INTEGRATING BIM AND GIS FOR ASSET MANAGEMENT

PIPELINE INSPECTION UTILIZING ULTRASOUND TECHNOLOGY: ON THE ISSUE OF RESOLUTION By, M. Beller, NDT Systems & Services AG, Stutensee, Germany

Geofacilities Management System for Gas Distribution and Pipeline

PIPELINE INSPECTION USING INTELLIGENT PIGS AN SGA/BATTELLE WORKSHOP COLUMBUS, OHIO MAY 11-14, 2010 AGENDA

Solid Edge ST3 Advances the Future of 3D Design

SMALL DIAMETER, MULTIPLE DATASET INSPECTION IN LOW FLOW AND LOW PRESSURE ENVIRONMENTS

Collaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved.

PODS!"#$% &"'&( )*+,-+(*+ PODS, + *+./0 -(12$3 4&-050% -56 *(1"&7(&8&-&8 (APDM, PPDM) 9:+.&8 ;4$*($% dushakov@dataplus.ru

Oracle Database 10g: Building GIS Applications Using the Oracle Spatial Network Data Model. An Oracle Technical White Paper May 2005

High Performance Spatial Queries and Analytics for Spatial Big Data. Fusheng Wang. Department of Biomedical Informatics Emory University

How To Write An Slcm Project Plan

Solution. gas distribution. & Pipeline Infrastructure Management

DEVELOPMENT OF INTEGRATED HIGHWAY MANAGEMENT SYSTEM IN KOREA

Developing Microsoft SQL Server Databases MOC 20464

Training Management with TrackWise

Asset Management for Green Manufacturing

Towards Better Pipeline Data Governance. J. Tracy Thorleifson Eagle Information Mapping, Inc.

Effort and Cost Allocation in Medium to Large Software Development Projects

LearnFromGuru Polish your knowledge

GE Energy Oil & Gas. GIS & Data Management. Integrated software and services for pipelines

Model-Driven Development of a Biosignal Analysis Framework: Benefits and Impacts on Processes. Nikolas Hofmann

Creative Commons Attribution-NonCommercial-ShareAlike 2.5 License

Design Strategies for High Availability: Accommodating In-Vessel Piping Services and Auxiliary Systems

MongoDB Developer and Administrator Certification Course Agenda

A Web services solution for Work Management Operations. Venu Kanaparthy Dr. Charles O Hara, Ph. D. Abstract

Software Life-Cycle Management

State of SIEM Challenges, Myths & technology Landscape 4/21/2013 1

NatureServe s Environmental Review Tool

Copyright Soleran, Inc. esalestrack On-Demand CRM. Trademarks and all rights reserved. esalestrack is a Soleran product Privacy Statement

Is your SIEM ready.???

NitroView. Content Aware SIEM TM. Unified Security and Compliance Unmatched Speed and Scale. Application Data Monitoring. Database Monitoring

NASCIO EA Development Tool-Kit Solution Architecture. Version 3.0

PATHFINDER FOAM CALIPER PIG Case Study 12 REFINED PRODUCTS PIPELINE, NAPLES ITALY. Pipeline Innovations Ltd. The Problem

MNLARS Project Audit Checklist

NON-DESTRUCTIVE TESTING FULL SCOPE OF INTEGRATED NDT SERVICES

TOWARDS AN AUTOMATED HEALING OF 3D URBAN MODELS

Professional Organization Checklist for the Computer Science Curriculum Updates. Association of Computing Machinery Computing Curricula 2008

White Paper Case Study: How Collaboration Platforms Support the ITIL Best Practices Standard

How To Create An Enterprise Class Model Driven Integration

Applied Business Intelligence. Iakovos Motakis, Ph.D. Director, DW & Decision Support Systems Intrasoft SA

Outline. MCSE: Data Platform. Course Content. Course 10776C: MCSA: Developing Microsoft SQL Server 2012 Databases 5 Days

Course 20464C: Developing Microsoft SQL Server Databases

Deploying Hadoop with Manager

Achieving Actionable Situational Awareness... McAfee ESM. Ad Quist, Sales Engineer NEEUR

Pitfalls and Best Practices in Role Engineering


Integrating GIS within the Enterprise Options, Considerations and Experiences

BSM Transformation through CMDB Deployment. Streamlining the Integration of Change and Release Management

Efficiently Managing Firewall Conflicting Policies

Automotive Applications of 3D Laser Scanning Introduction

Client Requirement. Why SharePoint

secure intelligence collection and assessment system Your business technologists. Powering progress

CHAPTER 8 ASSET MANAGEMENT

Key New Capabilities Complete, Open, Integrated. Oracle Identity Analytics 11g: Identity Intelligence and Governance

Software Engineering. An Introduction. Fakhar Lodhi

AV-18 Introduction of the GIS Integration

Expanding Uniformance. Driving Digital Intelligence through Unified Data, Analytics, and Visualization

>

Iterative Database Design Challenges and Solutions for a Geomechanics Database

Project Management Office Best Practices

The Internet of Things... Hype or not?

Risk Based Asset Management

Geodatabase Programming with SQL

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database

SOLUTION BRIEF. JUST THE FAQs: Moving Big Data with Bulk Load.

Chapter 5 More SQL: Complex Queries, Triggers, Views, and Schema Modification

High Availability Storage

In Memory Accelerator for MongoDB

Rebuilding the World s Pipeline Infrastructure

OVERCOMING FIELD SERVICE & REVERSE LOGISTICS CHALLENGES WITH AN INTEGRATED, BEST OF BREED ENTERPRISE SERVICE MANAGEMENT SYSTEM

An Approach Towards Customized Multi- Tenancy

Big Data - Business, Math, Technology Best combination for big data 商 业 理 解, 数 据 科 学, 技 术 实 践 之 完 美 结 合

Information Retrieval Elasticsearch

Physical Security Information Management: A Technical Perspective

Transcription:

Challenges Managing ILI Data in an Enterprise Environment using PODS 6.0 Relational Bruce Dupuis John Spurlock Alejandro Reyes

Triggers Partnership between TransCanada and ROSEN to implement a PIMS ILI is one of TransCanada's core integrity management drivers PODS 6.0 relational supports Pipe Integrity's business processes

Challenges Business requirements Performance and model scalability Enterprise integration Centerline Maintenance STANDARD PODS ILI MODULE DID NOT MEET THE REQUIREMENTS

Business Requirements Unified enterprise ILI view Low quality ILI sections and report revisions Multiple ILI technologies Risk and feature assessment support Data integration & & &

Performance & Scalability Massive amounts of data Estimated +1 billion records in 10 years TCPL s network 65,000 km of pipe >100 ILI runs per year Overpopulation of the event tables

Enterprise Integration Data volume effects inside the organization Integration of various systems Workflow coordination

Centerline Maintenance Geometry changes Re-routings, in-line replacements, repairs GIS centerline maintenance Data alignment and correlation Historical ILI Centerline components

Conquering the Challenges Started from standard PODS model Several refinement iterations Contributions: Business requirements (operator) Product vision (vendor) Technical constraints (both)

Possible architectures Architecture Keep as single PODS database Split PODS DB horizontally (by events) Split PODS DB vertically (by lines) External ILI DB Decision to externalize the ILI module

ILI Module (current) Follows PODS conventions Could be re-inserted into PODS database if need arises 13 primary tables with 300+ attributes 13 Code List tables

ILI Module (current)

ILI Module - Inspection Before: - 24 Attributes - Basic run & tool information After: - 50 attributes - Pipetally revisions - Comprehensive tool/run statistics - Data quality information - Special tool/run configurations - General tool information moved to tool specific tables

ILI Module - Tool

ILI Module Tool (cont d) Before: - No support for combo tools - Core tool information After: - Support for combo tools - Support more tool technologies - Store detailed tool information, statistics, and capabilities

ILI Module ILI_Data Before: - 56 attributes - Basic support for MFL and GEO features - ~10 attributes dedicated to positioning - All data stored in single table After: - 2 core tables (Anomaly + Reference) - ~110 attributes (Anomaly + Reference) - ILI_Cluster table removed - Support MFL, GEO, EMAT, UT, UTCD, IMU, etc. - Remove link to Coordinate and Event_Range

ILI Module - Calculations Before: - Subset of ILI_DATA table - Standard assessment results - New assessments require extension of table After: - Assessment specific tables - Extensible model: can add operator specific assessments, new industry methods - Can store multiple results per feature - Corrosion growth + re-clustering

Advantages Supports required data volumes Follows PODS conventions Supports wide variety of ILI tools Supports business processes Advanced data mining Extended Extensible Normalized

Disadvantages Increased software complexity Additional development effort Loading and querying data ILI Alignment to Centerline Centerline and geometry changes History management Point vs. linear event representation No mechanism to describe it

What s Next? Continue module development New requirements, clarifications, improvements, addressing disadvantages Dig Programs & Feature Verification More robust tool tolerances model PODS Spatial integration (?) Open discussions with PODS committees

Contact Information Bruce Dupuis - TransCanada Pipelines - bruce_dupuis@transcanada.com John Spurlock ROSEN jspurlock@rosen-group.com Alejandro Reyes ROSEN jrcarrillo@rosen-group.com