Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations



Similar documents
Self-Organizing g Maps (SOM) COMP61021 Modelling and Visualization of High Dimensional Data

Visualization of Breast Cancer Data by SOM Component Planes

A Partially Supervised Metric Multidimensional Scaling Algorithm for Textual Data Visualization

Self Organizing Maps: Fundamentals

Reconstructing Self Organizing Maps as Spider Graphs for better visual interpretation of large unstructured datasets

Data topology visualization for the Self-Organizing Map

CITY UNIVERSITY OF HONG KONG 香 港 城 市 大 學. Self-Organizing Map: Visualization and Data Handling 自 組 織 神 經 網 絡 : 可 視 化 和 數 據 處 理

Visualizing an Auto-Generated Topic Map

Fuel Cell Health Monitoring Using Self Organizing Maps

USING SELF-ORGANIZING MAPS FOR INFORMATION VISUALIZATION AND KNOWLEDGE DISCOVERY IN COMPLEX GEOSPATIAL DATASETS

LVQ Plug-In Algorithm for SQL Server

On the use of Three-dimensional Self-Organizing Maps for Visualizing Clusters in Geo-referenced Data

Self Organizing Maps for Visualization of Categories

A Case of Study on Hadoop Benchmark Behavior Modeling Using ALOJA-ML

PRACTICAL DATA MINING IN A LARGE UTILITY COMPANY

Data Mining and Neural Networks in Stata

Neural networks and their rules for classification in marine geology

MANAGING QUEUE STABILITY USING ART2 IN ACTIVE QUEUE MANAGEMENT FOR CONGESTION CONTROL

Classification of Engineering Consultancy Firms Using Self-Organizing Maps: A Scientific Approach

Visualization of large data sets using MDS combined with LVQ.

Online data visualization using the neural gas network

Analysis of Performance Metrics from a Database Management System Using Kohonen s Self Organizing Maps

A Computational Framework for Exploratory Data Analysis

Introduction to Data Mining

INTRUSION DETECTION SYSTEM USING SELF ORGANIZING MAP

An Introduction to Data Mining. Big Data World. Related Fields and Disciplines. What is Data Mining? 2/12/2015

Data Clustering and Topology Preservation Using 3D Visualization of Self Organizing Maps

SPPA-D3000 Plant Monitor Technical Description

Data Quality Mining: Employing Classifiers for Assuring consistent Datasets

Comparing large datasets structures through unsupervised learning

Integration of Process Simulation and Data Mining Techniques for the Analysis and Optimization of Process Systems. Balazs Balasko

Is a Data Scientist the New Quant? Stuart Kozola MathWorks

Multivariate Tools for Modern Pharmaceutical Control FDA Perspective

Mobile Phone APP Software Browsing Behavior using Clustering Analysis

ViSOM A Novel Method for Multivariate Data Projection and Structure Visualization

EVALUATION OF NEURAL NETWORK BASED CLASSIFICATION SYSTEMS FOR CLINICAL CANCER DATA CLASSIFICATION

UNIVERSITY OF BOLTON SCHOOL OF ENGINEERING MS SYSTEMS ENGINEERING AND ENGINEERING MANAGEMENT SEMESTER 1 EXAMINATION 2015/2016 INTELLIGENT SYSTEMS

A Discussion on Visual Interactive Data Exploration using Self-Organizing Maps

Maschinelles Lernen mit MATLAB

Knowledge Discovery from patents using KMX Text Analytics

Using Data Mining for Mobile Communication Clustering and Characterization

Advanced Web Usage Mining Algorithm using Neural Network and Principal Component Analysis

Load balancing in a heterogeneous computer system by self-organizing Kohonen network

Data Mining using Rule Extraction from Kohonen Self-Organising Maps

Industrial Roadmap for Connected Machines. Sal Spada Research Director ARC Advisory Group

9. Text & Documents. Visualizing and Searching Documents. Dr. Thorsten Büring, 20. Dezember 2007, Vorlesung Wintersemester 2007/08

Credit Card Fraud Detection Using Self Organised Map

What is Data Mining? Data Mining (Knowledge discovery in database) Data mining: Basic steps. Mining tasks. Classification: YES, NO

INTERACTIVE DATA EXPLORATION USING MDS MAPPING

Using Smoothed Data Histograms for Cluster Visualization in Self-Organizing Maps

Grid e-services for Multi-Layer SOM Neural Network Simulation

Overview. Swarms in nature. Fish, birds, ants, termites, Introduction to swarm intelligence principles Particle Swarm Optimization (PSO)

Quality Assessment in Spatial Clustering of Data Mining

2002 IEEE. Reprinted with permission.

Exploratory Data Analysis with MATLAB

Network Intrusion Detection Systems

CS Master Level Courses and Areas COURSE DESCRIPTIONS. CSCI 521 Real-Time Systems. CSCI 522 High Performance Computing

Sensory-motor control scheme based on Kohonen Maps and AVITE model

Barcode Based Automated Parking Management System

NETWORK-BASED INTRUSION DETECTION USING NEURAL NETWORKS

Igniting the Next Industrial Revolution

Clustering. Data Mining. Abraham Otero. Data Mining. Agenda

COPYRIGHTED MATERIAL. Contents. List of Figures. Acknowledgments

Ryan F. Schkoda, Ph.D. Postdoctoral Fellow Wind Turbine Drivetrain Testing Facility Charleston, SC

How To Use A Fault Docket System For A Fault Fault System

Using Predictive Analytics to Detect Fraudulent Claims

Big Data Text Mining and Visualization. Anton Heijs

6.2.8 Neural networks for data mining

Big Data, Physics, and the Industrial Internet! How Modeling & Analytics are Making the World Work Better."

Information Management course

TIETS34 Seminar: Data Mining on Biometric identification

Models of Cortical Maps II

Comparison of Non-linear Dimensionality Reduction Techniques for Classification with Gene Expression Microarray Data

Intrusion Detection. Jeffrey J.P. Tsai. Imperial College Press. A Machine Learning Approach. Zhenwei Yu. University of Illinois, Chicago, USA

BIOINF 585 Fall 2015 Machine Learning for Systems Biology & Clinical Informatics

SYSTEMS, CONTROL AND MECHATRONICS

VISUALIZATION OF GEOSPATIAL DATA BY COMPONENT PLANES AND U-MATRIX

Segmentation of stock trading customers according to potential value

ultra fast SOM using CUDA

Introduction to Data Mining and Machine Learning Techniques. Iza Moise, Evangelos Pournaras, Dirk Helbing

Machine Learning CS Lecture 01. Razvan C. Bunescu School of Electrical Engineering and Computer Science

Transcription:

Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations Christian W. Frey 2012

Monitoring of Complex Industrial Processes based on Self-Organizing Maps and Watershed Transformations 1. Motivation 2. Monitoring of Industrial Processes 3. Self-Organizing Maps 4. Demonstrator System at IOSB 5. Industrial Application PROCMON 6. Summary 2012 2

1. Motivation Monitoring of complex Industrial Processes: Production processes in process industry are characterized by high complexity and system order Typically the production plants are equipped with a high number of sensors and actuators Distributed automation systems require a continuous and integral monitoring functionality to increase operational availability and cost effectiveness Online monitoring and diagnosis of the asset functionality Detection of process anomalies and component malfunctions Application-oriented visualization of the diagnosis information 3

2. Monitoring of Industrial Processes Model-Based Monitoring: Diagnosis of technical processes is performed by measuring the residual between the process model and the measured system states Analytical process models require a mathematical description of the process relations: Y (t) Comprehensive physical system knowledge is required and can be very expensive due to experimental investigations X (t) Process Model Y m(t) Highly complex processes e.g. chemical plants are difficult to describe by an analytical process model due to their high system order E (t) 4

2. Monitoring of Industrial Processes Model-Based Monitoring: Data-driven process modeling concepts can be applied to obtain model of the unknown system behavior: No mathematical description of the physical behavior Recorded input / output samples are used to induce an data-driven process model X (t) Y (t) Novelity Detection N (t) Machine learning algorithms are capable of modeling the input / output behavior based on training data For anomaly detection an multiple-input multiple-output model (MIMO) of the process is not required The measured system states only need to be classified with respect to their novelty 5

3. Self-Organizing Maps Topology Preserving Mapping: High dimensional input data is mapped topological ordered into a lower dimensional output space f : A n B, A R, B R m f f Similar input vectors are mapped topological close together and dissimilar apart Topology preserving concepts: Self Organizing Maps (SOM) Growing Grid / Neural Gas (GGRID) Generative Topographic Mapping (GTM) 6

3. Self-Organizing Maps Self-Organizing Maps (SOM): f f Self Organizing Maps developed by Teuvo Kohonen in 1989 The self-organizing map performs a topological mapping from a higher dimensional input space to a lower dimensional map space The map consists of neurons arranged in a defined topology (ring, toroid) No data connection between neurons the neurons are characterized by their position in the topology Each Neuron holds an prototype vector the dimensionality corresponds to the number of input signals 7

3. Self-Organizing Maps Self Organizing Maps (SOM): High dimensional input data is topological ordered by so called neighborhood function SOM forms a semantic map where similar input vectors are mapped topological close together and dissimilar apart Approximation quality of the map is calculated by the distance (e.g. Euclidian) between input vector and neuron vector (quantification error) d Input Vector Prototype Vector d l x, m x, m i j i m m,..., j 1 m jd x x,..., i 1 x id il jl 2 8

3. Self-Organizing Maps Unified-Distance-Matrix (UMatrix): UMatrix transformation adds a third dimension to the 2D map of the SOM which corresponds to the distance between the neighboring neurons Valleys (blue) in the UMatrix are clusters in the map where the stored prototype vectors are similar (specific process phases) Mountain Ridges (red) reflect the cluster boarders in the data set (transient phases) By analyzing the UMatrix: Detection of process phases and transient process phases BMU trajectory can be interpreted as process phase sequence 9

3. Self-Organizing Maps Unified-Distance-Matrix (UMatrix): UMatrix transformation adds a third dimension to the 2D map of the SOM which corresponds to the distance between the neighboring neurons Valleys (blue) in the UMatrix are clusters in the map where the stored prototype vectors are similar (specific process phases) Mountain Ridges (red) reflect the cluster boarders in the data set (transient phases) By analyzing the UMatrix: Detection of process phases and transient process phases BMU trajectory can be interpreted as process phase sequence 10

3. Self-Organizing Maps Unified-Distance-Matrix (UMatrix): UMatrix transformation adds a third dimension to the 2D map of the SOM which corresponds to the distance between the neighboring neurons Valleys (blue) in the UMatrix are clusters in the map where the stored prototype vectors are similar (specific process phases) Mountain Ridges (red) reflect the cluster boarders in the data set (transient phases) By analyzing the UMatrix: Detection of process phases and transient process phases BMU trajectory can be interpreted as process phase sequence 11

3. Self-Organizing Maps Watershed-Transformation : UMatrix representation holds information about the number of clusters and the cluster borders The Watershed-Transformation is capable of extracting the number of clusters and the cluster areas in the UMatrix The basic idea is to flood the UMatrix valleys the watershed lines corresponds to the cluster borders in the training data set By applying the Watershed Transformation: Process phases can be determined Process phase sequence can be monitored 12

4. Demonstrator System at IOSB 13

4. Demonstrator System at IOSB 14

4. Demonstrator System at IOSB 15

4. Demonstrator System at IOSB Prozessdaten Fehler 16

5. Industrial Application PROCMON Process and Condition Monitoring: Embedding of the monitoring functionalities in a software engine (PROCMON) Implementation in C++ with interfaces for: ANSI C++ Microsoft.NET3.5 /.NET4.0 32/64 BIT (C++/Cli, C#, VB) Matlab Implementation of standardized graphical user interface (GUI) for Microsoft operating systems (WIN32/64) 17

5. Industrial Application PROCMON Bayer Technology Services PuMon: Development of monitoring application for process industry in cooperation with Bayer Technology Services (BTS) Process-Unit-Monitoring (PUMon) functionality is optimized for monitoring of chemical and pharmaceutical production plants 18

5. Industrial Application PROCMON Monitoring of drinking water quality: 19

5. Industrial Application PROCMON Monitoring of wind power plants: P [MW] V [m/s] f1 [HZ] Error fn [HZ] 20

6. Summary Monitoring concept based on machine learning methods Appliance of self organizing maps for generating an data driven model of the physical process behavior Watershed algorithm for detecting automatically the typical process phases Verification of the concept by appliance to an chemical test plant Appliance of the diagnosis concept to a wide range of processes in process industry 21