Dynamic Modeling, Predictive Control and Performance Monitoring

Size: px
Start display at page:

Download "Dynamic Modeling, Predictive Control and Performance Monitoring"

Transcription

1 Biao Huang, Ramesh Kadali Dynamic Modeling, Predictive Control and Performance Monitoring A Data-driven Subspace Approach 4y Spri nnger g<

2 Contents Notation XIX 1 Introduction An Overview of This Book Main Features of This Book Organization of This Book 4 Part I Dynamic Modeling through Subspace Identification 2 System Identification: Conventional Approach Introduction Discrete-time Systems Finite Difference Models Exact Discretization for Linear Systems Backshift Operator and Discrete-time Transfer Functions An Example of System Identification: ARX Modeling Persistent Excitation in Input Signal Model Structures Prediction Error Model (PEM) AutoRegressive with Exogenous Input Model (ARX) AutoRegressive Moving Average with Exogenous Input Model (ARMAX) Box-Jenkins Model (BJ) Output Error Model (OE) MISO (Multi-input and Single-output) Prediction Error Model State Space Model Prediction Error Method Motivation Optimal Prediction Prediction Error Method 24

3 XIV Contents 2.7 Closed-loop Identification Identifiability without External Excitations Direct Closed-loop Identification Indirect Closed-loop Identification Joint Input-output Closed-loop Identification Summary 29 3 Open-loop Subspace Identification Introduction Subspace Matrices Description State Space Models Notations and Subspace Equations Open-loop Subspace Identification Methods Regression Analysis Approach Projection Approach and N4SID Projections Non-steady-state Kaiman Filters Projection Approach for Subspace Identification QR Factorization and MOESP Statistical Approach and CVA CVA Approach Determination of System Order Instrument-variable Methods and EIV Subspace Identification Summary 53 4 Closed-loop Subspace Identification Introduction Review of Closed-loop Subspace Identification Methods N4SID Approach Joint Input-Output Approach ARX Prediction Approach An Innovation Estimation Approach An Orthogonal Projection Approach A Solution through Orthogonal Projection The Problem of Biased Estimation and the Solution Model Extraction through Kaiman Filter State Sequence Extension to Error-in-variable (EIV) Systems Simulation Summary 78 5 Identification of Dynamic Matrix and Noise Model Using Closed-loop Data Introduction Estimation of Process Dynamic Matrix and Noise Model Estimation of Dynamic Matrix of the Process Estimation of the Noise Model 85

4 Contents XV 5.3 Some Guidelines for the Practical Implementation of the Algorithm Extension to the Case of Measured Disturbance Variables Closed-loop Simulations Univariate System Multivariate System Identification of the Dynamic Matrix: Pilot-scale Experimental Evaluation Summary 96 Part II Predictive Control 6 Model Predictive Control: Conventional Approach Introduction Understanding MPC Fundamentals of MPC Process and Disturbance Models Predictions Free and Forced Response Objective Function Constraints Control Law Dynamic Matrix Control (DMC) The Prediction Model Unconstrained DMC Design Penalizing the Control Action Handling Disturbances in DMC Multivariate Dynamic Matrix Control Hard Constrained DMC Economic Optimization Generalized Predictive Control (GPC) Summary Data-driven Subspace Approach to Predictive Control Introduction Predictive Controller Design from Subspace Matrices Inclusion of Integral Action Inclusion of Feedforward Control Constraint Handling Tuning the Noise Model Simulations Experiment on a Pilot-scale Process Summary 141

5 XVI Contents Part III Control Performance Monitoring 8 Control Loop Performance Assessment: Conventional Approach Introduction SISO Feedback Control Performance Assessment MIMO Feedback Control Performance Assessment Summary State-of-the-art MPC Performance Monitoring Introduction MPC Performance Monitoring: Model-based Approach Minimum-variance Control Benchmark LQG/MPC Benchmark Model-based Simulation Approach Designed/Historical vs Achieved Historical Covariance Benchmark MPC Performance Monitoring through Model Validation MPC Performance Monitoring: Model-free Approach Impulse-Response Curvature Prediction-error Approach Markov Chain Approach MPC Economic Performance Assessment and Tuning Probabilistic Inference for Diagnosis of MPC Performance Bayesian Network for Diagnosis Decision Making in Performance Diagnosis Summary Subspace Approach to MIMO Feedback Control Performance Assessment Introduction Subspace Matrices and Their Estimation Revisit of Important Subspace Matrices Estimation of Subspace Matrices from Open-loop Data Estimation of MVC-benchmark from Input/Output Data Closed-loop Subspace Expression of Process Response under Feedback Control Estimation of MVC-benchmark Directly from Input/Output Data Simulations and Application Example Summary 193

6 Contents XVII 11 Prediction Error Approach to Feedback Control Performance Assessment Introduction Prediction Error Approach to Feedback Control Performance Assessment Subspace Algorithm for Multi-step Optimal Prediction Errors Preliminary Calculation of Multi-step Optimal Prediction Errors Case Study Summary Performance Assessment with LQG-benchmark from Closed-loop Data Introduction Obtaining LQG-benchmark from Feedback Closed-loop Data Obtaining LQG-benchmark with Measured Disturbances Controller Performance Analysis Case 1: Feedback Controller Acting on the Process with Unmeasured Disturbances Case 2: Feedforward Plus Feedback Controller Acting on the Process Case 3: Feedback Controller Acting on the Process with Measured Disturbances Summary of the Subspace Approach to the Calculation of LQG-benchmark Simulations Application on a Pilot-scale Process Summary 227 References 229 Index 237

Univariate and Multivariate Methods PEARSON. Addison Wesley

Univariate and Multivariate Methods PEARSON. Addison Wesley Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston

More information

On Parametric Model Estimation

On Parametric Model Estimation Proceedings of the 11th WSEAS International Conference on COMPUTERS, Agios Nikolaos, Crete Island, Greece, July 26-28, 2007 608 On Parametric Model Estimation LUMINITA GIURGIU, MIRCEA POPA Technical Sciences

More information

Formulations of Model Predictive Control. Dipartimento di Elettronica e Informazione

Formulations of Model Predictive Control. Dipartimento di Elettronica e Informazione Formulations of Model Predictive Control Riccardo Scattolini Riccardo Scattolini Dipartimento di Elettronica e Informazione Impulse and step response models 2 At the beginning of the 80, the early formulations

More information

C21 Model Predictive Control

C21 Model Predictive Control C21 Model Predictive Control Mark Cannon 4 lectures Hilary Term 216-1 Lecture 1 Introduction 1-2 Organisation 4 lectures: week 3 week 4 { Monday 1-11 am LR5 Thursday 1-11 am LR5 { Monday 1-11 am LR5 Thursday

More information

Towards Dual MPC. Tor Aksel N. Heirung B. Erik Ydstie Bjarne Foss

Towards Dual MPC. Tor Aksel N. Heirung B. Erik Ydstie Bjarne Foss 4th IFAC Nonlinear Model Predictive Control Conference International Federation of Automatic Control Towards Dual MPC Tor Aksel N. Heirung B. Erik Ydstie Bjarne Foss Department of Engineering Cybernetics,

More information

Black-box Performance Models for Virtualized Web. Danilo Ardagna, Mara Tanelli, Marco Lovera, Li Zhang ardagna@elet.polimi.it

Black-box Performance Models for Virtualized Web. Danilo Ardagna, Mara Tanelli, Marco Lovera, Li Zhang ardagna@elet.polimi.it Black-box Performance Models for Virtualized Web Service Applications Danilo Ardagna, Mara Tanelli, Marco Lovera, Li Zhang ardagna@elet.polimi.it Reference scenario 2 Virtualization, proposed in early

More information

How To Understand Multivariate Models

How To Understand Multivariate Models Neil H. Timm Applied Multivariate Analysis With 42 Figures Springer Contents Preface Acknowledgments List of Tables List of Figures vii ix xix xxiii 1 Introduction 1 1.1 Overview 1 1.2 Multivariate Models

More information

State-Space Feedback Control for Elastic Distributed Storage in a Cloud Environment

State-Space Feedback Control for Elastic Distributed Storage in a Cloud Environment State-Space Feedback Control for Elastic Distributed Storage in a Cloud Environment M. Amir Moulavi Ahmad Al-Shishtawy Vladimir Vlassov KTH Royal Institute of Technology, Stockholm, Sweden ICAS 2012, March

More information

MATHEMATICAL METHODS OF STATISTICS

MATHEMATICAL METHODS OF STATISTICS MATHEMATICAL METHODS OF STATISTICS By HARALD CRAMER TROFESSOK IN THE UNIVERSITY OF STOCKHOLM Princeton PRINCETON UNIVERSITY PRESS 1946 TABLE OF CONTENTS. First Part. MATHEMATICAL INTRODUCTION. CHAPTERS

More information

Statistics Graduate Courses

Statistics Graduate Courses Statistics Graduate Courses STAT 7002--Topics in Statistics-Biological/Physical/Mathematics (cr.arr.).organized study of selected topics. Subjects and earnable credit may vary from semester to semester.

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct

More information

Network Security A Decision and Game-Theoretic Approach

Network Security A Decision and Game-Theoretic Approach Network Security A Decision and Game-Theoretic Approach Tansu Alpcan Deutsche Telekom Laboratories, Technical University of Berlin, Germany and Tamer Ba ar University of Illinois at Urbana-Champaign, USA

More information

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S.

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S. AUTOMATION OF ENERGY DEMAND FORECASTING by Sanzad Siddique, B.S. A Thesis submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree

More information

Neuro-Dynamic Programming An Overview

Neuro-Dynamic Programming An Overview 1 Neuro-Dynamic Programming An Overview Dimitri Bertsekas Dept. of Electrical Engineering and Computer Science M.I.T. September 2006 2 BELLMAN AND THE DUAL CURSES Dynamic Programming (DP) is very broadly

More information

ARX-Model based Model Predictive Control with Offset-Free Tracking.

ARX-Model based Model Predictive Control with Offset-Free Tracking. 0 th European Symposium on Computer Aided Process Engineering ESCAPE0 S. Pierucci and G. Buzzi Ferraris (Editors) 00 Elsevier B.V. All rights reserved. ARX-Model based Model Predictive Control with Offset-Free

More information

IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY 1

IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY 1 This article has been accepted for inclusion in a future issue of this journal Content is final as presented, with the exception of pagination IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY 1 An Improved

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

Content. Professur für Steuerung, Regelung und Systemdynamik. Lecture: Vehicle Dynamics Tutor: T. Wey Date: 01.01.08, 20:11:52

Content. Professur für Steuerung, Regelung und Systemdynamik. Lecture: Vehicle Dynamics Tutor: T. Wey Date: 01.01.08, 20:11:52 1 Content Overview 1. Basics on Signal Analysis 2. System Theory 3. Vehicle Dynamics Modeling 4. Active Chassis Control Systems 5. Signals & Systems 6. Statistical System Analysis 7. Filtering 8. Modeling,

More information

2014-2015 The Master s Degree with Thesis Course Descriptions in Industrial Engineering

2014-2015 The Master s Degree with Thesis Course Descriptions in Industrial Engineering 2014-2015 The Master s Degree with Thesis Course Descriptions in Industrial Engineering Compulsory Courses IENG540 Optimization Models and Algorithms In the course important deterministic optimization

More information

PID Controller Design for Nonlinear Systems Using Discrete-Time Local Model Networks

PID Controller Design for Nonlinear Systems Using Discrete-Time Local Model Networks PID Controller Design for Nonlinear Systems Using Discrete-Time Local Model Networks 4. Workshop für Modellbasierte Kalibriermethoden Nikolaus Euler-Rolle, Christoph Hametner, Stefan Jakubek Christian

More information

Nonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms

Nonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms Nonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms Al-Duwaish H. and Naeem, Wasif Electrical Engineering Department/King Fahd University of Petroleum and Minerals

More information

Control-Relevant Demand Forecasting for Management of a Production-Inventory System

Control-Relevant Demand Forecasting for Management of a Production-Inventory System 28 American Control Conference Westin Seattle Hotel, Seattle, Washington, USA June -3, 28 FrA3. Control-Relevant Demand Forecasting for Management of a Production-Inventory System Jay D. Schwartz, Manuel

More information

Regression Modeling Strategies

Regression Modeling Strategies Frank E. Harrell, Jr. Regression Modeling Strategies With Applications to Linear Models, Logistic Regression, and Survival Analysis With 141 Figures Springer Contents Preface Typographical Conventions

More information

Contents. List of Figures. List of Tables. List of Examples. Preface to Volume IV

Contents. List of Figures. List of Tables. List of Examples. Preface to Volume IV Contents List of Figures List of Tables List of Examples Foreword Preface to Volume IV xiii xvi xxi xxv xxix IV.1 Value at Risk and Other Risk Metrics 1 IV.1.1 Introduction 1 IV.1.2 An Overview of Market

More information

Process Mining. ^J Springer. Discovery, Conformance and Enhancement of Business Processes. Wil M.R van der Aalst Q UNIVERS1TAT.

Process Mining. ^J Springer. Discovery, Conformance and Enhancement of Business Processes. Wil M.R van der Aalst Q UNIVERS1TAT. Wil M.R van der Aalst Process Mining Discovery, Conformance and Enhancement of Business Processes Q UNIVERS1TAT m LIECHTENSTEIN Bibliothek ^J Springer Contents 1 Introduction I 1.1 Data Explosion I 1.2

More information

System Identification for Acoustic Comms.:

System Identification for Acoustic Comms.: System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation

More information

PREDICTOR DEVELOPMENT FOR CONTROLLING REAL-TIME APPLICATIONS OVER THE INTERNET. A Thesis MALLIK KOMMARAJU

PREDICTOR DEVELOPMENT FOR CONTROLLING REAL-TIME APPLICATIONS OVER THE INTERNET. A Thesis MALLIK KOMMARAJU PREDICTOR DEVELOPMENT FOR CONTROLLING REAL-TIME APPLICATIONS OVER THE INTERNET A Thesis by MALLIK KOMMARAJU Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of

More information

NEURAL NETWORKS A Comprehensive Foundation

NEURAL NETWORKS A Comprehensive Foundation NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments

More information

Dynamic Neural Networks for Actuator Fault Diagnosis: Application to the DAMADICS Benchmark Problem

Dynamic Neural Networks for Actuator Fault Diagnosis: Application to the DAMADICS Benchmark Problem Dynamic Neural Networks for Actuator Fault Diagnosis: Application to the DAMADICS Benchmark Problem Krzysztof PATAN and Thomas PARISINI University of Zielona Góra Poland e-mail: k.patan@issi.uz.zgora.pl

More information

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA 2015 School of Information Technology and Electrical Engineering at the University of Queensland TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA Schedule Week Date

More information

Power and Performance Management in Cloud Computing Systems

Power and Performance Management in Cloud Computing Systems UNIVERSITY OF TORINO DOCTORAL SCHOOL IN SCIENCE AND HIGH TECHNOLOGY SPECIALIZATION IN COMPUTER SCIENCE XXIII PHD CYCLE Power and Performance Management in Cloud Computing Systems by MARCO GUAZZONE Advisor:

More information

Principles of Data Mining by Hand&Mannila&Smyth

Principles of Data Mining by Hand&Mannila&Smyth Principles of Data Mining by Hand&Mannila&Smyth Slides for Textbook Ari Visa,, Institute of Signal Processing Tampere University of Technology October 4, 2010 Data Mining: Concepts and Techniques 1 Differences

More information

Real-Time Systems Versus Cyber-Physical Systems: Where is the Difference?

Real-Time Systems Versus Cyber-Physical Systems: Where is the Difference? Real-Time Systems Versus Cyber-Physical Systems: Where is the Difference? Samarjit Chakraborty www.rcs.ei.tum.de TU Munich, Germany Joint work with Dip Goswami*, Reinhard Schneider #, Alejandro Masrur

More information

Service courses for graduate students in degree programs other than the MS or PhD programs in Biostatistics.

Service courses for graduate students in degree programs other than the MS or PhD programs in Biostatistics. Course Catalog In order to be assured that all prerequisites are met, students must acquire a permission number from the education coordinator prior to enrolling in any Biostatistics course. Courses are

More information

THE LOGIC OF ADAPTIVE BEHAVIOR

THE LOGIC OF ADAPTIVE BEHAVIOR THE LOGIC OF ADAPTIVE BEHAVIOR Knowledge Representation and Algorithms for Adaptive Sequential Decision Making under Uncertainty in First-Order and Relational Domains Martijn van Otterlo Department of

More information

MixedÀ¾ нOptimization Problem via Lagrange Multiplier Theory

MixedÀ¾ нOptimization Problem via Lagrange Multiplier Theory MixedÀ¾ нOptimization Problem via Lagrange Multiplier Theory Jun WuÝ, Sheng ChenÞand Jian ChuÝ ÝNational Laboratory of Industrial Control Technology Institute of Advanced Process Control Zhejiang University,

More information

SALEM COMMUNITY COLLEGE Carneys Point, New Jersey 08069 COURSE SYLLABUS COVER SHEET. Action Taken (Please Check One) New Course Initiated

SALEM COMMUNITY COLLEGE Carneys Point, New Jersey 08069 COURSE SYLLABUS COVER SHEET. Action Taken (Please Check One) New Course Initiated SALEM COMMUNITY COLLEGE Carneys Point, New Jersey 08069 COURSE SYLLABUS COVER SHEET Course Title Course Number Department Linear Algebra Mathematics MAT-240 Action Taken (Please Check One) New Course Initiated

More information

FORECASTING AND TIME SERIES ANALYSIS USING THE SCA STATISTICAL SYSTEM

FORECASTING AND TIME SERIES ANALYSIS USING THE SCA STATISTICAL SYSTEM FORECASTING AND TIME SERIES ANALYSIS USING THE SCA STATISTICAL SYSTEM VOLUME 2 Expert System Capabilities for Time Series Modeling Simultaneous Transfer Function Modeling Vector Modeling by Lon-Mu Liu

More information

Using Wireless Measurements in Control Applications

Using Wireless Measurements in Control Applications Using Wireless Measurements in Control Applications Terry Blevins, Mark Nixon, Marty Zielinski Emerson Process Management Keywords: PID Control, Industrial Control, Wireless Transmitters ABSTRACT Wireless

More information

Safe robot motion planning in dynamic, uncertain environments

Safe robot motion planning in dynamic, uncertain environments Safe robot motion planning in dynamic, uncertain environments RSS 2011 Workshop: Guaranteeing Motion Safety for Robots June 27, 2011 Noel du Toit and Joel Burdick California Institute of Technology Dynamic,

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XVI - Fault Accomodation Using Model Predictive Methods - Jovan D. Bošković and Raman K.

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XVI - Fault Accomodation Using Model Predictive Methods - Jovan D. Bošković and Raman K. FAULT ACCOMMODATION USING MODEL PREDICTIVE METHODS Scientific Systems Company, Inc., Woburn, Massachusetts, USA. Keywords: Fault accommodation, Model Predictive Control (MPC), Failure Detection, Identification

More information

A Design of a PID Self-Tuning Controller Using LabVIEW

A Design of a PID Self-Tuning Controller Using LabVIEW Journal of Software Engineering and Applications, 2011, 4, 161-171 doi:10.4236/jsea.2011.43018 Published Online March 2011 (http://www.scirp.org/journal/jsea) 161 A Design of a PID Self-Tuning Controller

More information

QUALITY ENGINEERING PROGRAM

QUALITY ENGINEERING PROGRAM QUALITY ENGINEERING PROGRAM Production engineering deals with the practical engineering problems that occur in manufacturing planning, manufacturing processes and in the integration of the facilities and

More information

Using Simulation Models to Evolve Business Processes

Using Simulation Models to Evolve Business Processes Using Simulation Models to Evolve Business Processes Marin Litoiu, Andrei Solomon York University with ideas from IBM Toronto Lab, CAS Agenda Motivation and Goals Intro to BP Life Cycle BP Evolution Loop

More information

Principles of Dat Da a t Mining Pham Tho Hoan hoanpt@hnue.edu.v hoanpt@hnue.edu. n

Principles of Dat Da a t Mining Pham Tho Hoan hoanpt@hnue.edu.v hoanpt@hnue.edu. n Principles of Data Mining Pham Tho Hoan hoanpt@hnue.edu.vn References [1] David Hand, Heikki Mannila and Padhraic Smyth, Principles of Data Mining, MIT press, 2002 [2] Jiawei Han and Micheline Kamber,

More information

Singular Spectrum Analysis with Rssa

Singular Spectrum Analysis with Rssa Singular Spectrum Analysis with Rssa Maurizio Sanarico Chief Data Scientist SDG Consulting Milano R June 4, 2014 Motivation Discover structural components in complex time series Working hypothesis: a signal

More information

Systems and control theory for increased oil recovery

Systems and control theory for increased oil recovery Systems and control theory for increased oil recovery Jan-Dirk Jansen, Delft University of Technology 1 Research & development drivers Increasing demand; reducing supply energy demand continues to grow

More information

Capacity Limits of MIMO Channels

Capacity Limits of MIMO Channels Tutorial and 4G Systems Capacity Limits of MIMO Channels Markku Juntti Contents 1. Introduction. Review of information theory 3. Fixed MIMO channels 4. Fading MIMO channels 5. Summary and Conclusions References

More information

Mixed Neural and Feedback Controller for Apache Web Server

Mixed Neural and Feedback Controller for Apache Web Server SETIT 2009 5 th International Conference: Sciences of Electronic, Technologies of Information and Telecommunications March 22-26, 2009 TUNISIA Mixed Neural and Feedback Controller for Apache Web Server

More information

Exploratory Data Analysis with MATLAB

Exploratory Data Analysis with MATLAB Computer Science and Data Analysis Series Exploratory Data Analysis with MATLAB Second Edition Wendy L Martinez Angel R. Martinez Jeffrey L. Solka ( r ec) CRC Press VV J Taylor & Francis Group Boca Raton

More information

Statistics in Applications III. Distribution Theory and Inference

Statistics in Applications III. Distribution Theory and Inference 2.2 Master of Science Degrees The Department of Statistics at FSU offers three different options for an MS degree. 1. The applied statistics degree is for a student preparing for a career as an applied

More information

Learning is a very general term denoting the way in which agents:

Learning is a very general term denoting the way in which agents: What is learning? Learning is a very general term denoting the way in which agents: Acquire and organize knowledge (by building, modifying and organizing internal representations of some external reality);

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical

More information

Force/position control of a robotic system for transcranial magnetic stimulation

Force/position control of a robotic system for transcranial magnetic stimulation Force/position control of a robotic system for transcranial magnetic stimulation W.N. Wan Zakaria School of Mechanical and System Engineering Newcastle University Abstract To develop a force control scheme

More information

APPLIED MISSING DATA ANALYSIS

APPLIED MISSING DATA ANALYSIS APPLIED MISSING DATA ANALYSIS Craig K. Enders Series Editor's Note by Todd D. little THE GUILFORD PRESS New York London Contents 1 An Introduction to Missing Data 1 1.1 Introduction 1 1.2 Chapter Overview

More information

Design Methods for Control Systems

Design Methods for Control Systems Design Methods for Control Systems Okko H. Bosgra Delft University of Technology Delft, The Netherlands Huibert Kwakernaak Emeritus Professor University of Twente Enschede, The Netherlands Gjerrit Meinsma

More information

Stephane Crepey. Financial Modeling. A Backward Stochastic Differential Equations Perspective. 4y Springer

Stephane Crepey. Financial Modeling. A Backward Stochastic Differential Equations Perspective. 4y Springer Stephane Crepey Financial Modeling A Backward Stochastic Differential Equations Perspective 4y Springer Part I An Introductory Course in Stochastic Processes 1 Some Classes of Discrete-Time Stochastic

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

Optimization of warehousing and transportation costs, in a multiproduct multi-level supply chain system, under a stochastic demand

Optimization of warehousing and transportation costs, in a multiproduct multi-level supply chain system, under a stochastic demand Int. J. Simul. Multidisci. Des. Optim. 4, 1-5 (2010) c ASMDO 2010 DOI: 10.1051/ijsmdo / 2010001 Available online at: http://www.ijsmdo.org Optimization of warehousing and transportation costs, in a multiproduct

More information

Introduction to Financial Models for Management and Planning

Introduction to Financial Models for Management and Planning CHAPMAN &HALL/CRC FINANCE SERIES Introduction to Financial Models for Management and Planning James R. Morris University of Colorado, Denver U. S. A. John P. Daley University of Colorado, Denver U. S.

More information

Self-Tuning Memory Management of A Database System

Self-Tuning Memory Management of A Database System Self-Tuning Memory Management of A Database System Yixin Diao diao@us.ibm.com IM 2009 Tutorial: Recent Advances in the Application of Control Theory to Network and Service Management DB2 Self-Tuning Memory

More information

Gunther Ruhe Claes Wohlin. Editors. Software Project. Management in a Changing World. ^ Springer

Gunther Ruhe Claes Wohlin. Editors. Software Project. Management in a Changing World. ^ Springer Gunther Ruhe Claes Wohlin Editors Software Project Management in a Changing World ^ Springer Contents 1 Software Project Management: Setting the Context 1 1.1 Motivation 1 1.2 Characteristics of Software

More information

Design of an Adaptive Cruise Control Model for. Hybrid Systems Fault Diagnosis

Design of an Adaptive Cruise Control Model for. Hybrid Systems Fault Diagnosis Design of an Adaptive Cruise Control Model for Hybrid Systems Fault Diagnosis DESIGN OF AN ADAPTIVE CRUISE CONTROL MODEL FOR HYBRID SYSTEMS FAULT DIAGNOSIS BY BENJAMIN BREIMER, B.Eng a thesis submitted

More information

A spreadsheet Approach to Business Quantitative Methods

A spreadsheet Approach to Business Quantitative Methods A spreadsheet Approach to Business Quantitative Methods by John Flaherty Ric Lombardo Paul Morgan Basil desilva David Wilson with contributions by: William McCluskey Richard Borst Lloyd Williams Hugh Williams

More information

Convolution. 1D Formula: 2D Formula: Example on the web: http://www.jhu.edu/~signals/convolve/

Convolution. 1D Formula: 2D Formula: Example on the web: http://www.jhu.edu/~signals/convolve/ Basic Filters (7) Convolution/correlation/Linear filtering Gaussian filters Smoothing and noise reduction First derivatives of Gaussian Second derivative of Gaussian: Laplacian Oriented Gaussian filters

More information

CHAPTER 9 EXAMPLES: MULTILEVEL MODELING WITH COMPLEX SURVEY DATA

CHAPTER 9 EXAMPLES: MULTILEVEL MODELING WITH COMPLEX SURVEY DATA Examples: Multilevel Modeling With Complex Survey Data CHAPTER 9 EXAMPLES: MULTILEVEL MODELING WITH COMPLEX SURVEY DATA Complex survey data refers to data obtained by stratification, cluster sampling and/or

More information

Identification algorithms for hybrid systems

Identification algorithms for hybrid systems Identification algorithms for hybrid systems Giancarlo Ferrari-Trecate Modeling paradigms Chemistry White box Thermodynamics System Mechanics... Drawbacks: Parameter values of components must be known

More information

Handling missing data in large data sets. Agostino Di Ciaccio Dept. of Statistics University of Rome La Sapienza

Handling missing data in large data sets. Agostino Di Ciaccio Dept. of Statistics University of Rome La Sapienza Handling missing data in large data sets Agostino Di Ciaccio Dept. of Statistics University of Rome La Sapienza The problem Often in official statistics we have large data sets with many variables and

More information

Cell Phone based Activity Detection using Markov Logic Network

Cell Phone based Activity Detection using Markov Logic Network Cell Phone based Activity Detection using Markov Logic Network Somdeb Sarkhel sxs104721@utdallas.edu 1 Introduction Mobile devices are becoming increasingly sophisticated and the latest generation of smart

More information

Approach to Process Modeling

Approach to Process Modeling A Hybrid Neural Network-First Principles Approach to Process Modeling Dimitris C. Psichogios and Lyle H. Ungar Dept. of Chemical Engineering, University of Pennsylvania, Philadelphia, PA 19104 A hybrid

More information

CS 2750 Machine Learning. Lecture 1. Machine Learning. http://www.cs.pitt.edu/~milos/courses/cs2750/ CS 2750 Machine Learning.

CS 2750 Machine Learning. Lecture 1. Machine Learning. http://www.cs.pitt.edu/~milos/courses/cs2750/ CS 2750 Machine Learning. Lecture Machine Learning Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square, x5 http://www.cs.pitt.edu/~milos/courses/cs75/ Administration Instructor: Milos Hauskrecht milos@cs.pitt.edu 539 Sennott

More information

System Aware Cyber Security

System Aware Cyber Security System Aware Cyber Security Application of Dynamic System Models and State Estimation Technology to the Cyber Security of Physical Systems Barry M. Horowitz, Kate Pierce University of Virginia April, 2012

More information

Copyright. Network and Protocol Simulation. What is simulation? What is simulation? What is simulation? What is simulation?

Copyright. Network and Protocol Simulation. What is simulation? What is simulation? What is simulation? What is simulation? Copyright Network and Protocol Simulation Michela Meo Maurizio M. Munafò Michela.Meo@polito.it Maurizio.Munafo@polito.it Quest opera è protetta dalla licenza Creative Commons NoDerivs-NonCommercial. Per

More information

DATA MINING IN FINANCE

DATA MINING IN FINANCE DATA MINING IN FINANCE Advances in Relational and Hybrid Methods by BORIS KOVALERCHUK Central Washington University, USA and EVGENII VITYAEV Institute of Mathematics Russian Academy of Sciences, Russia

More information

054414 PROCESS CONTROL SYSTEM DESIGN. 054414 Process Control System Design. LECTURE 6: SIMO and MISO CONTROL

054414 PROCESS CONTROL SYSTEM DESIGN. 054414 Process Control System Design. LECTURE 6: SIMO and MISO CONTROL 05444 Process Control System Design LECTURE 6: SIMO and MISO CONTROL Daniel R. Lewin Department of Chemical Engineering Technion, Haifa, Israel 6 - Introduction This part of the course explores opportunities

More information

Robust Path Planning and Feedback Design under Stochastic Uncertainty

Robust Path Planning and Feedback Design under Stochastic Uncertainty Robust Path Planning and Feedback Design under Stochastic Uncertainty Lars Blackmore Autonomous vehicles require optimal path planning algorithms to achieve mission goals while avoiding obstacles and being

More information

Propulsion Gas Path Health Management Task Overview. Donald L. Simon NASA Glenn Research Center

Propulsion Gas Path Health Management Task Overview. Donald L. Simon NASA Glenn Research Center Propulsion Gas Path Health Management Task Overview Donald L. Simon NASA Glenn Research Center Propulsion Controls and s Research Workshop December 8-10, 2009 Cleveland, OH www.nasa.gov 1 National Aeronautics

More information

Automatic Stress and Load Testing for Embedded Systems

Automatic Stress and Load Testing for Embedded Systems Automatic Stress and Load Testing for Embedded Systems Mohamad S. Bayan João W. Cangussu Department of Computer Science University of Texas at Dallas msb021000,cangussu @utdallas.edu Abstract Load and

More information

Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences

Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences Third Edition Jacob Cohen (deceased) New York University Patricia Cohen New York State Psychiatric Institute and Columbia University

More information

ElastMan: Autonomic Elasticity Manager for Cloud-Based Key-Value Stores

ElastMan: Autonomic Elasticity Manager for Cloud-Based Key-Value Stores ElastMan: Autonomic Elasticity Manager for Cloud-Based Key-Value Stores Ahmad Al-Shishtawy KTH Royal Institute of Technology Stockholm, Sweden Doctoral School Day in Cloud Computing Louvain-la-Neuve, Belgium,

More information

Planning and Scheduling in Manufacturing and Services

Planning and Scheduling in Manufacturing and Services Michael L. Pinedo Planning and Scheduling in Manufacturing and Services Second edition 4y Springer Preface Contents of CD-ROM vii xvii Part I Preliminaries 1 Introduction 3 1.1 Planning and Scheduling:

More information

Probability and Statistics

Probability and Statistics Probability and Statistics Syllabus for the TEMPUS SEE PhD Course (Podgorica, April 4 29, 2011) Franz Kappel 1 Institute for Mathematics and Scientific Computing University of Graz Žaneta Popeska 2 Faculty

More information

Applied Computational Economics and Finance

Applied Computational Economics and Finance Applied Computational Economics and Finance Mario J. Miranda and Paul L. Fackler The MIT Press Cambridge, Massachusetts London, England Preface xv 1 Introduction 1 1.1 Some Apparently Simple Questions

More information

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Thomas Reilly Data Physics Corporation 1741 Technology Drive, Suite 260 San Jose, CA 95110 (408) 216-8440 This paper

More information

Azure Machine Learning, SQL Data Mining and R

Azure Machine Learning, SQL Data Mining and R Azure Machine Learning, SQL Data Mining and R Day-by-day Agenda Prerequisites No formal prerequisites. Basic knowledge of SQL Server Data Tools, Excel and any analytical experience helps. Best of all:

More information

LOOP TRANSFER RECOVERY FOR SAMPLED-DATA SYSTEMS 1

LOOP TRANSFER RECOVERY FOR SAMPLED-DATA SYSTEMS 1 LOOP TRANSFER RECOVERY FOR SAMPLED-DATA SYSTEMS 1 Henrik Niemann Jakob Stoustrup Mike Lind Rank Bahram Shafai Dept. of Automation, Technical University of Denmark, Building 326, DK-2800 Lyngby, Denmark

More information

Similarity Search and Mining in Uncertain Spatial and Spatio Temporal Databases. Andreas Züfle

Similarity Search and Mining in Uncertain Spatial and Spatio Temporal Databases. Andreas Züfle Similarity Search and Mining in Uncertain Spatial and Spatio Temporal Databases Andreas Züfle Geo Spatial Data Huge flood of geo spatial data Modern technology New user mentality Great research potential

More information

ANALYTICS IN BIG DATA ERA

ANALYTICS IN BIG DATA ERA ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY, DISCOVER RELATIONSHIPS AND CLASSIFY HUGE AMOUNT OF DATA MAURIZIO SALUSTI SAS Copyr i g ht 2012, SAS Ins titut

More information

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm 1 Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm Hani Mehrpouyan, Student Member, IEEE, Department of Electrical and Computer Engineering Queen s University, Kingston, Ontario,

More information

Nonlinear Iterative Partial Least Squares Method

Nonlinear Iterative Partial Least Squares Method Numerical Methods for Determining Principal Component Analysis Abstract Factors Béchu, S., Richard-Plouet, M., Fernandez, V., Walton, J., and Fairley, N. (2016) Developments in numerical treatments for

More information

Sample Size Designs to Assess Controls

Sample Size Designs to Assess Controls Sample Size Designs to Assess Controls B. Ricky Rambharat, PhD, PStat Lead Statistician Office of the Comptroller of the Currency U.S. Department of the Treasury Washington, DC FCSM Research Conference

More information

Mathematics (MAT) MAT 061 Basic Euclidean Geometry 3 Hours. MAT 051 Pre-Algebra 4 Hours

Mathematics (MAT) MAT 061 Basic Euclidean Geometry 3 Hours. MAT 051 Pre-Algebra 4 Hours MAT 051 Pre-Algebra Mathematics (MAT) MAT 051 is designed as a review of the basic operations of arithmetic and an introduction to algebra. The student must earn a grade of C or in order to enroll in MAT

More information

Transportation Research Part A 36 (2002) 763 778 www.elsevier.com/locate/tra Optimal maintenance and repair policies in infrastructure management under uncertain facility deterioration rates: an adaptive

More information

PRINCIPLES OF INVENTORY AND MATERIALS MANAGEMENT

PRINCIPLES OF INVENTORY AND MATERIALS MANAGEMENT PRINCIPLES OF INVENTORY AND MATERIALS MANAGEMENT Fourth Edition Richard J. Tersine The University of Oklahoma TEGHNISCHE HOCHSCHULE DARMSTADT Fochbereich 1 Gesonr> 11-. ib I iothek Betiier >wi rtschottsiehre

More information

The primary goal of this thesis was to understand how the spatial dependence of

The primary goal of this thesis was to understand how the spatial dependence of 5 General discussion 5.1 Introduction The primary goal of this thesis was to understand how the spatial dependence of consumer attitudes can be modeled, what additional benefits the recovering of spatial

More information

Kalman Filter Applied to a Active Queue Management Problem

Kalman Filter Applied to a Active Queue Management Problem IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-issn: 2278-1676,p-ISSN: 2320-3331, Volume 9, Issue 4 Ver. III (Jul Aug. 2014), PP 23-27 Jyoti Pandey 1 and Prof. Aashih Hiradhar 2 Department

More information