Relational Dynamic Bayesian Networks: a report. Cristina Manfredotti

Size: px
Start display at page:

Download "Relational Dynamic Bayesian Networks: a report. Cristina Manfredotti"

Transcription

1 Relational Dynamic Bayesian Networks: a report Cristina Manfredotti Dipartimento di Informatica, Sistemistica e Comunicazione (D.I.S.Co.) Università degli Studi Milano-Bicocca Bayesian Networks: C T T Encode the joint probability distribution of a set of variables, as a Direct Acyclic Graph A Direct Acyclic Graph which nodes are conditionally independent of its non-descendent given its parents B T T P(D C,B) D T P(E D) C E D D T A P(C) T.90 P( D) P(B A).05 B A P(A) 0.01 P(A,B,C,D,E,) = = P(A)P(B A)P(C)P(D C,B)P(E D)P( D) = P(Z i Pa(Z i )) Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 2

2 The alarm example(1) I'm at work, neighbor John calls to say my alarm is ringing, but neighbor Mary doesn't call. Sometimes it's set off by minor earthquakes. Is there a burglary? Variables: BurglarEnter, EarthquakeAppens, AlarmRings, JohnCalls, MaryCalls Network topology reflects "causal" knowledge: A burglar can set the alarm off An earthquake can set the alarm off The alarm can cause Mary to call The alarm can cause John to call from Russel&Norvig Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 3 The alarm example(2) Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 4

3 Bayesian Networks Each node is a variable: Two different nodes in the network This is why we have such structure: Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 5 Bayesian Networks If we should have 4 neighbors? We have to construct a graph with 2 more knods. Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 6

4 A large BN Thanks to Mark Chavira Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 7 Relational Domain Objects: groups of attributes which belong together (tables of a database), c.f. a structure in a programming language e.g.: Object Relational Domain contains a set of objects with relations and/or predicates between them e.g.: Relation neighbor alarm burglar (honer of an house) neighbor s attributes: his capacity of hearing, his attention,... alarm s attributes: its volume, its sensibility,... e.g.: Predicate tocall (the honer of the house) tohear (the alarm) toring Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 8

5 The alarm Relational Domain: Burglary Alarm Volume Sensibility ToRing... Listening Neighbor DegOfDef NoiseAround Teleph... Calling Honer DegOfBelieve Teleph... Red words: predicates, that concern only the object itself Dashed arrows: relation between an object and an attribute of the object (or a predicate) Green arrows: dependence between two attributes Continouse arrows: relations between two objects Bold black words: objects names Black words: objects attributes (caracteristic of the variables, they make an instanciation of each object different by each other). Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 9 Relational Bayesian Networks difficult definition Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 10

6 Relational Bayesian Network Syntax RBN: a set of nodes, one per variable predicate/relation/attribute a directed, acyclic graph a conditional distribution for each node given its parents, this distribution must take into account the actual complexity of the nodes! Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 11 Alarm RBN: Earthquacke Neigh.DegOfDef Alarm.Volume Neigh.NoiseAround I relationated only that part of the graph, I could make the same for each knodes of the BN NeighborCalls Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 12

7 Conditional Probability Distribution/Table The CPTs will take into account the values of each attributes or each variable in the system (i.e. for each actor playing a role in the represented world) an object will be instantiated, the conditional probability of each variable will be the same but they will depend by the particular instantiation of their attributes. NOT ONLY BY THE ACT THAT THE ALARM HAS RANG E.g.: P(NeighCall Neigh.DegOfDef, Neigh.NoiseAround,Alarm.Vol) = =.90 if the Neighbor isn t def but he listen music (John case). =.70 if the Neighbor is def but his house is very quite (Mary case). Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 13 Relational Bayesian Networks Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 14

8 Dynamic Bayesian Networks: Extension of BN for modeling dynamic systems. State at time t represented by a set of random variables z t = (z 1,t,,z d,t ). The state at time t depends on the states at previous time steps. A 2TBN is a BN that contains variables from z t-1 whose parents are variables from z t and/or z t-1, and variables from z t without their parents. A 2TBN defines P(z t z t-1 ) by means of a directed acyclic graph (DAG) as follows: P(z t z t-1 ) = N i=1p(z i t Pa(z i t)) Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 15 Dynamic Bayesian Networks A Dynamic Bayesian Network (DBN) is defined to be a pair of Bayesian Networks (B 0, B ), where B 0 represents the initial distribution P(z 0 ), and B is a 2TBN, which defines the transition distribution P(z t+1 z t ). Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 16

9 Relational Dynamic Bayesian Nets: Once you defined a RBN and a DBN it is easy to define a RDBN... GUESS IT! Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 17 Particle ilters: Tecnique that implements a ricursive Bayesian Ilter through a Monte Carlo simulation. The key idea is to represent the posterior pdf with a set of random samples with associated weights and compute the estimation based on these samples and weights. As the number of samples becomes very large, this MC caratterization becomes an equivalent representation to the usual functional description of the posterior pdf, and the SIS algorithm filter approaches the optimal Bayesian estimate. Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 18

10 Particle iltering: steps ix the number of particles: M 1. Particle generation x ( m) k ~ p( xk xk 1) At time k arrives the observation/measure z k 2a. Weight computation w = p( z x *( m) ( m) k k k ) 2b. Weight normalization 3. Resampling w ( m) k = M w m= 1 *( m) k w *( m) k Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 19 Particle filtering operations Represents the required pdf by a set of samples with associated weights. Computs the estimate based in these samples and weights. Posterior pdf Sample space x ( m) k ~ p( xk xk 1 ) Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 20

11 Pros: Arbitrary pdf Most probable state-space Non-Gaussian noise More than one model Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 21 Cons: Computational complexity How to determine the number of particles Probable problems: density extraction, sampling variance Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 22

12 Rao-Blackwellized P: Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 23 Rao-Blackwellized P Rao-Blackwellization: Some components of the model can have a liner dynamic and can be estimate by a traditional Kalman ilter. Kalman ilter is combine with P to reduce the number of particles to be used for a satisfying performance. Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 24

13 Domingos P Complex & Simple Predicates Abstractions: (set of pairs of objects which are related in some way) P smoothing on an Abstraction lattice Cristina Manfredotti D.I.S.Co. Università di Milano - Bicocca 25

Bayesian Networks. Mausam (Slides by UW-AI faculty)

Bayesian Networks. Mausam (Slides by UW-AI faculty) Bayesian Networks Mausam (Slides by UW-AI faculty) Bayes Nets In general, joint distribution P over set of variables (X 1 x... x X n ) requires exponential space for representation & inference BNs provide

More information

An Introduction to the Use of Bayesian Network to Analyze Gene Expression Data

An Introduction to the Use of Bayesian Network to Analyze Gene Expression Data n Introduction to the Use of ayesian Network to nalyze Gene Expression Data Cristina Manfredotti Dipartimento di Informatica, Sistemistica e Comunicazione (D.I.S.Co. Università degli Studi Milano-icocca

More information

Bayesian Networks Chapter 14. Mausam (Slides by UW-AI faculty & David Page)

Bayesian Networks Chapter 14. Mausam (Slides by UW-AI faculty & David Page) Bayesian Networks Chapter 14 Mausam (Slides by UW-AI faculty & David Page) Bayes Nets In general, joint distribution P over set of variables (X 1 x... x X n ) requires exponential space for representation

More information

13.3 Inference Using Full Joint Distribution

13.3 Inference Using Full Joint Distribution 191 The probability distribution on a single variable must sum to 1 It is also true that any joint probability distribution on any set of variables must sum to 1 Recall that any proposition a is equivalent

More information

Artificial Intelligence. Conditional probability. Inference by enumeration. Independence. Lesson 11 (From Russell & Norvig)

Artificial Intelligence. Conditional probability. Inference by enumeration. Independence. Lesson 11 (From Russell & Norvig) Artificial Intelligence Conditional probability Conditional or posterior probabilities e.g., cavity toothache) = 0.8 i.e., given that toothache is all I know tation for conditional distributions: Cavity

More information

Probability, Conditional Independence

Probability, Conditional Independence Probability, Conditional Independence June 19, 2012 Probability, Conditional Independence Probability Sample space Ω of events Each event ω Ω has an associated measure Probability of the event P(ω) Axioms

More information

Logic, Probability and Learning

Logic, Probability and Learning Logic, Probability and Learning Luc De Raedt luc.deraedt@cs.kuleuven.be Overview Logic Learning Probabilistic Learning Probabilistic Logic Learning Closely following : Russell and Norvig, AI: a modern

More information

Bayesian Networks. Read R&N Ch. 14.1-14.2. Next lecture: Read R&N 18.1-18.4

Bayesian Networks. Read R&N Ch. 14.1-14.2. Next lecture: Read R&N 18.1-18.4 Bayesian Networks Read R&N Ch. 14.1-14.2 Next lecture: Read R&N 18.1-18.4 You will be expected to know Basic concepts and vocabulary of Bayesian networks. Nodes represent random variables. Directed arcs

More information

Artificial Intelligence Mar 27, Bayesian Networks 1 P (T D)P (D) + P (T D)P ( D) =

Artificial Intelligence Mar 27, Bayesian Networks 1 P (T D)P (D) + P (T D)P ( D) = Artificial Intelligence 15-381 Mar 27, 2007 Bayesian Networks 1 Recap of last lecture Probability: precise representation of uncertainty Probability theory: optimal updating of knowledge based on new information

More information

CS 188: Artificial Intelligence. Probability recap

CS 188: Artificial Intelligence. Probability recap CS 188: Artificial Intelligence Bayes Nets Representation and Independence Pieter Abbeel UC Berkeley Many slides over this course adapted from Dan Klein, Stuart Russell, Andrew Moore Conditional probability

More information

Lecture 2: Introduction to belief (Bayesian) networks

Lecture 2: Introduction to belief (Bayesian) networks Lecture 2: Introduction to belief (Bayesian) networks Conditional independence What is a belief network? Independence maps (I-maps) January 7, 2008 1 COMP-526 Lecture 2 Recall from last time: Conditional

More information

Tracking Algorithms. Lecture17: Stochastic Tracking. Joint Probability and Graphical Model. Probabilistic Tracking

Tracking Algorithms. Lecture17: Stochastic Tracking. Joint Probability and Graphical Model. Probabilistic Tracking Tracking Algorithms (2015S) Lecture17: Stochastic Tracking Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Deterministic methods Given input video and current state, tracking result is always same. Local

More information

Life of A Knowledge Base (KB)

Life of A Knowledge Base (KB) Life of A Knowledge Base (KB) A knowledge base system is a special kind of database management system to for knowledge base management. KB extraction: knowledge extraction using statistical models in NLP/ML

More information

Variable Elimination 1

Variable Elimination 1 Variable Elimination 1 Inference Exact inference Enumeration Variable elimination Junction trees and belief propagation Approximate inference Loopy belief propagation Sampling methods: likelihood weighting,

More information

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber 2011 1

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber 2011 1 Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2011 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields

More information

Master s thesis tutorial: part III

Master s thesis tutorial: part III for the Autonomous Compliant Research group Tinne De Laet, Wilm Decré, Diederik Verscheure Katholieke Universiteit Leuven, Department of Mechanical Engineering, PMA Division 30 oktober 2006 Outline General

More information

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 Motivation Recall: Discrete filter Discretize

More information

CURRICULUM VITAE. Ilaria.giordani@disco.unimib.it. Phd in computer science

CURRICULUM VITAE. Ilaria.giordani@disco.unimib.it. Phd in computer science CURRICULUM VITAE PERSONAL INFORMATION Name Address Giordani Ilaria Via Volturno 13 22063 Cantù (Co) Mobile phone number (+ 39) 333.8725026 Phone number (+ 39) 031.712957 E-mail Ilaria.giordani@disco.unimib.it

More information

Informatics 2D Reasoning and Agents Semester 2, 2015-16

Informatics 2D Reasoning and Agents Semester 2, 2015-16 Informatics 2D Reasoning and Agents Semester 2, 2015-16 Alex Lascarides alex@inf.ed.ac.uk Lecture 29 Decision Making Under Uncertainty 24th March 2016 Informatics UoE Informatics 2D 1 Where are we? Last

More information

Querying Joint Probability Distributions

Querying Joint Probability Distributions Querying Joint Probability Distributions Sargur Srihari srihari@cedar.buffalo.edu 1 Queries of Interest Probabilistic Graphical Models (BNs and MNs) represent joint probability distributions over multiple

More information

Chapter 28. Bayesian Networks

Chapter 28. Bayesian Networks Chapter 28. Bayesian Networks The Quest for Artificial Intelligence, Nilsson, N. J., 2009. Lecture Notes on Artificial Intelligence, Spring 2012 Summarized by Kim, Byoung-Hee and Lim, Byoung-Kwon Biointelligence

More information

EE 570: Location and Navigation

EE 570: Location and Navigation EE 570: Location and Navigation On-Line Bayesian Tracking Aly El-Osery 1 Stephen Bruder 2 1 Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA 2 Electrical and Computer Engineering

More information

Monte Carlo-based statistical methods (MASM11/FMS091)

Monte Carlo-based statistical methods (MASM11/FMS091) Monte Carlo-based statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 3, 2012 Changes in HA1 Problem

More information

An Introduction to Using WinBUGS for Cost-Effectiveness Analyses in Health Economics

An Introduction to Using WinBUGS for Cost-Effectiveness Analyses in Health Economics Slide 1 An Introduction to Using WinBUGS for Cost-Effectiveness Analyses in Health Economics Dr. Christian Asseburg Centre for Health Economics Part 1 Slide 2 Talk overview Foundations of Bayesian statistics

More information

Big Data, Machine Learning, Causal Models

Big Data, Machine Learning, Causal Models Big Data, Machine Learning, Causal Models Sargur N. Srihari University at Buffalo, The State University of New York USA Int. Conf. on Signal and Image Processing, Bangalore January 2014 1 Plan of Discussion

More information

Model-based Synthesis. Tony O Hagan

Model-based Synthesis. Tony O Hagan Model-based Synthesis Tony O Hagan Stochastic models Synthesising evidence through a statistical model 2 Evidence Synthesis (Session 3), Helsinki, 28/10/11 Graphical modelling The kinds of models that

More information

Mapping and Localization with RFID Technology

Mapping and Localization with RFID Technology Mapping and Localization with RFID Technology Matthai Philipose, Kenneth P Fishkin, Dieter Fox, Dirk Hahnel, Wolfram Burgard Presenter: Aniket Shah Outline Introduction Related Work Probabilistic Sensor

More information

Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)

Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February

More information

Discovering Structure in Continuous Variables Using Bayesian Networks

Discovering Structure in Continuous Variables Using Bayesian Networks In: "Advances in Neural Information Processing Systems 8," MIT Press, Cambridge MA, 1996. Discovering Structure in Continuous Variables Using Bayesian Networks Reimar Hofmann and Volker Tresp Siemens AG,

More information

6 CONDITIONAL PROBABILITY

6 CONDITIONAL PROBABILITY 1 6 CONDITIONAL PROBABILITY Example: In a computer installation, 200 programs are written each week, 120 in C ++ and 80 in Java. 60% of the programs written in C ++ compile on the first run and 80% of

More information

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking 174 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 2, FEBRUARY 2002 A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking M. Sanjeev Arulampalam, Simon Maskell, Neil

More information

Particle Filtering. Emin Orhan August 11, 2012

Particle Filtering. Emin Orhan August 11, 2012 Particle Filtering Emin Orhan eorhan@bcs.rochester.edu August 11, 1 Introduction: Particle filtering is a general Monte Carlo (sampling) method for performing inference in state-space models where the

More information

The Basics of Graphical Models

The Basics of Graphical Models The Basics of Graphical Models David M. Blei Columbia University October 3, 2015 Introduction These notes follow Chapter 2 of An Introduction to Probabilistic Graphical Models by Michael Jordan. Many figures

More information

Monte Carlo-based statistical methods (MASM11/FMS091)

Monte Carlo-based statistical methods (MASM11/FMS091) Monte Carlo-based statistical methods (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 7, 2014 M. Wiktorsson

More information

Compression algorithm for Bayesian network modeling of binary systems

Compression algorithm for Bayesian network modeling of binary systems Compression algorithm for Bayesian network modeling of binary systems I. Tien & A. Der Kiureghian University of California, Berkeley ABSTRACT: A Bayesian network (BN) is a useful tool for analyzing the

More information

Spatial Statistics Chapter 3 Basics of areal data and areal data modeling

Spatial Statistics Chapter 3 Basics of areal data and areal data modeling Spatial Statistics Chapter 3 Basics of areal data and areal data modeling Recall areal data also known as lattice data are data Y (s), s D where D is a discrete index set. This usually corresponds to data

More information

Real-time Visual Tracker by Stream Processing

Real-time Visual Tracker by Stream Processing Real-time Visual Tracker by Stream Processing Simultaneous and Fast 3D Tracking of Multiple Faces in Video Sequences by Using a Particle Filter Oscar Mateo Lozano & Kuzahiro Otsuka presented by Piotr Rudol

More information

Bayesian Networks of Customer Satisfaction Survey Data

Bayesian Networks of Customer Satisfaction Survey Data Bayesian Networks of Customer Satisfaction Survey Data Silvia Salini * University of Milan, Italy Ron S. Kenett KPA Ltd., Raanana, Israel and University of Torino, Torino, Italy Abstract: A Bayesian Network

More information

Tracking in flussi video 3D. Ing. Samuele Salti

Tracking in flussi video 3D. Ing. Samuele Salti Seminari XXIII ciclo Tracking in flussi video 3D Ing. Tutors: Prof. Tullio Salmon Cinotti Prof. Luigi Di Stefano The Tracking problem Detection Object model, Track initiation, Track termination, Tracking

More information

CS 771 Artificial Intelligence. Reasoning under uncertainty

CS 771 Artificial Intelligence. Reasoning under uncertainty CS 771 Artificial Intelligence Reasoning under uncertainty Today Representing uncertainty is useful in knowledge bases Probability provides a coherent framework for uncertainty Review basic concepts in

More information

The intuitions in examples from last time give us D-separation and inference in belief networks

The intuitions in examples from last time give us D-separation and inference in belief networks CSC384: Lecture 11 Variable Elimination Last time The intuitions in examples from last time give us D-separation and inference in belief networks a simple inference algorithm for networks without Today

More information

Performance evaluation of multi-camera visual tracking

Performance evaluation of multi-camera visual tracking Performance evaluation of multi-camera visual tracking Lucio Marcenaro, Pietro Morerio, Mauricio Soto, Andrea Zunino, Carlo S. Regazzoni DITEN, University of Genova Via Opera Pia 11A 16145 Genoa - Italy

More information

Decision Trees and Networks

Decision Trees and Networks Lecture 21: Uncertainty 6 Today s Lecture Victor R. Lesser CMPSCI 683 Fall 2010 Decision Trees and Networks Decision Trees A decision tree is an explicit representation of all the possible scenarios from

More information

Intelligent Systems: Reasoning and Recognition. Uncertainty and Plausible Reasoning

Intelligent Systems: Reasoning and Recognition. Uncertainty and Plausible Reasoning Intelligent Systems: Reasoning and Recognition James L. Crowley ENSIMAG 2 / MoSIG M1 Second Semester 2015/2016 Lesson 12 25 march 2015 Uncertainty and Plausible Reasoning MYCIN (continued)...2 Backward

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct

More information

Vulnerabilità dei protocolli SSL/TLS

Vulnerabilità dei protocolli SSL/TLS Università degli Studi di Milano Facoltà di Scienze Matematiche, Fisiche e Naturali Dipartimento di Informatica e Comunicazione Vulnerabilità dei protocolli SSL/TLS Andrea Visconti Overview Introduction

More information

The Certainty-Factor Model

The Certainty-Factor Model The Certainty-Factor Model David Heckerman Departments of Computer Science and Pathology University of Southern California HMR 204, 2025 Zonal Ave Los Angeles, CA 90033 dheck@sumex-aim.stanford.edu 1 Introduction

More information

Part III: Machine Learning. CS 188: Artificial Intelligence. Machine Learning This Set of Slides. Parameter Estimation. Estimation: Smoothing

Part III: Machine Learning. CS 188: Artificial Intelligence. Machine Learning This Set of Slides. Parameter Estimation. Estimation: Smoothing CS 188: Artificial Intelligence Lecture 20: Dynamic Bayes Nets, Naïve Bayes Pieter Abbeel UC Berkeley Slides adapted from Dan Klein. Part III: Machine Learning Up until now: how to reason in a model and

More information

Algorithms for detecting variations from Next-Generation Sequencing Data

Algorithms for detecting variations from Next-Generation Sequencing Data Dottorato di Ricerca in Informatica - Ciclo XXV Dipartimento di Informatica, Sistemistica e Comunicazione Facoltà di Scienze Matematiche, Fisiche e Naturali Università degli Studi di Milano - Bicocca Algorithms

More information

Probabilistic Networks An Introduction to Bayesian Networks and Influence Diagrams

Probabilistic Networks An Introduction to Bayesian Networks and Influence Diagrams Probabilistic Networks An Introduction to Bayesian Networks and Influence Diagrams Uffe B. Kjærulff Department of Computer Science Aalborg University Anders L. Madsen HUGIN Expert A/S 10 May 2005 2 Contents

More information

References. Importance Sampling. Jessi Cisewski (CMU) Carnegie Mellon University. June 2014

References. Importance Sampling. Jessi Cisewski (CMU) Carnegie Mellon University. June 2014 Jessi Cisewski Carnegie Mellon University June 2014 Outline 1 Recall: Monte Carlo integration 2 3 Examples of (a) Monte Carlo, Monaco (b) Monte Carlo Casino Some content and examples from Wasserman (2004)

More information

Part 2: Kalman Filtering COS 323

Part 2: Kalman Filtering COS 323 Part 2: Kalman Filtering COS 323 On-Line Estimation Have looked at off-line model estimation: all data is available For many applications, want best estimate immediately when each new datapoint arrives

More information

DDS-Enabled Cloud Management Support for Fast Task Offloading

DDS-Enabled Cloud Management Support for Fast Task Offloading DDS-Enabled Cloud Management Support for Fast Task Offloading IEEE ISCC 2012, Cappadocia Turkey Antonio Corradi 1 Luca Foschini 1 Javier Povedano-Molina 2 Juan M. Lopez-Soler 2 1 Dipartimento di Elettronica,

More information

Micro to Macro Equation-Free Bifurcation Analysis of Neuronal Random Graphs: Symmetry Breaking of Majority Rule Dynamics

Micro to Macro Equation-Free Bifurcation Analysis of Neuronal Random Graphs: Symmetry Breaking of Majority Rule Dynamics Micro to Macro Equation-Free Bifurcation Analysis of Neuronal Random Graphs: Symmetry Breang of Majority Rule Dynamics Konstantinos Spiliotis 1, Lucia Russo, Constantinos I. Siettos 1 1 School of Applied

More information

UNIVERSITY OF LYON DOCTORAL SCHOOL OF COMPUTER SCIENCES AND MATHEMATICS P H D T H E S I S. Specialty : Computer Science. Author

UNIVERSITY OF LYON DOCTORAL SCHOOL OF COMPUTER SCIENCES AND MATHEMATICS P H D T H E S I S. Specialty : Computer Science. Author UNIVERSITY OF LYON DOCTORAL SCHOOL OF COMPUTER SCIENCES AND MATHEMATICS P H D T H E S I S Specialty : Computer Science Author Sérgio Rodrigues de Morais on November 16, 29 Bayesian Network Structure Learning

More information

Cell Phone based Activity Detection using Markov Logic Network

Cell Phone based Activity Detection using Markov Logic Network Cell Phone based Activity Detection using Markov Logic Network Somdeb Sarkhel sxs104721@utdallas.edu 1 Introduction Mobile devices are becoming increasingly sophisticated and the latest generation of smart

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Raquel Urtasun and Tamir Hazan TTI Chicago April 4, 2011 Raquel Urtasun and Tamir Hazan (TTI-C) Graphical Models April 4, 2011 1 / 22 Bayesian Networks and independences

More information

Chapter 14 Managing Operational Risks with Bayesian Networks

Chapter 14 Managing Operational Risks with Bayesian Networks Chapter 14 Managing Operational Risks with Bayesian Networks Carol Alexander This chapter introduces Bayesian belief and decision networks as quantitative management tools for operational risks. Bayesian

More information

PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units)

PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units) PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units) Instructor: Behnam Jafarpour, Mork Family Department of Chemical Engineering and Material Science Petroleum Engineering, HED 313,

More information

The Visualization Pipeline

The Visualization Pipeline The Visualization Pipeline Conceptual perspective Implementation considerations Algorithms used in the visualization Structure of the visualization applications Contents The focus is on presenting the

More information

Feedforward Neural Networks and Backpropagation

Feedforward Neural Networks and Backpropagation Feedforward Neural Networks and Backpropagation Feedforward neural networks Architectural issues, computational capabilities Sigmoidal and radial basis functions Gradient-based learning and Backprogation

More information

Question 2 Naïve Bayes (16 points)

Question 2 Naïve Bayes (16 points) Question 2 Naïve Bayes (16 points) About 2/3 of your email is spam so you downloaded an open source spam filter based on word occurrences that uses the Naive Bayes classifier. Assume you collected the

More information

Knowledge Discovery and Data Mining. Bootstrap review. Bagging Important Concepts. Notes. Lecture 19 - Bagging. Tom Kelsey. Notes

Knowledge Discovery and Data Mining. Bootstrap review. Bagging Important Concepts. Notes. Lecture 19 - Bagging. Tom Kelsey. Notes Knowledge Discovery and Data Mining Lecture 19 - Bagging Tom Kelsey School of Computer Science University of St Andrews http://tom.host.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-19-B &

More information

Agenda. Interface Agents. Interface Agents

Agenda. Interface Agents. Interface Agents Agenda Marcelo G. Armentano Problem Overview Interface Agents Probabilistic approach Monitoring user actions Model of the application Model of user intentions Example Summary ISISTAN Research Institute

More information

QDquaderni. UP-DRES User Profiling for a Dynamic REcommendation System E. Messina, D. Toscani, F. Archetti. university of milano bicocca

QDquaderni. UP-DRES User Profiling for a Dynamic REcommendation System E. Messina, D. Toscani, F. Archetti. university of milano bicocca A01 084/01 university of milano bicocca QDquaderni department of informatics, systems and communication UP-DRES User Profiling for a Dynamic REcommendation System E. Messina, D. Toscani, F. Archetti research

More information

MAP ESTIMATION WITH LASER SCANS BASED ON INCREMENTAL TREE NETWORK OPTIMIZER

MAP ESTIMATION WITH LASER SCANS BASED ON INCREMENTAL TREE NETWORK OPTIMIZER MAP ESTIMATION WITH LASER SCANS BASED ON INCREMENTAL TREE NETWORK OPTIMIZER Dario Lodi Rizzini 1, Stefano Caselli 1 1 Università degli Studi di Parma Dipartimento di Ingegneria dell Informazione viale

More information

5 Directed acyclic graphs

5 Directed acyclic graphs 5 Directed acyclic graphs (5.1) Introduction In many statistical studies we have prior knowledge about a temporal or causal ordering of the variables. In this chapter we will use directed graphs to incorporate

More information

Automated Classification of Book Blurbs According to the Emotional Tags of the Social Network Zazie

Automated Classification of Book Blurbs According to the Emotional Tags of the Social Network Zazie Automated Classification of Book Blurbs According to the Emotional Tags of the Social Network Zazie V. FRANZONI, V. POGGIONI AND F. ZOLLO DIPARTIMENTO DI MATEMATICA E INFORMATICA UNIVERSITÀ DEGLI STUDI

More information

ROBUST REAL-TIME ON-BOARD VEHICLE TRACKING SYSTEM USING PARTICLES FILTER. Ecole des Mines de Paris, Paris, France

ROBUST REAL-TIME ON-BOARD VEHICLE TRACKING SYSTEM USING PARTICLES FILTER. Ecole des Mines de Paris, Paris, France ROBUST REAL-TIME ON-BOARD VEHICLE TRACKING SYSTEM USING PARTICLES FILTER Bruno Steux Yotam Abramson Ecole des Mines de Paris, Paris, France Abstract: We describe a system for detection and tracking of

More information

Building Large-Scale Bayesian Networks

Building Large-Scale Bayesian Networks Building Large-Scale Bayesian Networks Martin Neil 1, Norman Fenton 1 and Lars Nielsen 2 1 Risk Assessment and Decision Analysis Research (RADAR) group, Computer Science Department, Queen Mary and Westfield

More information

Lezione 10 Introduzione a OPNET

Lezione 10 Introduzione a OPNET Corso di A.A. 2007-2008 Lezione 10 Introduzione a OPNET Ing. Marco GALEAZZI 1 What is OPNET? Con il nome OPNET viene indicata una suite di prodotti software sviluppati e commercializzati da OPNET Technologies,

More information

Generating Random Samples from the Generalized Pareto Mixture Model

Generating Random Samples from the Generalized Pareto Mixture Model Generating Random Samples from the Generalized Pareto Mixture Model MUSTAFA ÇAVUŞ AHMET SEZER BERNA YAZICI Department of Statistics Anadolu University Eskişehir 26470 TURKEY mustafacavus@anadolu.edu.tr

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence ICS461 Fall 2010 1 Lecture #12B More Representations Outline Logics Rules Frames Nancy E. Reed nreed@hawaii.edu 2 Representation Agents deal with knowledge (data) Facts (believe

More information

A Measurement Association Model Based on Particle Filters for Automatic Tracking of Occluded Soccer Players

A Measurement Association Model Based on Particle Filters for Automatic Tracking of Occluded Soccer Players A Measurement Association Model Based on Particle Filters for Automatic Tracking of Occluded Soccer Players A. Papo 1, A. Averbuch 2, B.Z. Bobrovsky 1 1 Department of Electrical Engineering - Systems School

More information

Bayesian networks - Time-series models - Apache Spark & Scala

Bayesian networks - Time-series models - Apache Spark & Scala Bayesian networks - Time-series models - Apache Spark & Scala Dr John Sandiford, CTO Bayes Server Data Science London Meetup - November 2014 1 Contents Introduction Bayesian networks Latent variables Anomaly

More information

Course: Model, Learning, and Inference: Lecture 5

Course: Model, Learning, and Inference: Lecture 5 Course: Model, Learning, and Inference: Lecture 5 Alan Yuille Department of Statistics, UCLA Los Angeles, CA 90095 yuille@stat.ucla.edu Abstract Probability distributions on structured representation.

More information

A crash course in probability and Naïve Bayes classification

A crash course in probability and Naïve Bayes classification Probability theory A crash course in probability and Naïve Bayes classification Chapter 9 Random variable: a variable whose possible values are numerical outcomes of a random phenomenon. s: A person s

More information

DETERMINING THE CONDITIONAL PROBABILITIES IN BAYESIAN NETWORKS

DETERMINING THE CONDITIONAL PROBABILITIES IN BAYESIAN NETWORKS Hacettepe Journal of Mathematics and Statistics Volume 33 (2004), 69 76 DETERMINING THE CONDITIONAL PROBABILITIES IN BAYESIAN NETWORKS Hülya Olmuş and S. Oral Erbaş Received 22 : 07 : 2003 : Accepted 04

More information

A discussion of Statistical Mechanics of Complex Networks P. Part I

A discussion of Statistical Mechanics of Complex Networks P. Part I A discussion of Statistical Mechanics of Complex Networks Part I Review of Modern Physics, Vol. 74, 2002 Small Word Networks Clustering Coefficient Scale-Free Networks Erdös-Rényi model cover only parts

More information

7. Lecture. Image restoration: Spatial domain

7. Lecture. Image restoration: Spatial domain 7. Lecture Image restoration: Spatial domain 1 Example: Movie restoration ² Very popular - digital remastering of old movies ² e.g. Limelight from Joanneum Research 2 Example: Scan from old film 3 Example:

More information

A Hybrid Anytime Algorithm for the Construction of Causal Models From Sparse Data.

A Hybrid Anytime Algorithm for the Construction of Causal Models From Sparse Data. 142 A Hybrid Anytime Algorithm for the Construction of Causal Models From Sparse Data. Denver Dash t Department of Physics and Astronomy and Decision Systems Laboratory University of Pittsburgh Pittsburgh,

More information

VEHICLE TRACKING USING ACOUSTIC AND VIDEO SENSORS

VEHICLE TRACKING USING ACOUSTIC AND VIDEO SENSORS VEHICLE TRACKING USING ACOUSTIC AND VIDEO SENSORS Aswin C Sankaranayanan, Qinfen Zheng, Rama Chellappa University of Maryland College Park, MD - 277 {aswch, qinfen, rama}@cfar.umd.edu Volkan Cevher, James

More information

Network Tomography Based on to-end Measurements

Network Tomography Based on to-end Measurements Network Tomography Based on end-to to-end Measurements Francesco Lo Presti Dipartimento di Informatica - Università dell Aquila The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN NETWORKING

More information

itesla Project Innovative Tools for Electrical System Security within Large Areas

itesla Project Innovative Tools for Electrical System Security within Large Areas itesla Project Innovative Tools for Electrical System Security within Large Areas Samir ISSAD RTE France samir.issad@rte-france.com PSCC 2014 Panel Session 22/08/2014 Advanced data-driven modeling techniques

More information

Software and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth

Software and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth Smart Process Plants Software and Hardware Solutions for Accurate Data and Profitable Operations Miguel J. Bagajewicz, Ph.D. University of Oklahoma Donald J. Chmielewski Contributor DuyQuang Nguyen Tanth

More information

Gaussian Tail or Long Tail: On Error Characterization of MLC NAND Flash

Gaussian Tail or Long Tail: On Error Characterization of MLC NAND Flash Gaussian Tail or Long Tail: On Error Characterization of MLC NAND Flash Presented by: Shu-Yi Jack Wong Computer Engineering University of Toronto, Ontario, Canada Importance and Positioning A Multi-Level-Cell

More information

Dependency Networks for Collaborative Filtering and Data Visualization

Dependency Networks for Collaborative Filtering and Data Visualization 264 UNCERTAINTY IN ARTIFICIAL INTELLIGENCE PROCEEDINGS 2000 Dependency Networks for Collaborative Filtering and Data Visualization David Heckerman, David Maxwell Chickering, Christopher Meek, Robert Rounthwaite,

More information

/ Informatica. Intelligent Systems. Agents dealing with uncertainty. Example: driving to the airport. Why logic fails

/ Informatica. Intelligent Systems. Agents dealing with uncertainty. Example: driving to the airport. Why logic fails Intelligent Systems Prof. dr. Paul De Bra Technische Universiteit Eindhoven debra@win.tue.nl Agents dealing with uncertainty Uncertainty Probability Syntax and Semantics Inference Independence and Bayes'

More information

Assistant Professor, Dipartimento di Matematica, Università di Genova.

Assistant Professor, Dipartimento di Matematica, Università di Genova. Alberto Sorrentino Dipartimento di Matematica, Università di Genova 16146 Genova H +39 349 8821450 T +39 010 353 6836 B sorrentino@dima.unige.it Position 1/2013 to date Assistant Professor, Dipartimento

More information

Advanced Linear Modeling

Advanced Linear Modeling Ronald Christensen Advanced Linear Modeling Multivariate, Time Series, and Spatial Data; Nonparametric Regression and Response Surface Maximization Second Edition Springer Preface to the Second Edition

More information

Stock Investing Using HUGIN Software

Stock Investing Using HUGIN Software Stock Investing Using HUGIN Software An Easy Way to Use Quantitative Investment Techniques Abstract Quantitative investment methods have gained foothold in the financial world in the last ten years. This

More information

TUTORIAL MOVE 2009.1: 3D MODEL CONSTRUCTION FROM SURFACE GEOLOGICAL DATA

TUTORIAL MOVE 2009.1: 3D MODEL CONSTRUCTION FROM SURFACE GEOLOGICAL DATA UNIVERSITÁ DEGLI STUDI DI MILANO FACOLTÀ DI SCIENZE MATEMATICHE FISICHE E NATURALI DIPARTIMENTO DI SCIENZE DELLA TERRA ARDITO DESIO TUTORIAL MOVE 2009.1: 3D MODEL CONSTRUCTION FROM SURFACE GEOLOGICAL DATA

More information

Measuring the Power of a Test

Measuring the Power of a Test Textbook Reference: Chapter 9.5 Measuring the Power of a Test An economic problem motivates the statement of a null and alternative hypothesis. For a numeric data set, a decision rule can lead to the rejection

More information

SYSM 6304: Risk and Decision Analysis Lecture 5: Methods of Risk Analysis

SYSM 6304: Risk and Decision Analysis Lecture 5: Methods of Risk Analysis SYSM 6304: Risk and Decision Analysis Lecture 5: Methods of Risk Analysis M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu October 17, 2015 Outline

More information

Particle Filters and Their Applications

Particle Filters and Their Applications Particle Filters and Their Applications Kaijen Hsiao Henry de Plinval-Salgues Jason Miller Cognitive Robotics April 11, 2005 1 Why Particle Filters? Tool for tracking the state of a dynamic system modeled

More information

Learning Instance-Specific Predictive Models

Learning Instance-Specific Predictive Models Journal of Machine Learning Research 11 (2010) 3333-3369 Submitted 3/09; Revised 7/10; Published 12/10 Learning Instance-Specific Predictive Models Shyam Visweswaran Gregory F. Cooper Department of Biomedical

More information

Global Optimisation of Neural Network Models Via Sequential Sampling

Global Optimisation of Neural Network Models Via Sequential Sampling Global Optimisation of Neural Network Models Via Sequential Sampling J oao FG de Freitas jfgf@eng.cam.ac.uk [Corresponding author] Mahesan Niranjan niranjan@eng.cam.ac.uk Arnaud Doucet ad2@eng.cam.ac.uk

More information

Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)

Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February

More information

CHAPTER 6 SECURE PACKET TRANSMISSION IN WIRELESS SENSOR NETWORKS USING DYNAMIC ROUTING TECHNIQUES

CHAPTER 6 SECURE PACKET TRANSMISSION IN WIRELESS SENSOR NETWORKS USING DYNAMIC ROUTING TECHNIQUES CHAPTER 6 SECURE PACKET TRANSMISSION IN WIRELESS SENSOR NETWORKS USING DYNAMIC ROUTING TECHNIQUES 6.1 Introduction The process of dispersive routing provides the required distribution of packets rather

More information

MAS108 Probability I

MAS108 Probability I 1 QUEEN MARY UNIVERSITY OF LONDON 2:30 pm, Thursday 3 May, 2007 Duration: 2 hours MAS108 Probability I Do not start reading the question paper until you are instructed to by the invigilators. The paper

More information