# Robert Collins CSE598G. More on Mean-shift. R.Collins, CSE, PSU CSE598G Spring 2006

Save this PDF as:

Size: px
Start display at page:

Download "Robert Collins CSE598G. More on Mean-shift. R.Collins, CSE, PSU CSE598G Spring 2006"

## Transcription

1 More on Mean-shift R.Collins, CSE, PSU Spring 2006

2 Recall: Kernel Density Estimation Given a set of data samples x i ; i=1...n Convolve with a kernel function H to generate a smooth function f(x) Equivalent to superposition of multiple kernels centered at each data point H

3 Recall: Kernel Density Estimation For kernel H with bandwidth h, estimated function value f at location x is superposition of kernels centered at x i some sample kernels:

4 Radially Symmetric Kernels Height at point is function only of distance from center Can be written in terms of a 1D Profile function that is is a function of the radius (we will use squared radius below)

5 Kernel-Shadow Pairs Given a convolution kernel H, what is the corresponding mean-shift kernel K? Perform change of variables r = x i -x 2 Rewrite H(x i -x) => h( x i -x 2 ) => h(r). Then kernel K must satisfy h (r) = - c k (r) Examples Epanichnikov Flat Biweight Epanichnikov Gaussian Gaussian self-replicating!

6 Kernel-Shadow Pairs Given a convolution kernel H, what is the corresponding mean-shift kernel K? Perform change of variables r = x i -x 2 Rewrite H(x i -x) => h( x i -x 2 ) => h(r). Then kernel K must satisfy h (r) = - c k (r) 2D Shadow Examples Kernel 2D Epanichnikov Flat Gaussian Gaussian

7 Mean-Shift and Gradient Ascent We will derive an explicit equation relating the mean-shift procedure using kernel K with gradient ascent on the KDE surface formed by using the shadow kernel H. gradient of KDE rewrite using profile function

8 Mean-Shift and Gradient Ascent Sidebar derivation: change of variables chain rule change variables back

9 Mean-Shift and Gradient Ascent We will derive an explicit equation relating the mean-shift procedure using kernel K with gradient ascent on the KDE surface formed by using the shadow kernel H. gradient of KDE rewrite using profile function change of vars + chain rule definition of kernel shadow pairs h (r) = - c k(r) rewrite as kernel K

10 cont. Mean-Shift and Gradient Ascent call this p(x). It is another KDE, using kernel K instead of H x this does not depend on i, so can come out of the summation this is just 1! this is the relationship we wanted to derive.

11 cont. Mean-Shift and Gradient Ascent weighted center of mass mean shift vector same direction as gradient of KDE H step size is inversely proportional to KDE K mean-shift performs gradient ascent with adaptive step size

12 Generalizing to Weighted Points Let each point sample x i have an associated nonnegative weight w(x i ) Can rederive the equations with w(x i ) factors in them: KDE using shadow kernel H KDE using kernel K mean shift vector is still a gradient ascent process This is important for running on images. Since pixels form a lattice, spatial density of samples is fixed, so need a weight to denote sample density at each point.

13 Mean-Shift Tracking Let pixels form a uniform grid of data points, each with a weight (pixel value) proportional to the likelihood that the pixel is on the object we want to track. Perform standard mean-shift algorithm using this weighted set of points. Δx = Σ i K(x i -x) w(x i ) (x i -x) Σ i K(x i -x) w(x i )

14 Nice Property Running mean-shift with kernel K on weight image w is equivalent to performing gradient ascent in a (virtual) image formed by convolving w with some shadow kernel H. Computational savings: only have to compute convolution values at the relatively small number of points you visit on the path to the mode.

15 Mean-shift on Weight Images Ideally, we want an indicator function that returns 1 for pixels on the object we are tracking, and 0 for all other pixels Instead, we compute likelihood maps where the value at a pixel is proportional to the likelihood that the pixel comes from the object we are tracking. Computation of likelihood can be based on color texture shape (boundary) predicted location Claim: these weight images are all the mean-shift algorithm sees, whether they be explicitly computed (e.g. Bradski) or implicitly computed (e.g. Comaniciu, Ramesh and Meer).

16 Explicit Weight Images histogram backprojection histogram is an empirical estimate of p(color object) = p(c o) Bayes rule says p(o c) = p(c o) p(o) / p(c) Simplistic approx: assume (p(o)/p(c)) is constant. Then p(o c) = p(c o). Use histogram h as a lookup table to set pixel values in the weight image. (if pixel maps to bucket i in histogram h, set weight for that pixel to h(i)

17 Sidebar: Swain and Ballard, 1991 Using color histograms for recognition.

18 Swain and Ballard does this sound familiar?

19 Swain and Ballard Note: relationship between recognition and tracking. This will come up again later.

20 Sidebar: Jones and Rehg, 2002 Statistical Color Models with Application to Skin Detection, M. J. Jones and J. M. Rehg, Int. J. of Computer Vision, 46(1):81-96, Jan 2002 General Idea: Learn skin color distribution from examples Learn distributions of skin and nonskin color Nonparametric distributions: color histograms Bayesian classification of skin pixels

21 Learning from Examples First, have your grad student hand label thousands of images from the web P(rgb skin) = number of times rgb seen for a skin pixel total number of skin pixels seen P(rgb not skin) = number of times rgb seen for a non-skin pixel total number of non-skin pixels seen These statistics stored in two 32x32x32 RGB histograms Skin histogram Non-Skin histogram R R G B G B

22 Learned Distributions Skin color Non-Skin color

23 Likelihood Ratio Label a pixel skin if P(rgb skin) P(rgb not skin) > Θ Θ = (cost of false positive) P( seeing not skin) (cost of false negative) P( seeing skin) 0 <= Θ <= 1

24 Sample Pixel Classifications Θ =.4

25 Sample Application: HCI Haiying Guan, Matthew Turk, UCSB relevance to blob tracking is clear

26 Implicit Weight Images Sometimes the weight image is not explicitly created. An example is Comaniciu, Ramesh and Meer. Here, the weight image is embedded in the procedure (taking derivatives of bhattacharyya coeff with respect to image location of the window of samples). Interesting point: their weight image changes between iterations of mean-shift, as compared to iterating to convergence on an explicit weight image!

27 Comaniciu et.al. Color Histogram Representation: Distance between histograms measured by: where note: this is a function of window of location y Bhattacharyya coefficient

28 Comaniciu et.al. the histograms are computed via Parzen estimation: where k is some radially symmetric smoothing kernel (profile) This is Important! interpolates histograms in off-lattice locations makes histogram p u differentiable wrt to y

29 Comaniciu et.al. via Taylor series expansion about current window location y 0 : this does not depend on y so just need to maximize this. Note: it is a KDE!!!! where find mode of second term by mean-shift iterations:

30 At each iteration: Comaniciu et.al. which is just standard mean-shift on (implicit) weight image w i Let s look at the weight terms more closely. For each pixel x i : If pixel x i s value maps to histogram bucket B, then w i = sqrt(q B / p B (y 0 )) This term is only 1 once in the summation

31 Comaniciu et.al. So if model histogram is q 1, q 2,..., q m and current data histogram is p 1, p 2,..., p m form weights q 1 / p 1, q 2 / p 2,..., q m / p m and then do histogram backprojection of these values into the image to get the weight image w i note to self: Swain and Ballard also note, p 1, p 2,..., p m changes at each iteration, and therefore so does the weight image w i

32 Qualitative Intuition Assume some object that is 60% red and 40%green q1 =.6, q2 =.4, qi = 0 for all other i If we just did histogram backprojection of these likelihood values (ala Bradski), we would get a weight image

33 Qualitative Intuition Mean shift does a weighted center of mass computation at each interation Mean shift window will be biased towards the region of red pixels, since they have higher weight

34 Qualitative Intuition Now use Comaniciu et.al. s weights Let s say the data histogram is perfectly located q1 =.6, q2 =.4, qi = 0 for all other i p1 =.6, p2 =.4, pi = 0 for all other i w1 = sqrt(.6/.6), w2 = sqrt(.4/.4), wi = 0 for all other i Resulting weight image: say something about 0 values This is the indicator function image we always hope for!

35 Qualitative Intuition Say we have too little percentage of red in data hist q1 =.6, q2 =.4, qi = 0 for all other i p1 =.5, p2 =.5, pi = 0 for all other i w1 = sqrt(.6/.5), w2 = sqrt(.4/.5), wi = 0 for all other i >1 <1 So red pixels will be favored in center of mass computation, hopefully causing more of them to be included at the next iteration.

36 Qualitative Intuition Say we have very little percentage of red in data hist q1 =.6, q2 =.4, qi = 0 for all other i p1 =.2, p2 =.8, pi = 0 for all other i w1 = sqrt(.6/.2), w2 = sqrt(.4/.8), wi = 0 for all other i >>1 <<1 So red pixels will be even more highly weighted relative to green pixels.

37 Qualitative Intuition Say we have too much percentage of red in data hist q1 =.6, q2 =.4, qi = 0 for all other i p1 =.7, p2 =.3, pi = 0 for all other i w1 = sqrt(.6/.7), w2 = sqrt(.4/.3), wi = 0 for all other i <1 >1 So green pixels will now be favored.

38 Other Features We ve only talked about color, but of course we could use histograms of other features like edge orientations (or any filter-bank response) However, one point I ve been trying to make today is that we don t need histograms at all. We just need a way to label pixels with the likelihood that they belong to the object (rather than the background). That is, we just need to be able to specify a weight image, either explicitly or implicitly.

39 Discuss using mean-shift to find modes in correlation surfaces Explicit is easy. Implicit??

40 Brief overview of our two bleeding edge topics Choose discussion leaders.

### Lecture 3: Linear methods for classification

Lecture 3: Linear methods for classification Rafael A. Irizarry and Hector Corrada Bravo February, 2010 Today we describe four specific algorithms useful for classification problems: linear regression,

### Algorithm (DCABES 2009)

People Tracking via a Modified CAMSHIFT Algorithm (DCABES 2009) Fahad Fazal Elahi Guraya, Pierre-Yves Bayle and Faouzi Alaya Cheikh Department of Computer Science and Media Technology, Gjovik University

### Logistic Regression. Vibhav Gogate The University of Texas at Dallas. Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld.

Logistic Regression Vibhav Gogate The University of Texas at Dallas Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld. Generative vs. Discriminative Classifiers Want to Learn: h:x Y X features

### An Introduction to Machine Learning

An Introduction to Machine Learning L5: Novelty Detection and Regression Alexander J. Smola Statistical Machine Learning Program Canberra, ACT 0200 Australia Alex.Smola@nicta.com.au Tata Institute, Pune,

### Christfried Webers. Canberra February June 2015

c Statistical Group and College of Engineering and Computer Science Canberra February June (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 829 c Part VIII Linear Classification 2 Logistic

### Example: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.

Statistical Learning: Chapter 4 Classification 4.1 Introduction Supervised learning with a categorical (Qualitative) response Notation: - Feature vector X, - qualitative response Y, taking values in C

### Linear Classification. Volker Tresp Summer 2015

Linear Classification Volker Tresp Summer 2015 1 Classification Classification is the central task of pattern recognition Sensors supply information about an object: to which class do the object belong

### Segmentation & Clustering

EECS 442 Computer vision Segmentation & Clustering Segmentation in human vision K-mean clustering Mean-shift Graph-cut Reading: Chapters 14 [FP] Some slides of this lectures are courtesy of prof F. Li,

### Kernel-Based Hand Tracking

Australian Journal of Basic and Applied Sciences, 3(4): 4017-4025, 2009 ISSN 1991-8178 2009, INSInet Publication Kernel-Based Hand Tracking 1 2 Aras Dargazany, Ali Solimani 1 Department of ECE, Shahrood

### EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines

EECS 556 Image Processing W 09 Interpolation Interpolation techniques B splines What is image processing? Image processing is the application of 2D signal processing methods to images Image representation

### Mean-Shift Tracking with Random Sampling

1 Mean-Shift Tracking with Random Sampling Alex Po Leung, Shaogang Gong Department of Computer Science Queen Mary, University of London, London, E1 4NS Abstract In this work, boosting the efficiency of

### Colour Image Segmentation Technique for Screen Printing

60 R.U. Hewage and D.U.J. Sonnadara Department of Physics, University of Colombo, Sri Lanka ABSTRACT Screen-printing is an industry with a large number of applications ranging from printing mobile phone

### Classifiers & Classification

Classifiers & Classification Forsyth & Ponce Computer Vision A Modern Approach chapter 22 Pattern Classification Duda, Hart and Stork School of Computer Science & Statistics Trinity College Dublin Dublin

### Statistical Machine Learning

Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes

### Image Segmentation and Registration

Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation

### Introduction to Computer Vision. Week 11, Fall 2010 Instructor: Prof. Ko Nishino

Introduction to Computer Vision Week 11, Fall 2010 Instructor: Prof. Ko Nishino The Projective Plane Why do we need homogeneous coordinates? represent points at infinity, homographies, perspective projection,

### Problem definition: optical flow

Motion Estimation http://www.sandlotscience.com/distortions/breathing_objects.htm http://www.sandlotscience.com/ambiguous/barberpole.htm Why estimate motion? Lots of uses Track object behavior Correct

### Image Gradients. Given a discrete image Á Òµ, consider the smoothed continuous image Üµ defined by

Image Gradients Given a discrete image Á Òµ, consider the smoothed continuous image Üµ defined by Üµ Ü ¾ Ö µ Á Òµ Ü ¾ Ö µá µ (1) where Ü ¾ Ö Ô µ Ü ¾ Ý ¾. ½ ¾ ¾ Ö ¾ Ü ¾ ¾ Ö. Here Ü is the 2-norm for the

### STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct

### C4 Computer Vision. 4 Lectures Michaelmas Term Tutorial Sheet Prof A. Zisserman. fundamental matrix, recovering ego-motion, applications.

C4 Computer Vision 4 Lectures Michaelmas Term 2004 1 Tutorial Sheet Prof A. Zisserman Overview Lecture 1: Stereo Reconstruction I: epipolar geometry, fundamental matrix. Lecture 2: Stereo Reconstruction

### Linear Threshold Units

Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear

### Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression

Logistic Regression Department of Statistics The Pennsylvania State University Email: jiali@stat.psu.edu Logistic Regression Preserve linear classification boundaries. By the Bayes rule: Ĝ(x) = arg max

### Metrics on SO(3) and Inverse Kinematics

Mathematical Foundations of Computer Graphics and Vision Metrics on SO(3) and Inverse Kinematics Luca Ballan Institute of Visual Computing Optimization on Manifolds Descent approach d is a ascent direction

### A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow

, pp.233-237 http://dx.doi.org/10.14257/astl.2014.51.53 A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow Giwoo Kim 1, Hye-Youn Lim 1 and Dae-Seong Kang 1, 1 Department of electronices

### Assessment. Presenter: Yupu Zhang, Guoliang Jin, Tuo Wang Computer Vision 2008 Fall

Automatic Photo Quality Assessment Presenter: Yupu Zhang, Guoliang Jin, Tuo Wang Computer Vision 2008 Fall Estimating i the photorealism of images: Distinguishing i i paintings from photographs h Florin

### Probabilistic Latent Semantic Analysis (plsa)

Probabilistic Latent Semantic Analysis (plsa) SS 2008 Bayesian Networks Multimedia Computing, Universität Augsburg Rainer.Lienhart@informatik.uni-augsburg.de www.multimedia-computing.{de,org} References

### Introduction to Kernel Smoothing

Introduction to Kernel Smoothing Density 0.000 0.002 0.004 0.006 700 800 900 1000 1100 1200 1300 Wilcoxon score M. P. Wand & M. C. Jones Kernel Smoothing Monographs on Statistics and Applied Probability

### Basics of Statistical Machine Learning

CS761 Spring 2013 Advanced Machine Learning Basics of Statistical Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu Modern machine learning is rooted in statistics. You will find many familiar

Image Segmentation Preview Segmentation subdivides an image to regions or objects Two basic properties of intensity values Discontinuity Edge detection Similarity Thresholding Region growing/splitting/merging

### jorge s. marques image processing

image processing images images: what are they? what is shown in this image? What is this? what is an image images describe the evolution of physical variables (intensity, color, reflectance, condutivity)

### Digital Imaging and Multimedia. Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University

Digital Imaging and Multimedia Filters Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What are Filters Linear Filters Convolution operation Properties of Linear Filters Application

### A Learning Based Method for Super-Resolution of Low Resolution Images

A Learning Based Method for Super-Resolution of Low Resolution Images Emre Ugur June 1, 2004 emre.ugur@ceng.metu.edu.tr Abstract The main objective of this project is the study of a learning based method

### Image Enhancement in the Frequency Domain

Image Enhancement in the Frequency Domain Jesus J. Caban Outline! Assignment #! Paper Presentation & Schedule! Frequency Domain! Mathematical Morphology %& Assignment #! Questions?! How s OpenCV?! You

### CSE168 Computer Graphics II, Rendering. Spring 2006 Matthias Zwicker

CSE168 Computer Graphics II, Rendering Spring 2006 Matthias Zwicker Last time Global illumination Light transport notation Path tracing Sampling patterns Reflection vs. rendering equation Reflection equation

### PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical

### Lecture 9: Introduction to Pattern Analysis

Lecture 9: Introduction to Pattern Analysis g Features, patterns and classifiers g Components of a PR system g An example g Probability definitions g Bayes Theorem g Gaussian densities Features, patterns

### MVA ENS Cachan. Lecture 2: Logistic regression & intro to MIL Iasonas Kokkinos Iasonas.kokkinos@ecp.fr

Machine Learning for Computer Vision 1 MVA ENS Cachan Lecture 2: Logistic regression & intro to MIL Iasonas Kokkinos Iasonas.kokkinos@ecp.fr Department of Applied Mathematics Ecole Centrale Paris Galen

### Improvement of a Person Labelling Method Using Extracted Knowledge on Costume

Improvement of a Person Labelling Method Using Extracted Knowledge on Costume Gaël Jaffré and Philippe Joly Université Paul Sabatier, IRIT - Équipe SAMOVA, 31062 Toulouse Cedex 09, France {jaffre, joly}@irit.fr

### Practical Tour of Visual tracking. David Fleet and Allan Jepson January, 2006

Practical Tour of Visual tracking David Fleet and Allan Jepson January, 2006 Designing a Visual Tracker: What is the state? pose and motion (position, velocity, acceleration, ) shape (size, deformation,

### Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition

Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition 1. Image Pre-Processing - Pixel Brightness Transformation - Geometric Transformation - Image Denoising 1 1. Image Pre-Processing

### The Basics of Graphical Models

The Basics of Graphical Models David M. Blei Columbia University October 3, 2015 Introduction These notes follow Chapter 2 of An Introduction to Probabilistic Graphical Models by Michael Jordan. Many figures

### Using the ac Method to Factor

4.6 Using the ac Method to Factor 4.6 OBJECTIVES 1. Use the ac test to determine factorability 2. Use the results of the ac test 3. Completely factor a trinomial In Sections 4.2 and 4.3 we used the trial-and-error

### CHAPTER 5 SENDER AUTHENTICATION USING FACE BIOMETRICS

74 CHAPTER 5 SENDER AUTHENTICATION USING FACE BIOMETRICS 5.1 INTRODUCTION Face recognition has become very popular in recent years, and is used in many biometric-based security systems. Face recognition

### H.Calculating Normal Vectors

Appendix H H.Calculating Normal Vectors This appendix describes how to calculate normal vectors for surfaces. You need to define normals to use the OpenGL lighting facility, which is described in Chapter

### Several Views of Support Vector Machines

Several Views of Support Vector Machines Ryan M. Rifkin Honda Research Institute USA, Inc. Human Intention Understanding Group 2007 Tikhonov Regularization We are considering algorithms of the form min

### Predict Influencers in the Social Network

Predict Influencers in the Social Network Ruishan Liu, Yang Zhao and Liuyu Zhou Email: rliu2, yzhao2, lyzhou@stanford.edu Department of Electrical Engineering, Stanford University Abstract Given two persons

### Machine Learning and Pattern Recognition Logistic Regression

Machine Learning and Pattern Recognition Logistic Regression Course Lecturer:Amos J Storkey Institute for Adaptive and Neural Computation School of Informatics University of Edinburgh Crichton Street,

### These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

Music and Machine Learning (IFT6080 Winter 08) Prof. Douglas Eck, Université de Montréal These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher

### COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS

COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS B.K. Mohan and S. N. Ladha Centre for Studies in Resources Engineering IIT

### Factoring Trinomials: The ac Method

6.7 Factoring Trinomials: The ac Method 6.7 OBJECTIVES 1. Use the ac test to determine whether a trinomial is factorable over the integers 2. Use the results of the ac test to factor a trinomial 3. For

### 1 Maximum likelihood estimation

COS 424: Interacting with Data Lecturer: David Blei Lecture #4 Scribes: Wei Ho, Michael Ye February 14, 2008 1 Maximum likelihood estimation 1.1 MLE of a Bernoulli random variable (coin flips) Given N

### Mean Shift Based Clustering in High Dimensions: A Texture Classification Example

Mean Shift Based Clustering in High Dimensions: A Texture Classification Example Bogdan Georgescu µ Ilan Shimshoni µ Peter Meer ¾µ Computer Science µ Electrical and Computer Engineering ¾µ Rutgers University,

### A Real Time Hand Tracking System for Interactive Applications

A Real Time Hand Tracking System for Interactive Applications Siddharth Swarup Rautaray Indian Institute of Information Technology Allahabad ABSTRACT In vision based hand tracking systems color plays an

### Tracking Distributions with an Overlap Prior

Tracking Distributions with an Overlap Prior Ismail Ben Ayed, Shuo Li GE Healthcare London, ON, Canada {ismail.benayed, shuo.li}@ge.com Ian Ross London Health Sciences Centre London, ON, Canada ian.ross@lhsc.on.ca

### Machine Learning in Spam Filtering

Machine Learning in Spam Filtering A Crash Course in ML Konstantin Tretyakov kt@ut.ee Institute of Computer Science, University of Tartu Overview Spam is Evil ML for Spam Filtering: General Idea, Problems.

### suggestive contours and abstracted shading Daniel Arias

suggestive contours and abstracted shading Daniel Arias LINES AND SHADES Shape, volume, shades and texture in drawing lines as nonphotorealistic rendering technique Luis Caballero Suggestive contours Many

### CSCI567 Machine Learning (Fall 2014)

CSCI567 Machine Learning (Fall 2014) Drs. Sha & Liu {feisha,yanliu.cs}@usc.edu September 22, 2014 Drs. Sha & Liu ({feisha,yanliu.cs}@usc.edu) CSCI567 Machine Learning (Fall 2014) September 22, 2014 1 /

### Lecture 2: 2D Fourier transforms and applications

Lecture 2: 2D Fourier transforms and applications B14 Image Analysis Michaelmas 2014 A. Zisserman Fourier transforms and spatial frequencies in 2D Definition and meaning The Convolution Theorem Applications

### Syntax Menu Description Options Remarks and examples Stored results Methods and formulas References Also see. Description

Title stata.com lpoly Kernel-weighted local polynomial smoothing Syntax Menu Description Options Remarks and examples Stored results Methods and formulas References Also see Syntax lpoly yvar xvar [ if

### Automatic 3D Reconstruction via Object Detection and 3D Transformable Model Matching CS 269 Class Project Report

Automatic 3D Reconstruction via Object Detection and 3D Transformable Model Matching CS 69 Class Project Report Junhua Mao and Lunbo Xu University of California, Los Angeles mjhustc@ucla.edu and lunbo

### Robust Scale-adaptive Mean-Shift for Tracking

Robust Scale-adaptive Mean-Shift for Tracking Tomas Vojir, Jana Noskova 2, and Jiri Matas The Center for Machine Perception, FEE CTU in Prague Karlovo namesti 3, 2 35 Prague 2, Czech Republic {vojirtom,

### CCNY. BME I5100: Biomedical Signal Processing. Linear Discrimination. Lucas C. Parra Biomedical Engineering Department City College of New York

BME I5100: Biomedical Signal Processing Linear Discrimination Lucas C. Parra Biomedical Engineering Department CCNY 1 Schedule Week 1: Introduction Linear, stationary, normal - the stuff biology is not

### DYNAMIC RANGE IMPROVEMENT THROUGH MULTIPLE EXPOSURES. Mark A. Robertson, Sean Borman, and Robert L. Stevenson

c 1999 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or

### Java Modules for Time Series Analysis

Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series

### L10: Probability, statistics, and estimation theory

L10: Probability, statistics, and estimation theory Review of probability theory Bayes theorem Statistics and the Normal distribution Least Squares Error estimation Maximum Likelihood estimation Bayesian

### Determining optimal window size for texture feature extraction methods

IX Spanish Symposium on Pattern Recognition and Image Analysis, Castellon, Spain, May 2001, vol.2, 237-242, ISBN: 84-8021-351-5. Determining optimal window size for texture feature extraction methods Domènec

### Computer Vision: Filtering

Computer Vision: Filtering Raquel Urtasun TTI Chicago Jan 10, 2013 Raquel Urtasun (TTI-C) Computer Vision Jan 10, 2013 1 / 82 Today s lecture... Image formation Image Filtering Raquel Urtasun (TTI-C) Computer

### Color to Grayscale Conversion with Chrominance Contrast

Color to Grayscale Conversion with Chrominance Contrast Yuting Ye University of Virginia Figure 1: The sun in Monet s Impression Sunrise has similar luminance as the sky. It can hardly be seen when the

### CS 688 Pattern Recognition Lecture 4. Linear Models for Classification

CS 688 Pattern Recognition Lecture 4 Linear Models for Classification Probabilistic generative models Probabilistic discriminative models 1 Generative Approach ( x ) p C k p( C k ) Ck p ( ) ( x Ck ) p(

### degrees of freedom and are able to adapt to the task they are supposed to do [Gupta].

1.3 Neural Networks 19 Neural Networks are large structured systems of equations. These systems have many degrees of freedom and are able to adapt to the task they are supposed to do [Gupta]. Two very

### Machine vision systems - 2

Machine vision systems Problem definition Image acquisition Image segmentation Connected component analysis Machine vision systems - 1 Problem definition Design a vision system to see a flat world Page

### Chapter ML:XI (continued)

Chapter ML:XI (continued) XI. Cluster Analysis Data Mining Overview Cluster Analysis Basics Hierarchical Cluster Analysis Iterative Cluster Analysis Density-Based Cluster Analysis Cluster Evaluation Constrained

### 2.2 Creaseness operator

2.2. Creaseness operator 31 2.2 Creaseness operator Antonio López, a member of our group, has studied for his PhD dissertation the differential operators described in this section [72]. He has compared

### Bayesian Image Super-Resolution

Bayesian Image Super-Resolution Michael E. Tipping and Christopher M. Bishop Microsoft Research, Cambridge, U.K..................................................................... Published as: Bayesian

### Segmentation. Lecture 12. Many slides from: S. Lazebnik, K. Grauman and P. Kumar

Segmentation Lecture 12 Many slides from: S. Lazebnik, K. Grauman and P. Kumar Image Segmentation Image segmentation The goals of segmentation Group together similar-looking pixels for efficiency of further

### LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING. ----Changsheng Liu 10-30-2014

LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING ----Changsheng Liu 10-30-2014 Agenda Semi Supervised Learning Topics in Semi Supervised Learning Label Propagation Local and global consistency Graph

### THE DIFFUSION EQUATION

THE DIFFUSION EQUATION R. E. SHOWALTER 1. Heat Conduction in an Interval We shall describe the diffusion of heat energy through a long thin rod G with uniform cross section S. As before, we identify G

### DIGITAL IMAGE PROCESSING AND ANALYSIS

DIGITAL IMAGE PROCESSING AND ANALYSIS Human and Computer Vision Applications with CVIPtools SECOND EDITION SCOTT E UMBAUGH Uffi\ CRC Press Taylor &. Francis Group Boca Raton London New York CRC Press is

MA 134 Lecture Notes August 20, 2012 Introduction The purpose of this lecture is to... Introduction The purpose of this lecture is to... Learn about different types of equations Introduction The purpose

Adaptive Online Gradient Descent Peter L Bartlett Division of Computer Science Department of Statistics UC Berkeley Berkeley, CA 94709 bartlett@csberkeleyedu Elad Hazan IBM Almaden Research Center 650

### Performance Metrics for Graph Mining Tasks

Performance Metrics for Graph Mining Tasks 1 Outline Introduction to Performance Metrics Supervised Learning Performance Metrics Unsupervised Learning Performance Metrics Optimizing Metrics Statistical

### A New Robust Algorithm for Video Text Extraction

A New Robust Algorithm for Video Text Extraction Pattern Recognition, vol. 36, no. 6, June 2003 Edward K. Wong and Minya Chen School of Electrical Engineering and Computer Science Kyungpook National Univ.

### Logistic Regression (1/24/13)

STA63/CBB540: Statistical methods in computational biology Logistic Regression (/24/3) Lecturer: Barbara Engelhardt Scribe: Dinesh Manandhar Introduction Logistic regression is model for regression used

### Classification using intersection kernel SVMs is efficient

Classification using intersection kernel SVMs is efficient Jitendra Malik UC Berkeley Joint work with Subhransu Maji and Alex Berg Fast intersection kernel SVMs and other generalizations of linear SVMs

### Optical Flow as a property of moving objects used for their registration

Optical Flow as a property of moving objects used for their registration Wolfgang Schulz Computer Vision Course Project York University Email:wschulz@cs.yorku.ca 1. Introduction A soccer game is a real

### Spatio-Temporal Nonparametric Background Modeling and Subtraction

Spatio-Temporal Nonparametric Background Modeling and Subtraction Raviteja Vemulapalli and R. Aravind Department of Electrical engineering Indian Institute of Technology, Madras Background subtraction

### Application of Face Recognition to Person Matching in Trains

Application of Face Recognition to Person Matching in Trains May 2008 Objective Matching of person Context : in trains Using face recognition and face detection algorithms With a video-surveillance camera

### Introduction to machine learning and pattern recognition Lecture 1 Coryn Bailer-Jones

Introduction to machine learning and pattern recognition Lecture 1 Coryn Bailer-Jones http://www.mpia.de/homes/calj/mlpr_mpia2008.html 1 1 What is machine learning? Data description and interpretation

### Evaluation in Machine Learning (2) Aims. Introduction

Acknowledgements Evaluation in Machine Learning (2) 15s1: COMP9417 Machine Learning and Data Mining School of Computer Science and Engineering, University of New South Wales Material derived from slides

### Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Sample Exam Questions 2007

Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Questions 2007 INSTRUCTIONS: Answer all questions. Spend approximately 1 minute per mark. Question 1 30 Marks Total

### Computational Foundations of Cognitive Science

Computational Foundations of Cognitive Science Lecture 15: Convolutions and Kernels Frank Keller School of Informatics University of Edinburgh keller@inf.ed.ac.uk February 23, 2010 Frank Keller Computational

### Multivariate data visualization using shadow

Proceedings of the IIEEJ Ima and Visual Computing Wor Kuching, Malaysia, Novembe Multivariate data visualization using shadow Zhongxiang ZHENG Suguru SAITO Tokyo Institute of Technology ABSTRACT When visualizing

### QUALITY TESTING OF WATER PUMP PULLEY USING IMAGE PROCESSING

QUALITY TESTING OF WATER PUMP PULLEY USING IMAGE PROCESSING MRS. A H. TIRMARE 1, MS.R.N.KULKARNI 2, MR. A R. BHOSALE 3 MR. C.S. MORE 4 MR.A.G.NIMBALKAR 5 1, 2 Assistant professor Bharati Vidyapeeth s college

### Video Surveillance System for Security Applications

Video Surveillance System for Security Applications Vidya A.S. Department of CSE National Institute of Technology Calicut, Kerala, India V. K. Govindan Department of CSE National Institute of Technology

### Neural Networks. CAP5610 Machine Learning Instructor: Guo-Jun Qi

Neural Networks CAP5610 Machine Learning Instructor: Guo-Jun Qi Recap: linear classifier Logistic regression Maximizing the posterior distribution of class Y conditional on the input vector X Support vector

### Social Media Mining. Data Mining Essentials

Introduction Data production rate has been increased dramatically (Big Data) and we are able store much more data than before E.g., purchase data, social media data, mobile phone data Businesses and customers

### Vision based Vehicle Tracking using a high angle camera

Vision based Vehicle Tracking using a high angle camera Raúl Ignacio Ramos García Dule Shu gramos@clemson.edu dshu@clemson.edu Abstract A vehicle tracking and grouping algorithm is presented in this work

### Brightness and geometric transformations

Brightness and geometric transformations Václav Hlaváč Czech Technical University in Prague Center for Machine Perception (bridging groups of the) Czech Institute of Informatics, Robotics and Cybernetics