Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition

Size: px
Start display at page:

Download "Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition"

Transcription

1 Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition VO KU 1

2 Optical Flow (I) Content Introduction Local approach (Lucas Kanade) Global approaches (Horn-Schunck, TV-L1) Coarse-to-fine warping 2

3 What is Optical Flow? Optical Flow is a major task of every biological and artificial visual system Is the aparent motion in images sequenzes. Can be seen as a velocity field that transforms one image to the next image in a sequence 3

4 The apparent motion Optical flow is not the true 3D motion of the objects It is the 3D motion projected to the camera plane The true 3D motion is called the scene flow and additionally requires 3D information of the scene 4

5 5

6 Applications of Optical Flow Tracking Video Compression (Recent MPEG Standard) 3D Reconstruction (Stereo) Segmentation Object Detection Video Interpolation in time (The Matrix) 6

7 History Computing Optical Flow started in the early 80 s and is still a hot research topic 1980: Horn and Schunck (global approach) 1981: Lucas and Kanade (local approach) 1989: Shulman and Herve (discontinuity preserving) 1993: Black and Anandan (robust optical flow) 1999: Alvarez et al. (PDE model) 2003: Bruhn et al. (realtime optical flow using mulitgrid) 2004: Brox et al. (high accuracy using warping) 2007: Zach, Pock, Bischof: (duality based minimization) 7

8 Evaluation For a long time, the so-called Yosemite sequence (Barron et al. 1994) was used to evaluate the algorithms Yosemite Yosemite with clouds 8

9 Evaluation Middlebury optical flow benchmark (Baker et al. 2007) 9

10 Evaluation SINTEL open source synthetic movie, Butler et al

11 Basic assumptions Brightness constancy assumption The intensities remain constant, although the location might change. Problems by changing illumination Can be generalized to a feature constancy assumption Spatial coherence assumption Neighbouring pixels are likely to have the same motion Difficult to find a good model Temporal persistence Motion changes gradually over time Only useful in case of high frame rates (small motion) 11

12 Brightness constancy assumption We assume that intensity patterns only change their positions frame t frame t+1 12

13 Difficulties of the brightnes constancy assumption Aperture Problem: Only the normal flow can be estimated Untextured areas: No information in untextured areas 13

14 Changing illumination A changing illumination induces an optical flow that does not correspond to the motion of the object A changing illumination causes an optical flow although the object does not move 14

15 What to do if the brightness constancy assumption is violated? If the illumination changes from frame to frame, the brightness constancy assumption may be violated A simple idea is to perform a structure-texture decomposition Although the absolute intensity values might change, the texture part stays the same 1. Low-pass filter the images (e.g. total variation smoothing) 2. Subtract the low-pass filtered images from the original images 3. Work with the resulting images 15

16 Structure - Texture Decomposition 16

17 Structure - Texture Decomposition 17

18 Beyond the brightness constancy assumption What can we do if we want to compute the optical flow between such images? We can work on feature transforms such as SIFT Each pixel in the images is replaced by its SIFT feature. SIFT-Flow [Liu, Yuen, Torralba, 2011] 18

19 Spatial coherence assumption Describes the a-priori assumption about flow fields Can be learned from statistics of natural flow fields without spatial coherence with spatial coherence 19

20 Temporal persistency Idea: The motion of objects does not suddenly change for example, one can assume linear motion model between three frames Can be generalized to higher-order models Sometimes, it does not improve too much in practice 20

21 The optical flow constraint (OFC) Brightness constancy assumption Taylor development leads to the linearized Brightness Constancy Assumption Error function over the whole image Underdetermined problem 21

22 Warping In practice, we are given two images of an image sequence and an often an initial flow field The differential quantities are computed by Warping: Geometrically transform the second image by Compute on the warped second image 22

23 Linearization of the Image 23

24 The Linearized Data Term (p=2) 24

25 The Linearized Data Term (p=1) 25

26 General outlook We will now discuss three methods Lukas Kanade method Horn Schunck method TV-L1 method All methods can only be used to estimate small motion We will first assume that we only have small motion Large motion can be computed using a coarse-to-fine warping framework Finally we will discuss Matlab implementations of all three methods 26

27 The Lucas Kanade (LK) method 27

28 A local approach Impossible to compute the flow by only using the optical flow constraint, hence we need additional constraints Assume that all pixels in a patch have the same motion This gives the following equations for each pixel in the patch Example: 5x5 patch would give us 25 equations instead of one! A: 25x2 d: 2x1 b: 25x1 28

29 Lucas-Kanade optical flow We have more equations than unknowns Find least squares solution Solution is given by the pseudo inverse Note that the system to be solved is only 2x2 29

30 Conditions for solvability Optimal (u, v) satisfies Lucas-Kanade equation When is this system solvable? is recognized to be the structure tensor Invertible, if both eigenvalues are sufficiently larger than zero 30

31 The Lucas Kanade (LK) method Advantages Only one parameter (window size) Very fast to compute (easily realtime) Can be done dense or sparse Disadvantages Each patch is independent, no global consensus The local window assumes a constant motion Sometimes bad results 31

32 The Horn and Schunck (HS) Method 32

33 The Horn and Schunck (HS) Method Global energy to be minimized is the regularization parameter The image is of size are column vectors is a finite differences approximation of the gradient operator 33

34 Optimality conditions: The linear system The optimality condition can be re-arranged as the following linear system System is large but very sparse Suitable solvers are Gauss-Seidel, CG, or Matlab \ 34

35 The Horn and Schunck (HS) Method Advantages Easy and fast to solve due to quadratic functions Easy to implement Disadvantages Quadratic smoothnes term does not allow for sharp discontinuities in the motion field Quadratic data term does not allow for outliers in the optical flow constraint 35

36 The TV-L1 approach 36

37 The TV-L1 approach Due to the quadratic functions, the HS method does not allow for discontinuities in the flow field A good idea is to replacing the quadratic functions by norms Leads to the so-called TV-L1 approach The first term is the so-called total variation of the flow field, the second term is the norm of the OFC 37

38 Minimizing the TV-L1 energy The TV-L1 energy is convex but non-differentiable Standard gradient descent cannot be applied We can rely on recent advances in convex optimization We can apply two strategies: Smooth the total variation term and apply the FISTA algorithm Compute a saddle-point formulation of the energy and apply a primal-dual algorithm 38

39 The FISTA Algorithm Fast Iterative Shrinkage Thresholding Algorithm Proposed in 2008 by Beck and Teboulle Can be applied to the following class of convex optimization problems The function has a Lipschitz continuous gradient The function can be non-smooth but has a simple to compute proximal operator 39

40 FISTA Convergence rate: 40

41 Application to the TV-L1 energy (1) Smoothing of the TV term to make its gradient Lipschitz where denotes the Huber function, has a Lipschitz continuous gradient with 41

42 Application to the TV-L1 energy (2) The non-smooth function is given by the norm of the data term The solution of the proximal operator is given by where and 42

43 Primal-dual optimization A first-order primal-dual algorithm proposed in Chambolle, Pock, 2011 Can be used to find a saddle point of the following class of convex-concave saddle-point problems where is a linear operator, and are convex (non-smooth) functions and have simple proximal operators Corresponds to a saddle-point formulation of the primal and dual problems 43

44 The algorithm Step sizes:, Proximal operators 44

45 Saddle-point formulation of TV-L1 The total variation can be written as (convex conjugate) The TV-L1 optical flow model is written as with Exactly falls into the class of the primal-dual algorithm 45

46 The proximal operators The proximal operator with respect to is given by the same soft-shrinkage formula as before The proximal operator with respect to is a projection onto the Euclidean ball 46

47 The TV-L1 approach Advantages TV regularization allows for discontinuities in the flow field The L1 data term allows for outliers (occlusions) Reasonable fast to compute (GPU leads to realtime) Disadvantages The method requires an iterative solver to compute the minimizer (FISTA, or Primal-Dual) FISTA requires to smooth the TV Primal-Dual can also deal with the pure TV Hard to find a good stopping criterion 47

48 Coarse-to-fine warping framework Due to the restrictions of the OFC, the discussed methods are only able to recover small motion How to extend the method for large motion? 1. Solving, warping, re-linearization, solving, Implement the method on an image pyramide 48

49 Coarse-to-fine warping framework Compute image pyramids init Initialize the flow field solve Transform the moving image by the given flow field (warping) Perform linearization Apply one of the three methods (LK, HS, TV-L1) prolongate Initialize the flow field on the next finer level using interpolation and rescaling of the motion vectors 49

50 Coarse-to-fine warping framework Advantages Allows to compute large motion Due to the logarithmic nature of pyramids, not much more to compute Disadvantages Large motion that is not captured at a coarse scale cannot be found on finer levels Dilemma: Large motion of small objects Different interpolation, rescaling, filtering schemes lead to different results Can lead to unstable results in practice BUT: What is the alternative? 50

51 Comparison of the three methods In the following, we will show an comparison of the three methods we covered so far We use the Army sequence of the Middlebury benchmark Input frames Ground truth flow 51

52 Structure-texture decomposition The data set contains changing illumination and shadows 52

53 Lucas-Kanade 53

54 Horn-Schunck 54

55 TV-L1 55

56 Real-time implementation Implementation of the TV-L1 method on a GPU allows for real-time computation 56

57 Flow Games Jakob Santner et al. 57

58 Feature Flow How can we compute the motion between challenging sequences Large displacements Different modalities Image taken at different time points Images from objects of the same category 58

59 Feature Flow The idea is simple Replace each pixel in both images by a feature vector SIFT descriptor LBP Feature constancy assumption Linearize each feature channel individually 59

60 Some results using SIFT 60

61 Some results using SIFT 61

62 Some results using SIFT 62

63 Some results using SIFT 63

64 Some results using SIFT 64

65 Some results using SIFT 65

Feature Tracking and Optical Flow

Feature Tracking and Optical Flow 02/09/12 Feature Tracking and Optical Flow Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Many slides adapted from Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve

More information

Optical Flow. Shenlong Wang CSC2541 Course Presentation Feb 2, 2016

Optical Flow. Shenlong Wang CSC2541 Course Presentation Feb 2, 2016 Optical Flow Shenlong Wang CSC2541 Course Presentation Feb 2, 2016 Outline Introduction Variation Models Feature Matching Methods End-to-end Learning based Methods Discussion Optical Flow Goal: Pixel motion

More information

A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow

A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow , pp.233-237 http://dx.doi.org/10.14257/astl.2014.51.53 A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow Giwoo Kim 1, Hye-Youn Lim 1 and Dae-Seong Kang 1, 1 Department of electronices

More information

Object tracking & Motion detection in video sequences

Object tracking & Motion detection in video sequences Introduction Object tracking & Motion detection in video sequences Recomended link: http://cmp.felk.cvut.cz/~hlavac/teachpresen/17compvision3d/41imagemotion.pdf 1 2 DYNAMIC SCENE ANALYSIS The input to

More information

Two-Frame Motion Estimation Based on Polynomial Expansion

Two-Frame Motion Estimation Based on Polynomial Expansion Two-Frame Motion Estimation Based on Polynomial Expansion Gunnar Farnebäck Computer Vision Laboratory, Linköping University, SE-581 83 Linköping, Sweden gf@isy.liu.se http://www.isy.liu.se/cvl/ Abstract.

More information

ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER

ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER Fatemeh Karimi Nejadasl, Ben G.H. Gorte, and Serge P. Hoogendoorn Institute of Earth Observation and Space System, Delft University

More information

Dual Methods for Total Variation-Based Image Restoration

Dual Methods for Total Variation-Based Image Restoration Dual Methods for Total Variation-Based Image Restoration Jamylle Carter Institute for Mathematics and its Applications University of Minnesota, Twin Cities Ph.D. (Mathematics), UCLA, 2001 Advisor: Tony

More information

A Learning Based Method for Super-Resolution of Low Resolution Images

A Learning Based Method for Super-Resolution of Low Resolution Images A Learning Based Method for Super-Resolution of Low Resolution Images Emre Ugur June 1, 2004 emre.ugur@ceng.metu.edu.tr Abstract The main objective of this project is the study of a learning based method

More information

Computational Optical Imaging - Optique Numerique. -- Deconvolution --

Computational Optical Imaging - Optique Numerique. -- Deconvolution -- Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method

More information

Vision based Vehicle Tracking using a high angle camera

Vision based Vehicle Tracking using a high angle camera Vision based Vehicle Tracking using a high angle camera Raúl Ignacio Ramos García Dule Shu gramos@clemson.edu dshu@clemson.edu Abstract A vehicle tracking and grouping algorithm is presented in this work

More information

A Duality Based Algorithm for TV-L 1 -Optical-Flow Image Registration

A Duality Based Algorithm for TV-L 1 -Optical-Flow Image Registration A Duality Based Algorithm for TV-L 1 -Optical-Flow Image Registration Thomas Pock 1, Martin Urschler 1, Christopher Zach 2, Reinhard Beichel 3, and Horst Bischof 1 1 Institute for Computer Graphics & Vision,

More information

Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition

Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition 1. Image Pre-Processing - Pixel Brightness Transformation - Geometric Transformation - Image Denoising 1 1. Image Pre-Processing

More information

MOTION DETECTION FOR PC BASED SECURITY SYSTEM BY USING OPTICAL FLOW NUR NABILAH BT MOHAMAD HAMID

MOTION DETECTION FOR PC BASED SECURITY SYSTEM BY USING OPTICAL FLOW NUR NABILAH BT MOHAMAD HAMID MOTION DETECTION FOR PC BASED SECURITY SYSTEM BY USING OPTICAL FLOW NUR NABILAH BT MOHAMAD HAMID This thesis is submitted as partial fulfillment of the requirement for the award of the Bachelor of Electrical

More information

An Iterative Image Registration Technique with an Application to Stereo Vision

An Iterative Image Registration Technique with an Application to Stereo Vision An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract

More information

EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM

EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM Amol Ambardekar, Mircea Nicolescu, and George Bebis Department of Computer Science and Engineering University

More information

Automatic Restoration Algorithms for 35mm film

Automatic Restoration Algorithms for 35mm film P. Schallauer, A. Pinz, W. Haas. Automatic Restoration Algorithms for 35mm film. To be published in Videre, Journal of Computer Vision Research, web: http://mitpress.mit.edu/videre.html, 1999. Automatic

More information

10. Proximal point method

10. Proximal point method L. Vandenberghe EE236C Spring 2013-14) 10. Proximal point method proximal point method augmented Lagrangian method Moreau-Yosida smoothing 10-1 Proximal point method a conceptual algorithm for minimizing

More information

Accurate and robust image superresolution by neural processing of local image representations

Accurate and robust image superresolution by neural processing of local image representations Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica

More information

Metrics on SO(3) and Inverse Kinematics

Metrics on SO(3) and Inverse Kinematics Mathematical Foundations of Computer Graphics and Vision Metrics on SO(3) and Inverse Kinematics Luca Ballan Institute of Visual Computing Optimization on Manifolds Descent approach d is a ascent direction

More information

AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS

AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS Revised Edition James Epperson Mathematical Reviews BICENTENNIAL 0, 1 8 0 7 z ewiley wu 2007 r71 BICENTENNIAL WILEY-INTERSCIENCE A John Wiley & Sons, Inc.,

More information

Video stabilization for high resolution images reconstruction

Video stabilization for high resolution images reconstruction Advanced Project S9 Video stabilization for high resolution images reconstruction HIMMICH Youssef, KEROUANTON Thomas, PATIES Rémi, VILCHES José. Abstract Super-resolution reconstruction produces one or

More information

Face Model Fitting on Low Resolution Images

Face Model Fitting on Low Resolution Images Face Model Fitting on Low Resolution Images Xiaoming Liu Peter H. Tu Frederick W. Wheeler Visualization and Computer Vision Lab General Electric Global Research Center Niskayuna, NY, 1239, USA {liux,tu,wheeler}@research.ge.com

More information

Dense Point Trajectories by GPU-accelerated Large Displacement Optical Flow

Dense Point Trajectories by GPU-accelerated Large Displacement Optical Flow Dense Point Trajectories by GPU-accelerated Large Displacement Optical Flow Narayanan Sundaram, Thomas Brox, and Kurt Keutzer University of California at Berkeley {narayans,brox,keutzer}@eecs.berkeley.edu

More information

Illumination-Invariant Tracking via Graph Cuts

Illumination-Invariant Tracking via Graph Cuts Illumination-Invariant Tracking via Graph Cuts Daniel Freedman and Matthew W. Turek Computer Science Department, Rensselaer Polytechnic Institute, Troy, NY 12180 Abstract Illumination changes are a ubiquitous

More information

Constrained curve and surface fitting

Constrained curve and surface fitting Constrained curve and surface fitting Simon Flöry FSP-Meeting Strobl (June 20, 2006), floery@geoemtrie.tuwien.ac.at, Vienna University of Technology Overview Introduction Motivation, Overview, Problem

More information

Super-Resolution for Traditional and Omnidirectional Image Sequences

Super-Resolution for Traditional and Omnidirectional Image Sequences Acta Polytechnica Hungarica Vol. 6, No. 1, 2009 Super-Resolution for Traditional and Omnidirectional Image Sequences Attila Nagy, Zoltán Vámossy Institute of Software Technology, John von Neumann Faculty

More information

Big Data - Lecture 1 Optimization reminders

Big Data - Lecture 1 Optimization reminders Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Schedule Introduction Major issues Examples Mathematics

More information

Edge tracking for motion segmentation and depth ordering

Edge tracking for motion segmentation and depth ordering Edge tracking for motion segmentation and depth ordering P. Smith, T. Drummond and R. Cipolla Department of Engineering University of Cambridge Cambridge CB2 1PZ,UK {pas1001 twd20 cipolla}@eng.cam.ac.uk

More information

Parallel algorithms to a parallel hardware: Designing vision algorithms for a GPU

Parallel algorithms to a parallel hardware: Designing vision algorithms for a GPU Parallel algorithms to a parallel hardware: Designing vision algorithms for a GPU Jun-Sik Kim, Myung Hwangbo and Takeo Kanade Robotics Institute Carnegie Mellon University {kimjs,myung,tk}@cs.cmu.edu Abstract

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical

More information

OBJECT TRACKING USING LOG-POLAR TRANSFORMATION

OBJECT TRACKING USING LOG-POLAR TRANSFORMATION OBJECT TRACKING USING LOG-POLAR TRANSFORMATION A Thesis Submitted to the Gradual Faculty of the Louisiana State University and Agricultural and Mechanical College in partial fulfillment of the requirements

More information

Mean-Shift Tracking with Random Sampling

Mean-Shift Tracking with Random Sampling 1 Mean-Shift Tracking with Random Sampling Alex Po Leung, Shaogang Gong Department of Computer Science Queen Mary, University of London, London, E1 4NS Abstract In this work, boosting the efficiency of

More information

A Methodology for Obtaining Super-Resolution Images and Depth Maps from RGB-D Data

A Methodology for Obtaining Super-Resolution Images and Depth Maps from RGB-D Data A Methodology for Obtaining Super-Resolution Images and Depth Maps from RGB-D Data Daniel B. Mesquita, Mario F. M. Campos, Erickson R. Nascimento Computer Science Department Universidade Federal de Minas

More information

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines EECS 556 Image Processing W 09 Interpolation Interpolation techniques B splines What is image processing? Image processing is the application of 2D signal processing methods to images Image representation

More information

How To Analyze Ball Blur On A Ball Image

How To Analyze Ball Blur On A Ball Image Single Image 3D Reconstruction of Ball Motion and Spin From Motion Blur An Experiment in Motion from Blur Giacomo Boracchi, Vincenzo Caglioti, Alessandro Giusti Objective From a single image, reconstruct:

More information

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R. Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).

More information

Tracking Moving Objects In Video Sequences Yiwei Wang, Robert E. Van Dyck, and John F. Doherty Department of Electrical Engineering The Pennsylvania State University University Park, PA16802 Abstract{Object

More information

Towards License Plate Recognition: Comparying Moving Objects Segmentation Approaches

Towards License Plate Recognition: Comparying Moving Objects Segmentation Approaches 1 Towards License Plate Recognition: Comparying Moving Objects Segmentation Approaches V. J. Oliveira-Neto, G. Cámara-Chávez, D. Menotti UFOP - Federal University of Ouro Preto Computing Department Ouro

More information

An Introduction to Applied Mathematics: An Iterative Process

An Introduction to Applied Mathematics: An Iterative Process An Introduction to Applied Mathematics: An Iterative Process Applied mathematics seeks to make predictions about some topic such as weather prediction, future value of an investment, the speed of a falling

More information

A Prototype For Eye-Gaze Corrected

A Prototype For Eye-Gaze Corrected A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive

More information

Building an Advanced Invariant Real-Time Human Tracking System

Building an Advanced Invariant Real-Time Human Tracking System UDC 004.41 Building an Advanced Invariant Real-Time Human Tracking System Fayez Idris 1, Mazen Abu_Zaher 2, Rashad J. Rasras 3, and Ibrahiem M. M. El Emary 4 1 School of Informatics and Computing, German-Jordanian

More information

Numerical Methods For Image Restoration

Numerical Methods For Image Restoration Numerical Methods For Image Restoration CIRAM Alessandro Lanza University of Bologna, Italy Faculty of Engineering CIRAM Outline 1. Image Restoration as an inverse problem 2. Image degradation models:

More information

A REVIEW OF FAST l 1 -MINIMIZATION ALGORITHMS FOR ROBUST FACE RECOGNITION

A REVIEW OF FAST l 1 -MINIMIZATION ALGORITHMS FOR ROBUST FACE RECOGNITION A REVIEW OF FAST l 1 -MINIMIZATION ALGORITHMS FOR ROBUST FACE RECOGNITION ALLEN Y. YANG, ARVIND GANESH, ZIHAN ZHOU, S. SHANKAR SASTRY, AND YI MA Abstract. l 1 -minimization refers to finding the minimum

More information

Tracking of Small Unmanned Aerial Vehicles

Tracking of Small Unmanned Aerial Vehicles Tracking of Small Unmanned Aerial Vehicles Steven Krukowski Adrien Perkins Aeronautics and Astronautics Stanford University Stanford, CA 94305 Email: spk170@stanford.edu Aeronautics and Astronautics Stanford

More information

Subspace Analysis and Optimization for AAM Based Face Alignment

Subspace Analysis and Optimization for AAM Based Face Alignment Subspace Analysis and Optimization for AAM Based Face Alignment Ming Zhao Chun Chen College of Computer Science Zhejiang University Hangzhou, 310027, P.R.China zhaoming1999@zju.edu.cn Stan Z. Li Microsoft

More information

Computer Graphics. Geometric Modeling. Page 1. Copyright Gotsman, Elber, Barequet, Karni, Sheffer Computer Science - Technion. An Example.

Computer Graphics. Geometric Modeling. Page 1. Copyright Gotsman, Elber, Barequet, Karni, Sheffer Computer Science - Technion. An Example. An Example 2 3 4 Outline Objective: Develop methods and algorithms to mathematically model shape of real world objects Categories: Wire-Frame Representation Object is represented as as a set of points

More information

TESLA Report 2003-03

TESLA Report 2003-03 TESLA Report 23-3 A multigrid based 3D space-charge routine in the tracking code GPT Gisela Pöplau, Ursula van Rienen, Marieke de Loos and Bas van der Geer Institute of General Electrical Engineering,

More information

Edge-based Template Matching and Tracking for Perspectively Distorted Planar Objects

Edge-based Template Matching and Tracking for Perspectively Distorted Planar Objects Edge-based Template Matching and Tracking for Perspectively Distorted Planar Objects Andreas Hofhauser, Carsten Steger, and Nassir Navab TU München, Boltzmannstr. 3, 85748 Garching bei München, Germany

More information

Convolution. 1D Formula: 2D Formula: Example on the web: http://www.jhu.edu/~signals/convolve/

Convolution. 1D Formula: 2D Formula: Example on the web: http://www.jhu.edu/~signals/convolve/ Basic Filters (7) Convolution/correlation/Linear filtering Gaussian filters Smoothing and noise reduction First derivatives of Gaussian Second derivative of Gaussian: Laplacian Oriented Gaussian filters

More information

High Quality Image Magnification using Cross-Scale Self-Similarity

High Quality Image Magnification using Cross-Scale Self-Similarity High Quality Image Magnification using Cross-Scale Self-Similarity André Gooßen 1, Arne Ehlers 1, Thomas Pralow 2, Rolf-Rainer Grigat 1 1 Vision Systems, Hamburg University of Technology, D-21079 Hamburg

More information

A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA. Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo. University of Padova, Italy

A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA. Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo. University of Padova, Italy A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo University of Padova, Italy ABSTRACT Current Time-of-Flight matrix sensors allow for the acquisition

More information

Linear Threshold Units

Linear Threshold Units Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear

More information

Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems

Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001,

More information

Efficient Belief Propagation for Early Vision

Efficient Belief Propagation for Early Vision Efficient Belief Propagation for Early Vision Pedro F. Felzenszwalb and Daniel P. Huttenlocher Department of Computer Science, Cornell University {pff,dph}@cs.cornell.edu Abstract Markov random field models

More information

Adaptive Online Gradient Descent

Adaptive Online Gradient Descent Adaptive Online Gradient Descent Peter L Bartlett Division of Computer Science Department of Statistics UC Berkeley Berkeley, CA 94709 bartlett@csberkeleyedu Elad Hazan IBM Almaden Research Center 650

More information

Real-time Traffic Congestion Detection Based on Video Analysis

Real-time Traffic Congestion Detection Based on Video Analysis Journal of Information & Computational Science 9: 10 (2012) 2907 2914 Available at http://www.joics.com Real-time Traffic Congestion Detection Based on Video Analysis Shan Hu a,, Jiansheng Wu a, Ling Xu

More information

Bayesian Image Super-Resolution

Bayesian Image Super-Resolution Bayesian Image Super-Resolution Michael E. Tipping and Christopher M. Bishop Microsoft Research, Cambridge, U.K..................................................................... Published as: Bayesian

More information

3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials

3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials 3. Interpolation Closing the Gaps of Discretization... Beyond Polynomials Closing the Gaps of Discretization... Beyond Polynomials, December 19, 2012 1 3.3. Polynomial Splines Idea of Polynomial Splines

More information

Cloud tracking with optical flow for short-term solar forecasting

Cloud tracking with optical flow for short-term solar forecasting Cloud tracking with optical flow for short-term solar forecasting Philip Wood-Bradley, José Zapata, John Pye Solar Thermal Group, Australian National University, Canberra, Australia Corresponding author:

More information

OpenFOAM Optimization Tools

OpenFOAM Optimization Tools OpenFOAM Optimization Tools Henrik Rusche and Aleks Jemcov h.rusche@wikki-gmbh.de and a.jemcov@wikki.co.uk Wikki, Germany and United Kingdom OpenFOAM Optimization Tools p. 1 Agenda Objective Review optimisation

More information

Big Data Analytics: Optimization and Randomization

Big Data Analytics: Optimization and Randomization Big Data Analytics: Optimization and Randomization Tianbao Yang, Qihang Lin, Rong Jin Tutorial@SIGKDD 2015 Sydney, Australia Department of Computer Science, The University of Iowa, IA, USA Department of

More information

FLEXSYS Motion-based Traffic Analysis and Incident Detection

FLEXSYS Motion-based Traffic Analysis and Incident Detection FLEXSYS Motion-based Traffic Analysis and Incident Detection Authors: Lixin Yang and Hichem Sahli, IBBT/VUB-ETRO Contents.1 Introduction......................................... 1.2 Traffic flow modelling

More information

Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections

Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Maximilian Hung, Bohyun B. Kim, Xiling Zhang August 17, 2013 Abstract While current systems already provide

More information

Latest Results on High-Resolution Reconstruction from Video Sequences

Latest Results on High-Resolution Reconstruction from Video Sequences Latest Results on High-Resolution Reconstruction from Video Sequences S. Lertrattanapanich and N. K. Bose The Spatial and Temporal Signal Processing Center Department of Electrical Engineering The Pennsylvania

More information

GI01/M055 Supervised Learning Proximal Methods

GI01/M055 Supervised Learning Proximal Methods GI01/M055 Supervised Learning Proximal Methods Massimiliano Pontil (based on notes by Luca Baldassarre) (UCL) Proximal Methods 1 / 20 Today s Plan Problem setting Convex analysis concepts Proximal operators

More information

2.2 Creaseness operator

2.2 Creaseness operator 2.2. Creaseness operator 31 2.2 Creaseness operator Antonio López, a member of our group, has studied for his PhD dissertation the differential operators described in this section [72]. He has compared

More information

Binary Image Reconstruction

Binary Image Reconstruction A network flow algorithm for reconstructing binary images from discrete X-rays Kees Joost Batenburg Leiden University and CWI, The Netherlands kbatenbu@math.leidenuniv.nl Abstract We present a new algorithm

More information

Statistical machine learning, high dimension and big data

Statistical machine learning, high dimension and big data Statistical machine learning, high dimension and big data S. Gaïffas 1 14 mars 2014 1 CMAP - Ecole Polytechnique Agenda for today Divide and Conquer principle for collaborative filtering Graphical modelling,

More information

Applications to Data Smoothing and Image Processing I

Applications to Data Smoothing and Image Processing I Applications to Data Smoothing and Image Processing I MA 348 Kurt Bryan Signals and Images Let t denote time and consider a signal a(t) on some time interval, say t. We ll assume that the signal a(t) is

More information

Tracking in flussi video 3D. Ing. Samuele Salti

Tracking in flussi video 3D. Ing. Samuele Salti Seminari XXIII ciclo Tracking in flussi video 3D Ing. Tutors: Prof. Tullio Salmon Cinotti Prof. Luigi Di Stefano The Tracking problem Detection Object model, Track initiation, Track termination, Tracking

More information

Analyzing Facial Expressions for Virtual Conferencing

Analyzing Facial Expressions for Virtual Conferencing IEEE Computer Graphics & Applications, pp. 70-78, September 1998. Analyzing Facial Expressions for Virtual Conferencing Peter Eisert and Bernd Girod Telecommunications Laboratory, University of Erlangen,

More information

Face detection is a process of localizing and extracting the face region from the

Face detection is a process of localizing and extracting the face region from the Chapter 4 FACE NORMALIZATION 4.1 INTRODUCTION Face detection is a process of localizing and extracting the face region from the background. The detected face varies in rotation, brightness, size, etc.

More information

Probabilistic Latent Semantic Analysis (plsa)

Probabilistic Latent Semantic Analysis (plsa) Probabilistic Latent Semantic Analysis (plsa) SS 2008 Bayesian Networks Multimedia Computing, Universität Augsburg Rainer.Lienhart@informatik.uni-augsburg.de www.multimedia-computing.{de,org} References

More information

Template-based Eye and Mouth Detection for 3D Video Conferencing

Template-based Eye and Mouth Detection for 3D Video Conferencing Template-based Eye and Mouth Detection for 3D Video Conferencing Jürgen Rurainsky and Peter Eisert Fraunhofer Institute for Telecommunications - Heinrich-Hertz-Institute, Image Processing Department, Einsteinufer

More information

The Image Deblurring Problem

The Image Deblurring Problem page 1 Chapter 1 The Image Deblurring Problem You cannot depend on your eyes when your imagination is out of focus. Mark Twain When we use a camera, we want the recorded image to be a faithful representation

More information

Simultaneous Gamma Correction and Registration in the Frequency Domain

Simultaneous Gamma Correction and Registration in the Frequency Domain Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University

More information

Image Segmentation and Registration

Image Segmentation and Registration Image Segmentation and Registration Dr. Christine Tanner (tanner@vision.ee.ethz.ch) Computer Vision Laboratory, ETH Zürich Dr. Verena Kaynig, Machine Learning Laboratory, ETH Zürich Outline Segmentation

More information

Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Sample Exam Questions 2007

Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Sample Exam Questions 2007 Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Questions 2007 INSTRUCTIONS: Answer all questions. Spend approximately 1 minute per mark. Question 1 30 Marks Total

More information

3D Model based Object Class Detection in An Arbitrary View

3D Model based Object Class Detection in An Arbitrary View 3D Model based Object Class Detection in An Arbitrary View Pingkun Yan, Saad M. Khan, Mubarak Shah School of Electrical Engineering and Computer Science University of Central Florida http://www.eecs.ucf.edu/

More information

CHAPTER 6 TEXTURE ANIMATION

CHAPTER 6 TEXTURE ANIMATION CHAPTER 6 TEXTURE ANIMATION 6.1. INTRODUCTION Animation is the creating of a timed sequence or series of graphic images or frames together to give the appearance of continuous movement. A collection of

More information

Detecting and Tracking Moving Objects for Video Surveillance

Detecting and Tracking Moving Objects for Video Surveillance IEEE Proc. Computer Vision and Pattern Recognition Jun. 3-5, 1999. Fort Collins CO Detecting and Tracking Moving Objects for Video Surveillance Isaac Cohen Gérard Medioni University of Southern California

More information

Parameter Estimation for Bingham Models

Parameter Estimation for Bingham Models Dr. Volker Schulz, Dmitriy Logashenko Parameter Estimation for Bingham Models supported by BMBF Parameter Estimation for Bingham Models Industrial application of ceramic pastes Material laws for Bingham

More information

Environmental Remote Sensing GEOG 2021

Environmental Remote Sensing GEOG 2021 Environmental Remote Sensing GEOG 2021 Lecture 4 Image classification 2 Purpose categorising data data abstraction / simplification data interpretation mapping for land cover mapping use land cover class

More information

Geometric Camera Parameters

Geometric Camera Parameters Geometric Camera Parameters What assumptions have we made so far? -All equations we have derived for far are written in the camera reference frames. -These equations are valid only when: () all distances

More information

P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition

P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition K. Osypov* (WesternGeco), D. Nichols (WesternGeco), M. Woodward (WesternGeco) & C.E. Yarman (WesternGeco) SUMMARY Tomographic

More information

DETECTION OF PLANAR PATCHES IN HANDHELD IMAGE SEQUENCES

DETECTION OF PLANAR PATCHES IN HANDHELD IMAGE SEQUENCES DETECTION OF PLANAR PATCHES IN HANDHELD IMAGE SEQUENCES Olaf Kähler, Joachim Denzler Friedrich-Schiller-University, Dept. Mathematics and Computer Science, 07743 Jena, Germany {kaehler,denzler}@informatik.uni-jena.de

More information

How To Register Point Sets

How To Register Point Sets Non-rigid point set registration: Coherent Point Drift Andriy Myronenko Xubo Song Miguel Á. Carreira-Perpiñán Department of Computer Science and Electrical Engineering OGI School of Science and Engineering

More information

Motion Analysis for Event Detection and Tracking with a Mobile Omni-Directional Camera

Motion Analysis for Event Detection and Tracking with a Mobile Omni-Directional Camera Motion Analysis for Event Detection and Tracking with a Mobile Omni-Directional Camera Tarak Gandhi Computer Vision and Robotics Research Laboratory University of California San Diego tgandhi@ucsd.edu

More information

Fast and efficient dense variational stereo on GPU

Fast and efficient dense variational stereo on GPU Fast and efficient dense variational stereo on GPU Julien Mairal, Renaud Keriven and Alexandre Chariot CERTIS ENPC 77455 Marne-la-Vallee cedex 2 France julien.mairal@m4x.org, keriven@certis.enpc.fr, chariot@certis.enpc.fr

More information

An Overview Of Software For Convex Optimization. Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.

An Overview Of Software For Convex Optimization. Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt. An Overview Of Software For Convex Optimization Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.edu In fact, the great watershed in optimization isn t between linearity

More information

Quality Estimation for Scalable Video Codec. Presented by Ann Ukhanova (DTU Fotonik, Denmark) Kashaf Mazhar (KTH, Sweden)

Quality Estimation for Scalable Video Codec. Presented by Ann Ukhanova (DTU Fotonik, Denmark) Kashaf Mazhar (KTH, Sweden) Quality Estimation for Scalable Video Codec Presented by Ann Ukhanova (DTU Fotonik, Denmark) Kashaf Mazhar (KTH, Sweden) Purpose of scalable video coding Multiple video streams are needed for heterogeneous

More information

Introduction Epipolar Geometry Calibration Methods Further Readings. Stereo Camera Calibration

Introduction Epipolar Geometry Calibration Methods Further Readings. Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration 12.10.2004 Overview Introduction Summary / Motivation Depth Perception Ambiguity of Correspondence

More information

JPEG Image Compression by Using DCT

JPEG Image Compression by Using DCT International Journal of Computer Sciences and Engineering Open Access Research Paper Volume-4, Issue-4 E-ISSN: 2347-2693 JPEG Image Compression by Using DCT Sarika P. Bagal 1* and Vishal B. Raskar 2 1*

More information

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA N. Zarrinpanjeh a, F. Dadrassjavan b, H. Fattahi c * a Islamic Azad University of Qazvin - nzarrin@qiau.ac.ir

More information

Multi-Modal Acoustic Echo Canceller for Video Conferencing Systems

Multi-Modal Acoustic Echo Canceller for Video Conferencing Systems Multi-Modal Acoustic Echo Canceller for Video Conferencing Systems Mario Gazziro,Guilherme Almeida,Paulo Matias, Hirokazu Tanaka and Shigenobu Minami ICMC/USP, Brazil Email: mariogazziro@usp.br Wernher

More information

Keywords: Image Generation and Manipulation, Video Processing, Video Factorization, Face Morphing

Keywords: Image Generation and Manipulation, Video Processing, Video Factorization, Face Morphing TENSORIAL FACTORIZATION METHODS FOR MANIPULATION OF FACE VIDEOS S. Manikandan, Ranjeeth Kumar, C.V. Jawahar Center for Visual Information Technology International Institute of Information Technology, Hyderabad

More information

Superresolution images reconstructed from aliased images

Superresolution images reconstructed from aliased images Superresolution images reconstructed from aliased images Patrick Vandewalle, Sabine Süsstrunk and Martin Vetterli LCAV - School of Computer and Communication Sciences Ecole Polytechnique Fédérale de Lausanne

More information

DYNAMIC RANGE IMPROVEMENT THROUGH MULTIPLE EXPOSURES. Mark A. Robertson, Sean Borman, and Robert L. Stevenson

DYNAMIC RANGE IMPROVEMENT THROUGH MULTIPLE EXPOSURES. Mark A. Robertson, Sean Borman, and Robert L. Stevenson c 1999 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or

More information

Variational approach to restore point-like and curve-like singularities in imaging

Variational approach to restore point-like and curve-like singularities in imaging Variational approach to restore point-like and curve-like singularities in imaging Daniele Graziani joint work with Gilles Aubert and Laure Blanc-Féraud Roma 12/06/2012 Daniele Graziani (Roma) 12/06/2012

More information