Stereo Vision (Correspondences)

Size: px
Start display at page:

Download "Stereo Vision (Correspondences)"

Transcription

1 Stereo Vision (Correspondences) EECS Fall 2014! Foundations of Computer Vision!! Instructor: Jason Corso (jjcorso)! web.eecs.umich.edu/~jjcorso/t/598f14!! Readings: FP 7; SZ 11; TV 7! Date: 10/27/14!! Materials on these slides have come from many sources in addition to myself; individual slides reference specific sources. The primary source for these slides is Silvio Savarese.!

2 Plan 2 Stereo vision! Rectification! Correspondence problem! Active stereo vision systems!

3 Stereo Vision P! p! p! O 1! O 2! Goal: estimate the position of P given the observation of! P from two view points! Assumptions: known camera parameters and position (K, R, T)!

4 Stereo Vision P! p! p! O 1! O 2! Subgoals:! - Solve the correspondence problem! - Use corresponding observations to triangulate!

5 The Correspondence Problem P! p! p! O 1! O 2! Given a point in 3d, discover corresponding observations in left and right images!

6 Triangulation P! p! p! O 1! O 2! Intersecting the two lines of sight gives rise to P!

7 Epipolar Geometry P! p! p! e 1! e 2! Epipolar Plane! Epipoles e 1, e 2! Baseline! Epipolar Lines! O 1! O 2! = intersections of baseline with image planes! = projections of the other camera center!!

8 The Epipolar Constraint p T E p = P! p 1! l 1! l 2! e 1! e 2! p 2! O 1! O 2! E p 2 is the epipolar line associated with p 2 (l 1 = E p 2 )! E T p 1 is the epipolar line associated with p 1 (l 2 = E T p 1 )! E e 2 = 0 and E T e 1 = 0! E is 3x3 matrix; 5 DOF! E is singular (rank two)!!

9 Parallel Image Planes P! p! p! O! O! When views are parallel both correspondence and triangulation become much easier!!

10 Parallel Image Planes P! v! v! e 2! p! p! e 2! y! u! u! z! K! K! O x!! O! Parallel epipolar lines! Epipoles at infinity! v = v! Rectification: making two images parallel!

11 Parallel Image Planes P! v! v! e 2! p! p! e 2! y! u! u! z! K! K! O x!! O! K 1 =K 2 = known! x parallel to O 1 O 2! E =[ t ] R

12 b a b a ] [ = = z y x x y x z y z b b b a a a a a a Cross product as matrix multiplication 12

13 Parallel Image Planes P! v! v! e 2! p! p! e 2! y! u! u! z! K! K! O x!! O! K 1 =K 2 = known! x parallel to O 1 O 2! E = [ t = ] R 0 0 T 0 T 0 v = v?!

14 Parallel Image Planes P! v! v! e 2! p! p! e 2! y! u! u! K! K! O x!! O! uʹ 1 0 Tv ʹ ( u v 1) 0 0 T vʹ = 0 ( u v 1) T = 0 Tv = Tv T z! 0 0 p T E pʹ = 0 ʹ

15 Making Image Planes Parallel P! H! p! p! O! O! GOAL: Estimate the perspective transformation H!! that makes the images parallel!

16 Making the Image Planes Parallel The Projective Transformation H! x i xʹ i x ʹ = H x i i Now we don t have the destination image L!

17 Making the Image Planes Parallel P! H! p! p! O! O! GOAL: Estimate the perspective transformation H that makes images parallel! Impose v =v! This leaves degrees of freedom for determining H! If an inappropriate H is chosen, severe projective distortions on image take place! We impose a number of restrictions while computing H!

18 Making the Image Planes Parallel P K[ I 0] P P! P Kʹ [ R T] P p! p! e! e! O! R,T! O! 0. Compute epipoles! e = e e 1] T = T [ 1 2 K R T eʹ = Kʹ T

19 Making the Image Planes Parallel P! p! p! e! e! O! O! 1. Map e to the x-axis at location [1,0,1] T (normalization)! e = [e T 1 e2 1] [ 1 0 1] T H = R T 1 H H

20 Making the Image Planes Parallel P! p! p! e! 2. Send epipole to infinity:! O! O! H 2 1 = e = [ 1 0 1] T [ 1 0 0] T Minimizes the distortion in a! neighborhood (approximates id. mapping)!

21 Making the Image Planes Parallel P! H = H 2 H 1! e! p! p! e! O! O! 3. Define: H = H 2 H 1! 4. Align epipolar lines!

22 Projective Transformation of a Line H = A v t b l! H T l

23 Making the Image Planes Parallel P! H = H 2 H 1! e! p! l lʹ p! e! O! O! 3. Define: H = H 2 H 1! Hʹ T lʹ = H T l 4. Align epipolar lines! [HZ] Chapters: 11 (sec )! These are called matched pair of transformation!

24 Making the Image Planes Parallel H! Courtesy figure S. Lazebnik!

25 Why is Rectification Useful? Makes the correspondence problem easier! Makes triangulation easy!

26 Application: View Morphing S. M. Seitz and C. R. Dyer, Proc. SIGGRAPH 96, 1996, 21-30!

27 Morphing Without Using Geometry

28 Rectification

29

30 Stereo Vision P! p! p! O 1! O 2! Subgoals:! - Solve the correspondence problem! - Use corresponding observations to triangulate!

31 Computing Depth P! v! v! e 2! p! p! e 2! y! u! u! z! K! K! O x!! O!

32 Computing Depth P z x x f f O Baseline B! O x xʹ = B f z = disparity! Note: Disparity is inversely proportional to depth!

33 Computing Depth X 33 Z! u 2! u 1! c 2! x x 2! 1! c 1! f! T! O 2! O 1!

34 Disparity Maps x! x! Stereo pair! Disparity map / depth map! Disparity map with occlusions!

35 Stereo Vision P! p! p! O 1! O 2! Subgoals:! - Solve the correspondence problem! - Use corresponding observations to triangulate!

36 The Correspondence Problem P! p! p! O 1! O 2! Given a point in 3d, discover corresponding observations! in left and right images [also called binocular fusion problem]!

37 The Correspondence Problem A Cooperative Model (Marr and Poggio, 1976)! Correlation Methods (1970--)! Multi-Scale Edge Matching (Marr, Poggio and Grimson, )!! [FP] Chapters: 8!!

38 Correlation Methods (1970--) p! p! 210! 195! 150! 210!

39 Correlation Methods (1970--) p! Pick up a window around p(u,v)!

40 Correlation Methods (1970--) Pick up a window around p(u,v)! Build vector W! Slide the window along v line in image 2 and compute w! Keep sliding until w w is maximized.!

41 Correlation Methods (1970--) Normalized Correlation; minimize:! (w (w w)(wʹ w)(wʹ w ʹ ) w ʹ )

42 Left! Right! scanline! Credit slide S. Lazebnik! Norm. corr!

43 Correlation Methods Smaller window! - More detail! - More noise! Larger window! - Smoother disparity maps! - Less prone to noise! Window size = 3 Window size = 20 Credit slide S. Lazebnik!

44 Issues Fore shortening effect! O! O! Occlusions! O! O!

45 Issues It is desirable to have small T/z ratio!! Small error in measurements implies large error in estimating depth! O! O!

46 Issues Homogeneous regions! Hard to match pixels in these regions!

47 Issues Repetitive patterns!

48 The Correspondence Problem is Difficult - Occlusions! - Fore shortening! - Baseline trade-off! - Homogeneous regions! - Repetitive patterns! Apply non-local constraints to help enforce the correspondences!

49 Results with window search Data! Ground truth! Window-based matching! Credit slide S. Lazebnik!

50 Improving correspondence: Non-local constraints Uniqueness! For any point in one image, there should be at most one matching point in the other image!

51 Improving correspondence: Non-local constraints Uniqueness! For any point in one image, there should be at most one matching point in the other image! Ordering! Corresponding points should be in the same order in both views! Not always! in presence! of occlusions!! courtesy slide to J. Ponce!

52 Dynamic Programming (Baker and Binford, 1981)! [Uses ordering constraint]! Nodes = matched feature points (e.g., edge points).! Arcs = matched intervals along the epipolar lines.! Arc cost = discrepancy between intervals.!! Find the minimum-cost path going monotonically! down and right from the top-left corner of the! graph to its bottom-right corner.!! courtesy slide to J. Ponce!

53 Dynamic Programming (Baker and Binford, 1981)! courtesy slide to J. Ponce!

54 Dynamic Programming (Ohta and Kanade, 1985)! Reprinted from Stereo by Intra- and Intet-Scanline Search, by Y. Ohta and T. Kanade, IEEE Trans. on Pattern Analysis and Machine! Intelligence, 7(2): (1985) IEEE.!

55 Improving correspondence: Non-local constraints Uniqueness! For any point in one image, there should be at most one matching point in the other image! Ordering! Corresponding points should be in the same order in both views! Smoothness! Disparity is typically a smooth function of x (expect in occluding boundaries)!

56 Smoothness

57 Stereo Matching as Energy Minimization Y. Boykov, O. Veksler, and R. Zabih, Fast Approximate Energy Minimization via Graph Cuts, PAMI 01! I 1 I 2 D W 1 (i ) W 2 (i+d(i )) D(i ) E = α Edata ( I1, I2, D) + β Esmooth ( D) E ( W ( i) W ( i D( i ) 2 + data = 1 2 )) i ( D( i) D( j ) Esmooth = ρ ) neighbors i, j Energy functions of this form can be minimized using graph cuts! Credit slide S. Lazebnik!

58 Stereo Matching as Energy Minimization Y. Boykov, O. Veksler, and R. Zabih, Fast Approximate Energy Minimization via Graph Cuts, PAMI 01! Ground truth! Window-based! matching! Graph cuts!

59 Stereo SDK! stereo vision software development kit.! A. Criminisi, A. Blake and D. Robertson!

60 Application: Foreground/Background Segmentation V. Kolmogorov, A. Criminisi, A. Blake, G. Cross and C. Rother.! Bi-layer segmentation of binocular stereo video CVPR 2005!

61 Application: 3D Urban Scene Modeling 3D Urban Scene Modeling Integrating Recognition and Reconstruction,! N. Cornelis, B. Leibe, K. Cornelis, L. Van Gool, IJCV 08.! Link to movie.!

62 Active Stereo: Point P! p! projector! O 2! Replace one of the two cameras by a projector! - Single camera! - Projector geometry calibrated! - What s the advantage of having the projector?! Correspondence problem solved!

63 Active Stereo: Stripe projector! O! - Projector and camera are parallel! - Correspondence problem solved!!

64 Laser scanning Digital Michelangelo Project Optical triangulation! Project a single stripe of laser light! Scan it across the surface of the object! This is a very precise version of structured light scanning! Source: S. Seitz

65 Laser scanning The Digital Michelangelo Project, Levoy et al.! Source: S. Seitz

66 Active Stereo: Shadows J. Bouguet & P. Perona, 99! Light source! O! - 1 camera,1 light source! - very cheap setup! - calibrated the light source!

67 Active Stereo: Shadows

68 Active Stereo: Color-Coded Stripes L. Zhang, B. Curless, and S. M. Seitz 2002! S. Rusinkiewicz & Levoy 2002! projector! O! - Dense reconstruction! - Correspondence problem again! - Get around it by using color codes!

69 L. Zhang, B. Curless, and S. M. Seitz. Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming. 3DPVT 2002!

70 L. Zhang, B. Curless, and S. M. Seitz. Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming. 3DPVT 2002! Rapid shape acquisition: Projector + stereo cameras!

71 Next Lecture: Affine Structure from Motion 71 Readings: FP 8.1-2; SZ 7!

Announcements. Active stereo with structured light. Project structured light patterns onto the object

Announcements. Active stereo with structured light. Project structured light patterns onto the object Announcements Active stereo with structured light Project 3 extension: Wednesday at noon Final project proposal extension: Friday at noon > consult with Steve, Rick, and/or Ian now! Project 2 artifact

More information

Current status of image matching for Earth observation

Current status of image matching for Earth observation Current status of image matching for Earth observation Christian Heipke IPI - Institute for Photogrammetry and GeoInformation Leibniz Universität Hannover Secretary General, ISPRS Content Introduction

More information

CS635 Spring 2010. Department of Computer Science Purdue University

CS635 Spring 2010. Department of Computer Science Purdue University Structured Light Based Acquisition (Part 1) CS635 Spring 2010 Daniel G Aliaga Daniel G. Aliaga Department of Computer Science Purdue University Passive vs. Active Acquisition Passive + Just take pictures

More information

3D Scanner using Line Laser. 1. Introduction. 2. Theory

3D Scanner using Line Laser. 1. Introduction. 2. Theory . Introduction 3D Scanner using Line Laser Di Lu Electrical, Computer, and Systems Engineering Rensselaer Polytechnic Institute The goal of 3D reconstruction is to recover the 3D properties of a geometric

More information

Feature Tracking and Optical Flow

Feature Tracking and Optical Flow 02/09/12 Feature Tracking and Optical Flow Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Many slides adapted from Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve

More information

A Prototype For Eye-Gaze Corrected

A Prototype For Eye-Gaze Corrected A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive

More information

3D/4D acquisition. 3D acquisition taxonomy 22.10.2014. Computer Vision. Computer Vision. 3D acquisition methods. passive. active.

3D/4D acquisition. 3D acquisition taxonomy 22.10.2014. Computer Vision. Computer Vision. 3D acquisition methods. passive. active. Das Bild kann zurzeit nicht angezeigt werden. 22.10.2014 3D/4D acquisition 3D acquisition taxonomy 3D acquisition methods passive active uni-directional multi-directional uni-directional multi-directional

More information

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R. Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).

More information

ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/

ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/ ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/ Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized

More information

Window-based, discontinuity preserving stereo

Window-based, discontinuity preserving stereo indow-based, discontinuity preserving stereo Motilal Agrawal SRI International 333 Ravenswood Ave. Menlo Park, CA 94025 agrawal@ai.sri.com Larry S. Davis Univ. of Maryland Dept. of Computer Science College

More information

Colorado School of Mines Computer Vision Professor William Hoff

Colorado School of Mines Computer Vision Professor William Hoff Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Introduction to 2 What is? A process that produces from images of the external world a description

More information

Segmentation & Clustering

Segmentation & Clustering EECS 442 Computer vision Segmentation & Clustering Segmentation in human vision K-mean clustering Mean-shift Graph-cut Reading: Chapters 14 [FP] Some slides of this lectures are courtesy of prof F. Li,

More information

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry.

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry. Image-Based Photo Hulls Greg Slabaugh, Ron Schafer Georgia Institute of Technology Center for Signal and Image Processing Atlanta, GA 30332 {slabaugh, rws}@ece.gatech.edu Mat Hans Hewlett-Packard Laboratories

More information

MetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH

MetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH MetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH VRVis Research Center for Virtual Reality and Visualization, Virtual Habitat, Inffeldgasse

More information

Interactive 3D Scanning Without Tracking

Interactive 3D Scanning Without Tracking Interactive 3D Scanning Without Tracking Matthew J. Leotta, Austin Vandergon, Gabriel Taubin Brown University Division of Engineering Providence, RI 02912, USA {matthew leotta, aev, taubin}@brown.edu Abstract

More information

Epipolar Geometry and Visual Servoing

Epipolar Geometry and Visual Servoing Epipolar Geometry and Visual Servoing Domenico Prattichizzo joint with with Gian Luca Mariottini and Jacopo Piazzi www.dii.unisi.it/prattichizzo Robotics & Systems Lab University of Siena, Italy Scuoladi

More information

Automatic Labeling of Lane Markings for Autonomous Vehicles

Automatic Labeling of Lane Markings for Autonomous Vehicles Automatic Labeling of Lane Markings for Autonomous Vehicles Jeffrey Kiske Stanford University 450 Serra Mall, Stanford, CA 94305 jkiske@stanford.edu 1. Introduction As autonomous vehicles become more popular,

More information

2-View Geometry. Mark Fiala Ryerson University Mark.fiala@ryerson.ca

2-View Geometry. Mark Fiala Ryerson University Mark.fiala@ryerson.ca CRV 2010 Tutorial Day 2-View Geometry Mark Fiala Ryerson University Mark.fiala@ryerson.ca 3-Vectors for image points and lines Mark Fiala 2010 2D Homogeneous Points Add 3 rd number to a 2D point on image

More information

ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER

ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER Fatemeh Karimi Nejadasl, Ben G.H. Gorte, and Serge P. Hoogendoorn Institute of Earth Observation and Space System, Delft University

More information

Projection Center Calibration for a Co-located Projector Camera System

Projection Center Calibration for a Co-located Projector Camera System Projection Center Calibration for a Co-located Camera System Toshiyuki Amano Department of Computer and Communication Science Faculty of Systems Engineering, Wakayama University Sakaedani 930, Wakayama,

More information

INTRODUCTION TO RENDERING TECHNIQUES

INTRODUCTION TO RENDERING TECHNIQUES INTRODUCTION TO RENDERING TECHNIQUES 22 Mar. 212 Yanir Kleiman What is 3D Graphics? Why 3D? Draw one frame at a time Model only once X 24 frames per second Color / texture only once 15, frames for a feature

More information

Improvements in Real-Time Correlation-Based Stereo Vision

Improvements in Real-Time Correlation-Based Stereo Vision Improvements in Real-Time Correlation-Based Stereo Vision Heiko Hirschmüller Centre for Computational Intelligence, De Montfort University, Leicester, LE1 9BH, UK, hhm@dmu.ac.uk. Abstract A stereo vision

More information

Introduction Epipolar Geometry Calibration Methods Further Readings. Stereo Camera Calibration

Introduction Epipolar Geometry Calibration Methods Further Readings. Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration 12.10.2004 Overview Introduction Summary / Motivation Depth Perception Ambiguity of Correspondence

More information

Edge tracking for motion segmentation and depth ordering

Edge tracking for motion segmentation and depth ordering Edge tracking for motion segmentation and depth ordering P. Smith, T. Drummond and R. Cipolla Department of Engineering University of Cambridge Cambridge CB2 1PZ,UK {pas1001 twd20 cipolla}@eng.cam.ac.uk

More information

521493S Computer Graphics. Exercise 2 & course schedule change

521493S Computer Graphics. Exercise 2 & course schedule change 521493S Computer Graphics Exercise 2 & course schedule change Course Schedule Change Lecture from Wednesday 31th of March is moved to Tuesday 30th of March at 16-18 in TS128 Question 2.1 Given two nonparallel,

More information

Relating Vanishing Points to Catadioptric Camera Calibration

Relating Vanishing Points to Catadioptric Camera Calibration Relating Vanishing Points to Catadioptric Camera Calibration Wenting Duan* a, Hui Zhang b, Nigel M. Allinson a a Laboratory of Vision Engineering, University of Lincoln, Brayford Pool, Lincoln, U.K. LN6

More information

ACCURACY ASSESSMENT OF BUILDING POINT CLOUDS AUTOMATICALLY GENERATED FROM IPHONE IMAGES

ACCURACY ASSESSMENT OF BUILDING POINT CLOUDS AUTOMATICALLY GENERATED FROM IPHONE IMAGES ACCURACY ASSESSMENT OF BUILDING POINT CLOUDS AUTOMATICALLY GENERATED FROM IPHONE IMAGES B. Sirmacek, R. Lindenbergh Delft University of Technology, Department of Geoscience and Remote Sensing, Stevinweg

More information

Cees Snoek. Machine. Humans. Multimedia Archives. Euvision Technologies The Netherlands. University of Amsterdam The Netherlands. Tree.

Cees Snoek. Machine. Humans. Multimedia Archives. Euvision Technologies The Netherlands. University of Amsterdam The Netherlands. Tree. Visual search: what's next? Cees Snoek University of Amsterdam The Netherlands Euvision Technologies The Netherlands Problem statement US flag Tree Aircraft Humans Dog Smoking Building Basketball Table

More information

Highlight Removal by Illumination-Constrained Inpainting

Highlight Removal by Illumination-Constrained Inpainting Highlight Removal by Illumination-Constrained Inpainting Ping Tan Stephen Lin Long Quan Heung-Yeung Shum Microsoft Research, Asia Hong Kong University of Science and Technology Abstract We present a single-image

More information

Illumination-Invariant Tracking via Graph Cuts

Illumination-Invariant Tracking via Graph Cuts Illumination-Invariant Tracking via Graph Cuts Daniel Freedman and Matthew W. Turek Computer Science Department, Rensselaer Polytechnic Institute, Troy, NY 12180 Abstract Illumination changes are a ubiquitous

More information

A Reliability Point and Kalman Filter-based Vehicle Tracking Technique

A Reliability Point and Kalman Filter-based Vehicle Tracking Technique A Reliability Point and Kalman Filter-based Vehicle Tracing Technique Soo Siang Teoh and Thomas Bräunl Abstract This paper introduces a technique for tracing the movement of vehicles in consecutive video

More information

Dense Matching Methods for 3D Scene Reconstruction from Wide Baseline Images

Dense Matching Methods for 3D Scene Reconstruction from Wide Baseline Images Dense Matching Methods for 3D Scene Reconstruction from Wide Baseline Images Zoltán Megyesi PhD Theses Supervisor: Prof. Dmitry Chetverikov Eötvös Loránd University PhD Program in Informatics Program Director:

More information

How does the Kinect work? John MacCormick

How does the Kinect work? John MacCormick How does the Kinect work? John MacCormick Xbox demo Laptop demo The Kinect uses structured light and machine learning Inferring body position is a two-stage process: first compute a depth map (using structured

More information

VEHICLE LOCALISATION AND CLASSIFICATION IN URBAN CCTV STREAMS

VEHICLE LOCALISATION AND CLASSIFICATION IN URBAN CCTV STREAMS VEHICLE LOCALISATION AND CLASSIFICATION IN URBAN CCTV STREAMS Norbert Buch 1, Mark Cracknell 2, James Orwell 1 and Sergio A. Velastin 1 1. Kingston University, Penrhyn Road, Kingston upon Thames, KT1 2EE,

More information

A Learning Based Method for Super-Resolution of Low Resolution Images

A Learning Based Method for Super-Resolution of Low Resolution Images A Learning Based Method for Super-Resolution of Low Resolution Images Emre Ugur June 1, 2004 emre.ugur@ceng.metu.edu.tr Abstract The main objective of this project is the study of a learning based method

More information

Vision based Vehicle Tracking using a high angle camera

Vision based Vehicle Tracking using a high angle camera Vision based Vehicle Tracking using a high angle camera Raúl Ignacio Ramos García Dule Shu gramos@clemson.edu dshu@clemson.edu Abstract A vehicle tracking and grouping algorithm is presented in this work

More information

Segmentation of building models from dense 3D point-clouds

Segmentation of building models from dense 3D point-clouds Segmentation of building models from dense 3D point-clouds Joachim Bauer, Konrad Karner, Konrad Schindler, Andreas Klaus, Christopher Zach VRVis Research Center for Virtual Reality and Visualization, Institute

More information

The Limits of Human Vision

The Limits of Human Vision The Limits of Human Vision Michael F. Deering Sun Microsystems ABSTRACT A model of the perception s of the human visual system is presented, resulting in an estimate of approximately 15 million variable

More information

Solution Guide III-C. 3D Vision. Building Vision for Business. MVTec Software GmbH

Solution Guide III-C. 3D Vision. Building Vision for Business. MVTec Software GmbH Solution Guide III-C 3D Vision MVTec Software GmbH Building Vision for Business Machine vision in 3D world coordinates, Version 10.0.4 All rights reserved. No part of this publication may be reproduced,

More information

3D Model based Object Class Detection in An Arbitrary View

3D Model based Object Class Detection in An Arbitrary View 3D Model based Object Class Detection in An Arbitrary View Pingkun Yan, Saad M. Khan, Mubarak Shah School of Electrical Engineering and Computer Science University of Central Florida http://www.eecs.ucf.edu/

More information

Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling

Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling , March 13-15, 2013, Hong Kong Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling Naveed Ahmed Abstract We present a system for spatio-temporally

More information

Spatial location in 360 of reference points over an object by using stereo vision

Spatial location in 360 of reference points over an object by using stereo vision EDUCATION Revista Mexicana de Física E 59 (2013) 23 27 JANUARY JUNE 2013 Spatial location in 360 of reference points over an object by using stereo vision V. H. Flores a, A. Martínez a, J. A. Rayas a,

More information

Camera geometry and image alignment

Camera geometry and image alignment Computer Vision and Machine Learning Winter School ENS Lyon 2010 Camera geometry and image alignment Josef Sivic http://www.di.ens.fr/~josef INRIA, WILLOW, ENS/INRIA/CNRS UMR 8548 Laboratoire d Informatique,

More information

Motion Capture Sistemi a marker passivi

Motion Capture Sistemi a marker passivi Motion Capture Sistemi a marker passivi N. Alberto Borghese Laboratory of Human Motion Analysis and Virtual Reality (MAVR) Department of Computer Science University of Milano 1/41 Outline Introduction:

More information

A method of generating free-route walk-through animation using vehicle-borne video image

A method of generating free-route walk-through animation using vehicle-borne video image A method of generating free-route walk-through animation using vehicle-borne video image Jun KUMAGAI* Ryosuke SHIBASAKI* *Graduate School of Frontier Sciences, Shibasaki lab. University of Tokyo 4-6-1

More information

An Iterative Image Registration Technique with an Application to Stereo Vision

An Iterative Image Registration Technique with an Application to Stereo Vision An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract

More information

Lecture 2: Homogeneous Coordinates, Lines and Conics

Lecture 2: Homogeneous Coordinates, Lines and Conics Lecture 2: Homogeneous Coordinates, Lines and Conics 1 Homogeneous Coordinates In Lecture 1 we derived the camera equations λx = P X, (1) where x = (x 1, x 2, 1), X = (X 1, X 2, X 3, 1) and P is a 3 4

More information

Real-Time Automated Simulation Generation Based on CAD Modeling and Motion Capture

Real-Time Automated Simulation Generation Based on CAD Modeling and Motion Capture 103 Real-Time Automated Simulation Generation Based on CAD Modeling and Motion Capture Wenjuan Zhu, Abhinav Chadda, Ming C. Leu and Xiaoqing F. Liu Missouri University of Science and Technology, zhuwe@mst.edu,

More information

Generalized Multi-camera Scene Reconstruction Using Graph Cuts

Generalized Multi-camera Scene Reconstruction Using Graph Cuts Generalized Multi-camera Scene Reconstruction Using Graph Cuts Vladimir Kolmogorov 1,RaminZabih 1, and Steven Gortler 2 1 Computer Science Department, Cornell University, Ithaca, NY 14853 2 Computer Science

More information

T-REDSPEED White paper

T-REDSPEED White paper T-REDSPEED White paper Index Index...2 Introduction...3 Specifications...4 Innovation...6 Technology added values...7 Introduction T-REDSPEED is an international patent pending technology for traffic violation

More information

Robust Pedestrian Detection and Tracking From A Moving Vehicle

Robust Pedestrian Detection and Tracking From A Moving Vehicle Robust Pedestrian Detection and Tracking From A Moving Vehicle Nguyen Xuan Tuong a, Thomas Müller b and Alois Knoll b a Department of Computer Engineering, Nanyang Technological University, Singapore b

More information

Stereo+Kinect for High Resolution Stereo Correspondences

Stereo+Kinect for High Resolution Stereo Correspondences Stereo+Kinect for High Resolution Stereo Correspondences Gowri Somanath University of Delaware gowri@udel.edu Scott Cohen, Brian Price Adobe Research {scohen,bprice}@adobe.com Chandra Kambhamettu University

More information

Objective Functions for Feature Discrimination

Objective Functions for Feature Discrimination Objective Functions for Feature Discrimination Pascal Fua and Andrew J. Hanson* Artificial Intelligence Center SRI International 333 Ravenswood Avenue Menlo Park, California 94025 Abstract We propose and

More information

EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM

EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM Amol Ambardekar, Mircea Nicolescu, and George Bebis Department of Computer Science and Engineering University

More information

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines EECS 556 Image Processing W 09 Interpolation Interpolation techniques B splines What is image processing? Image processing is the application of 2D signal processing methods to images Image representation

More information

Optical Flow. Shenlong Wang CSC2541 Course Presentation Feb 2, 2016

Optical Flow. Shenlong Wang CSC2541 Course Presentation Feb 2, 2016 Optical Flow Shenlong Wang CSC2541 Course Presentation Feb 2, 2016 Outline Introduction Variation Models Feature Matching Methods End-to-end Learning based Methods Discussion Optical Flow Goal: Pixel motion

More information

Terrain Traversability Analysis using Organized Point Cloud, Superpixel Surface Normals-based segmentation and PCA-based Classification

Terrain Traversability Analysis using Organized Point Cloud, Superpixel Surface Normals-based segmentation and PCA-based Classification Terrain Traversability Analysis using Organized Point Cloud, Superpixel Surface Normals-based segmentation and PCA-based Classification Aras Dargazany 1 and Karsten Berns 2 Abstract In this paper, an stereo-based

More information

1. INTRODUCTION Graphics 2

1. INTRODUCTION Graphics 2 1. INTRODUCTION Graphics 2 06-02408 Level 3 10 credits in Semester 2 Professor Aleš Leonardis Slides by Professor Ela Claridge What is computer graphics? The art of 3D graphics is the art of fooling the

More information

COMP175: Computer Graphics. Lecture 1 Introduction and Display Technologies

COMP175: Computer Graphics. Lecture 1 Introduction and Display Technologies COMP175: Computer Graphics Lecture 1 Introduction and Display Technologies Course mechanics Number: COMP 175-01, Fall 2009 Meetings: TR 1:30-2:45pm Instructor: Sara Su (sarasu@cs.tufts.edu) TA: Matt Menke

More information

3D Vehicle Extraction and Tracking from Multiple Viewpoints for Traffic Monitoring by using Probability Fusion Map

3D Vehicle Extraction and Tracking from Multiple Viewpoints for Traffic Monitoring by using Probability Fusion Map Electronic Letters on Computer Vision and Image Analysis 7(2):110-119, 2008 3D Vehicle Extraction and Tracking from Multiple Viewpoints for Traffic Monitoring by using Probability Fusion Map Zhencheng

More information

Geometric Camera Parameters

Geometric Camera Parameters Geometric Camera Parameters What assumptions have we made so far? -All equations we have derived for far are written in the camera reference frames. -These equations are valid only when: () all distances

More information

Shape Measurement of a Sewer Pipe. Using a Mobile Robot with Computer Vision

Shape Measurement of a Sewer Pipe. Using a Mobile Robot with Computer Vision International Journal of Advanced Robotic Systems ARTICLE Shape Measurement of a Sewer Pipe Using a Mobile Robot with Computer Vision Regular Paper Kikuhito Kawasue 1,* and Takayuki Komatsu 1 1 Department

More information

How To Find The Location Of A Building In A Map Of The World

How To Find The Location Of A Building In A Map Of The World Estimating Camera Pose from a Single Urban Ground-View Omnidirectional Image and a 2D Building Outline Map Tat-Jen Cham astjcham@ntu.edu.sg Arridhana Ciptadi carridhana@ntu.edu.sg Wei-Chian Tan wctan@ntu.edu.sg

More information

Image-Based Motion Compensation for Structured Light Scanning of Dynamic Surfaces. Sören König and Stefan Gumhold

Image-Based Motion Compensation for Structured Light Scanning of Dynamic Surfaces. Sören König and Stefan Gumhold Dynamic 3D Imaging (Workshop in Conjunction with DAGM 07) 173 Image-Based Motion Compensation for Structured Light Scanning of Dynamic Surfaces Sören König and Stefan Gumhold TU Dresden, SMT, Department

More information

Digital Image Increase

Digital Image Increase Exploiting redundancy for reliable aerial computer vision 1 Digital Image Increase 2 Images Worldwide 3 Terrestrial Image Acquisition 4 Aerial Photogrammetry 5 New Sensor Platforms Towards Fully Automatic

More information

Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite

Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite Philip Lenz 1 Andreas Geiger 2 Christoph Stiller 1 Raquel Urtasun 3 1 KARLSRUHE INSTITUTE OF TECHNOLOGY 2 MAX-PLANCK-INSTITUTE IS 3

More information

A unified representation for interactive 3D modeling

A unified representation for interactive 3D modeling A unified representation for interactive 3D modeling Dragan Tubić, Patrick Hébert, Jean-Daniel Deschênes and Denis Laurendeau Computer Vision and Systems Laboratory, University Laval, Québec, Canada [tdragan,hebert,laurendeau]@gel.ulaval.ca

More information

Character Image Patterns as Big Data

Character Image Patterns as Big Data 22 International Conference on Frontiers in Handwriting Recognition Character Image Patterns as Big Data Seiichi Uchida, Ryosuke Ishida, Akira Yoshida, Wenjie Cai, Yaokai Feng Kyushu University, Fukuoka,

More information

Differentiation of 3D scanners and their positioning method when applied to pipeline integrity

Differentiation of 3D scanners and their positioning method when applied to pipeline integrity 11th European Conference on Non-Destructive Testing (ECNDT 2014), October 6-10, 2014, Prague, Czech Republic More Info at Open Access Database www.ndt.net/?id=16317 Differentiation of 3D scanners and their

More information

VECTORAL IMAGING THE NEW DIRECTION IN AUTOMATED OPTICAL INSPECTION

VECTORAL IMAGING THE NEW DIRECTION IN AUTOMATED OPTICAL INSPECTION VECTORAL IMAGING THE NEW DIRECTION IN AUTOMATED OPTICAL INSPECTION Mark J. Norris Vision Inspection Technology, LLC Haverhill, MA mnorris@vitechnology.com ABSTRACT Traditional methods of identifying and

More information

Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds

Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds HOPPE, KLOPSCHITZ, DONOSER, BISCHOF: INCREMENTAL SURFACE EXTRACTION 1 Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds Christof Hoppe 1 hoppe@icg.tugraz.at Manfred Klopschitz

More information

Robot Perception Continued

Robot Perception Continued Robot Perception Continued 1 Visual Perception Visual Odometry Reconstruction Recognition CS 685 11 Range Sensing strategies Active range sensors Ultrasound Laser range sensor Slides adopted from Siegwart

More information

Manufacturing Process and Cost Estimation through Process Detection by Applying Image Processing Technique

Manufacturing Process and Cost Estimation through Process Detection by Applying Image Processing Technique Manufacturing Process and Cost Estimation through Process Detection by Applying Image Processing Technique Chalakorn Chitsaart, Suchada Rianmora, Noppawat Vongpiyasatit Abstract In order to reduce the

More information

Self-Calibrated Structured Light 3D Scanner Using Color Edge Pattern

Self-Calibrated Structured Light 3D Scanner Using Color Edge Pattern Self-Calibrated Structured Light 3D Scanner Using Color Edge Pattern Samuel Kosolapov Department of Electrical Engineering Braude Academic College of Engineering Karmiel 21982, Israel e-mail: ksamuel@braude.ac.il

More information

Using Many Cameras as One

Using Many Cameras as One Using Many Cameras as One Robert Pless Department of Computer Science and Engineering Washington University in St. Louis, Box 1045, One Brookings Ave, St. Louis, MO, 63130 pless@cs.wustl.edu Abstract We

More information

PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY

PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY V. Knyaz a, *, Yu. Visilter, S. Zheltov a State Research Institute for Aviation System (GosNIIAS), 7, Victorenko str., Moscow, Russia

More information

Computer vision. 3D Stereo camera Bumblebee. 25 August 2014

Computer vision. 3D Stereo camera Bumblebee. 25 August 2014 Computer vision 3D Stereo camera Bumblebee 25 August 2014 Copyright 2001 2014 by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved Thomas Osinga j.van.de.loosdrecht@nhl.nl, jaap@vdlmv.nl

More information

Optical Tracking Using Projective Invariant Marker Pattern Properties

Optical Tracking Using Projective Invariant Marker Pattern Properties Optical Tracking Using Projective Invariant Marker Pattern Properties Robert van Liere, Jurriaan D. Mulder Department of Information Systems Center for Mathematics and Computer Science Amsterdam, the Netherlands

More information

Limitations of Human Vision. What is computer vision? What is computer vision (cont d)?

Limitations of Human Vision. What is computer vision? What is computer vision (cont d)? What is computer vision? Limitations of Human Vision Slide 1 Computer vision (image understanding) is a discipline that studies how to reconstruct, interpret and understand a 3D scene from its 2D images

More information

DESIGNING A HIGH RESOLUTION 3D IMAGING DEVICE FOR FOOTPRINT AND TIRE TRACK IMPRESSIONS AT CRIME SCENES 1 TR-CIS-0416-12. Ruwan Egoda Gamage

DESIGNING A HIGH RESOLUTION 3D IMAGING DEVICE FOR FOOTPRINT AND TIRE TRACK IMPRESSIONS AT CRIME SCENES 1 TR-CIS-0416-12. Ruwan Egoda Gamage DESIGNING A HIGH RESOLUTION 3D IMAGING DEVICE FOR FOOTPRINT AND TIRE TRACK IMPRESSIONS AT CRIME SCENES 1 TR-CIS-0416-12 Ruwan Egoda Gamage Abhishek Joshi Jiang Yu Zheng Mihran Tuceryan A Technical Report

More information

The goal is multiply object tracking by detection with application on pedestrians.

The goal is multiply object tracking by detection with application on pedestrians. Coupled Detection and Trajectory Estimation for Multi-Object Tracking By B. Leibe, K. Schindler, L. Van Gool Presented By: Hanukaev Dmitri Lecturer: Prof. Daphna Wienshall The Goal The goal is multiply

More information

Surface Curvature from Laser Triangulation Data. John Rugis ELECTRICAL & COMPUTER ENGINEERING

Surface Curvature from Laser Triangulation Data. John Rugis ELECTRICAL & COMPUTER ENGINEERING Surface Curvature from Laser Triangulation Data John Rugis ELECTRICAL & COMPUTER ENGINEERING 1) Laser scan data? Application: Digital archive, preserve, restore. Cultural and scientific heritage. Michelangelo

More information

Projective Geometry. Projective Geometry

Projective Geometry. Projective Geometry Euclidean versus Euclidean geometry describes sapes as tey are Properties of objects tat are uncanged by rigid motions» Lengts» Angles» Parallelism Projective geometry describes objects as tey appear Lengts,

More information

Tracking Densely Moving Markers

Tracking Densely Moving Markers Tracking Densely Moving Markers N. Alberto Borghese and Paolo Rigiroli b) Laboratory of Human Motion Analysis and Virtual Reality (MAVR), Department of Computer Science, University of Milano, Via Comelico

More information

Head-Coupled Perspective

Head-Coupled Perspective Head-Coupled Perspective Introduction Head-Coupled Perspective (HCP) refers to a technique of rendering a scene that takes into account the position of the viewer relative to the display. As a viewer moves

More information

Projective Reconstruction from Line Correspondences

Projective Reconstruction from Line Correspondences Projective Reconstruction from Line Correspondences Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Abstract The paper gives a practical rapid algorithm for doing projective reconstruction of a scene

More information

Affine Object Representations for Calibration-Free Augmented Reality

Affine Object Representations for Calibration-Free Augmented Reality Affine Object Representations for Calibration-Free Augmented Reality Kiriakos N. Kutulakos kyros@cs.rochester.edu James Vallino vallino@cs.rochester.edu Computer Science Department University of Rochester

More information

An Approach for Utility Pole Recognition in Real Conditions

An Approach for Utility Pole Recognition in Real Conditions 6th Pacific-Rim Symposium on Image and Video Technology 1st PSIVT Workshop on Quality Assessment and Control by Image and Video Analysis An Approach for Utility Pole Recognition in Real Conditions Barranco

More information

CS 534: Computer Vision 3D Model-based recognition

CS 534: Computer Vision 3D Model-based recognition CS 534: Computer Vision 3D Model-based recognition Ahmed Elgammal Dept of Computer Science CS 534 3D Model-based Vision - 1 High Level Vision Object Recognition: What it means? Two main recognition tasks:!

More information

3D Vision An enabling Technology for Advanced Driver Assistance and Autonomous Offroad Driving

3D Vision An enabling Technology for Advanced Driver Assistance and Autonomous Offroad Driving 3D Vision An enabling Technology for Advanced Driver Assistance and Autonomous Offroad Driving AIT Austrian Institute of Technology Safety & Security Department Christian Zinner Safe and Autonomous Systems

More information

Measurement of Micro-bathymetry with a GOPRO Underwater Stereo Camera Pair

Measurement of Micro-bathymetry with a GOPRO Underwater Stereo Camera Pair Measurement of Micro-bathymetry with a GOPRO Underwater Stereo Camera Pair Val E. Schmidt and Yuri Rzhanov Center for Coastal and Ocean Mapping University of New Hampshire Durham, NH Abstract A GO-PRO

More information

V-PITS : VIDEO BASED PHONOMICROSURGERY INSTRUMENT TRACKING SYSTEM. Ketan Surender

V-PITS : VIDEO BASED PHONOMICROSURGERY INSTRUMENT TRACKING SYSTEM. Ketan Surender V-PITS : VIDEO BASED PHONOMICROSURGERY INSTRUMENT TRACKING SYSTEM by Ketan Surender A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science (Electrical Engineering)

More information

B2.53-R3: COMPUTER GRAPHICS. NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions.

B2.53-R3: COMPUTER GRAPHICS. NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions. B2.53-R3: COMPUTER GRAPHICS NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions. 2. PART ONE is to be answered in the TEAR-OFF ANSWER

More information

Tracking in flussi video 3D. Ing. Samuele Salti

Tracking in flussi video 3D. Ing. Samuele Salti Seminari XXIII ciclo Tracking in flussi video 3D Ing. Tutors: Prof. Tullio Salmon Cinotti Prof. Luigi Di Stefano The Tracking problem Detection Object model, Track initiation, Track termination, Tracking

More information

Point Cloud Simulation & Applications Maurice Fallon

Point Cloud Simulation & Applications Maurice Fallon Point Cloud & Applications Maurice Fallon Contributors: MIT: Hordur Johannsson and John Leonard U. of Salzburg: Michael Gschwandtner and Roland Kwitt Overview : Dense disparity information Efficient Image

More information

Structured Light Based Reconstruction Under Local Spatial Coherence Assumption

Structured Light Based Reconstruction Under Local Spatial Coherence Assumption Structured Light Based Reconstruction Under Local Spatial Coherence Assumption Hao Li, Raphael Straub, and Hartmut Prautzsch Universita t Karlsruhe (TH) Karlsruhe, Germany {hao,raphael,prau}@ira.uka.de

More information

RIEGL VZ-400 NEW. Laser Scanners. Latest News March 2009

RIEGL VZ-400 NEW. Laser Scanners. Latest News March 2009 Latest News March 2009 NEW RIEGL VZ-400 Laser Scanners The following document details some of the excellent results acquired with the new RIEGL VZ-400 scanners, including: Time-optimised fine-scans The

More information

The Visual Internet of Things System Based on Depth Camera

The Visual Internet of Things System Based on Depth Camera The Visual Internet of Things System Based on Depth Camera Xucong Zhang 1, Xiaoyun Wang and Yingmin Jia Abstract The Visual Internet of Things is an important part of information technology. It is proposed

More information

A Method for Controlling Mouse Movement using a Real- Time Camera

A Method for Controlling Mouse Movement using a Real- Time Camera A Method for Controlling Mouse Movement using a Real- Time Camera Hojoon Park Department of Computer Science Brown University, Providence, RI, USA hojoon@cs.brown.edu Abstract This paper presents a new

More information

BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality

BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality Henry Fuchs University of North Carolina at Chapel Hill (USA) and NSF Science and Technology Center for Computer Graphics and

More information