Introduction to Computer Vision for Robotics. Overview. Jan-Michael Frahm
|
|
- Myra Skinner
- 7 years ago
- Views:
Transcription
1 Introduction to Computer Vision for Robotics Jan-Michael Frahm Overview Camera model Multi-view geometr Camera pose estimation Feature tracking & matching Robust pose estimation
2 Homogeneous coordinates e 3 M Unified notation: include origin in affine basis a 3 e 2 o a 2 a Affine basis matri M e a r r r r e e2 e3 o a 2 = a3 Homogeneous Coordinates of M Properties of affine transformation Transformation T affine combines linear mapping and coordinate shift in homogeneous coordinates Linear mapping with A 33 matri coordinate shift with t 3 translation vector A t = = 33 3 M TaffineM M Parallelism is preserved affine = a3 a32 a33 tz ratios of length, area, and volume are preserved Transformations can be concatenated: if M = T M and M = T M M = T T M = T M T a a2 a3 t a a a t
3 Projective geometr Projective space P 2 is space of ras emerging from O view point O forms projection center for all ras ras v emerge from viewpoint into scene ra g is called projective point, defined as scaled v: g=lv w R 3 v = O v g( λ) = = λv, λ R w Projective and homogeneous points Given: Plane Π in R 2 embedded in P 2 at coordinates w= viewing ra g intersects plane at v (homogeneous coordinates) all points on ra g project onto the same homogeneous point v projection of g onto Π is defined b scaling v=g/l = g/w Π (Ρ 2 ) w R 3 g( λ) = λv = λ = w w= v w v = g = = w w O 3
4 Finite and infinite points All ras g that are not parallel to Π intersect at an affine point v on Π. The ra g(w=) does not intersect Π. Hence v is not an affine point but a direction. Directions have the coordinates (,,z,) T Projective space combines affine space with infinite points (directions). P 3 g g g 2 w= Π (Ρ 2 ) v v v2 O v g = Affine and projective transformations Affine transformation leaves infinite points at infinit ' M = TaffineM X a a2 a3 t X a2 a22 a23 t = Z a3 a32 a33 t z Z Projective transformations move infinite points into finite affine space ' M = TprojectiveM p X a a2 a3 t X a a a t = = p λ λ zp Z a3 a32 a33 tz Z w w 4 w42 w43 w44 Eample: Parallel lines intersect at the horizon (line of infinite points). We can see this intersection due to perspective projection! 4
5 Pinhole Camera (Camera obscura) Interior of camera obscura Camera obscura (Sunda Magazine, 838) (France, 83) Pinhole camera model Image sensor aperture Center (c, c ) object View direction Focal length f image lens 5
6 Perspective projection Perspective projection in P 3 models pinhole camera: scene geometr is affine Ρ 3 space with coordinates M=(X,,Z,) T camera focal point in O=(,,,) T, camera viewing direction along Z image plane (,) in Π(Ρ 2 ) aligned with (X,) at Z= Z Scene point M projects onto point M p on plane surface X Z (Optical ais) M = Z Π 3 Π (Ρ 2 ) Z M p O Camera center X Image plane ZX p X Z Z p Z Z Mp = = = ZZ Z Z Z Z Z Z Projective Transformation Projective Transformation maps M onto M p in Ρ 3 space O M p X M ρ ρm p p X X p = TpM ρ = = Z Z Z W z Z ρ = = projective scale factor Z Projective Transformation linearizes projection 6
7 Perspective Projection Dimension reduction from Ρ 3 into Ρ 2 b projection onto Π(Ρ 2 ) Π (Ρ 2 ) O m p X M p p p p p p Z = Z Perspective projection P from Ρ 3 onto Ρ 2 : X Z ρmp = DpTpM = PM ρ =, ρ = Z Z z Image plane and image sensor A sensor with picture elements (Piel) is added onto the image plane Piel coordinates m = (,) T Piel scale f= (f,f ) T Focal length Z Z (Optical ais) Projection center Image center c= (c, c ) T X Image sensor Image-sensor mapping: m = Km p Piel coordinates are related to image coordinates b affine transformation K with five parameters: f s c K = f c Image center c at optical ais distance Z p (focal length) and Piel size determines piel resolution f, f image skew s to model angle between piel rows and columns 7
8 Projection in general pose T cam R C = T P m p Rotation [R] Projection: ρ m = PM p Projection center C M T T R R C Tscene = T cam = T World coordinates Projection matri P Camera projection matri P combines: inverse affine transformation T cam - from general pose to origin Perspective projection P to image plane at Z = affine mapping K from image to sensor coordinates scene pose transformation: T projection: P = = [ I ] scene T T R R C = T f s c sensor calibration: K = f c T T ρm = PM, P = KP Tscene = K R R C 8
9 2-view geometr: F-Matri Projection onto two views: P K R I = [ ] [ ] [ ] ρ m = P M = K R I M ρ m = K R I M ρ M M P Z m O X e m C P K R I C P [ ] [ ] [ ] [ ] = ρ m = PM = K R I C M M = + K R I M K R I C O ρ m = K R R K ρ m K R C ρ m = ρ H m + e H m Epipolar line X X = = + M = M + O Z Z The Fundamental Matri F The projective points e and (H m ) define a plane in camera (epipolar plane Π e ) the epipolar plane intersect the image plane in a line (epipolar line u e ) the corresponding point m lies on that line: m T u e = If the points (e ),(m ),(H m ) are all collinear, then the collinearit theorem applies: (m T e H m ) =. T collinearit of m, e, H m m ( e H m ) = ez e [ e] = ez e e e [ ] F3 3 Fundamental Matri F F = [ e ] H Epipolar constraint T m Fm = 9
10 Estimation of F from correspondences Given a set of corresponding points, solve linearil for the 9 elements of F in projective coordinates since the epipolar constraint is homogeneous up to scale, onl eight elements are independent since the operator [e] and hence F have rank 2, F has onl 7 independent parameters (all epipolar lines intersect at e) each correspondence gives collinearit constraint => solve F with minimum of 7 correspondences for N>7 correspondences minimize distance point-line: N n= T 2 ( m Fm ) min!, n, n m Fm = T i i det( F ) = (Rank 2 constraint) The Essential Matri E F is the most general constraint on an image pair. If the camera calibration matri K is known, then more constraints are available Essential Matri E m T ~ ~ ~ m ~ Fm = E = [ e] T T T ( Km ) F( Km ) = m ( K FK ) R with [ e] = ez e e 4243 E holds the relative orientation of a calibrated camera pair. It has 5 degrees of freedom: 3 from rotation matri R ik, 2 from direction of translation e, the epipole. e z E e e
11 Estimation of P from E From E we can obtain a camera projection matri pair: E=Udiag(,,)V T P =[I 33 3 ] and there are four choices for P : P =[UWV T +u 3 ] or P =[UWV T -u 3 ] or P =[UW T V T +u 3 ] or P =[UW T V T -u 3 ] with W = onl one with 3D point in front of both cameras four possible configurations: 3D Feature Reconstruction corresponding point pair (m, m ) is projected from 3D feature point M M is reconstructed from b (m, m ) triangulation M has minimum distance of intersection P m I m I M d 2 d min! constraints: I d = T I d = T F minimize reprojection error: P ( m P M) + ( m PM) min. 2 2
12 Multi View Tracking 2D match: Image correspondence (m, mi) 3D match: Correspondence transfer (mi, M) via P 3D Pose estimation of Pi with mi - Pi M => min. P m M 3D match m mi P 2D match Pi Minimize lobal reprojection error: N K i = k = m PM k, i i k 2 min! Correspondences matching vs. tracking Image-to-image correspondences are essential to 3D reconstruction KLT-tracker SIFT-matcher Etract features independentl and then match b comparing descriptors [Lowe 24] Etract features in first images and find same feature back in net view [Lucas & Kanade 98], [Shi & Tomasi 994] Small difference between frames potential large difference overall 2
13 SIFT-detector Scale and image-plane-rotation invariant feature descriptor [Lowe 24] SIFT-detector Image content is transformed into local feature coordinates that are invariant to translation, rotation, scale, and other imaging parameters 3
14 Difference of Gaussian for Scale invariance Gaussian Difference of Gaussian Difference-of-Gaussian with constant ratio of scales is a close approimation to Lindeberg s scale-normalized Laplacian [Lindeberg 998] Difference of Gaussian for Scale invariance Difference-of-Gaussian with constant ratio of scales is a close approimation to Lindeberg s scale-normalized Laplacian [Lindeberg 998] 4
15 Blur Subtract Detect maima and minima of difference-of-gaussian in scale space Fit a quadratic to surrounding values for sub-piel and sub-scale interpolation (Brown & Lowe, 22) Talor epansion around point: Ke point localization Offset of etremum (use finite differences for derivatives): Orientation normalization Histogram of local gradient directions computed at selected scale Assign principal orientation at peak of smoothed histogram Each ke specifies stable 2D coordinates (,, scale, orientation) 2π 5
16 Eample of kepoint detection Threshold on value at DOG peak and on ratio of principle curvatures (Harris approach) (a) image (b) 832 DOG etrema (c) 729 left after peak value threshold (d) 536 left after testing ratio of principle curvatures courtes Lowe SIFT vector formation Thresholded image gradients are sampled over 66 arra of locations in scale space Create arra of orientation histograms 8 orientations 44 histogram arra = 28 dimensions eample 22 histogram arra Lowe 6
17 Sift feature detector Robust data selection: RANSAC Estimation of plane from point data {potential plane points} Select m samples Compute n-parameter solution Evaluate on {potential plane points} {inlier samples } Best solution so far? es no Keep it no -(-(#inlier/ {potential plane points} ) n ) steps >.99 Best solution, {inlier}, {outlier} 7
18 RANSAC: Evaluate Hpotheses Evaluate cost function 2 2 c λ ε + c c c λ ε < + c c else if 2λ ε c + c 2 2 λ ε 2 c 2 2 ( + λ ε ) ε 2 ε potential points ε ε ε n ε ε ε n ε ε ε n plane hpotheses ε ε ε n Robust Pose Estimation Calibrated Camera Bootstrap known 3D points {2D-2D correspondences} {2D-3D correspondences} E-RANSAC(5-point algorithm) E Estimate P,P P,P RANSAC(3-point algorithm) P nonlinear refinement with all inliers P nonlinear refinement with all inliers P,P triangulate points 8
19 References [Lowe 24] David Lowe, Distinctive Image Features from Scale- Invariant Kepoints, IJCV, 6(2), 24, pp9- [Lucas & Kanade 98] Bruce D. Lucas and Takeo Kanade. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings International Joint Conference on Artificial Intelligence, 98. [Shi & Tomasi 994] Jianbo Shi and Carlo Tomasi, Good Features to Track, IEEE Conference on Computer Vision and Pattern Recognition 994 [Baker & Matthews 24] S. Baker and I. Matthews, Lucas-Kanade 2 ears On: A Unifing Framework.International Journal of Computer Vision, 56(3):22 255, March 24. [Fischler & Bolles] M.A. Fischler and R.C. Bolles, Random sample consensus: A paradigm for model fitting with applications to image analsis and automated cartograph.cacm, 24(6), June 8. References [Mikolajczk 23], K.Mikolajczk, C.Schmid. A Performance Evaluation of Local Descriptors. CVPR 23 [Lindeberg 998], T. Lindeberg, "Feature detection with automatic scale selection," International Journal of Computer Vision, vol. 3, no. 2, 998 [Hartle 23] R. hartle and A. Zisserman, Multiple View Geometr in Computer Vision, 2 nd edition, Cambridge Press, 23 9
Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.
Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).
More informationFeature Tracking and Optical Flow
02/09/12 Feature Tracking and Optical Flow Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Many slides adapted from Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve
More informationGeometric Camera Parameters
Geometric Camera Parameters What assumptions have we made so far? -All equations we have derived for far are written in the camera reference frames. -These equations are valid only when: () all distances
More informationB4 Computational Geometry
3CG 2006 / B4 Computational Geometry David Murray david.murray@eng.o.ac.uk www.robots.o.ac.uk/ dwm/courses/3cg Michaelmas 2006 3CG 2006 2 / Overview Computational geometry is concerned with the derivation
More information2D Geometrical Transformations. Foley & Van Dam, Chapter 5
2D Geometrical Transformations Fole & Van Dam, Chapter 5 2D Geometrical Transformations Translation Scaling Rotation Shear Matri notation Compositions Homogeneous coordinates 2D Geometrical Transformations
More informationMake and Model Recognition of Cars
Make and Model Recognition of Cars Sparta Cheung Department of Electrical and Computer Engineering University of California, San Diego 9500 Gilman Dr., La Jolla, CA 92093 sparta@ucsd.edu Alice Chu Department
More informationInteractive 3D Scanning Without Tracking
Interactive 3D Scanning Without Tracking Matthew J. Leotta, Austin Vandergon, Gabriel Taubin Brown University Division of Engineering Providence, RI 02912, USA {matthew leotta, aev, taubin}@brown.edu Abstract
More informationMetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH
MetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH VRVis Research Center for Virtual Reality and Visualization, Virtual Habitat, Inffeldgasse
More informationEXPERIMENTAL EVALUATION OF RELATIVE POSE ESTIMATION ALGORITHMS
EXPERIMENTAL EVALUATION OF RELATIVE POSE ESTIMATION ALGORITHMS Marcel Brückner, Ferid Bajramovic, Joachim Denzler Chair for Computer Vision, Friedrich-Schiller-University Jena, Ernst-Abbe-Platz, 7743 Jena,
More informationA Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow
, pp.233-237 http://dx.doi.org/10.14257/astl.2014.51.53 A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow Giwoo Kim 1, Hye-Youn Lim 1 and Dae-Seong Kang 1, 1 Department of electronices
More informationA Learning Based Method for Super-Resolution of Low Resolution Images
A Learning Based Method for Super-Resolution of Low Resolution Images Emre Ugur June 1, 2004 emre.ugur@ceng.metu.edu.tr Abstract The main objective of this project is the study of a learning based method
More informationRotation and Inter interpolation Using Quaternion Representation
This week CENG 732 Computer Animation Spring 2006-2007 Week 2 Technical Preliminaries and Introduction to Keframing Recap from CEng 477 The Displa Pipeline Basic Transformations / Composite Transformations
More informationRelating Vanishing Points to Catadioptric Camera Calibration
Relating Vanishing Points to Catadioptric Camera Calibration Wenting Duan* a, Hui Zhang b, Nigel M. Allinson a a Laboratory of Vision Engineering, University of Lincoln, Brayford Pool, Lincoln, U.K. LN6
More informationIntroduction Epipolar Geometry Calibration Methods Further Readings. Stereo Camera Calibration
Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration Stereo Camera Calibration 12.10.2004 Overview Introduction Summary / Motivation Depth Perception Ambiguity of Correspondence
More informationOptical Tracking Using Projective Invariant Marker Pattern Properties
Optical Tracking Using Projective Invariant Marker Pattern Properties Robert van Liere, Jurriaan D. Mulder Department of Information Systems Center for Mathematics and Computer Science Amsterdam, the Netherlands
More informationCamera geometry and image alignment
Computer Vision and Machine Learning Winter School ENS Lyon 2010 Camera geometry and image alignment Josef Sivic http://www.di.ens.fr/~josef INRIA, WILLOW, ENS/INRIA/CNRS UMR 8548 Laboratoire d Informatique,
More informationFlow Separation for Fast and Robust Stereo Odometry
Flow Separation for Fast and Robust Stereo Odometry Michael Kaess, Kai Ni and Frank Dellaert Abstract Separating sparse flow provides fast and robust stereo visual odometry that deals with nearly degenerate
More informationWii Remote Calibration Using the Sensor Bar
Wii Remote Calibration Using the Sensor Bar Alparslan Yildiz Abdullah Akay Yusuf Sinan Akgul GIT Vision Lab - http://vision.gyte.edu.tr Gebze Institute of Technology Kocaeli, Turkey {yildiz, akay, akgul}@bilmuh.gyte.edu.tr
More informationw = COI EYE view direction vector u = w ( 010,, ) cross product with y-axis v = w u up vector
. w COI EYE view direction vector u w ( 00,, ) cross product with -ais v w u up vector (EQ ) Computer Animation: Algorithms and Techniques 29 up vector view vector observer center of interest 30 Computer
More informationAn Iterative Image Registration Technique with an Application to Stereo Vision
An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract
More informationCS 534: Computer Vision 3D Model-based recognition
CS 534: Computer Vision 3D Model-based recognition Ahmed Elgammal Dept of Computer Science CS 534 3D Model-based Vision - 1 High Level Vision Object Recognition: What it means? Two main recognition tasks:!
More informationProjective Geometry. Projective Geometry
Euclidean versus Euclidean geometry describes sapes as tey are Properties of objects tat are uncanged by rigid motions» Lengts» Angles» Parallelism Projective geometry describes objects as tey appear Lengts,
More informationThe Geometry of Perspective Projection
The Geometry o Perspective Projection Pinhole camera and perspective projection - This is the simplest imaging device which, however, captures accurately the geometry o perspective projection. -Rays o
More informationBuild Panoramas on Android Phones
Build Panoramas on Android Phones Tao Chu, Bowen Meng, Zixuan Wang Stanford University, Stanford CA Abstract The purpose of this work is to implement panorama stitching from a sequence of photos taken
More informationEFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM
EFFICIENT VEHICLE TRACKING AND CLASSIFICATION FOR AN AUTOMATED TRAFFIC SURVEILLANCE SYSTEM Amol Ambardekar, Mircea Nicolescu, and George Bebis Department of Computer Science and Engineering University
More informationLeast-Squares Intersection of Lines
Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a
More informationRandomized Trees for Real-Time Keypoint Recognition
Randomized Trees for Real-Time Keypoint Recognition Vincent Lepetit Pascal Lagger Pascal Fua Computer Vision Laboratory École Polytechnique Fédérale de Lausanne (EPFL) 1015 Lausanne, Switzerland Email:
More informationSolution Guide III-C. 3D Vision. Building Vision for Business. MVTec Software GmbH
Solution Guide III-C 3D Vision MVTec Software GmbH Building Vision for Business Machine vision in 3D world coordinates, Version 10.0.4 All rights reserved. No part of this publication may be reproduced,
More informationTracking in flussi video 3D. Ing. Samuele Salti
Seminari XXIII ciclo Tracking in flussi video 3D Ing. Tutors: Prof. Tullio Salmon Cinotti Prof. Luigi Di Stefano The Tracking problem Detection Object model, Track initiation, Track termination, Tracking
More informationDESIGN & DEVELOPMENT OF AUTONOMOUS SYSTEM TO BUILD 3D MODEL FOR UNDERWATER OBJECTS USING STEREO VISION TECHNIQUE
DESIGN & DEVELOPMENT OF AUTONOMOUS SYSTEM TO BUILD 3D MODEL FOR UNDERWATER OBJECTS USING STEREO VISION TECHNIQUE N. Satish Kumar 1, B L Mukundappa 2, Ramakanth Kumar P 1 1 Dept. of Information Science,
More informationCore Maths C2. Revision Notes
Core Maths C Revision Notes November 0 Core Maths C Algebra... Polnomials: +,,,.... Factorising... Long division... Remainder theorem... Factor theorem... 4 Choosing a suitable factor... 5 Cubic equations...
More informationAutomatic georeferencing of imagery from high-resolution, low-altitude, low-cost aerial platforms
Automatic georeferencing of imagery from high-resolution, low-altitude, low-cost aerial platforms Amanda Geniviva, Jason Faulring and Carl Salvaggio Rochester Institute of Technology, 54 Lomb Memorial
More informationLecture 2: Homogeneous Coordinates, Lines and Conics
Lecture 2: Homogeneous Coordinates, Lines and Conics 1 Homogeneous Coordinates In Lecture 1 we derived the camera equations λx = P X, (1) where x = (x 1, x 2, 1), X = (X 1, X 2, X 3, 1) and P is a 3 4
More informationA Prototype For Eye-Gaze Corrected
A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive
More informationSegmentation of building models from dense 3D point-clouds
Segmentation of building models from dense 3D point-clouds Joachim Bauer, Konrad Karner, Konrad Schindler, Andreas Klaus, Christopher Zach VRVis Research Center for Virtual Reality and Visualization, Institute
More informationFace Model Fitting on Low Resolution Images
Face Model Fitting on Low Resolution Images Xiaoming Liu Peter H. Tu Frederick W. Wheeler Visualization and Computer Vision Lab General Electric Global Research Center Niskayuna, NY, 1239, USA {liux,tu,wheeler}@research.ge.com
More informationA PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA
A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA N. Zarrinpanjeh a, F. Dadrassjavan b, H. Fattahi c * a Islamic Azad University of Qazvin - nzarrin@qiau.ac.ir
More informationRemoving Moving Objects from Point Cloud Scenes
1 Removing Moving Objects from Point Cloud Scenes Krystof Litomisky klitomis@cs.ucr.edu Abstract. Three-dimensional simultaneous localization and mapping is a topic of significant interest in the research
More information4BA6 - Topic 4 Dr. Steven Collins. Chap. 5 3D Viewing and Projections
4BA6 - Topic 4 Dr. Steven Collins Chap. 5 3D Viewing and Projections References Computer graphics: principles & practice, Fole, vandam, Feiner, Hughes, S-LEN 5.644 M23*;-6 (has a good appendix on linear
More information3D Human Face Recognition Using Point Signature
3D Human Face Recognition Using Point Signature Chin-Seng Chua, Feng Han, Yeong-Khing Ho School of Electrical and Electronic Engineering Nanyang Technological University, Singapore 639798 ECSChua@ntu.edu.sg
More informationDistinctive Image Features from Scale-Invariant Keypoints
Distinctive Image Features from Scale-Invariant Keypoints David G. Lowe Computer Science Department University of British Columbia Vancouver, B.C., Canada lowe@cs.ubc.ca January 5, 2004 Abstract This paper
More informationDetecting and positioning overtaking vehicles using 1D optical flow
Detecting and positioning overtaking vehicles using 1D optical flow Daniel Hultqvist 1, Jacob Roll 1, Fredrik Svensson 1, Johan Dahlin 2, and Thomas B. Schön 3 Abstract We are concerned with the problem
More informationAffine Transformations
A P P E N D I X C Affine Transformations CONTENTS C The need for geometric transformations 335 C2 Affine transformations 336 C3 Matri representation of the linear transformations 338 C4 Homogeneous coordinates
More informationIntroduction Feature Estimation Keypoint Detection Keypoints + Features. PCL :: Features. Michael Dixon and Radu B. Rusu
PCL :: Features Michael Dixon and Radu B. Rusu July 1, 2011 Outline 1. Introduction 2. Feature Estimation 3. Keypoint Detection 4. Keypoints + Features Outline 1. Introduction 2. Feature Estimation 3.
More information2-View Geometry. Mark Fiala Ryerson University Mark.fiala@ryerson.ca
CRV 2010 Tutorial Day 2-View Geometry Mark Fiala Ryerson University Mark.fiala@ryerson.ca 3-Vectors for image points and lines Mark Fiala 2010 2D Homogeneous Points Add 3 rd number to a 2D point on image
More informationBildverarbeitung und Mustererkennung Image Processing and Pattern Recognition
Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition 1. Image Pre-Processing - Pixel Brightness Transformation - Geometric Transformation - Image Denoising 1 1. Image Pre-Processing
More informationProbabilistic Latent Semantic Analysis (plsa)
Probabilistic Latent Semantic Analysis (plsa) SS 2008 Bayesian Networks Multimedia Computing, Universität Augsburg Rainer.Lienhart@informatik.uni-augsburg.de www.multimedia-computing.{de,org} References
More informationAccurate and robust image superresolution by neural processing of local image representations
Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica
More informationEpipolar Geometry and Visual Servoing
Epipolar Geometry and Visual Servoing Domenico Prattichizzo joint with with Gian Luca Mariottini and Jacopo Piazzi www.dii.unisi.it/prattichizzo Robotics & Systems Lab University of Siena, Italy Scuoladi
More informationMean-Shift Tracking with Random Sampling
1 Mean-Shift Tracking with Random Sampling Alex Po Leung, Shaogang Gong Department of Computer Science Queen Mary, University of London, London, E1 4NS Abstract In this work, boosting the efficiency of
More informationVision based Vehicle Tracking using a high angle camera
Vision based Vehicle Tracking using a high angle camera Raúl Ignacio Ramos García Dule Shu gramos@clemson.edu dshu@clemson.edu Abstract A vehicle tracking and grouping algorithm is presented in this work
More informationSolving Simultaneous Equations and Matrices
Solving Simultaneous Equations and Matrices The following represents a systematic investigation for the steps used to solve two simultaneous linear equations in two unknowns. The motivation for considering
More informationConvolution. 1D Formula: 2D Formula: Example on the web: http://www.jhu.edu/~signals/convolve/
Basic Filters (7) Convolution/correlation/Linear filtering Gaussian filters Smoothing and noise reduction First derivatives of Gaussian Second derivative of Gaussian: Laplacian Oriented Gaussian filters
More informationHigh-Resolution Multiscale Panoramic Mosaics from Pan-Tilt-Zoom Cameras
High-Resolution Multiscale Panoramic Mosaics from Pan-Tilt-Zoom Cameras Sudipta N. Sinha Marc Pollefeys Seon Joo Kim Department of Computer Science, University of North Carolina at Chapel Hill. Abstract
More informationsiftservice.com - Turning a Computer Vision algorithm into a World Wide Web Service
siftservice.com - Turning a Computer Vision algorithm into a World Wide Web Service Ahmad Pahlavan Tafti 1, Hamid Hassannia 2, and Zeyun Yu 1 1 Department of Computer Science, University of Wisconsin -Milwaukee,
More informationHuman behavior analysis from videos using optical flow
L a b o r a t o i r e I n f o r m a t i q u e F o n d a m e n t a l e d e L i l l e Human behavior analysis from videos using optical flow Yassine Benabbas Directeur de thèse : Chabane Djeraba Multitel
More informationPHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY
PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY V. Knyaz a, *, Yu. Visilter, S. Zheltov a State Research Institute for Aviation System (GosNIIAS), 7, Victorenko str., Moscow, Russia
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical
More informationHow To Analyze Ball Blur On A Ball Image
Single Image 3D Reconstruction of Ball Motion and Spin From Motion Blur An Experiment in Motion from Blur Giacomo Boracchi, Vincenzo Caglioti, Alessandro Giusti Objective From a single image, reconstruct:
More informationGeometric Transformation CS 211A
Geometric Transformation CS 211A What is transformation? Moving points (x,y) moves to (x+t, y+t) Can be in any dimension 2D Image warps 3D 3D Graphics and Vision Can also be considered as a movement to
More information2.1 Three Dimensional Curves and Surfaces
. Three Dimensional Curves and Surfaces.. Parametric Equation of a Line An line in two- or three-dimensional space can be uniquel specified b a point on the line and a vector parallel to the line. The
More informationDynamic composition of tracking primitives for interactive vision-guided navigation
Dynamic composition of tracking primitives for interactive vision-guided navigation Darius Burschka and Gregory Hager Johns Hopkins University, Baltimore, USA ABSTRACT We present a system architecture
More informationLecture 12: Cameras and Geometry. CAP 5415 Fall 2010
Lecture 12: Cameras and Geometry CAP 5415 Fall 2010 The midterm What does the response of a derivative filter tell me about whether there is an edge or not? Things aren't working Did you look at the filters?
More informationLocalization of Mobile Robots Using Odometry and an External Vision Sensor
Sensors 21, 1, 3655-368; doi:1.339/s143655 OPEN ACCESS sensors ISSN 1424-822 www.mdpi.com/journal/sensors Article Localization of Mobile Robots Using Odometry and an External Vision Sensor Daniel Pizarro,
More information3D Arm Motion Tracking for Home-based Rehabilitation
hapter 13 3D Arm Motion Tracking for Home-based Rehabilitation Y. Tao and H. Hu 13.1 Introduction This paper presents a real-time hbrid solution to articulated 3D arm motion tracking for home-based rehabilitation
More informationPCL Tutorial: The Point Cloud Library By Example. Jeff Delmerico. Vision and Perceptual Machines Lab 106 Davis Hall UB North Campus. jad12@buffalo.
PCL Tutorial: The Point Cloud Library By Example Jeff Delmerico Vision and Perceptual Machines Lab 106 Davis Hall UB North Campus jad12@buffalo.edu February 11, 2013 Jeff Delmerico February 11, 2013 1/38
More informationUniversidad de Cantabria Departamento de Tecnología Electrónica, Ingeniería de Sistemas y Automática. Tesis Doctoral
Universidad de Cantabria Departamento de Tecnología Electrónica, Ingeniería de Sistemas y Automática Tesis Doctoral CONTRIBUCIONES AL ALINEAMIENTO DE NUBES DE PUNTOS 3D PARA SU USO EN APLICACIONES DE CAPTURA
More informationSECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA
SECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA This handout presents the second derivative test for a local extrema of a Lagrange multiplier problem. The Section 1 presents a geometric motivation for the
More informationVideo stabilization for high resolution images reconstruction
Advanced Project S9 Video stabilization for high resolution images reconstruction HIMMICH Youssef, KEROUANTON Thomas, PATIES Rémi, VILCHES José. Abstract Super-resolution reconstruction produces one or
More informationTHE problem of visual servoing guiding a robot using
582 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 13, NO. 4, AUGUST 1997 A Modular System for Robust Positioning Using Feedback from Stereo Vision Gregory D. Hager, Member, IEEE Abstract This paper
More informationProjective Reconstruction from Line Correspondences
Projective Reconstruction from Line Correspondences Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Abstract The paper gives a practical rapid algorithm for doing projective reconstruction of a scene
More informationBayesian Image Super-Resolution
Bayesian Image Super-Resolution Michael E. Tipping and Christopher M. Bishop Microsoft Research, Cambridge, U.K..................................................................... Published as: Bayesian
More informationThe use of computer vision technologies to augment human monitoring of secure computing facilities
The use of computer vision technologies to augment human monitoring of secure computing facilities Marius Potgieter School of Information and Communication Technology Nelson Mandela Metropolitan University
More informationReal-Time Camera Tracking Using a Particle Filter
Real-Time Camera Tracking Using a Particle Filter Mark Pupilli and Andrew Calway Department of Computer Science University of Bristol, UK {pupilli,andrew}@cs.bris.ac.uk Abstract We describe a particle
More informationReciprocal Image Features for Uncalibrated Helmholtz Stereopsis
Reciprocal Image Features for Uncalibrated Helmholtz Stereopsis Todd Zickler Division of Engineering and Applied Sciences, Harvard University zickler@eecs.harvard.edu Abstract Helmholtz stereopsis is a
More informationPractical Tour of Visual tracking. David Fleet and Allan Jepson January, 2006
Practical Tour of Visual tracking David Fleet and Allan Jepson January, 2006 Designing a Visual Tracker: What is the state? pose and motion (position, velocity, acceleration, ) shape (size, deformation,
More informationDistance measuring based on stereoscopic pictures
9th International Ph Workshop on Systems and Control: Young Generation Viewpoint 1. - 3. October 8, Izola, Slovenia istance measuring d on stereoscopic pictures Jernej Mrovlje 1 and amir Vrančić Abstract
More informationModel-Based Video Coding Using Colour and Depth Cameras
Model-Based Video Coding Using Colour and Depth Cameras David Sandberg Per-Erik Forsse n Jens Ogniewski Computer Vision Laboratory Department of Electrical Engineering Linko ping University SE-581 83 Linko
More information3D Model based Object Class Detection in An Arbitrary View
3D Model based Object Class Detection in An Arbitrary View Pingkun Yan, Saad M. Khan, Mubarak Shah School of Electrical Engineering and Computer Science University of Central Florida http://www.eecs.ucf.edu/
More informationRobot Perception Continued
Robot Perception Continued 1 Visual Perception Visual Odometry Reconstruction Recognition CS 685 11 Range Sensing strategies Active range sensors Ultrasound Laser range sensor Slides adopted from Siegwart
More informationRECOGNIZING SIMPLE HUMAN ACTIONS USING 3D HEAD MOVEMENT
Computational Intelligence, Volume 23, Number 4, 2007 RECOGNIZING SIMPLE HUMAN ACTIONS USING 3D HEAD MOVEMENT JORGE USABIAGA, GEORGE BEBIS, ALI EROL, AND MIRCEA NICOLESCU Computer Vision Laboratory, University
More information3D Tranformations. CS 4620 Lecture 6. Cornell CS4620 Fall 2013 Lecture 6. 2013 Steve Marschner (with previous instructors James/Bala)
3D Tranformations CS 4620 Lecture 6 1 Translation 2 Translation 2 Translation 2 Translation 2 Scaling 3 Scaling 3 Scaling 3 Scaling 3 Rotation about z axis 4 Rotation about z axis 4 Rotation about x axis
More informationReal-Time Automated Simulation Generation Based on CAD Modeling and Motion Capture
103 Real-Time Automated Simulation Generation Based on CAD Modeling and Motion Capture Wenjuan Zhu, Abhinav Chadda, Ming C. Leu and Xiaoqing F. Liu Missouri University of Science and Technology, zhuwe@mst.edu,
More informationConstrained curve and surface fitting
Constrained curve and surface fitting Simon Flöry FSP-Meeting Strobl (June 20, 2006), floery@geoemtrie.tuwien.ac.at, Vienna University of Technology Overview Introduction Motivation, Overview, Problem
More information2D Geometric Transformations
2D Geometric Transformations (Chapter 5 in FVD) 2D Geometric Transformations Question: How do we represent a geometric object in the plane? Answer: For now, assume that objects consist of points and lines.
More informationPHYSIOLOGICALLY-BASED DETECTION OF COMPUTER GENERATED FACES IN VIDEO
PHYSIOLOGICALLY-BASED DETECTION OF COMPUTER GENERATED FACES IN VIDEO V. Conotter, E. Bodnari, G. Boato H. Farid Department of Information Engineering and Computer Science University of Trento, Trento (ITALY)
More informationMetrics on SO(3) and Inverse Kinematics
Mathematical Foundations of Computer Graphics and Vision Metrics on SO(3) and Inverse Kinematics Luca Ballan Institute of Visual Computing Optimization on Manifolds Descent approach d is a ascent direction
More informationDigital Image Increase
Exploiting redundancy for reliable aerial computer vision 1 Digital Image Increase 2 Images Worldwide 3 Terrestrial Image Acquisition 4 Aerial Photogrammetry 5 New Sensor Platforms Towards Fully Automatic
More informationCommon Core Unit Summary Grades 6 to 8
Common Core Unit Summary Grades 6 to 8 Grade 8: Unit 1: Congruence and Similarity- 8G1-8G5 rotations reflections and translations,( RRT=congruence) understand congruence of 2 d figures after RRT Dilations
More informationEssential Mathematics for Computer Graphics fast
John Vince Essential Mathematics for Computer Graphics fast Springer Contents 1. MATHEMATICS 1 Is mathematics difficult? 3 Who should read this book? 4 Aims and objectives of this book 4 Assumptions made
More informationRobotics. Chapter 25. Chapter 25 1
Robotics Chapter 25 Chapter 25 1 Outline Robots, Effectors, and Sensors Localization and Mapping Motion Planning Motor Control Chapter 25 2 Mobile Robots Chapter 25 3 Manipulators P R R R R R Configuration
More informationMIFT: A Mirror Reflection Invariant Feature Descriptor
MIFT: A Mirror Reflection Invariant Feature Descriptor Xiaojie Guo, Xiaochun Cao, Jiawan Zhang, and Xuewei Li School of Computer Science and Technology Tianjin University, China {xguo,xcao,jwzhang,lixuewei}@tju.edu.cn
More informationGPS-aided Recognition-based User Tracking System with Augmented Reality in Extreme Large-scale Areas
GPS-aided Recognition-based User Tracking System with Augmented Reality in Extreme Large-scale Areas Wei Guan Computer Graphics and Immersive Technologies Computer Science, USC wguan@usc.edu Suya You Computer
More informationMSc in Autonomous Robotics Engineering University of York
MSc in Autonomous Robotics Engineering University of York Practical Robotics Module 2015 A Mobile Robot Navigation System: Labs 1a, 1b, 2a, 2b. Associated lectures: Lecture 1 and lecture 2, given by Nick
More informationEdge detection. (Trucco, Chapt 4 AND Jain et al., Chapt 5) -Edges are significant local changes of intensity in an image.
Edge detection (Trucco, Chapt 4 AND Jain et al., Chapt 5) Definition of edges -Edges are significant local changes of intensity in an image. -Edges typically occur on the boundary between two different
More informationDICOM Correction Item
Correction Number DICOM Correction Item CP-626 Log Summary: Type of Modification Clarification Rationale for Correction Name of Standard PS 3.3 2004 + Sup 83 The description of pixel spacing related attributes
More informationModelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches
Modelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches PhD Thesis by Payam Birjandi Director: Prof. Mihai Datcu Problematic
More informationGeometry: Unit 1 Vocabulary TERM DEFINITION GEOMETRIC FIGURE. Cannot be defined by using other figures.
Geometry: Unit 1 Vocabulary 1.1 Undefined terms Cannot be defined by using other figures. Point A specific location. It has no dimension and is represented by a dot. Line Plane A connected straight path.
More informationAnnouncements. Active stereo with structured light. Project structured light patterns onto the object
Announcements Active stereo with structured light Project 3 extension: Wednesday at noon Final project proposal extension: Friday at noon > consult with Steve, Rick, and/or Ian now! Project 2 artifact
More informationIntegrated Sensor Analysis Tool (I-SAT )
FRONTIER TECHNOLOGY, INC. Advanced Technology for Superior Solutions. Integrated Sensor Analysis Tool (I-SAT ) Core Visualization Software Package Abstract As the technology behind the production of large
More information