Latest Results on High-Resolution Reconstruction from Video Sequences
|
|
- Avis Bailey
- 7 years ago
- Views:
Transcription
1 Latest Results on High-Resolution Reconstruction from Video Sequences S. Lertrattanapanich and N. K. Bose The Spatial and Temporal Signal Processing Center Department of Electrical Engineering The Pennsylvania State University, University Park, PA 16802, U.S.A Fax:(814) Abstract A problem of recurring interest involves the construction of a panoramic video mosaic from a video sequence generated from a camera and then obtain high resolution images of regions of interest in the mosaic. The camera motions are estimated by calculating the parameters of a projective model and then superresolution is attained by an algorithm for constructing a high resolution image from undersampled noisy and blurred frames. Research is currently in progress to assess and incorporate robustness to errors in motion parameter estimation of the camera and also the blurring phenomenon. 1 Introduction The classical noise-free image restoration (deconvolution) problem involving the finding of a multidimensional discrete signal s from the linearly blurred observation, g = s h where h denotes a compactly supported blurring operator is ill-posed in the sense that the deconvolution algorithm is not robust to errors in estimating h. On the other hand consider the multiple This research was supported by AFRL Contract F
2 deconvolution problem involving observations g i = s h i, i = 1, 2,..., n resulting from snapshots with multiple camera (a single camera with displacements is not excluded). It has been established [1] that if there exists a set of compactly supported distributions, f i, i = 1, 2,..., n such that n h i f i = δ i, (1) i=1 where δ i is the unit impulse function, then the multiple deconvolution problem is well-posed and the original image is given by n s = g i f i. i=1 In the transform domain Eq. (1) leads to the coprimeness condition, n H i ( )F i ( ) = 1 (2) i=1 where H i and F i are, respectively, the transforms of h i and f i. The preceding condition states that the set {H i } of transforms of the blur operators is devoid of a common zero so that no information about the signal to be reconstructed is lost. Here, a well-posed problem is one for which a unique solution exists and the inverse operator is continuous. Naturally, the single deconvolution problem fails to satisfy both the uniqueness and the continuity conditions. The need to reconstruct a high resolution image from multiple undersampled, blurred and noisy frames occur in many applications including, LANDSAT pictures, medical images, and, more recently, in video, where a resolution higher than that of the cameras (sensors) are required. It involved upsampling (interpolation) of the input sampling lattice as well as the reduction or elimination of aliasing, blurring and noise. Remember that most images contain sharp edges that are not strictly bandlimited and, therefore, digital images suffer from aliasing due to undersampling, loss of highwavenumber detail due to low resolution point-spread function of the sensors and possible blurring due to relative motion, optical aberrations, media turbulence, and a variety of camera motions. Dramatic progress has been documented during the last decade in the area of high resolution image sequence processing that encompasses the stages of image registration or camera motion parameter estimation, 2
3 deblurring and noise reduction (filtering), and upsampling (interpolation) [2], [3], [4], [5], [6], [7], [8], [9], [10], [11]. In this paper, the latest research activity pertaining to the attainment of spatial resolution increase or to get a panoramic mosaic for an acceptable resolution of the scene is reported. Because the video is used as a source of information, the user will get the sequence of images that contain both spatial and temporal information. The number of pixels in each frame is fixed to a known resolution. To generate one big snapshot of the scene which covers all desired areas (panoramic image), one needs to adjust the camera in various ways to capture the effects of zooming, panning, tilting, etc. that may be required for capturing the entire scene. Usually, the resulting picture will suffer from undersampling or low resolution effect because the whole scene has to be represented by the limited number of pixels. Therefore, the bigger the scene, the lower will be the resolution. On the other hand, higher resolution of the scene can be obtained if the camera is zoomed into a specific region. However, in this case the panoramic image will not be obtained. Therefore the trade-off between the size of the scene and its resolution has to be addressed. The idea is to take advantage of the intraframe spatial information alongwith interframe temporal information to create the high resolution panoramic image and then attain superresolution of regions of interest in the mosaic. 2 Models for Camera Motion Parameter There are several models for camera motion parameters. The projective model is widely used. This model is described by the eight parameters m i, i = 1, 2,..., 8 through the matrix equation u m 1 m 2 m 3 x v = m 4 m 5 m 6 y w m 7 m (3) where the transformed spatial coordinates (x, y ) are x = m 1x + m 2 y + m 3 m 7 x + m 8 y + 1 = u w, y = m 4x + m 5 y + m 6 m 7 x + m 8 y + 1 In the model, m 1, m 2, m 4, m 5 represent scaling, rotation, shearing, m 3 and m 6 represent respectively, horizontal and vertical translations while m 7 and m 8 characterize chirping and keystoning (panning, tilting). The assumptions of static scene and absence of parallax are invoked. The projective model = v w (4) 3
4 is derivable from its approximating bilinear model [14] x = q 1 xy + q 2 x + q 3 y + q 4 y = q 5 xy + q 6 x + q 7 y + q 8, (5) whose parameter vector q [q 1 q 2... q 8 ] T is obtained as described below in the subsection on automatic registration. After calculating q, the projective motion parameter vector m [m 1 m 2... m 8 ] T can be obtained by relating Eqs. (4) and (5). 3 Image Registration Image registration is the procedure that is used to estimate the relative motion parameters between two images, the reference image and the current image, by bringing one to coincide with another. In a video sequence, there are more than two images and each successive images I i and I i+1 where i = 1, 2,..., N 1 (N is the number of images in the sequence) can be registered independently. After all motion parameters are estimated, one can stitch the images into a panoramic mosaic. The existing methods for image registration can be categorized into manual and automatic registration. In order to make this paper self-contained, each method will be discussed briefly. 3.1 Manual registration The concept of manual registration is very straightforward. To estimate the eight motion parameters m 1, m 2,..., m 8 in Eq (4), it is necessary to establish at least eight equations by manually selecting at least four pairs of corresponding points, (x i, y i ) and (x i, y i ), i = 1, 2,..., P where P 4, in the reference and the current images, respectively. From Eq. (4), each pair of point (x i, y i ) and (x i, y i ) will give two linear equations which can be written in the generic form x i y i x i x i x i y i m = x i y i 1 y i x i y i y i x i y i. (6) After substituting all pairs of corresponding points into Eq. equations in the compact form (6), one can write the set of linear Am = b (7) 4
5 where the corresponding points are assumed to be such that the (2P 8) matrix A is of full rank. Then the minimum norm least-squares solution is given by m = (A T A) 1 A T b. (8) 3.2 Automatic registration Because the process of manual registration is too tedious to be useful in large scale composition applications, the automatic approach is more suitable in both speed and accuracy. However, the manual registration is more robust than automatic approach. Automatic registrations can be categorized to be either optimization theory based (such as least square method (LSE) [13]) or spatio-temporal derivative and optical flow theory based Optimization theory based method This method directly minimizes the sum of squares of discrepancies in intensities over overlapping pixel locations in a pair of images that are to be registered. The cost funtion is E = i [I (x i, y i ) I(x i, y i )] 2 = i e 2 (9) where (x i, y i ) is given by Eq. (4) and I is the transformed current image with respect to reference image I. To perform the minimization problem, several gradient-based optimization methods could be used. However, the Levenberg-Marquardt iterative non-linear algorithm is recommended by Szeliski [13] because it provides a good balance between speed of convergence and computational complexity. The Levenberg-Marquardt algorithm involves the computation of partial derivatives of e i with respect to each unknown motion parameters m k, k = 1, 2,..., 8 and forms an approximate Hessian matrix A and a weighted gradient vector b. Then the estimated motion parameter vector m can be updated recursively until a preset error criterion is satisfied for local convergence. The detailed implementation could be found in [13] Optical flow based method An optical flow method was proposed by Mann and Picard [14]. The optical flow is the velocity field in the image plane due to the motion of camera and the motion of objects in the scene. The 2-D 5
6 optical flow equation is given by u f E x + v f E y + E t 0. (10) where u f and v f are the flow velocities along x and y directions, respectively and E x, E y, E t are the partial derivatives of I(x, y, t) with respect to x, y, and t, respectively. The goal of this method is to fit model velocities u m and v m into the optical flow equation. Those model velocities are defined by u m = x x and v m = y y (11) where x and y are given in Eq. (4). The cost function is ɛ = x (u m E x + v m E y + E t ) 2. (12) Due to the complexity of the projective model motion parameters, the bilinear model in Eq. (5) can be used as an approximant to the projective model. To minimize ɛ, one differentiates ɛ with respect to each element in the parameter vector q = [q 1 q 2... q 8 ] T and then sets the derivatives to zero. Then the resulting linear system of equations from which q is calculated is ( ) Φ(x, y)φ T (x, y) q = E t Φ(x, y), (13) x,y x,y where Φ(x, y) = [xye x xe x ye y E x xye y xe y ye y E y ] T. 4 Panoramic Video Mosaic After estimating motion parameters of each successive images in the sequence, one gets a set of motion parameter matrices {T i,i+1 : i = 1, 2,..., N 1} where matrix T i,i+1 contains all motion parameters m 1, m 2,..., m 8 of image I i+1 with respect to I i as shown in Eq. (3). This set of motion parameter is called differential motion parameter because it is the parameter between successive images. Next, one needs to select one image in the sequence to be an absolute reference image and then calculates a set of absolute motion parameter matrices for the frames with respect to this chosen absolute reference frame [15]. For example, if the image I r is chosen to be absolute reference image, the absolute motion parameter set will be {T r,i : i = 1, 2,..., N and i r}. It is noted that T r,r is the 3 3 identity matrix. After the absolute motion parameters have been calculated, each image in the sequence can be transformed and aligned with respect to the absolute reference frame. The resulting image is a 6
7 (a) Some frames in Alan Alda sequence. (b) Panoramic video mosaic from Alan Alda sequence. Figure 1: An example of panoramic video mosaic from the Alan Alda sequence. 7
8 panoramic video mosaic. An example of panoramic video mosaic construction will be give next. In Figure 1(a), some images in Alan Alda sequence are shown. Note that this sequence is originally obtained from Mann and Picard [14] which contains 29 frames. In this computer simulation, the authors estimate differential motion parameters using automatic registration based on optical flow method and choose frame 15 to be the absolute reference image. mosaic is shown in Figure 1(b). The resulting panoramic video 5 Superresolution for Region of Interest Since there is a lot of redundant information over the overlapping parts in a panoramic video mosaic, it is possible to improve the resolution of any Region of Interest (ROI) in the panoramic image. The term Superresolution usually has been used for this area of research. It involves the reconstruction of a high resolution image from a sequence of low resolution frames. The superresolution technique can be directly applied to get higher resolution of ROI in the panoramic image. The procedure is summarized as followings: 1. Construct the panoramic video sequence from the sequence of low resolution images. 2. Define any ROI on the panoramic image by selecting appropriate corners of of an enclosing rectangle. 3. Extract the subsequence of low resolution images each of which meets a minimum preset overlap of the chosen ROI or its subset present with the same ROI in a reference frame from the original sequence. 4. Apply the superresolution technique to the subsequence of low resolution ROIs. The earliest work on superresolution was proposed by Tsai and Huang [17] in They used a transform domain method to eliminate the aliasing problem due to undersampling. Their algorithm exploits the aliasing relationship between the continuous and discrete Fourier transforms of the original analog and undersampled image. The main drawbacks of their algorithm involve failure to compensate for blur and noise and the restriction to purely translational motion parameters. Later, Kim, Bose and Valenzuela [2] generalized the work of Tsai and Huang [17] to include filtering simultaneously with interpolation and provided a set of necessary and sufficient conditions for solving a 8
9 Sequence of low resolution images... Image alignment Panoramic video mosaic Image registration... Motion parameters Select two points to define ROI High resolution ROI Supperresolution Extract sequence of ROIs Figure 2: The procedure of superresolution for ROI. structured system of linear equations. Morever, a recursive scheme using the weighted least square algorithm was proposed in [2]. Next, Kim and Su [3] presented the RLMS method for noisy blurred images by using Tikhonov regularization. Subsequently, Bose, Kim, and Valenzuela [4] extended the work in [2] by proposing a recursive total least square algorithm in order to take into accounts both observation error and error in motion parameter estimation. Projection Onto Convex Sets (POCS) is another method that can be used to reconstruct high resolution image. This method exploits the convex sets which represent tight constrains on the required image. POCS-based method was first proposed by Stark and Oskoui [18] and then Tekalp et al. [5] have extended their works by incorporating observation noise into the problem. Later, Patti et al. [6] proposed more a general approach by taking the aperture time into account. Another methodology toward the problem of superresolution is suggested by Elad and Feuer [7]. Their superresolution restoration is modeled by using sparse matrices and the ML (Maximum Likelihood), the MAP (Maximum a Posteriori), and the POCS points of view. They claimed that their algorithm is a unified method which incorporates POCS into the ML or MAP restoration. Recently, they also proposed superresolution restoration based on adaptive filtering [8]. A different approach towards superresolution was suggested by Irani and Peleg [9] [10]. Rather than using the pure translation model, the rigid model (including rotation) was chosen in the image registration process. The iterative back projection algorithm (IBP) was proposed to reconstruct a high resolution image from a sequence of low resolution frames. Recently, this algorithm was directly 9
10 applied by Zomet and Peleg [11] to construct a high resolution panoramic mosaic. A polyphase backprojection algorithm was reported [12]; however, it is restricted only to translational motion parameters. 6 Conclusion A panoramic video mosaic is constructed from a video sequence following the estimation of the projective model motion parameters of the camera. Subsequently, superresolution of any regions of interest (ROI) in the panoramic mosaic is generated from an appropriate subsequence, each of whose elements contain a chosen acceptably significant portion of the ROI. Researach is in progress for incorporating in the superresolution algorithm the property of robustness to errors in motion parameter estimation and the identification of blur parameters [16]. The desired robustness must be considered in conjunction with fast implementation, possibly using filter banks. In the use of the algorithm for superresolution by backprojection, the choice of the backprojection kernel is crucial to convergence and the quality of the solution. This choice ranges from the inverse of the transform of the blur point-spread function (as done here in the simulation) to the square of the blur PSF, assumed to be known, as in [12], where camera motions are restricted to translations. The problem of simultaneously estimating an unknown blur (or even blurs in case of multiple cameras) from the observed sequence and attaining superresolution of a region of interest, ideally in real time, remains to be tackled. References [1] C.A. Berenstein and E.V. Patrick, Exact deconvolution for multiple convolution operators - An overview, plus performance characterizations for imaging sensors, Proceedings of the IEEE, Vol. 78, No.4, April 1990, pp [2] S.P. Kim, N.K. Bose and H.M. Valenzuela, Recursive reconstruction of high resolution image from noisy undersampled multiframes, IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. 38, 1990, pp
11 [3] S.P. Kim and W.Y. Su, Recursive high-resolution reconstruction of blurred multiframe images, IEEE Proceedings on International Conference Acoustics, Speech, and Signal Processing (ICASSP), Toronto, Canada, 1991, pp [4] N.K. Bose, H.C. Kim and H.M. Valenzuela, Recursive total least squares algorithm for image reconstruction from noisy, undersampled frames, Multidimensional Systems and Signal Processing, Vol. 4, 1993, pp [5] A.M. Tekalp, M.K. Ozkan and M.I. Sezan, High-resolution image reconstruction from lowerresolution image sequences and space-varying image restoration, IEEE International Conference Acoustics, Speech, and Signal Processing, Vol. III, San Francisco, CA, March 1992, pp [6] A.J. Patti, M.I. Sezan and A.M. Tekalp, Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time, IEEE Transactions on Image Processing, Vol. 6, No. 8, August 1997, pp [7] M. Elad and A. Feuer, Restoration of single super-resolution image from several blurred, noisy and undersampled measured images, IEEE Transactions on Image Processing, Vol. 6, No. 12, December 1997, pp [8] M. Elad and A. Feuer, Superresolution restoration of an image sequence: Adaptive filtering approach, IEEE Transactions on Image Processing, Vol. 8, No. 3, March 1999, pp [9] M. Irani and S. Peleg, Improving resolution by image registration, CVGIP: Graphical Models and Image Processing, Vol. 53, No. 3, May 1991, pp [10] M. Irani and S. Peleg, Motion analysis for image enhancement: resolution, occlusion, and transpanrency, Journal of Visual Communication and Image Representation, Vol. 4, 1993, pp [11] A. Zomet and S. Peleg, Applying superresolution to panoramic mosaics, IEEE Workshop on Applications of Computer Vision, Princeton, October 1998, pp [12] B. Cohen and I.A. Dinstein, Resolution enhancement by polyphase back-projection filtering, Proceedings of the IEEE Internation Conference on Acoustics, Speech and Signal Processing, Vol. 5, 1998, pp
12 [13] R. Szeliski, Video Mosaics for virtual environments, IEEE Computer Graphics and Applications, Vol. 16, March 1996, pp [14] S. Mann and R.W. Picard, Video orbits of the projective group: A simple approach to featureless estimation of parameters, IEEE Transactions on Image Processing, Vol. 6, No.9, September 1997, pp [15] S. Lertrattanapanich, Image registration for video mosaic, Master s thesis, The Pennsylvania State University, May [16] R.L. Lagendijk and J. Biemond, Iterative identification and restoration of images, Kluwer Academic Publishers, Massachusetts, USA, [17] R.Y. Tsai and T.S. Huang, Multiframe image restoration and registration, Advances in Computer Vision and Image Processing, Vol. 1, 1984, pp [18] H. Stark and P. Oskoui, High resolution image recovery from image-plane arrays using convex projection, J. Opt. Soc. Am. A, Vol.6, 1989, pp
SUPER-RESOLUTION FROM MULTIPLE IMAGES HAVING ARBITRARY MUTUAL MOTION
#! Chapter 2 SUPER-RESOLUTION FROM MULTIPLE IMAGES HAVING ARBITRARY MUTUAL MOTION Assaf Zomet and Shmuel Peleg School of Computer Science and Engineering The Hebrew University of Jerusalem 9190 Jerusalem,
More informationTracking Moving Objects In Video Sequences Yiwei Wang, Robert E. Van Dyck, and John F. Doherty Department of Electrical Engineering The Pennsylvania State University University Park, PA16802 Abstract{Object
More informationSuperresolution images reconstructed from aliased images
Superresolution images reconstructed from aliased images Patrick Vandewalle, Sabine Süsstrunk and Martin Vetterli LCAV - School of Computer and Communication Sciences Ecole Polytechnique Fédérale de Lausanne
More information1646 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 6, NO. 12, DECEMBER 1997
1646 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL 6, NO 12, DECEMBER 1997 Restoration of a Single Superresolution Image from Several Blurred, Noisy, and Undersampled Measured Images Michael Elad and Arie
More informationJoint MAP Registration and High Resolution Image Estimation Using a Sequence of Undersampled Images 1
Joint MAP Registration and High Resolution Image Estimation Using a Sequence of Undersampled Images Russell C. Hardie, Kenneth J. Barnard and Ernest E. Armstrong Department of Electrical and Computer Engineering
More informationSuper-Resolution Imaging : Use of Zoom as a Cue
Super-Resolution Imaging : Use of Zoom as a Cue M.V. Joshi and Subhasis Chaudhuri Department of Electrical Engineering Indian Institute of Technology - Bombay Powai, Mumbai-400076. India mvjoshi, sc@ee.iitb.ac.in
More informationSuper-Resolution from Image Sequences - A Review
Super-Resolution from Image Sequences - A Review Sean Borman, Robert L. Stevenson Department of Electrical Engineering University of Notre Dame Notre Dame, IN 46556, USA sborman@nd.edu Abstract Growing
More informationSUPER RESOLUTION FROM MULTIPLE LOW RESOLUTION IMAGES
SUPER RESOLUTION FROM MULTIPLE LOW RESOLUTION IMAGES ABSTRACT Florin Manaila 1 Costin-Anton Boiangiu 2 Ion Bucur 3 Although the technology of optical instruments is constantly advancing, the capture of
More informationA Novel Method for Brain MRI Super-resolution by Wavelet-based POCS and Adaptive Edge Zoom
A Novel Method for Brain MRI Super-resolution by Wavelet-based POCS and Adaptive Edge Zoom N. Hema Rajini*, R.Bhavani Department of Computer Science and Engineering, Annamalai University, Annamalai Nagar
More informationAccurate and robust image superresolution by neural processing of local image representations
Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica
More informationVideo stabilization for high resolution images reconstruction
Advanced Project S9 Video stabilization for high resolution images reconstruction HIMMICH Youssef, KEROUANTON Thomas, PATIES Rémi, VILCHES José. Abstract Super-resolution reconstruction produces one or
More informationLow-resolution Character Recognition by Video-based Super-resolution
2009 10th International Conference on Document Analysis and Recognition Low-resolution Character Recognition by Video-based Super-resolution Ataru Ohkura 1, Daisuke Deguchi 1, Tomokazu Takahashi 2, Ichiro
More informationA Learning Based Method for Super-Resolution of Low Resolution Images
A Learning Based Method for Super-Resolution of Low Resolution Images Emre Ugur June 1, 2004 emre.ugur@ceng.metu.edu.tr Abstract The main objective of this project is the study of a learning based method
More informationSuper-Resolution Methods for Digital Image and Video Processing
CZECH TECHNICAL UNIVERSITY IN PRAGUE FACULTY OF ELECTRICAL ENGINEERING DEPARTMENT OF RADIOELECTRONICS Super-Resolution Methods for Digital Image and Video Processing DIPLOMA THESIS Author: Bc. Tomáš Lukeš
More informationHigh Quality Image Deblurring Panchromatic Pixels
High Quality Image Deblurring Panchromatic Pixels ACM Transaction on Graphics vol. 31, No. 5, 2012 Sen Wang, Tingbo Hou, John Border, Hong Qin, and Rodney Miller Presented by Bong-Seok Choi School of Electrical
More informationRESOLUTION IMPROVEMENT OF DIGITIZED IMAGES
Proceedings of ALGORITMY 2005 pp. 270 279 RESOLUTION IMPROVEMENT OF DIGITIZED IMAGES LIBOR VÁŠA AND VÁCLAV SKALA Abstract. A quick overview of preprocessing performed by digital still cameras is given
More informationMachine Learning in Multi-frame Image Super-resolution
Machine Learning in Multi-frame Image Super-resolution Lyndsey C. Pickup Robotics Research Group Department of Engineering Science University of Oxford Michaelmas Term, 2007 Lyndsey C. Pickup Doctor of
More informationExtracting a Good Quality Frontal Face Images from Low Resolution Video Sequences
Extracting a Good Quality Frontal Face Images from Low Resolution Video Sequences Pritam P. Patil 1, Prof. M.V. Phatak 2 1 ME.Comp, 2 Asst.Professor, MIT, Pune Abstract The face is one of the important
More informationHigh Quality Image Magnification using Cross-Scale Self-Similarity
High Quality Image Magnification using Cross-Scale Self-Similarity André Gooßen 1, Arne Ehlers 1, Thomas Pralow 2, Rolf-Rainer Grigat 1 1 Vision Systems, Hamburg University of Technology, D-21079 Hamburg
More informationAn Iterative Image Registration Technique with an Application to Stereo Vision
An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract
More informationHigh Resolution Images from a Sequence of Low Resolution Observations
High Resolution Images from a Sequence of Low Resolution Observations L. D. Alvarez, R. Molina Department of Computer Science and A.I. University of Granada, 18071 Granada, Spain. A. K. Katsaggelos Department
More informationSimultaneous Gamma Correction and Registration in the Frequency Domain
Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University
More informationFAST REGISTRATION METHODS FOR SUPER-RESOLUTION IMAGING. Jari Hannuksela, Jarno Väyrynen, Janne Heikkilä and Pekka Sangi
FAST REGISTRATION METHODS FOR SUPER-RESOLUTION IMAGING Jari Hannuksela, Jarno Väyrynen, Janne Heikkilä and Pekka Sangi Machine Vision Group, Infotech Oulu Department of Electrical and Information Engineering
More informationImage super-resolution: Historical overview and future challenges
1 Image super-resolution: Historical overview and future challenges Jianchao Yang University of Illinois at Urbana-Champaign Thomas Huang University of Illinois at Urbana-Champaign CONTENTS 1.1 Introduction
More informationComputational Optical Imaging - Optique Numerique. -- Deconvolution --
Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method
More informationPerformance Verification of Super-Resolution Image Reconstruction
Performance Verification of Super-Resolution Image Reconstruction Masaki Sugie Department of Information Science, Kogakuin University Tokyo, Japan Email: em13010@ns.kogakuin.ac.jp Seiichi Gohshi Department
More informationMANY problems require finding the coordinate transformation
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 6, NO. 9, SEPTEMBER 1997 1281 Video Orbits of the Projective Group: A Simple Approach to Featureless Estimation of Parameters Steve Mann, Member, IEEE, and Rosalind
More informationResolving Objects at Higher Resolution from a Single Motion-blurred Image
Resolving Objects at Higher Resolution from a Single Motion-blurred Image Amit Agrawal and Ramesh Raskar Mitsubishi Electric Research Labs (MERL) 201 Broadway, Cambridge, MA, USA 02139 [agrawal,raskar]@merl.com
More informationHow To Analyze Ball Blur On A Ball Image
Single Image 3D Reconstruction of Ball Motion and Spin From Motion Blur An Experiment in Motion from Blur Giacomo Boracchi, Vincenzo Caglioti, Alessandro Giusti Objective From a single image, reconstruct:
More informationBayesian Image Super-Resolution
Bayesian Image Super-Resolution Michael E. Tipping and Christopher M. Bishop Microsoft Research, Cambridge, U.K..................................................................... Published as: Bayesian
More informationChapter 1 Simultaneous demosaicing and resolution enhancement from under-sampled image sequences
Chapter Simultaneous demosaicing and resolution enhancement from under-sampled image sequences SINA FARSIU Duke University Eye Center Durham, NC Email: sina.farsiu@duke.edu DIRK ROBINSON Ricoh Innovations
More informationROBUST COLOR JOINT MULTI-FRAME DEMOSAICING AND SUPER- RESOLUTION ALGORITHM
ROBUST COLOR JOINT MULTI-FRAME DEMOSAICING AND SUPER- RESOLUTION ALGORITHM Theodor Heinze Hasso-Plattner-Institute for Software Systems Engineering Prof.-Dr.-Helmert-Str. 2-3, 14482 Potsdam, Germany theodor.heinze@hpi.uni-potsdam.de
More informationA Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution
Hindawi Publishing Corporation EURASIP Journal on Applied Signal Processing Volume 2006, Article ID 71459, Pages 1 14 DOI 10.1155/ASP/2006/71459 A Frequency Domain Approach to Registration of Aliased Images
More informationTime Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication
Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Thomas Reilly Data Physics Corporation 1741 Technology Drive, Suite 260 San Jose, CA 95110 (408) 216-8440 This paper
More informationSuper-resolution Reconstruction Algorithm Based on Patch Similarity and Back-projection Modification
1862 JOURNAL OF SOFTWARE, VOL 9, NO 7, JULY 214 Super-resolution Reconstruction Algorithm Based on Patch Similarity and Back-projection Modification Wei-long Chen Digital Media College, Sichuan Normal
More informationA Reliability Point and Kalman Filter-based Vehicle Tracking Technique
A Reliability Point and Kalman Filter-based Vehicle Tracing Technique Soo Siang Teoh and Thomas Bräunl Abstract This paper introduces a technique for tracing the movement of vehicles in consecutive video
More informationLimitation of Super Resolution Image Reconstruction for Video
2013 Fifth International Conference on Computational Intelligence, Communication Systems and Networks Limitation of Super Resolution Image Reconstruction for Video Seiichi Gohshi Kogakuin University Tokyo,
More informationBildverarbeitung und Mustererkennung Image Processing and Pattern Recognition
Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition 1. Image Pre-Processing - Pixel Brightness Transformation - Geometric Transformation - Image Denoising 1 1. Image Pre-Processing
More informationSUPER-RESOLUTION IMAGE RECONSTRUCTION FROM ALIASED FLIR IMAGERY
SUPER-RESOLUTION IMAGE RECONSTRUCTION FROM ALIASED FLIR IMAGERY S. Susan Young Army Research Laboratory, Adelphi, MD 0783 USA Ronald G. Driggers Night Vision & Electronic Sensors Directorate, Fort Belvoir,
More informationAn MRF-Based Approach to Generation of Super-Resolution Images from Blurred Observations
Journal of Mathematical Imaging and Vision 16: 5 15, 2002 c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. An MRF-Based Approach to Generation of Super-Resolution Images from Blurred
More informationTwo-Frame Motion Estimation Based on Polynomial Expansion
Two-Frame Motion Estimation Based on Polynomial Expansion Gunnar Farnebäck Computer Vision Laboratory, Linköping University, SE-581 83 Linköping, Sweden gf@isy.liu.se http://www.isy.liu.se/cvl/ Abstract.
More informationJitter-Camera: High Resolution Video from a Low Resolution Detector
Images in this paper are best viewed magnified or printed on a high resolution color printer. Jitter-Camera: High Resolution Video from a Low Resolution Detector Moshe Ben-Ezra, Assaf Zomet, and Shree
More informationNumerical Methods For Image Restoration
Numerical Methods For Image Restoration CIRAM Alessandro Lanza University of Bologna, Italy Faculty of Engineering CIRAM Outline 1. Image Restoration as an inverse problem 2. Image degradation models:
More informationFeature Tracking and Optical Flow
02/09/12 Feature Tracking and Optical Flow Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Many slides adapted from Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve
More informationEECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines
EECS 556 Image Processing W 09 Interpolation Interpolation techniques B splines What is image processing? Image processing is the application of 2D signal processing methods to images Image representation
More informationImage Super-Resolution for Improved Automatic Target Recognition
Image Super-Resolution for Improved Automatic Target Recognition Raymond S. Wagner a and Donald Waagen b and Mary Cassabaum b a Rice University, Houston, TX b Raytheon Missile Systems, Tucson, AZ ABSTRACT
More informationA PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA
A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA N. Zarrinpanjeh a, F. Dadrassjavan b, H. Fattahi c * a Islamic Azad University of Qazvin - nzarrin@qiau.ac.ir
More informationA Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow
, pp.233-237 http://dx.doi.org/10.14257/astl.2014.51.53 A Study on SURF Algorithm and Real-Time Tracking Objects Using Optical Flow Giwoo Kim 1, Hye-Youn Lim 1 and Dae-Seong Kang 1, 1 Department of electronices
More informationBy choosing to view this document, you agree to all provisions of the copyright laws protecting it.
This material is posted here with permission of the IEEE Such permission of the IEEE does not in any way imply IEEE endorsement of any of Helsinki University of Technology's products or services Internal
More informationSuper-Resolution Reconstruction in MRI: Better Images Faster?
Super-Resolution Reconstruction in MRI: Better Images Faster? Esben Plenge 1,, Dirk H. J. Poot 1, Monique Bernsen 2, Gyula Kotek 2, Gavin Houston 2, Piotr Wielopolski 2, Louise van der Weerd 3, Wiro J.
More informationThe Scientific Data Mining Process
Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In
More informationThe Image Deblurring Problem
page 1 Chapter 1 The Image Deblurring Problem You cannot depend on your eyes when your imagination is out of focus. Mark Twain When we use a camera, we want the recorded image to be a faithful representation
More informationParameter Estimation in Bayesian High-Resolution Image Reconstruction With Multisensors
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL 12, NO 12, DECEMBER 2003 1655 Parameter Estimation in Bayesian High-Resolution Image Reconstruction With Multisensors Rafael Molina, Member, IEEE, Miguel Vega,
More informationRSA algorithm for blurred on blinded deconvolution technique
RSA algorithm for blurred on technique *Kirti Bhadauria 1, *U. Dutta 2, **Priyank gupta 3 *Computer Science and Engineering Department, Maharana Pratap College of technology Putli Ghar Road, Near Collectorate,
More informationAlgorithms for the resizing of binary and grayscale images using a logical transform
Algorithms for the resizing of binary and grayscale images using a logical transform Ethan E. Danahy* a, Sos S. Agaian b, Karen A. Panetta a a Dept. of Electrical and Computer Eng., Tufts University, 161
More informationROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER
ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER Fatemeh Karimi Nejadasl, Ben G.H. Gorte, and Serge P. Hoogendoorn Institute of Earth Observation and Space System, Delft University
More informationResolution Enhancement of Photogrammetric Digital Images
DICTA2002: Digital Image Computing Techniques and Applications, 21--22 January 2002, Melbourne, Australia 1 Resolution Enhancement of Photogrammetric Digital Images John G. FRYER and Gabriele SCARMANA
More informationjorge s. marques image processing
image processing images images: what are they? what is shown in this image? What is this? what is an image images describe the evolution of physical variables (intensity, color, reflectance, condutivity)
More informationSachin Patel HOD I.T Department PCST, Indore, India. Parth Bhatt I.T Department, PCST, Indore, India. Ankit Shah CSE Department, KITE, Jaipur, India
Image Enhancement Using Various Interpolation Methods Parth Bhatt I.T Department, PCST, Indore, India Ankit Shah CSE Department, KITE, Jaipur, India Sachin Patel HOD I.T Department PCST, Indore, India
More informationSuper-resolution method based on edge feature for high resolution imaging
Science Journal of Circuits, Systems and Signal Processing 2014; 3(6-1): 24-29 Published online December 26, 2014 (http://www.sciencepublishinggroup.com/j/cssp) doi: 10.11648/j.cssp.s.2014030601.14 ISSN:
More informationSuper-Resolution from a Single Image
Super-Resolution from a Single Image Daniel Glasner Shai Bagon Michal Irani Dept. of Computer Science and Applied Mathematics The Weizmann Institute of Science Rehovot 76100, Israel Abstract Methods for
More informationHigh Resolution Image Reconstruction From a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System
High Resolution Image Reconstruction From a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System Russell C. Hardie a, Kenneth J. Barnard b, John G. Bognar c, Ernest
More informationEpipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.
Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).
More informationPoint Lattices in Computer Graphics and Visualization how signal processing may help computer graphics
Point Lattices in Computer Graphics and Visualization how signal processing may help computer graphics Dimitri Van De Ville Ecole Polytechnique Fédérale de Lausanne Biomedical Imaging Group dimitri.vandeville@epfl.ch
More informationAutomatic Restoration Algorithms for 35mm film
P. Schallauer, A. Pinz, W. Haas. Automatic Restoration Algorithms for 35mm film. To be published in Videre, Journal of Computer Vision Research, web: http://mitpress.mit.edu/videre.html, 1999. Automatic
More informationHow To Fix Out Of Focus And Blur Images With A Dynamic Template Matching Algorithm
IJSTE - International Journal of Science Technology & Engineering Volume 1 Issue 10 April 2015 ISSN (online): 2349-784X Image Estimation Algorithm for Out of Focus and Blur Images to Retrieve the Barcode
More informationFace Model Fitting on Low Resolution Images
Face Model Fitting on Low Resolution Images Xiaoming Liu Peter H. Tu Frederick W. Wheeler Visualization and Computer Vision Lab General Electric Global Research Center Niskayuna, NY, 1239, USA {liux,tu,wheeler}@research.ge.com
More informationBlind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections
Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Maximilian Hung, Bohyun B. Kim, Xiling Zhang August 17, 2013 Abstract While current systems already provide
More informationVision based Vehicle Tracking using a high angle camera
Vision based Vehicle Tracking using a high angle camera Raúl Ignacio Ramos García Dule Shu gramos@clemson.edu dshu@clemson.edu Abstract A vehicle tracking and grouping algorithm is presented in this work
More informationDiscrete Curvelet Transform Based Super-resolution using Sub-pixel Image Registration
Vol. 4, No., June, 0 Discrete Curvelet Transform Based Super-resolution using Sub-pixel Image Registration Anil A. Patil, Dr. Jyoti Singhai Department of Electronics and Telecomm., COE, Malegaon(Bk), Pune,
More informationA System for Capturing High Resolution Images
A System for Capturing High Resolution Images G.Voyatzis, G.Angelopoulos, A.Bors and I.Pitas Department of Informatics University of Thessaloniki BOX 451, 54006 Thessaloniki GREECE e-mail: pitas@zeus.csd.auth.gr
More informationWii Remote Calibration Using the Sensor Bar
Wii Remote Calibration Using the Sensor Bar Alparslan Yildiz Abdullah Akay Yusuf Sinan Akgul GIT Vision Lab - http://vision.gyte.edu.tr Gebze Institute of Technology Kocaeli, Turkey {yildiz, akay, akgul}@bilmuh.gyte.edu.tr
More informationLow-resolution Image Processing based on FPGA
Abstract Research Journal of Recent Sciences ISSN 2277-2502. Low-resolution Image Processing based on FPGA Mahshid Aghania Kiau, Islamic Azad university of Karaj, IRAN Available online at: www.isca.in,
More informationObject tracking & Motion detection in video sequences
Introduction Object tracking & Motion detection in video sequences Recomended link: http://cmp.felk.cvut.cz/~hlavac/teachpresen/17compvision3d/41imagemotion.pdf 1 2 DYNAMIC SCENE ANALYSIS The input to
More informationHigh Resolution Images from Low Resolution Video Sequences
High Resolution Images from Low Resolution Video Sequences Federico Cristina fcristina@lidi.info.unlp.edu.ar - Ayudante Diplomado UNLP Sebastián Dapoto sdapoto@lidi.info.unlp.edu.ar - Becario III-LIDI
More informationMean-Shift Tracking with Random Sampling
1 Mean-Shift Tracking with Random Sampling Alex Po Leung, Shaogang Gong Department of Computer Science Queen Mary, University of London, London, E1 4NS Abstract In this work, boosting the efficiency of
More informationNEIGHBORHOOD REGRESSION FOR EDGE-PRESERVING IMAGE SUPER-RESOLUTION. Yanghao Li, Jiaying Liu, Wenhan Yang, Zongming Guo
NEIGHBORHOOD REGRESSION FOR EDGE-PRESERVING IMAGE SUPER-RESOLUTION Yanghao Li, Jiaying Liu, Wenhan Yang, Zongming Guo Institute of Computer Science and Technology, Peking University, Beijing, P.R.China,
More informationVEHICLE TRACKING USING ACOUSTIC AND VIDEO SENSORS
VEHICLE TRACKING USING ACOUSTIC AND VIDEO SENSORS Aswin C Sankaranayanan, Qinfen Zheng, Rama Chellappa University of Maryland College Park, MD - 277 {aswch, qinfen, rama}@cfar.umd.edu Volkan Cevher, James
More informationAdvanced Signal Processing and Digital Noise Reduction
Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New
More informationWhite paper. H.264 video compression standard. New possibilities within video surveillance.
White paper H.264 video compression standard. New possibilities within video surveillance. Table of contents 1. Introduction 3 2. Development of H.264 3 3. How video compression works 4 4. H.264 profiles
More informationSection for Cognitive Systems DTU Informatics, Technical University of Denmark
Transformation Invariant Sparse Coding Morten Mørup & Mikkel N Schmidt Morten Mørup & Mikkel N. Schmidt Section for Cognitive Systems DTU Informatics, Technical University of Denmark Redundancy Reduction
More informationMediated Reality using Computer Graphics Hardware for Computer Vision
Mediated Reality using Computer Graphics Hardware for Computer Vision James Fung, Felix Tang and Steve Mann University of Toronto, Dept. of Electrical and Computer Engineering 10 King s College Road, Toronto,
More informationFinal Year Project Progress Report. Frequency-Domain Adaptive Filtering. Myles Friel. Supervisor: Dr.Edward Jones
Final Year Project Progress Report Frequency-Domain Adaptive Filtering Myles Friel 01510401 Supervisor: Dr.Edward Jones Abstract The Final Year Project is an important part of the final year of the Electronic
More informationLecture 14. Point Spread Function (PSF)
Lecture 14 Point Spread Function (PSF), Modulation Transfer Function (MTF), Signal-to-noise Ratio (SNR), Contrast-to-noise Ratio (CNR), and Receiver Operating Curves (ROC) Point Spread Function (PSF) Recollect
More informationEdge tracking for motion segmentation and depth ordering
Edge tracking for motion segmentation and depth ordering P. Smith, T. Drummond and R. Cipolla Department of Engineering University of Cambridge Cambridge CB2 1PZ,UK {pas1001 twd20 cipolla}@eng.cam.ac.uk
More informationDetecting and Tracking Moving Objects for Video Surveillance
IEEE Proc. Computer Vision and Pattern Recognition Jun. 3-5, 1999. Fort Collins CO Detecting and Tracking Moving Objects for Video Surveillance Isaac Cohen Gérard Medioni University of Southern California
More informationFalse alarm in outdoor environments
Accepted 1.0 Savantic letter 1(6) False alarm in outdoor environments Accepted 1.0 Savantic letter 2(6) Table of contents Revision history 3 References 3 1 Introduction 4 2 Pre-processing 4 3 Detection,
More informationMetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH
MetropoGIS: A City Modeling System DI Dr. Konrad KARNER, DI Andreas KLAUS, DI Joachim BAUER, DI Christopher ZACH VRVis Research Center for Virtual Reality and Visualization, Virtual Habitat, Inffeldgasse
More informationIntroduction to Robotics Analysis, Systems, Applications
Introduction to Robotics Analysis, Systems, Applications Saeed B. Niku Mechanical Engineering Department California Polytechnic State University San Luis Obispo Technische Urw/carsMt Darmstadt FACHBEREfCH
More informationRedundant Wavelet Transform Based Image Super Resolution
Redundant Wavelet Transform Based Image Super Resolution Arti Sharma, Prof. Preety D Swami Department of Electronics &Telecommunication Samrat Ashok Technological Institute Vidisha Department of Electronics
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical
More informationApplications to Data Smoothing and Image Processing I
Applications to Data Smoothing and Image Processing I MA 348 Kurt Bryan Signals and Images Let t denote time and consider a signal a(t) on some time interval, say t. We ll assume that the signal a(t) is
More informationSuper-Resolution Imaging Applied to Moving Targets in High Dynamic Scenes
Super-Resolution Imaging Applied to Moving Targets in High Dynamic Scenes Olegs Mise *a, Toby P. Breckon b a GE Intelligent Platforms Applied Image Processing, Billerica, USA, e-mail: olegs.mise@ge.com,
More informationSynchronization of sampling in distributed signal processing systems
Synchronization of sampling in distributed signal processing systems Károly Molnár, László Sujbert, Gábor Péceli Department of Measurement and Information Systems, Budapest University of Technology and
More informationDYNAMIC RANGE IMPROVEMENT THROUGH MULTIPLE EXPOSURES. Mark A. Robertson, Sean Borman, and Robert L. Stevenson
c 1999 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or
More informationImage Interpolation by Pixel Level Data-Dependent Triangulation
Volume xx (200y), Number z, pp. 1 7 Image Interpolation by Pixel Level Data-Dependent Triangulation Dan Su, Philip Willis Department of Computer Science, University of Bath, Bath, BA2 7AY, U.K. mapds,
More informationIMAGE RESOLUTION ENHANCEMENT USING BLIND TECHNIQUE A SURVEY
IMAGE RESOLUTION ENHANCEMENT USING BLIND TECHNIQUE A SURVEY P.Rani 1, H.JeyaLakshmi 2, S.Sumathi 3 1 PG Research Scholar, 2, 3 Assistant Professor, Department of CSE, Sardar Raja College of Engineering,
More informationCOMPUTING CLOUD MOTION USING A CORRELATION RELAXATION ALGORITHM Improving Estimation by Exploiting Problem Knowledge Q. X. WU
COMPUTING CLOUD MOTION USING A CORRELATION RELAXATION ALGORITHM Improving Estimation by Exploiting Problem Knowledge Q. X. WU Image Processing Group, Landcare Research New Zealand P.O. Box 38491, Wellington
More informationSingle Depth Image Super Resolution and Denoising Using Coupled Dictionary Learning with Local Constraints and Shock Filtering
Single Depth Image Super Resolution and Denoising Using Coupled Dictionary Learning with Local Constraints and Shock Filtering Jun Xie 1, Cheng-Chuan Chou 2, Rogerio Feris 3, Ming-Ting Sun 1 1 University
More informationAutomatic 3D Mapping for Infrared Image Analysis
Automatic 3D Mapping for Infrared Image Analysis i r f m c a d a r a c h e V. Martin, V. Gervaise, V. Moncada, M.H. Aumeunier, M. irdaouss, J.M. Travere (CEA) S. Devaux (IPP), G. Arnoux (CCE) and JET-EDA
More information