Fourier Transform and Image Filtering. CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010

Similar documents
Aliasing, Image Sampling and Reconstruction

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines

FFT Algorithms. Chapter 6. Contents 6.1

The continuous and discrete Fourier transforms

Design of FIR Filters

Analysis/resynthesis with the short time Fourier transform

SGN-1158 Introduction to Signal Processing Test. Solutions

Correlation and Convolution Class Notes for CMSC 426, Fall 2005 David Jacobs

Lectures 6&7: Image Enhancement

Admin stuff. 4 Image Pyramids. Spatial Domain. Projects. Fourier domain 2/26/2008. Fourier as a change of basis

SIGNAL PROCESSING & SIMULATION NEWSLETTER

Linear Filtering Part II

Sampling and Interpolation. Yao Wang Polytechnic University, Brooklyn, NY11201

Sampling Theorem Notes. Recall: That a time sampled signal is like taking a snap shot or picture of signal periodically.

Chapter 8 - Power Density Spectrum

FAST Fourier Transform (FFT) and Digital Filtering Using LabVIEW

chapter Introduction to Digital Signal Processing and Digital Filtering 1.1 Introduction 1.2 Historical Perspective

How To Understand The Nyquist Sampling Theorem

Chapter 4 Image Enhancement in the Frequency Domain. Chapter 4 Image Enhancement in the Frequency Domain

Analog Filters. A common instrumentation filter application is the attenuation of high frequencies to avoid frequency aliasing in the sampled data.

L9: Cepstral analysis

ANALYZER BASICS WHAT IS AN FFT SPECTRUM ANALYZER? 2-1

Short-time FFT, Multi-taper analysis & Filtering in SPM12

Review of Fourier series formulas. Representation of nonperiodic functions. ECE 3640 Lecture 5 Fourier Transforms and their properties

CHAPTER 6 Frequency Response, Bode Plots, and Resonance

Lecture 14. Point Spread Function (PSF)

Computational Foundations of Cognitive Science

Lecture 7 ELE 301: Signals and Systems

Time series analysis Matlab tutorial. Joachim Gross

The Fourier Analysis Tool in Microsoft Excel

SWISS ARMY KNIFE INDICATOR John F. Ehlers

Lecture 8 ELE 301: Signals and Systems

1.4 Fast Fourier Transform (FFT) Algorithm

SIGNAL PROCESSING FOR EFFECTIVE VIBRATION ANALYSIS

Probability and Random Variables. Generation of random variables (r.v.)

Convolution, Correlation, & Fourier Transforms. James R. Graham 10/25/2005

1995 Mixed-Signal Products SLAA013

Agilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox. Application Note

5 Signal Design for Bandlimited Channels

MATRIX TECHNICAL NOTES

Introduction to IQ-demodulation of RF-data

Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)

Lab 1. The Fourier Transform

Convolution. 1D Formula: 2D Formula: Example on the web:

Sampling Theory For Digital Audio By Dan Lavry, Lavry Engineering, Inc.

How To Understand The Discrete Fourier Transform

Frequency Response of FIR Filters

Voice---is analog in character and moves in the form of waves. 3-important wave-characteristics:

Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition

2.161 Signal Processing: Continuous and Discrete Fall 2008

DIGITAL IMAGE PROCESSING AND ANALYSIS

8 Filtering. 8.1 Mathematical operation

Lecture 3: Signaling and Clock Recovery. CSE 123: Computer Networks Stefan Savage

Big Ideas in Mathematics

Fast Fourier Transform: Theory and Algorithms

Digital Image Processing

Digital Imaging and Multimedia. Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University

Prentice Hall Algebra Correlated to: Colorado P-12 Academic Standards for High School Mathematics, Adopted 12/2009

SR2000 FREQUENCY MONITOR

Applications of the DFT

SECTION 6 DIGITAL FILTERS

Electronic Communications Committee (ECC) within the European Conference of Postal and Telecommunications Administrations (CEPT)

Analog and Digital Filters Anthony Garvert November 13, 2015

Filter Comparison. Match #1: Analog vs. Digital Filters

Computational Optical Imaging - Optique Numerique. -- Deconvolution --

AVX EMI SOLUTIONS Ron Demcko, Fellow of AVX Corporation Chris Mello, Principal Engineer, AVX Corporation Brian Ward, Business Manager, AVX Corporation

3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials

Analog and Digital Signals, Time and Frequency Representation of Signals

ALFFT FAST FOURIER Transform Core Application Notes

T = 1 f. Phase. Measure of relative position in time within a single period of a signal For a periodic signal f(t), phase is fractional part t p

Sharpening through spatial filtering

POLYNOMIAL FUNCTIONS

Software for strong-motion data display and processing

SUMMARY. Additional Digital/Software filters are included in Chart and filter the data after it has been sampled and recorded by the PowerLab.

CHAPTER 3: DIGITAL IMAGING IN DIAGNOSTIC RADIOLOGY. 3.1 Basic Concepts of Digital Imaging

NEW YORK STATE TEACHER CERTIFICATION EXAMINATIONS

Doppler. Doppler. Doppler shift. Doppler Frequency. Doppler shift. Doppler shift. Chapter 19

9 Fourier Transform Properties

with functions, expressions and equations which follow in units 3 and 4.

Sachin Patel HOD I.T Department PCST, Indore, India. Parth Bhatt I.T Department, PCST, Indore, India. Ankit Shah CSE Department, KITE, Jaipur, India

PYKC Jan Lecture 1 Slide 1

Introduction to Digital Filters

Introduction to Digital Audio

T = 10-' s. p(t)= ( (t-nt), T= 3. n=-oo. Figure P16.2

Image Compression through DCT and Huffman Coding Technique

Sophomore Physics Laboratory (PH005/105)

Resolution Enhancement of images with Interpolation and DWT-SWT Wavelet Domain Components

More Filter Design on a Budget

PRACTICAL GUIDE TO DATA SMOOTHING AND FILTERING

Introduction to Medical Imaging. Lecture 11: Cone-Beam CT Theory. Introduction. Available cone-beam reconstruction methods: Our discussion:

In mathematics, there are four attainment targets: using and applying mathematics; number and algebra; shape, space and measures, and handling data.

Relations between the statistics of natural images and the

Agilent Time Domain Analysis Using a Network Analyzer

jorge s. marques image processing

Nonlinear Algebraic Equations. Lectures INF2320 p. 1/88

MATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform

UNIVERSITY OF CALIFORNIA, SAN DIEGO Electrical & Computer Engineering Department ECE Fall 2010 Linear Systems Fundamentals

Transcription:

Fourier Transform and Image Filtering CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010

The Fourier Transform

Fourier Transform Forward, mapping to frequency domain: Backward, inverse mapping to time domain:

Fourier Series Projection or change of basis Coordinates in Fourier basis: Rewrite f as:

Example: Step Function Step function as sum of infinite sine waves

Discrete Fourier Transform

Fourier Basis Why Fourier basis? Orthonormal in [-pi, pi] Periodic Continuous, differentiable basis

FT Properties

Common Transform Pairs Dirac delta - constant

Common Transform Pairs Rectangle sinc sinc(x) = sin(x) / x

Common Transform Pairs Two symmetric Diracs - cosine

Common Transform Pairs Comb comb (inverse width)

Common Transform Pairs Gaussian Gaussian (inverse variance)

Common Transform Pairs Summary

Quiz What is the FT of a triangle function? Hint: how do you get triangle function from the functions shown so far?

Triangle Function FT Triangle = box convolved with box So its FT is sinc * sinc

Fourier Transform of Images

2D Fourier Transform Forward transform: Backward transform: Forward transform to freq. yields complex values (magnitude and phase):

2D Fourier Transform

Fourier Spectrum Image Fourier spectrum Origin in corners Retiled with origin In center Log of spectrum

Fourier Spectrum Rotation

Phase vs Spectrum Image Reconstruction from phase map Reconstruction from spectrum

Fourier Spectrum Demo http://bigwww.epfl.ch/demo/basisfft/demo.html

Low-Pass Filter Reduce/eliminate high frequencies Applications Noise reduction uncorrelated noise is broad band Images have sprectrum that focus on low frequencies 100% 98% 96% 94% 92% 90% 88% 86% 0% 10% 20% 30% 40% 50% 60% 70% 80%

Ideal LP Filter Box, Rect Cutoff freq Ringing Gibbs phenomenon

Extending Filters to 2D (or higher) Two options Separable H(s) -> H(u)H(v) Easy, analysis Rotate H(s) -> H((u 2 + v 2 ) 1/2 ) Rotationally invariant

Ideal LP Filter Box, Rect

Ideal Low-Pass Rectangle With Cutoff of 2/3 Image Filtered Filtered + HE

Ideal LP 1/3

Ideal LP 2/3

Butterworth Filter Control of cutoff and slope Can control ringing

Butterworth - 1/3

Butterworth vs Ideal LP

Butterworth 2/3

Gaussian LP Filtering ILPF BLPF GLPF F1 F2

High Pass Filtering HP = 1 - LP All the same filters as HP apply Applications Visualization of high-freq data (accentuate) High boost filtering HB = (1- a) + a(1 - LP) = 1 - a*lp

High-Pass Filters

High-Pass Filters in Spatial Domain

High-Pass Filtering with IHPF

BHPF

GHPF

HP, HB, HE

High Boost with GLPF

High-Boost Filtering

Band-Pass Filters Shift LP filter in Fourier domain by convolution with delta LP Typically 2-3 parameters -Width -Slope -Band value BP

Band Pass - Two Dimensions Two strategies Rotate Radially symmetric Translate in 2D Oriented filters Note: Convolution with delta-pair in FD is multiplication with cosine in spatial domain

Band Bass Filtering

SEM Image and Spectrum

Band-Pass Filter

Radial Band Pass/Reject

Band Reject Filtering

Band Reject Filtering

Band Reject Filtering

Aliasing

Discrete Sampling and Aliasing Digital signals and images are discrete representations of the real world Which is continuous What happens to signals/images when we sample them? Can we quantify the effects? Can we understand the artifacts and can we limit them? Can we reconstruct the original image from the discrete data?

A Mathematical Model of Discrete Delta functional Samples Shah functional

Goal A Mathematical Model of Discrete Discrete signal Samples To be able to do a continuous Fourier transform on a signal before and after sampling Samples from continuous function Representation as a function of t Multiplication of f(t) with Shah

Fourier Series of A Shah Functional u

Fourier Transform of A Discrete Sampling u

Fourier Transform of A Discrete Sampling Frequencies get mixed. The original signal is not recoverable. u Energy from higher freqs gets folded back down into lower freqs Aliasing

What if F(u) is Narrower in the Fourier Domain? No aliasing! How could we recover the original signal? u

What Comes Out of This Model Sampling criterion for complete recovery An understanding of the effects of sampling Aliasing and how to avoid it Reconstruction of signals from discrete samples

Shannon Sampling Theorem Assuming a signal that is band limited: Given set of samples from that signal Samples can be used to generate the original signal Samples and continuous signal are equivalent

Sampling Theorem Quantifies the amount of information in a signal Discrete signal contains limited frequencies Band-limited signals contain no more information then their discrete equivalents Reconstruction by cutting away the repeated signals in the Fourier domain Convolution with sinc function in space/time

Reconstruction Convolution with sinc function

Sinc Interpolation Issues Must functions are not band limited Forcing functions to be band-limited can cause artifacts (ringing) f(t) F(s)

Sinc Interpolation Issues Ringing - Gibbs phenomenon Other issues: Sinc is infinite - must be truncated

Aliasing High frequencies appear as low frequencies when undersampled

Aliasing 16 pixels 8 pixels 0.9174 pixels 0.4798 pixels

Overcoming Aliasing Filter data prior to sampling Ideally - band limit the data (conv with sinc function) In practice - limit effects with fuzzy/soft low pass

Antialiasing in Graphics Screen resolution produces aliasing on underlying geometry Multiple high-res samples get averaged to create one screen sample

Antialiasing

Interpolation as Convolution Any discrete set of samples can be considered as a functional Any linear interpolant can be considered as a convolution Nearest neighbor - rect(t) Linear - tri(t)

Convolution-Based Interpolation Can be studied in terms of Fourier Domain Issues Pass energy (=1) in band Low energy out of band Reduce hard cut off (Gibbs, ringing) 1.2 1 0.8 0.6 0.4 0.2 0-6 -5-4 -3-2 -1 0 1 2 3 4 5 6-0.2-0.4

Fast Fourier Transform With slides from Richard Stern, CMU

DFT Ordinary DFT is O(N 2 ) DFT is slow for large images Exploit periodicity and symmetricity Fast FT is O(N log N) FFT can be faster than convolution

Fast Fourier Transform Divide and conquer algorithm Gauss ~1805 Cooley & Tukey 1965 For N = 2 K

The Cooley-Tukey Algorithm Consider the DFT algorithm for an integer power of 2, N 1 N 1 X[k] = x[n]w nk N = x[n]e j2πnk / N ; W N = e j2π / N n=0 n=0 Create separate sums for even and odd values of n: X[k] = x[n]w nk N + x[n]w nk N n even n odd Letting n = 2r for n even and n = 2r +1 for n odd, we obtain ( N / 2) 1 ( N /2) 1 X[k] = x[2r]w 2rk N + x[2r +1]W ( 2r+1)k N r=0 r=0 N = 2 ν

The Cooley-Tukey Algorithm Splitting indices in time, we have obtained ( N / 2) 1 ( N /2) 1 X[k] = x[2r]w 2rk N + x[2r +1]W ( 2r+1)k N r=0 r=0 But and So 2 W N = e j2π2 / N = e j2π /(N / 2) = WN 2rk k / 2 W N WN = k WN WN rk / 2 (N/ 2) 1 (N/ 2) 1 X[k] = x[2r]w rk k N /2 + W N x[2r +1]W rk N / 2 n=0 n=0 N/2-point DFT of x[2r] N/2-point DFT of x[2r+1]

Divide and reuse Example: N=8

Example: N=8, Upper Part Continue to divide and reuse

Two-Point FFT The expression for the 2-point DFT is: X[k] = Evaluating for k = 0,1 we obtain X[0] = x[0]+ x[1] 1 1 nk x[n]w 2 = x[n]e j2πnk / 2 n=0 n=0 X[1] = x[0] + e j2π1/ 2 x[1] = x[0] x[1] which in signal flowgraph notation looks like... This topology is referred to as the basic butterfly