# Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)

Save this PDF as:

Size: px
Start display at page:

Download "Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)"

## Transcription

1 Wavelet analysis In the case of Fourier series, the orthonormal basis is generated by integral dilation of a single function e jx Every 2π-periodic square-integrable function is generated by a superposition of integral dilations of the basic function e jx. The time information is lost; no knowledge of when a particular event took place. Look for wavelets---small waves---to generate the basis. Use a single function ψ (mother wavelet) with fast decay (compact support) to generate all the basis elements. Need to shift as well as scale the mother wavelet. Continuous and discrete wavelets Wavelet requirements Zero mean, oscillatory (wave) ψ (x) dx = Ψ(ω) 2 Admissibility condition Fast decay (let) compact support Regularity condition ω dω < 2 Stationary signal 2 Hz + Hz + 2Hz Example signals 3 6 Occur at all times Stationary Signal Signals with frequency content unchanged in time All frequency components exist at all times Stationary Non-stationary Signal Frequency changes in time One example: the Chirp Signal.-.4: 2 Hz : Hz +.7-.: 2 Hz Non- Stationary Time Frequency (Hz) Do not appear at all times Time Frequency (Hz) 4

2 Chirp signal Resolution of time & frquency Frequency: 2 Hz to 2 Hz Frequency: 2 Hz to 2 Hz Different in Time Domain Better time resolution; Poor frequency resolution Frequency Time Frequency (Hz) -.5 Same in Frequency Domain At what time the frequency components occur? FT can not tell! Time Frequency (Hz) Better frequency resolution; Poor time resolution Time 6 Decomposing non-stationary signals Decomposing non-stationary signals f L f L Signal:.-.4: 2 Hz.4-.7: Hz.7-.: 2 Hz Signal:.-.4: 2 Hz.4-.7: Hz.7-.: 2Hz f H Wavelet: db4 Level: 6 7 f H Wavelet: db4 Level: 6 8 2

3 Discrete wavelets: binary dilation and dyadic translation Use basis functions ψ j,k (x) = 2 j/2 ψ (2 j x-k), j,k є Z compression by 2 j (scale = 2 -j ) translation by k2 -j Example of compression and translation scaling by 2 j/2 to preserve L 2 norm A function ψ is called an orthogonal wavelet if the above family of functions is an orthonormal basis for L 2 (R), <ψ j,k, ψ l,m > = δ j,l δ k,m j,k,l,m є Z δ j,k = if j = l and k = m, and otherwise. the family of functions spans L 2 (R). Orthogonal and nested subspaces Let W j be the span of {ψ j,k, k є Z} W j W k for j k (case of orthogonal wavelets) L 2 (R) = W j = W - W W more details j є Z denotes orthogonal sum Let V j = W j-2 W j- V j+ = V j W j V = V - W - = V -2 W -2 W - = Consider the following conditions. {} V - V V (nested subspaces) 2. closure ( V j ) = L 2 (R) j є Z j є Z 3. V j = {} 4. φ j,k (x) = 2 j/2 φ (2 j x-k), j,k є Z 5. {φ j,k (x) k є Z} generates an orthonormal basis for V j. 9 Scaling function A function φ is called a scaling function (also called father wavelet) if it generates a nested sequence of subspaces that satisfies conditions on the previous slide. φ generates V j ψ generates W j Example of space generated by Haar scaling function. Decomposition I(x) = c 2 2 (x) + c 2 2 (x) + c (x) + c (x) V V - W - V -2 W -2 W - 2 3

4 Decomposition Decomposition c N c N- c N-2 d N- d N-2 d N-M c N-M Decompose each basis vector of V j into basis vectors of V j- and W j-. This results in a coefficient for each basis vector of V j- and W j-. Could also take inner products directly with the basis vectors. 3 Since V j is the orthogonal sum of V j- and W j-, there are decomposition sequences {p i }, {q i } such that φ j,k (x) = [ p k,m φ j-,m (x) + q k,m ψ j-,m (x) ] m This is called the decomposition relation 4 Decomposition f j (x) Reconstruction c N c N- c N-2 c N-M d N- d N-2 d N-M c j,k φ j,k (x) c j,k+ φ j,k+ (x) c j,k+2 φ j,k+2 (x) p k,m p k+,m p k+2,m φ j-,m (x) c j-,m = p l,m c j,l l ψ j-,m (x) d j-,m = q l,m c j,l l 5 We have a coefficient for each basis vector of V j- and W j-. Decompose each basis vector of V j- into basis vectors of V j. Repeat for W j-. Coefficient of each basis of V j as a function of coefficients of bases of V j- and W j- This results in a coefficient for each basis vector of V j. 6 4

5 Two-scale relation Since φ(2 j- x-k) and ψ(2 j- x-k) belong to V j, there exist reconstruction sequences {a i }, {b i } such that φ j-,k (x) = a k,m φ j,m (x) m ψ j-,k (x) = b k,m φ j,m (x) m The above relation is called the two-scale relation of the scaling function and the wavelet respectively. Reconstruction c j-,k φ j-,k (x) c j-,k+l φ j-,k+l (x) d j-,k ψ j-,k (x) a k,m a k+l,m b k,m φ j,m (x) c j,m = (a l,m c j-,l + b l,m d j-,l ) l d j-,k+l ψ j-,k+l (x) b k+l,m 7 8 Example: Haar wavelet ψ, (x) = for x <.5, - for.5 x <, otherwise. φ, (x) = for x <, otherwise. Check the orthonormality conditions Decomposition φ j,2k (x) = / 2 [φ j-,k (x) + ψ j-,k (x)] φ j,2k+ (x) = / 2 [φ j-,k (x) - ψ j-,k (x)] c j-,k (x) = / 2 [c j,2k + c j,2k+ ] d j-,k (x) = / 2 [c j,2k - c j,2k+ ] Reconstruction φ j-,k (x) = / 2 [φ j,2k (x) + φ j,2k+ (x)] ψ j-,k (x) = / 2 [φ j,2k (x) - φ j,2k+ (x)] c j,2k (x) = / 2 [c j-,k + d j-,k ] c j,2k+ (x) = / 2 [c j-,k - d j-,k ] Decomposition relation Two-scale relation c =[4,2,3,3,6,8,,7] Representation 4 φ, (x) 2 φ, (x-) 3 φ, (x-2) / 2 / 2 Decomposition 3 2φ -, (x) c - =[3 2,3 2,7 2,4 2 ] d - =[ 2,,- 2,-3 2] c -2 =[6,] d -2 =[,3] c -3 =[7/ 2] d -3 =[- 5/ 2] 2ψ -, (x) 9 2 5

6 Reconstruction Decomposition matrix c - =[3 2,3 2,7 2,4 2 ] d - =[ 2,,- 2,-3 2] / 2 / 2 / 2 -/ 2 c =[4,2,3,3,6,8,,7] / c, c, c,2 c,3 c,4 c,5 c,6 c,7 = c -, d -, c -, d -, c -,2 d -,2 c -,3 d -, Reconstruction matrix Example: Daubechies wavelet (D 4 ) - / c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 = c, c, c,2 c,3 c,4 c,5 c,6 c,7 Scaling function φ (x) Wavelet function ψ (x) (h, h, h2, h3) = (+ 3, 3+ 3, 3-3, - 3)/

7 Decomposition matrix Reconstruction matrix h h h 2 h 3 h 3 -h 2 h -h h h h 2 h 3 h 3 -h 2 h -h h h h 2 h 3 h 3 -h 2 h -h h 2 h 3 h h c, c, c,2 c,3 c,4 c,5 c,6 c,7 = c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 h h 3 h 2 h h -h 2 h 3 -h h 2 h h h 3 h 3 -h h -h 2 h 2 h h h 3 h 3 -h h -h 2 h 2 h h h 3 h 3 -h h -h 2 c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 = c, c, c,2 c,3 c,4 c,5 c,6 c,7 h -h h 3 -h Wavelets in 2-d (standard decomposition) Apply wavelet transform along the rows. Decompose the signal into a set of coefficients. Apply transform along the columns on the row coefficients. Wavelets in 2-d (non-standard decomposition) Alternate between row and column transformations

8 Parseval s theorem: Properties f 2 = <f,ψ j,k > 2 f-g 2 = <f,ψ j,k > - <g,ψ j,k > 2 Also holds for the decomposition into a set of multiresolution details and a single summary. f N = g N- + g N f N-M Time complexity of decomposition Each step is O(n) The amount of work gets halved at each step Overall complexity is still O(n) Faster than DFT Time complexity of reconstruction is also O(n). Applications Images and videos Compression Smoothing and Denoising Big Data Dimensionality reduction Summarization Which would you use Fourier Wavelets (which one?) 29 3 Bibliography Wavelets and Dilation Equations: A Brief Introduction, Gilbert Strang, SIAM Review, Vol. 3, No. 4. (Dec., 989), pp

### Wavelet Analysis Based Estimation of Probability Density function of Wind Data

, pp.23-34 http://dx.doi.org/10.14257/ijeic.2014.5.3.03 Wavelet Analysis Based Estimation of Probability Density function of Wind Data Debanshee Datta Department of Mechanical Engineering Indian Institute

More information

### α = u v. In other words, Orthogonal Projection

Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v

More information

### 5. Orthogonal matrices

L Vandenberghe EE133A (Spring 2016) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal

More information

### Inner product. Definition of inner product

Math 20F Linear Algebra Lecture 25 1 Inner product Review: Definition of inner product. Slide 1 Norm and distance. Orthogonal vectors. Orthogonal complement. Orthogonal basis. Definition of inner product

More information

### MATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform

MATH 433/533, Fourier Analysis Section 11, The Discrete Fourier Transform Now, instead of considering functions defined on a continuous domain, like the interval [, 1) or the whole real line R, we wish

More information

### WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE

Sunway Academic Journal 3, 87 98 (26) WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE SHIRLEY WONG a RAY ANDERSON Victoria University, Footscray Park Campus, Australia ABSTRACT This paper

More information

### A Primer on Index Notation

A Primer on John Crimaldi August 28, 2006 1. Index versus Index notation (a.k.a. Cartesian notation) is a powerful tool for manipulating multidimensional equations. However, there are times when the more

More information

### Similarity Search on Time Series Data. Presented by Zhe Wang

Similarity Search on Time Series Data Presented by Zhe Wang Motivations Fast searching for time-series of real numbers. ( data mining ) Scientific database: weather, geological, astrophysics, etc. find

More information

### CITY UNIVERSITY LONDON. BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION

No: CITY UNIVERSITY LONDON BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION ENGINEERING MATHEMATICS 2 (resit) EX2005 Date: August

More information

### SNMP Simple Network Measurements Please!

SNMP Simple Network Measurements Please! Matthew Roughan (+many others) 1 Outline Part I: SNMP traffic data Simple Network Management Protocol Why? How? What? Part II: Wavelets

More information

### These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

DEFINITION: A vector space is a nonempty set V of objects, called vectors, on which are defined two operations, called addition and multiplication by scalars (real numbers), subject to the following axioms

More information

### Recall that two vectors in are perpendicular or orthogonal provided that their dot

Orthogonal Complements and Projections Recall that two vectors in are perpendicular or orthogonal provided that their dot product vanishes That is, if and only if Example 1 The vectors in are orthogonal

More information

### A Wavelet Based Prediction Method for Time Series

A Wavelet Based Prediction Method for Time Series Cristina Stolojescu 1,2 Ion Railean 1,3 Sorin Moga 1 Philippe Lenca 1 and Alexandru Isar 2 1 Institut TELECOM; TELECOM Bretagne, UMR CNRS 3192 Lab-STICC;

More information

### SPEECH SIGNAL CODING FOR VOIP APPLICATIONS USING WAVELET PACKET TRANSFORM A

International Journal of Science, Engineering and Technology Research (IJSETR), Volume, Issue, January SPEECH SIGNAL CODING FOR VOIP APPLICATIONS USING WAVELET PACKET TRANSFORM A N.Rama Tej Nehru, B P.Sunitha

More information

### WAVELETS AND THEIR USAGE ON THE MEDICAL IMAGE COMPRESSION WITH A NEW ALGORITHM

WAVELETS AND THEIR USAGE ON THE MEDICAL IMAGE COMPRESSION WITH A NEW ALGORITHM Gulay TOHUMOGLU Electrical and Electronics Engineering Department University of Gaziantep 27310 Gaziantep TURKEY ABSTRACT

More information

### BANACH AND HILBERT SPACE REVIEW

BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but

More information

### Linearly Independent Sets and Linearly Dependent Sets

These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation

More information

### Orthogonal Projections and Orthonormal Bases

CS 3, HANDOUT -A, 3 November 04 (adjusted on 7 November 04) Orthogonal Projections and Orthonormal Bases (continuation of Handout 07 of 6 September 04) Definition (Orthogonality, length, unit vectors).

More information

### Admin stuff. 4 Image Pyramids. Spatial Domain. Projects. Fourier domain 2/26/2008. Fourier as a change of basis

Admin stuff 4 Image Pyramids Change of office hours on Wed 4 th April Mon 3 st March 9.3.3pm (right after class) Change of time/date t of last class Currently Mon 5 th May What about Thursday 8 th May?

More information

### SGN-1158 Introduction to Signal Processing Test. Solutions

SGN-1158 Introduction to Signal Processing Test. Solutions 1. Convolve the function ( ) with itself and show that the Fourier transform of the result is the square of the Fourier transform of ( ). (Hints:

More information

### CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen LECTURE 3: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major

More information

### Part II Redundant Dictionaries and Pursuit Algorithms

Aisenstadt Chair Course CRM September 2009 Part II Redundant Dictionaries and Pursuit Algorithms Stéphane Mallat Centre de Mathématiques Appliquées Ecole Polytechnique Sparsity in Redundant Dictionaries

More information

### The continuous and discrete Fourier transforms

FYSA21 Mathematical Tools in Science The continuous and discrete Fourier transforms Lennart Lindegren Lund Observatory (Department of Astronomy, Lund University) 1 The continuous Fourier transform 1.1

More information

### Enhancement of scanned documents in Besov spaces using wavelet domain representations

Enhancement of scanned documents in Besov spaces using wavelet domain representations Kathrin Berkner 1 Ricoh Innovations, Inc., 2882 Sand Hill Road, Suite 115, Menlo Park, CA 94025 ABSTRACT After scanning,

More information

### ELEC 4801 THESIS PROJECT

School of Information Technology and Electrical Engineering ELEC 4801 THESIS PROJECT Thesis: Speech Compression Using Wavelets Name: Nikhil Rao Student No: 33710745 Supervisor: Dr John Homer Submitted

More information

### Cheng Soon Ong & Christfried Webers. Canberra February June 2016

c Cheng Soon Ong & Christfried Webers Research Group and College of Engineering and Computer Science Canberra February June (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 31 c Part I

More information

### Orthogonal Diagonalization of Symmetric Matrices

MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding

More information

### Linear Algebra Review. Vectors

Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

More information

### Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity

Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities

More information

### 1 VECTOR SPACES AND SUBSPACES

1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such

More information

### Solutions to Linear Algebra Practice Problems

Solutions to Linear Algebra Practice Problems. Find all solutions to the following systems of linear equations. (a) x x + x 5 x x x + x + x 5 (b) x + x + x x + x + x x + x + 8x Answer: (a) We create the

More information

Tracking Moving Objects In Video Sequences Yiwei Wang, Robert E. Van Dyck, and John F. Doherty Department of Electrical Engineering The Pennsylvania State University University Park, PA16802 Abstract{Object

More information

### 1 Scalars, Vectors and Tensors

DEPARTMENT OF PHYSICS INDIAN INSTITUTE OF TECHNOLOGY, MADRAS PH350 Classical Physics Handout 1 8.8.2009 1 Scalars, Vectors and Tensors In physics, we are interested in obtaining laws (in the form of mathematical

More information

### Introduction to Medical Image Compression Using Wavelet Transform

National Taiwan University Graduate Institute of Communication Engineering Time Frequency Analysis and Wavelet Transform Term Paper Introduction to Medical Image Compression Using Wavelet Transform 李 自

More information

### International Transmission of Stock Market Movements : A Wavelet Analysis on MENA Stock Markets

International Transmission of Stock Market Movements : A Wavelet Analysis on MENA Stock Markets Hahn Shik Lee Department of Economics Sogang University Seoul, KOREA October 2001 This is a preliminary draft

More information

### Quantum Physics II (8.05) Fall 2013 Assignment 4

Quantum Physics II (8.05) Fall 2013 Assignment 4 Massachusetts Institute of Technology Physics Department Due October 4, 2013 September 27, 2013 3:00 pm Problem Set 4 1. Identitites for commutators (Based

More information

### VLSI Architecture for DCT Based On High Quality DA

International Journal of Engineering and Technical Research (IJETR) ISSN: 2321-0869, Volume-2, Issue-6, June 2014 VLSI Architecture for DCT Based On High Quality DA Urbi Sharma, Tarun Verma, Rita Jain

More information

### The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression

The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression The SVD is the most generally applicable of the orthogonal-diagonal-orthogonal type matrix decompositions Every

More information

### Correlation and Convolution Class Notes for CMSC 426, Fall 2005 David Jacobs

Correlation and Convolution Class otes for CMSC 46, Fall 5 David Jacobs Introduction Correlation and Convolution are basic operations that we will perform to extract information from images. They are in

More information

### FFT Algorithms. Chapter 6. Contents 6.1

Chapter 6 FFT Algorithms Contents Efficient computation of the DFT............................................ 6.2 Applications of FFT................................................... 6.6 Computing DFT

More information

### ON THE DEGREES OF FREEDOM OF SIGNALS ON GRAPHS. Mikhail Tsitsvero and Sergio Barbarossa

ON THE DEGREES OF FREEDOM OF SIGNALS ON GRAPHS Mikhail Tsitsvero and Sergio Barbarossa Sapienza Univ. of Rome, DIET Dept., Via Eudossiana 18, 00184 Rome, Italy E-mail: tsitsvero@gmail.com, sergio.barbarossa@uniroma1.it

More information

### Orthogonal and Symmetric Haar Wavelets on the Sphere. Christian Lessig

Orthogonal and Symmetric Haar Wavelets on the Sphere by Christian Lessig A thesis submitted in conformity with the requirements for the degree of Master of Science Graduate Department of Computer Science

More information

### VLSI Architecture for Efficient Lifting-Based Forward and Inverse DWT

VLSI Architecture for Efficient Lifting-Based Forward and Inverse DWT A. Kishore kumar 1, Dr. M. Satyanarayana 2 Electronics and Communication Engineering Dept., M.V.G.R College of Engineering, Vizianagaram,

More information

### WHICH LINEAR-FRACTIONAL TRANSFORMATIONS INDUCE ROTATIONS OF THE SPHERE?

WHICH LINEAR-FRACTIONAL TRANSFORMATIONS INDUCE ROTATIONS OF THE SPHERE? JOEL H. SHAPIRO Abstract. These notes supplement the discussion of linear fractional mappings presented in a beginning graduate course

More information

### 1 2 3 1 1 2 x = + x 2 + x 4 1 0 1

(d) If the vector b is the sum of the four columns of A, write down the complete solution to Ax = b. 1 2 3 1 1 2 x = + x 2 + x 4 1 0 0 1 0 1 2. (11 points) This problem finds the curve y = C + D 2 t which

More information

### Short-time FFT, Multi-taper analysis & Filtering in SPM12

Short-time FFT, Multi-taper analysis & Filtering in SPM12 Computational Psychiatry Seminar, FS 2015 Daniel Renz, Translational Neuromodeling Unit, ETHZ & UZH 20.03.2015 Overview Refresher Short-time Fourier

More information

### Very Preliminary Program

Very Preliminary Program Two of the participants will give Colloquium talks before the meeting. The workshop it self starts on Friday morning. All talks will take place in Lockett, 277. The room is equipped

More information

### 1 Inner Products and Norms on Real Vector Spaces

Math 373: Principles Techniques of Applied Mathematics Spring 29 The 2 Inner Product 1 Inner Products Norms on Real Vector Spaces Recall that an inner product on a real vector space V is a function from

More information

### Chapter 6. Orthogonality

6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

More information

### Section 1.7 22 Continued

Section 1.5 23 A homogeneous equation is always consistent. TRUE - The trivial solution is always a solution. The equation Ax = 0 gives an explicit descriptions of its solution set. FALSE - The equation

More information

### Lecture 2: Essential quantum mechanics

Department of Physical Sciences, University of Helsinki http://theory.physics.helsinki.fi/ kvanttilaskenta/ p. 1/46 Quantum information and computing Lecture 2: Essential quantum mechanics Jani-Petri Martikainen

More information

### Inner Product Spaces

Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and

More information

### Analysis/resynthesis with the short time Fourier transform

Analysis/resynthesis with the short time Fourier transform summer 2006 lecture on analysis, modeling and transformation of audio signals Axel Röbel Institute of communication science TU-Berlin IRCAM Analysis/Synthesis

More information

### Convolution, Correlation, & Fourier Transforms. James R. Graham 10/25/2005

Convolution, Correlation, & Fourier Transforms James R. Graham 10/25/2005 Introduction A large class of signal processing techniques fall under the category of Fourier transform methods These methods fall

More information

### The Hilbert Transform and Empirical Mode Decomposition as Tools for Data Analysis

The Hilbert Transform and Empirical Mode Decomposition as Tools for Data Analysis Susan Tolwinski First-Year RTG Project University of Arizona Program in Applied Mathematics Advisor: Professor Flaschka

More information

### B3. Short Time Fourier Transform (STFT)

B3. Short Time Fourier Transform (STFT) Objectives: Understand the concept of a time varying frequency spectrum and the spectrogram Understand the effect of different windows on the spectrogram; Understand

More information

### LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

More information

### Applied Linear Algebra I Review page 1

Applied Linear Algebra Review 1 I. Determinants A. Definition of a determinant 1. Using sum a. Permutations i. Sign of a permutation ii. Cycle 2. Uniqueness of the determinant function in terms of properties

More information

### Fourier Analysis and its applications

Fourier Analysis and its applications Fourier analysis originated from the study of heat conduction: Jean Baptiste Joseph Fourier (1768-1830) Fourier analysis enables a function (signal) to be decomposed

More information

### Linear Algebra: Vectors

A Linear Algebra: Vectors A Appendix A: LINEAR ALGEBRA: VECTORS TABLE OF CONTENTS Page A Motivation A 3 A2 Vectors A 3 A2 Notational Conventions A 4 A22 Visualization A 5 A23 Special Vectors A 5 A3 Vector

More information

### Model order reduction via Proper Orthogonal Decomposition

Model order reduction via Proper Orthogonal Decomposition Reduced Basis Summer School 2015 Martin Gubisch University of Konstanz September 17, 2015 Martin Gubisch (University of Konstanz) Model order reduction

More information

### Disjoint sparsity for signal separation and applications to hybrid imaging inverse problems

Disjoint sparsity for signal separation and applications to hybrid imaging inverse problems Giovanni S Alberti (joint with H Ammari) DMA, École Normale Supérieure, Paris June 16, 2015 Giovanni S Alberti

More information

### EFFICIENT HEDGING USING A DYNAMIC PORTFOLIO OF BINARY OPTIONS. Key Words: Heding; Portfolio of Options; Haar Wavelets; Martingales.

EFFICIENT HEDGING USING A DYNAMIC PORTFOLIO OF BINARY OPTIONS S. E. FERRANDO, P. J. CATUOGNO, AND A. L. GONZALEZ Abstract. We present a discretization of financial instruments in terms of martingale expansions

More information

### c 2003 Society for Industrial and Applied Mathematics

SIAM J. SCI. COMPUT. Vol. 4, No. 4, pp. 148 143 c 3 Society for Industrial and Applied Mathematics WAVELET ALGORITHMS FOR HIGH-RESOLUTION IMAGE RECONSTRUCTION RAYMOND H. CHAN, TONY F. CHAN, LIXIN SHEN,

More information

### Inner Product Spaces and Orthogonality

Inner Product Spaces and Orthogonality week 3-4 Fall 2006 Dot product of R n The inner product or dot product of R n is a function, defined by u, v a b + a 2 b 2 + + a n b n for u a, a 2,, a n T, v b,

More information

### When is missing data recoverable?

When is missing data recoverable? Yin Zhang CAAM Technical Report TR06-15 Department of Computational and Applied Mathematics Rice University, Houston, TX 77005 October, 2006 Abstract Suppose a non-random

More information

### Auto-Tuning Using Fourier Coefficients

Auto-Tuning Using Fourier Coefficients Math 56 Tom Whalen May 20, 2013 The Fourier transform is an integral part of signal processing of any kind. To be able to analyze an input signal as a superposition

More information

### In the companion article (1), it is shown that the eigenfunctions

Geometric diffusions as a tool for harmonic analysis and structure definition of data: Multiscale methods R. R. Coifman*, S. Lafon*, A. B. Lee*, M. Maggioni*, B. Nadler*, F. Warner*, and S. W. Zucker *Department

More information

### Smooth tight frame wavelets and image microanalysis in the Fourier domain

Smooth tight frame wavelets and image microanalysis in the Fourier domain Ryuichi Ashino, Steven J. Desjardins, Christopher Heil, Michihiro Nagase and Rémi Vaillancourt CRM-2864 September 2002 Division

More information

### Section 6.1 - Inner Products and Norms

Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,

More information

### Statistical Modeling by Wavelets

Statistical Modeling by Wavelets BRANI VIDAKOVIC Duke University A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York / Chichester / Weinheim / Brisbane / Singapore / Toronto Contents Preface

More information

### SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties

SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 3 Fall 2008 III. Spaces with special properties III.1 : Compact spaces I Problems from Munkres, 26, pp. 170 172 3. Show that a finite union of compact subspaces

More information

### MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

More information

### Building Your Own Wavelets at Home

Building Your Own Wavelets at Home Wim Sweldens y Peter Schröder z Abstract We give an practical overview of three simple techniques to construct wavelets under general circumstances: interpolating subdivision,

More information

### A VARIANT OF THE EMD METHOD FOR MULTI-SCALE DATA

Advances in Adaptive Data Analysis Vol. 1, No. 4 (2009) 483 516 c World Scientific Publishing Company A VARIANT OF THE EMD METHOD FOR MULTI-SCALE DATA THOMAS Y. HOU and MIKE P. YAN Applied and Computational

More information

### Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday.

Math 312, Fall 2012 Jerry L. Kazdan Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday. In addition to the problems below, you should also know how to solve

More information

### Introduction to General and Generalized Linear Models

Introduction to General and Generalized Linear Models General Linear Models - part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby

More information

### Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

More information

### Orthogonal Projections

Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors

More information

### An Evaluation of Irregularities of Milled Surfaces by the Wavelet Analysis

An Evaluation of Irregularities of Milled Surfaces by the Wavelet Analysis Włodzimierz Makieła Abstract This paper presents an introductory to wavelet analysis and its application in assessing the surface

More information

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

More information

### CS 5614: (Big) Data Management Systems. B. Aditya Prakash Lecture #18: Dimensionality Reduc7on

CS 5614: (Big) Data Management Systems B. Aditya Prakash Lecture #18: Dimensionality Reduc7on Dimensionality Reduc=on Assump=on: Data lies on or near a low d- dimensional subspace Axes of this subspace

More information

### Image Compression through DCT and Huffman Coding Technique

International Journal of Current Engineering and Technology E-ISSN 2277 4106, P-ISSN 2347 5161 2015 INPRESSCO, All Rights Reserved Available at http://inpressco.com/category/ijcet Research Article Rahul

More information

### 1 Norms and Vector Spaces

008.10.07.01 1 Norms and Vector Spaces Suppose we have a complex vector space V. A norm is a function f : V R which satisfies (i) f(x) 0 for all x V (ii) f(x + y) f(x) + f(y) for all x,y V (iii) f(λx)

More information

### Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Chapter 3 Linear Least Squares Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction

More information

### Lecture L3 - Vectors, Matrices and Coordinate Transformations

S. Widnall 16.07 Dynamics Fall 2009 Lecture notes based on J. Peraire Version 2.0 Lecture L3 - Vectors, Matrices and Coordinate Transformations By using vectors and defining appropriate operations between

More information

### L9: Cepstral analysis

L9: Cepstral analysis The cepstrum Homomorphic filtering The cepstrum and voicing/pitch detection Linear prediction cepstral coefficients Mel frequency cepstral coefficients This lecture is based on [Taylor,

More information

### Non-negative Matrix Factorization (NMF) in Semi-supervised Learning Reducing Dimension and Maintaining Meaning

Non-negative Matrix Factorization (NMF) in Semi-supervised Learning Reducing Dimension and Maintaining Meaning SAMSI 10 May 2013 Outline Introduction to NMF Applications Motivations NMF as a middle step

More information

### DESIGN OF VLSI ARCHITECTURE USING 2D DISCRETE WAVELET TRANSFORM

INTERNATIONAL JOURNAL OF ADVANCED RESEARCH IN ENGINEERING AND SCIENCE DESIGN OF VLSI ARCHITECTURE USING 2D DISCRETE WAVELET TRANSFORM Lavanya Pulugu 1, Pathan Osman 2 1 M.Tech Student, Dept of ECE, Nimra

More information

### Text Analytics (Text Mining)

CSE 6242 / CX 4242 Apr 3, 2014 Text Analytics (Text Mining) LSI (uses SVD), Visualization Duen Horng (Polo) Chau Georgia Tech Some lectures are partly based on materials by Professors Guy Lebanon, Jeffrey

More information

### Co-integration of Stock Markets using Wavelet Theory and Data Mining

Co-integration of Stock Markets using Wavelet Theory and Data Mining R.Sahu P.B.Sanjeev rsahu@iiitm.ac.in sanjeev@iiitm.ac.in ABV-Indian Institute of Information Technology and Management, India Abstract

More information

### Linear algebra, signal processing, and wavelets. A unified approach. Python version. Øyvind Ryan

Linear algebra, signal processing, and wavelets A unified approach Python version Øyvind Ryan January, 5 ii Contents Preface vii I Fourier analysis and applications to sound processing Sound and Fourier

More information

### Introduces the bra and ket notation and gives some examples of its use.

Chapter 7 ket and bra notation Introduces the bra and ket notation and gives some examples of its use. When you change the description of the world from the inutitive and everyday classical mechanics to

More information

### MATH 240 Fall, Chapter 1: Linear Equations and Matrices

MATH 240 Fall, 2007 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 9th Ed. written by Prof. J. Beachy Sections 1.1 1.5, 2.1 2.3, 4.2 4.9, 3.1 3.5, 5.3 5.5, 6.1 6.3, 6.5, 7.1 7.3 DEFINITIONS

More information

### Theta Functions. Lukas Lewark. Seminar on Modular Forms, 31. Januar 2007

Theta Functions Lukas Lewark Seminar on Modular Forms, 31. Januar 007 Abstract Theta functions are introduced, associated to lattices or quadratic forms. Their transformation property is proven and the

More information

### Speech Signal Processing: An Overview

Speech Signal Processing: An Overview S. R. M. Prasanna Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati December, 2012 Prasanna (EMST Lab, EEE, IITG) Speech

More information

### 4.6 Null Space, Column Space, Row Space

NULL SPACE, COLUMN SPACE, ROW SPACE Null Space, Column Space, Row Space In applications of linear algebra, subspaces of R n typically arise in one of two situations: ) as the set of solutions of a linear

More information

### SIGNAL PROCESSING & SIMULATION NEWSLETTER

1 of 10 1/25/2008 3:38 AM SIGNAL PROCESSING & SIMULATION NEWSLETTER Note: This is not a particularly interesting topic for anyone other than those who ar e involved in simulation. So if you have difficulty

More information

### Elementary Gradient-Based Parameter Estimation

Elementary Gradient-Based Parameter Estimation Julius O. Smith III Center for Computer Research in Music and Acoustics (CCRMA Department of Music, Stanford University, Stanford, California 94305 USA Abstract

More information

### Fourier Transform and Image Filtering. CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010

Fourier Transform and Image Filtering CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010 The Fourier Transform Fourier Transform Forward, mapping to frequency domain: Backward, inverse mapping to time domain:

More information