# Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)

Save this PDF as:
Size: px
Start display at page:

Download "Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)"

## Transcription

1 Wavelet analysis In the case of Fourier series, the orthonormal basis is generated by integral dilation of a single function e jx Every 2π-periodic square-integrable function is generated by a superposition of integral dilations of the basic function e jx. The time information is lost; no knowledge of when a particular event took place. Look for wavelets---small waves---to generate the basis. Use a single function ψ (mother wavelet) with fast decay (compact support) to generate all the basis elements. Need to shift as well as scale the mother wavelet. Continuous and discrete wavelets Wavelet requirements Zero mean, oscillatory (wave) ψ (x) dx = Ψ(ω) 2 Admissibility condition Fast decay (let) compact support Regularity condition ω dω < 2 Stationary signal 2 Hz + Hz + 2Hz Example signals 3 6 Occur at all times Stationary Signal Signals with frequency content unchanged in time All frequency components exist at all times Stationary Non-stationary Signal Frequency changes in time One example: the Chirp Signal.-.4: 2 Hz : Hz +.7-.: 2 Hz Non- Stationary Time Frequency (Hz) Do not appear at all times Time Frequency (Hz) 4

2 Chirp signal Resolution of time & frquency Frequency: 2 Hz to 2 Hz Frequency: 2 Hz to 2 Hz Different in Time Domain Better time resolution; Poor frequency resolution Frequency Time Frequency (Hz) -.5 Same in Frequency Domain At what time the frequency components occur? FT can not tell! Time Frequency (Hz) Better frequency resolution; Poor time resolution Time 6 Decomposing non-stationary signals Decomposing non-stationary signals f L f L Signal:.-.4: 2 Hz.4-.7: Hz.7-.: 2 Hz Signal:.-.4: 2 Hz.4-.7: Hz.7-.: 2Hz f H Wavelet: db4 Level: 6 7 f H Wavelet: db4 Level: 6 8 2

3 Discrete wavelets: binary dilation and dyadic translation Use basis functions ψ j,k (x) = 2 j/2 ψ (2 j x-k), j,k є Z compression by 2 j (scale = 2 -j ) translation by k2 -j Example of compression and translation scaling by 2 j/2 to preserve L 2 norm A function ψ is called an orthogonal wavelet if the above family of functions is an orthonormal basis for L 2 (R), <ψ j,k, ψ l,m > = δ j,l δ k,m j,k,l,m є Z δ j,k = if j = l and k = m, and otherwise. the family of functions spans L 2 (R). Orthogonal and nested subspaces Let W j be the span of {ψ j,k, k є Z} W j W k for j k (case of orthogonal wavelets) L 2 (R) = W j = W - W W more details j є Z denotes orthogonal sum Let V j = W j-2 W j- V j+ = V j W j V = V - W - = V -2 W -2 W - = Consider the following conditions. {} V - V V (nested subspaces) 2. closure ( V j ) = L 2 (R) j є Z j є Z 3. V j = {} 4. φ j,k (x) = 2 j/2 φ (2 j x-k), j,k є Z 5. {φ j,k (x) k є Z} generates an orthonormal basis for V j. 9 Scaling function A function φ is called a scaling function (also called father wavelet) if it generates a nested sequence of subspaces that satisfies conditions on the previous slide. φ generates V j ψ generates W j Example of space generated by Haar scaling function. Decomposition I(x) = c 2 2 (x) + c 2 2 (x) + c (x) + c (x) V V - W - V -2 W -2 W - 2 3

4 Decomposition Decomposition c N c N- c N-2 d N- d N-2 d N-M c N-M Decompose each basis vector of V j into basis vectors of V j- and W j-. This results in a coefficient for each basis vector of V j- and W j-. Could also take inner products directly with the basis vectors. 3 Since V j is the orthogonal sum of V j- and W j-, there are decomposition sequences {p i }, {q i } such that φ j,k (x) = [ p k,m φ j-,m (x) + q k,m ψ j-,m (x) ] m This is called the decomposition relation 4 Decomposition f j (x) Reconstruction c N c N- c N-2 c N-M d N- d N-2 d N-M c j,k φ j,k (x) c j,k+ φ j,k+ (x) c j,k+2 φ j,k+2 (x) p k,m p k+,m p k+2,m φ j-,m (x) c j-,m = p l,m c j,l l ψ j-,m (x) d j-,m = q l,m c j,l l 5 We have a coefficient for each basis vector of V j- and W j-. Decompose each basis vector of V j- into basis vectors of V j. Repeat for W j-. Coefficient of each basis of V j as a function of coefficients of bases of V j- and W j- This results in a coefficient for each basis vector of V j. 6 4

5 Two-scale relation Since φ(2 j- x-k) and ψ(2 j- x-k) belong to V j, there exist reconstruction sequences {a i }, {b i } such that φ j-,k (x) = a k,m φ j,m (x) m ψ j-,k (x) = b k,m φ j,m (x) m The above relation is called the two-scale relation of the scaling function and the wavelet respectively. Reconstruction c j-,k φ j-,k (x) c j-,k+l φ j-,k+l (x) d j-,k ψ j-,k (x) a k,m a k+l,m b k,m φ j,m (x) c j,m = (a l,m c j-,l + b l,m d j-,l ) l d j-,k+l ψ j-,k+l (x) b k+l,m 7 8 Example: Haar wavelet ψ, (x) = for x <.5, - for.5 x <, otherwise. φ, (x) = for x <, otherwise. Check the orthonormality conditions Decomposition φ j,2k (x) = / 2 [φ j-,k (x) + ψ j-,k (x)] φ j,2k+ (x) = / 2 [φ j-,k (x) - ψ j-,k (x)] c j-,k (x) = / 2 [c j,2k + c j,2k+ ] d j-,k (x) = / 2 [c j,2k - c j,2k+ ] Reconstruction φ j-,k (x) = / 2 [φ j,2k (x) + φ j,2k+ (x)] ψ j-,k (x) = / 2 [φ j,2k (x) - φ j,2k+ (x)] c j,2k (x) = / 2 [c j-,k + d j-,k ] c j,2k+ (x) = / 2 [c j-,k - d j-,k ] Decomposition relation Two-scale relation c =[4,2,3,3,6,8,,7] Representation 4 φ, (x) 2 φ, (x-) 3 φ, (x-2) / 2 / 2 Decomposition 3 2φ -, (x) c - =[3 2,3 2,7 2,4 2 ] d - =[ 2,,- 2,-3 2] c -2 =[6,] d -2 =[,3] c -3 =[7/ 2] d -3 =[- 5/ 2] 2ψ -, (x) 9 2 5

6 Reconstruction Decomposition matrix c - =[3 2,3 2,7 2,4 2 ] d - =[ 2,,- 2,-3 2] / 2 / 2 / 2 -/ 2 c =[4,2,3,3,6,8,,7] / c, c, c,2 c,3 c,4 c,5 c,6 c,7 = c -, d -, c -, d -, c -,2 d -,2 c -,3 d -, Reconstruction matrix Example: Daubechies wavelet (D 4 ) - / c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 = c, c, c,2 c,3 c,4 c,5 c,6 c,7 Scaling function φ (x) Wavelet function ψ (x) (h, h, h2, h3) = (+ 3, 3+ 3, 3-3, - 3)/

7 Decomposition matrix Reconstruction matrix h h h 2 h 3 h 3 -h 2 h -h h h h 2 h 3 h 3 -h 2 h -h h h h 2 h 3 h 3 -h 2 h -h h 2 h 3 h h c, c, c,2 c,3 c,4 c,5 c,6 c,7 = c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 h h 3 h 2 h h -h 2 h 3 -h h 2 h h h 3 h 3 -h h -h 2 h 2 h h h 3 h 3 -h h -h 2 h 2 h h h 3 h 3 -h h -h 2 c -, d -, c -, d -, c -,2 d -,2 c -,3 d -,3 = c, c, c,2 c,3 c,4 c,5 c,6 c,7 h -h h 3 -h Wavelets in 2-d (standard decomposition) Apply wavelet transform along the rows. Decompose the signal into a set of coefficients. Apply transform along the columns on the row coefficients. Wavelets in 2-d (non-standard decomposition) Alternate between row and column transformations

8 Parseval s theorem: Properties f 2 = <f,ψ j,k > 2 f-g 2 = <f,ψ j,k > - <g,ψ j,k > 2 Also holds for the decomposition into a set of multiresolution details and a single summary. f N = g N- + g N f N-M Time complexity of decomposition Each step is O(n) The amount of work gets halved at each step Overall complexity is still O(n) Faster than DFT Time complexity of reconstruction is also O(n). Applications Images and videos Compression Smoothing and Denoising Big Data Dimensionality reduction Summarization Which would you use Fourier Wavelets (which one?) 29 3 Bibliography Wavelets and Dilation Equations: A Brief Introduction, Gilbert Strang, SIAM Review, Vol. 3, No. 4. (Dec., 989), pp

### Wavelet Analysis Based Estimation of Probability Density function of Wind Data

, pp.23-34 http://dx.doi.org/10.14257/ijeic.2014.5.3.03 Wavelet Analysis Based Estimation of Probability Density function of Wind Data Debanshee Datta Department of Mechanical Engineering Indian Institute

### α = u v. In other words, Orthogonal Projection

Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v

### 5. Orthogonal matrices

L Vandenberghe EE133A (Spring 2016) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal

### MATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform

MATH 433/533, Fourier Analysis Section 11, The Discrete Fourier Transform Now, instead of considering functions defined on a continuous domain, like the interval [, 1) or the whole real line R, we wish

### Inner product. Definition of inner product

Math 20F Linear Algebra Lecture 25 1 Inner product Review: Definition of inner product. Slide 1 Norm and distance. Orthogonal vectors. Orthogonal complement. Orthogonal basis. Definition of inner product

### WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE

Sunway Academic Journal 3, 87 98 (26) WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE SHIRLEY WONG a RAY ANDERSON Victoria University, Footscray Park Campus, Australia ABSTRACT This paper

### A Primer on Index Notation

A Primer on John Crimaldi August 28, 2006 1. Index versus Index notation (a.k.a. Cartesian notation) is a powerful tool for manipulating multidimensional equations. However, there are times when the more

### SNMP Simple Network Measurements Please!

SNMP Simple Network Measurements Please! Matthew Roughan (+many others) 1 Outline Part I: SNMP traffic data Simple Network Management Protocol Why? How? What? Part II: Wavelets

### SGN-1158 Introduction to Signal Processing Test. Solutions

SGN-1158 Introduction to Signal Processing Test. Solutions 1. Convolve the function ( ) with itself and show that the Fourier transform of the result is the square of the Fourier transform of ( ). (Hints:

### CITY UNIVERSITY LONDON. BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION

No: CITY UNIVERSITY LONDON BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION ENGINEERING MATHEMATICS 2 (resit) EX2005 Date: August

### Recall that two vectors in are perpendicular or orthogonal provided that their dot

Orthogonal Complements and Projections Recall that two vectors in are perpendicular or orthogonal provided that their dot product vanishes That is, if and only if Example 1 The vectors in are orthogonal

### BANACH AND HILBERT SPACE REVIEW

BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but

### A Wavelet Based Prediction Method for Time Series

A Wavelet Based Prediction Method for Time Series Cristina Stolojescu 1,2 Ion Railean 1,3 Sorin Moga 1 Philippe Lenca 1 and Alexandru Isar 2 1 Institut TELECOM; TELECOM Bretagne, UMR CNRS 3192 Lab-STICC;

### Admin stuff. 4 Image Pyramids. Spatial Domain. Projects. Fourier domain 2/26/2008. Fourier as a change of basis

Admin stuff 4 Image Pyramids Change of office hours on Wed 4 th April Mon 3 st March 9.3.3pm (right after class) Change of time/date t of last class Currently Mon 5 th May What about Thursday 8 th May?

### These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

DEFINITION: A vector space is a nonempty set V of objects, called vectors, on which are defined two operations, called addition and multiplication by scalars (real numbers), subject to the following axioms

### SPEECH SIGNAL CODING FOR VOIP APPLICATIONS USING WAVELET PACKET TRANSFORM A

International Journal of Science, Engineering and Technology Research (IJSETR), Volume, Issue, January SPEECH SIGNAL CODING FOR VOIP APPLICATIONS USING WAVELET PACKET TRANSFORM A N.Rama Tej Nehru, B P.Sunitha

### WAVELETS AND THEIR USAGE ON THE MEDICAL IMAGE COMPRESSION WITH A NEW ALGORITHM

WAVELETS AND THEIR USAGE ON THE MEDICAL IMAGE COMPRESSION WITH A NEW ALGORITHM Gulay TOHUMOGLU Electrical and Electronics Engineering Department University of Gaziantep 27310 Gaziantep TURKEY ABSTRACT

### Orthogonal Projections and Orthonormal Bases

CS 3, HANDOUT -A, 3 November 04 (adjusted on 7 November 04) Orthogonal Projections and Orthonormal Bases (continuation of Handout 07 of 6 September 04) Definition (Orthogonality, length, unit vectors).

### Part II Redundant Dictionaries and Pursuit Algorithms

Aisenstadt Chair Course CRM September 2009 Part II Redundant Dictionaries and Pursuit Algorithms Stéphane Mallat Centre de Mathématiques Appliquées Ecole Polytechnique Sparsity in Redundant Dictionaries

### Linearly Independent Sets and Linearly Dependent Sets

These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation

### CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen LECTURE 3: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major

### The continuous and discrete Fourier transforms

FYSA21 Mathematical Tools in Science The continuous and discrete Fourier transforms Lennart Lindegren Lund Observatory (Department of Astronomy, Lund University) 1 The continuous Fourier transform 1.1

### Enhancement of scanned documents in Besov spaces using wavelet domain representations

Enhancement of scanned documents in Besov spaces using wavelet domain representations Kathrin Berkner 1 Ricoh Innovations, Inc., 2882 Sand Hill Road, Suite 115, Menlo Park, CA 94025 ABSTRACT After scanning,

### ELEC 4801 THESIS PROJECT

School of Information Technology and Electrical Engineering ELEC 4801 THESIS PROJECT Thesis: Speech Compression Using Wavelets Name: Nikhil Rao Student No: 33710745 Supervisor: Dr John Homer Submitted

### Orthogonal Diagonalization of Symmetric Matrices

MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding

### Linear Algebra Review. Vectors

Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

### 1 VECTOR SPACES AND SUBSPACES

1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such

### Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity

Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities

Tracking Moving Objects In Video Sequences Yiwei Wang, Robert E. Van Dyck, and John F. Doherty Department of Electrical Engineering The Pennsylvania State University University Park, PA16802 Abstract{Object

### 1 2 3 1 1 2 x = + x 2 + x 4 1 0 1

(d) If the vector b is the sum of the four columns of A, write down the complete solution to Ax = b. 1 2 3 1 1 2 x = + x 2 + x 4 1 0 0 1 0 1 2. (11 points) This problem finds the curve y = C + D 2 t which

### ON THE DEGREES OF FREEDOM OF SIGNALS ON GRAPHS. Mikhail Tsitsvero and Sergio Barbarossa

ON THE DEGREES OF FREEDOM OF SIGNALS ON GRAPHS Mikhail Tsitsvero and Sergio Barbarossa Sapienza Univ. of Rome, DIET Dept., Via Eudossiana 18, 00184 Rome, Italy E-mail: tsitsvero@gmail.com, sergio.barbarossa@uniroma1.it

### Introduction to Medical Image Compression Using Wavelet Transform

National Taiwan University Graduate Institute of Communication Engineering Time Frequency Analysis and Wavelet Transform Term Paper Introduction to Medical Image Compression Using Wavelet Transform 李 自

### International Transmission of Stock Market Movements : A Wavelet Analysis on MENA Stock Markets

International Transmission of Stock Market Movements : A Wavelet Analysis on MENA Stock Markets Hahn Shik Lee Department of Economics Sogang University Seoul, KOREA October 2001 This is a preliminary draft

### Quantum Physics II (8.05) Fall 2013 Assignment 4

Quantum Physics II (8.05) Fall 2013 Assignment 4 Massachusetts Institute of Technology Physics Department Due October 4, 2013 September 27, 2013 3:00 pm Problem Set 4 1. Identitites for commutators (Based

### The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression

The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression The SVD is the most generally applicable of the orthogonal-diagonal-orthogonal type matrix decompositions Every

### Correlation and Convolution Class Notes for CMSC 426, Fall 2005 David Jacobs

Correlation and Convolution Class otes for CMSC 46, Fall 5 David Jacobs Introduction Correlation and Convolution are basic operations that we will perform to extract information from images. They are in

### FFT Algorithms. Chapter 6. Contents 6.1

Chapter 6 FFT Algorithms Contents Efficient computation of the DFT............................................ 6.2 Applications of FFT................................................... 6.6 Computing DFT

### Convolution, Correlation, & Fourier Transforms. James R. Graham 10/25/2005

Convolution, Correlation, & Fourier Transforms James R. Graham 10/25/2005 Introduction A large class of signal processing techniques fall under the category of Fourier transform methods These methods fall

### Orthogonal and Symmetric Haar Wavelets on the Sphere. Christian Lessig

Orthogonal and Symmetric Haar Wavelets on the Sphere by Christian Lessig A thesis submitted in conformity with the requirements for the degree of Master of Science Graduate Department of Computer Science

### Very Preliminary Program

Very Preliminary Program Two of the participants will give Colloquium talks before the meeting. The workshop it self starts on Friday morning. All talks will take place in Lockett, 277. The room is equipped

### Orthogonal Projections

Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors

### Short-time FFT, Multi-taper analysis & Filtering in SPM12

Short-time FFT, Multi-taper analysis & Filtering in SPM12 Computational Psychiatry Seminar, FS 2015 Daniel Renz, Translational Neuromodeling Unit, ETHZ & UZH 20.03.2015 Overview Refresher Short-time Fourier

### Chapter 6. Orthogonality

6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

### Auto-Tuning Using Fourier Coefficients

Auto-Tuning Using Fourier Coefficients Math 56 Tom Whalen May 20, 2013 The Fourier transform is an integral part of signal processing of any kind. To be able to analyze an input signal as a superposition

### Section 1.7 22 Continued

Section 1.5 23 A homogeneous equation is always consistent. TRUE - The trivial solution is always a solution. The equation Ax = 0 gives an explicit descriptions of its solution set. FALSE - The equation

### Inner Product Spaces

Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and

### LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

### Analysis/resynthesis with the short time Fourier transform

Analysis/resynthesis with the short time Fourier transform summer 2006 lecture on analysis, modeling and transformation of audio signals Axel Röbel Institute of communication science TU-Berlin IRCAM Analysis/Synthesis

### 1 Inner Products and Norms on Real Vector Spaces

Math 373: Principles Techniques of Applied Mathematics Spring 29 The 2 Inner Product 1 Inner Products Norms on Real Vector Spaces Recall that an inner product on a real vector space V is a function from

### The Hilbert Transform and Empirical Mode Decomposition as Tools for Data Analysis

The Hilbert Transform and Empirical Mode Decomposition as Tools for Data Analysis Susan Tolwinski First-Year RTG Project University of Arizona Program in Applied Mathematics Advisor: Professor Flaschka

### B3. Short Time Fourier Transform (STFT)

B3. Short Time Fourier Transform (STFT) Objectives: Understand the concept of a time varying frequency spectrum and the spectrogram Understand the effect of different windows on the spectrogram; Understand

### Applied Linear Algebra I Review page 1

Applied Linear Algebra Review 1 I. Determinants A. Definition of a determinant 1. Using sum a. Permutations i. Sign of a permutation ii. Cycle 2. Uniqueness of the determinant function in terms of properties

### Fourier Analysis and its applications

Fourier Analysis and its applications Fourier analysis originated from the study of heat conduction: Jean Baptiste Joseph Fourier (1768-1830) Fourier analysis enables a function (signal) to be decomposed

### c 2003 Society for Industrial and Applied Mathematics

SIAM J. SCI. COMPUT. Vol. 4, No. 4, pp. 148 143 c 3 Society for Industrial and Applied Mathematics WAVELET ALGORITHMS FOR HIGH-RESOLUTION IMAGE RECONSTRUCTION RAYMOND H. CHAN, TONY F. CHAN, LIXIN SHEN,

### Model order reduction via Proper Orthogonal Decomposition

Model order reduction via Proper Orthogonal Decomposition Reduced Basis Summer School 2015 Martin Gubisch University of Konstanz September 17, 2015 Martin Gubisch (University of Konstanz) Model order reduction

### Inner Product Spaces and Orthogonality

Inner Product Spaces and Orthogonality week 3-4 Fall 2006 Dot product of R n The inner product or dot product of R n is a function, defined by u, v a b + a 2 b 2 + + a n b n for u a, a 2,, a n T, v b,

### Disjoint sparsity for signal separation and applications to hybrid imaging inverse problems

Disjoint sparsity for signal separation and applications to hybrid imaging inverse problems Giovanni S Alberti (joint with H Ammari) DMA, École Normale Supérieure, Paris June 16, 2015 Giovanni S Alberti

### When is missing data recoverable?

When is missing data recoverable? Yin Zhang CAAM Technical Report TR06-15 Department of Computational and Applied Mathematics Rice University, Houston, TX 77005 October, 2006 Abstract Suppose a non-random

### Statistical Modeling by Wavelets

Statistical Modeling by Wavelets BRANI VIDAKOVIC Duke University A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York / Chichester / Weinheim / Brisbane / Singapore / Toronto Contents Preface

### Section 6.1 - Inner Products and Norms

Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,

### Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday.

Math 312, Fall 2012 Jerry L. Kazdan Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday. In addition to the problems below, you should also know how to solve

### A VARIANT OF THE EMD METHOD FOR MULTI-SCALE DATA

Advances in Adaptive Data Analysis Vol. 1, No. 4 (2009) 483 516 c World Scientific Publishing Company A VARIANT OF THE EMD METHOD FOR MULTI-SCALE DATA THOMAS Y. HOU and MIKE P. YAN Applied and Computational

### SIGNAL PROCESSING & SIMULATION NEWSLETTER

1 of 10 1/25/2008 3:38 AM SIGNAL PROCESSING & SIMULATION NEWSLETTER Note: This is not a particularly interesting topic for anyone other than those who ar e involved in simulation. So if you have difficulty

### MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

### Introduction to General and Generalized Linear Models

Introduction to General and Generalized Linear Models General Linear Models - part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby

### Linear Algebra Notes

Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note

### Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

### An Evaluation of Irregularities of Milled Surfaces by the Wavelet Analysis

An Evaluation of Irregularities of Milled Surfaces by the Wavelet Analysis Włodzimierz Makieła Abstract This paper presents an introductory to wavelet analysis and its application in assessing the surface

### CS 5614: (Big) Data Management Systems. B. Aditya Prakash Lecture #18: Dimensionality Reduc7on

CS 5614: (Big) Data Management Systems B. Aditya Prakash Lecture #18: Dimensionality Reduc7on Dimensionality Reduc=on Assump=on: Data lies on or near a low d- dimensional subspace Axes of this subspace

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

### EFFICIENT HEDGING USING A DYNAMIC PORTFOLIO OF BINARY OPTIONS. Key Words: Heding; Portfolio of Options; Haar Wavelets; Martingales.

EFFICIENT HEDGING USING A DYNAMIC PORTFOLIO OF BINARY OPTIONS S. E. FERRANDO, P. J. CATUOGNO, AND A. L. GONZALEZ Abstract. We present a discretization of financial instruments in terms of martingale expansions

### Image Compression through DCT and Huffman Coding Technique

International Journal of Current Engineering and Technology E-ISSN 2277 4106, P-ISSN 2347 5161 2015 INPRESSCO, All Rights Reserved Available at http://inpressco.com/category/ijcet Research Article Rahul

### Mathematical Methods for Computer Science

Mathematical Methods for Computer Science lectures on Fourier and related methods Professor J. Daugman Computer Laboratory University of Cambridge Computer Science Tripos, Part IB Michaelmas Term 2015/16

### Linear Algebra: Vectors

A Linear Algebra: Vectors A Appendix A: LINEAR ALGEBRA: VECTORS TABLE OF CONTENTS Page A Motivation A 3 A2 Vectors A 3 A2 Notational Conventions A 4 A22 Visualization A 5 A23 Special Vectors A 5 A3 Vector

### Text Analytics (Text Mining)

CSE 6242 / CX 4242 Apr 3, 2014 Text Analytics (Text Mining) LSI (uses SVD), Visualization Duen Horng (Polo) Chau Georgia Tech Some lectures are partly based on materials by Professors Guy Lebanon, Jeffrey

### 8.04: Quantum Mechanics Professor Allan Adams Massachusetts Institute of Technology. Problem Set 5

8.04: Quantum Mechanics Professor Allan Adams Massachusetts Institute of Technology Tuesday March 5 Problem Set 5 Due Tuesday March 12 at 11.00AM Assigned Reading: E&R 6 9, App-I Li. 7 1 4 Ga. 4 7, 6 1,2

### Linear algebra, signal processing, and wavelets. A unified approach. Python version. Øyvind Ryan

Linear algebra, signal processing, and wavelets A unified approach Python version Øyvind Ryan January, 5 ii Contents Preface vii I Fourier analysis and applications to sound processing Sound and Fourier

### 1 Norms and Vector Spaces

008.10.07.01 1 Norms and Vector Spaces Suppose we have a complex vector space V. A norm is a function f : V R which satisfies (i) f(x) 0 for all x V (ii) f(x + y) f(x) + f(y) for all x,y V (iii) f(λx)

### Lecture L3 - Vectors, Matrices and Coordinate Transformations

S. Widnall 16.07 Dynamics Fall 2009 Lecture notes based on J. Peraire Version 2.0 Lecture L3 - Vectors, Matrices and Coordinate Transformations By using vectors and defining appropriate operations between

### HYBRID WAVELET ARTIFICIAL NEURAL NETWORK MODEL FOR MUNICIPAL WATER DEMAND FORECASTING

HYBRID WAVELET ARTIFICIAL NEURAL NETWORK MODEL FOR MUNICIPAL WATER DEMAND FORECASTING Jowhar R. Mohammed 1 and Hekmat M. Ibrahim 2 1 Water Resources Engineering, Faculty of Engineering and Applied Science,

### Smooth tight frame wavelets and image microanalysis in the Fourier domain

Smooth tight frame wavelets and image microanalysis in the Fourier domain Ryuichi Ashino, Steven J. Desjardins, Christopher Heil, Michihiro Nagase and Rémi Vaillancourt CRM-2864 September 2002 Division

### 1 Lecture: Integration of rational functions by decomposition

Lecture: Integration of rational functions by decomposition into partial fractions Recognize and integrate basic rational functions, except when the denominator is a power of an irreducible quadratic.

### In the companion article (1), it is shown that the eigenfunctions

Geometric diffusions as a tool for harmonic analysis and structure definition of data: Multiscale methods R. R. Coifman*, S. Lafon*, A. B. Lee*, M. Maggioni*, B. Nadler*, F. Warner*, and S. W. Zucker *Department

### Co-integration of Stock Markets using Wavelet Theory and Data Mining

Co-integration of Stock Markets using Wavelet Theory and Data Mining R.Sahu P.B.Sanjeev rsahu@iiitm.ac.in sanjeev@iiitm.ac.in ABV-Indian Institute of Information Technology and Management, India Abstract

### L9: Cepstral analysis

L9: Cepstral analysis The cepstrum Homomorphic filtering The cepstrum and voicing/pitch detection Linear prediction cepstral coefficients Mel frequency cepstral coefficients This lecture is based on [Taylor,

### MATH 590: Meshfree Methods

MATH 590: Meshfree Methods Chapter 7: Conditionally Positive Definite Functions Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter

### Non-negative Matrix Factorization (NMF) in Semi-supervised Learning Reducing Dimension and Maintaining Meaning

Non-negative Matrix Factorization (NMF) in Semi-supervised Learning Reducing Dimension and Maintaining Meaning SAMSI 10 May 2013 Outline Introduction to NMF Applications Motivations NMF as a middle step

### 3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials

3. Interpolation Closing the Gaps of Discretization... Beyond Polynomials Closing the Gaps of Discretization... Beyond Polynomials, December 19, 2012 1 3.3. Polynomial Splines Idea of Polynomial Splines

### SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties

SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 3 Fall 2008 III. Spaces with special properties III.1 : Compact spaces I Problems from Munkres, 26, pp. 170 172 3. Show that a finite union of compact subspaces

### Question 2: How do you solve a matrix equation using the matrix inverse?

Question : How do you solve a matrix equation using the matrix inverse? In the previous question, we wrote systems of equations as a matrix equation AX B. In this format, the matrix A contains the coefficients

Elementary Gradient-Based Parameter Estimation Julius O. Smith III Center for Computer Research in Music and Acoustics (CCRMA Department of Music, Stanford University, Stanford, California 94305 USA Abstract

### 1. Let P be the space of all polynomials (of one real variable and with real coefficients) with the norm

Uppsala Universitet Matematiska Institutionen Andreas Strömbergsson Prov i matematik Funktionalanalys Kurs: F3B, F4Sy, NVP 005-06-15 Skrivtid: 9 14 Tillåtna hjälpmedel: Manuella skrivdon, Kreyszigs bok

### The Matrix Elements of a 3 3 Orthogonal Matrix Revisited

Physics 116A Winter 2011 The Matrix Elements of a 3 3 Orthogonal Matrix Revisited 1. Introduction In a class handout entitled, Three-Dimensional Proper and Improper Rotation Matrices, I provided a derivation

### RN-Codings: New Insights and Some Applications

RN-Codings: New Insights and Some Applications Abstract During any composite computation there is a constant need for rounding intermediate results before they can participate in further processing. Recently

### ( ) which must be a vector

MATH 37 Linear Transformations from Rn to Rm Dr. Neal, WKU Let T : R n R m be a function which maps vectors from R n to R m. Then T is called a linear transformation if the following two properties are

### Section 5.3. Section 5.3. u m ] l jj. = l jj u j + + l mj u m. v j = [ u 1 u j. l mj

Section 5. l j v j = [ u u j u m ] l jj = l jj u j + + l mj u m. l mj Section 5. 5.. Not orthogonal, the column vectors fail to be perpendicular to each other. 5..2 his matrix is orthogonal. Check that

### Speech Signal Processing: An Overview

Speech Signal Processing: An Overview S. R. M. Prasanna Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati December, 2012 Prasanna (EMST Lab, EEE, IITG) Speech

### MATH1231 Algebra, 2015 Chapter 7: Linear maps

MATH1231 Algebra, 2015 Chapter 7: Linear maps A/Prof. Daniel Chan School of Mathematics and Statistics University of New South Wales danielc@unsw.edu.au Daniel Chan (UNSW) MATH1231 Algebra 1 / 43 Chapter