# 1.4 Fast Fourier Transform (FFT) Algorithm

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 74 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS 4 Fast Fourier Transform (FFT Algorithm Fast Fourier Transform, or FFT, is any algorithm for computing the -point DFT with a computational complexity of O( log It is not a new transform, but simply an efficient method of calculating the DFT of x(n If we assume that is even, we can write the -point DFT of x(n as X ( (k n is even: n is odd: m We make the following substitutions: x(ne j nm,m,,, x(ne j nl,l,,, j x(me m l n n x (m x(m, where m,,, x (l x(l, where l,, j x(l e (l ( Rewriting Eq (, we get X ( (k x (me m j m e j x (le l j l X ( j ( (ke X (k, ( where X ( (k is the -point DFT of the even-numbered samples of x(n and X( (k is the -point DFT of the odd-numbered samples of x(n ote that both of them are -periodic discrete-time functions We have the following algorithm to compute X ( (k for k,, ( : Compute X ( (k for k,, Compute X ( (k for k,, Perform the computation ( with complex multiplications and complex additions Actually, it is possible to use fewer than complex multiplications Let W e j π

2 Sec 4 Fast Fourier Transform (FFT Algorithm 75 x( x( x( x( x( x( -pt DFT X ( ( X ( ( X ( ( -pt X ( ( DFT X ( ( X ( W W X ( ( W X ( ( X ( ( W X( ( X ( ( X ( X ( ( W X( ( X ( X ( ( Figure 6 The FFT algorithm Then j( π W k e j e W k Therefore, X ( (k X ( (kwx k (k for k,,, ( X ( k X ( (k W k X (k for k,,, as illustrated in Fig 6 This shows that we do not need to actually perform complex multiplications, but only 8 Fig 7 illustrates the recursive implementation of the FFT supposing that M There is a total of M log stages of computation, each requiring complex operations Hence, the total computational complexity is O( log We see that the process ends at a -point DFT A -point DFT is the sample of the original signal: X( n π x(ne j( n x( The following remarks apply to the FFT: 8 Actually, slightly fewer if we do not count multiplications by ± and ±j

3 76 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS -pt DFT M -pt DFT M -pt DFT 4 X (k 4 X (k 4 X (k 4 X (k X (k operations X (k operations M -pt DFT X ( (k operations x x Total number of complex operations per DFT operation Total number of complex operations per level of recursion Figure 7 The recursive implementation of the FFT supposing that M There is a total of M log stages of computation, each requiring complex operations Hence, the total computational complexity is O( log For large, the FFT is much faster than the direct application of the definition of DFT, which is of complexity O( The particular implementation of the FFT described above is called decimationin-time radix- FFT The number of operations required by an FFT algorithm can be approximated as C log, where C is a constant There are many variations of FFT aimed at reducing this constant eg, if M, it may be better to use a radix- FFT 4 ote that { } DFT[x (n] { n n x (ne j( n x(ne j( n } which is the IDFT of x(n Thus, the FFT can also be used to compute the IDFT

4 Sec 4 Fast Fourier Transform (FFT Algorithm 77 -point DFT of x( x(4 «4-point DFT of x( x( x(4 x(6 C A x( x(4 X (8 ( X (8 ( x( x(6 x( x(5 x( x(7 W 4 «x( -point DFT of x(6 «x( -point DFT of x(5 W 4 W 8 W 8 W 8 X (8 ( X (8 ( X (8 (4 X (8 (5 X (8 (6 X (8 (7 -point DFT of x( x(7 «4-point DFT of x( x( x(4 x(6 C A Figure 8 The 8-point FFT Example 6 The 8-point FFT is depicted in Fig 8 The values of the twiddle factors are: W e j π, W 4 e j π 4 j, W 8 e j π 8

5 78 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS X A ( x W W W W W W A ( A ( x W W W W W W A ( A ( x( x( x( x( x( x( W X ( W W X ( W ( W W ( X ( ( X ( ( Figure 9 The FFT reduces the number of operations required to calculate the DFT by reducing A ( to two A ( that is only half the size of A ( This operation is repeated with every recursion until we reach the -point DFT

6 Sec 4 Fast Fourier Transform (FFT Algorithm 79 Recall that the DFT is a matrix multiplication (Fig 5 One stage of the FFT essentially reduces the multiplication by an matrix to two multiplications by matrices This reduces the number of operations required to calculate the DFT by almost a factor of two (Fig 9 Another interpretation of FFT involves analyzing the matrix ( A k,l j e L, j e L where k and L are nonnegative integers such that k< L ote that A k,l x,a k,l y (A k,l y H (A k,l x y H A H k,l A k,lx ( y H e j e j ( y H ( x y H x x, y, j e e j x ie, multiplication by A k,l preserves distances and angles roughly speaking, it is a rotation or reflection Continuing the matrix decomposition of Fig 9 further until we get the full FFT, it can be shown that FFT consists of log multiplications by matrices of the form A k,l, each operating on a pair of coordinates 9 Therefore, FFT breaks down the multiplication by the DFT matrix A into elementary planar transformations 4 Fast Computation of Convolution Consider a linear system described by y Sx, ( where x is the input vector, representing an -periodic input signal; S is an matrix; and y is the output vector, representing an -periodic output signal What conditions must the matrix S satisfy in order for the system to be time-invariant, ie, invariant to circular shifts of the input vector? ote that a circular shift by one sample is x( x( x( x( x( x( x( x( x( 9 The same conclusion can be reached by examining an FFT diagram such as Fig 8

7 8 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS Let the first column of S be ote that when and when h x h( h( h( h(, then y h, x then y is the second column of S, which therefore, in order for S to be invariant to circular shifts, must be equal to: h( h( h( h( Similarly, when x,,, then y is the third column of S, etc Thus, the matrix S must have the following structure: h( h( h( h( h( h( h( h( S h( h( h( h( h( h( h( h(

8 Sec 4 Fast Fourier Transform (FFT Algorithm 8 This is called a circulant matrix We can then write Eq ( as y(n m m x(mh(n m x(mh((n m mod (4 x h(n x h (5 Eq (5 is called a circular convolution or a periodic convolution ote that formula (4 works even when x or h are non-periodic Observe the following: For y(, the sum of the indices of x and h is always mod for every term y( x(h( x(h( x(h( x( h( For y(, the sum of the indices of x and h is always mod for every term y( x(h( x(h( x(h( x( h( This is true for all y(k, k,,, What are the eigenvectors of S? Let us try ej g k ej, where k,,, We have: ej ( y(n h(n g k m m { m h(mg k (n m h(m H(k } {{ } DFT of h ej (nm } j h(me m ej n ej n

9 8 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS Hence we have that Sg k H(kg k where g k is the k-th eigenvector and H(k gives the corresponding eigenvalue Therefore, H( S ( g g g ( H( g g g } {{ } The IDFT matrix B H( Then S can be written as: S B H( H( H( A, where the DFT matrix A is: A B H g H g H g H Complex exponentials are the eigenvectors of circulant matrices They diagonalize circulant matrices Thus, for any x C, H( H( Sx B Ax H( Let us compare two algorithms for computing the circular convolution of x and h Algorithm Directly perform the multiplication Sx This has computational complexity O ( Algorithm Represent x in the eigenbasis of S, ie, the Fourier basis, X Ax This step can be done with FFT whose complexity is O( log

10 Sec 4 Fast Fourier Transform (FFT Algorithm 8 Step Step Step x(n h(n -point DFT -point DFT X(k H(k Y (k X(kH(k Y (k -point IDFT y(n x h(n Figure 4 An illustration of the FFT implementation of the circular convolution Compute the representation of y in the eigenbasis of S: H( H( Y H( X This computation has complexity O( Reconstruct y from its Fourier coefficients: y BY This has complexity O( log, if done using the FFT This algorithm is summarized in Fig 4 Its total complexity is O( log (ote that the second algorithm does not necessarily perform better for any matrix Example 7 This example explores the relationship between the convolution and the circular convolution Let x and h be -periodic signals, and let { x(n, n x z, otherwise { h(n, n h z, otherwise If we let y z (n x z h z (n y(n x h(n then y(n can be expressed as { yz (ny y(n z ( n, n,,, y(, n

11 84 CHAPTER AALYSIS OF DISCRETE-TIME LIEAR TIME-IVARIAT SYSTEMS ote that the overlap of y z (n and y z ( n causes temporal aliasing in the resulting y(n This is the main difference between convolution and circular convolution x(n h(n 4 n 4 n (a Convolution y z (n x z h z (n y z (n n (b Circular convolution y(n x h(n y(n y( y z( y z( y( y z( y z(4 y( y z( y z(5 4 5 n Figure 4 A comparison between circular convolution and convolution Fig 4 illustrates the effect of temporal aliasing To remove or minimize the effect of temporal aliasing, we could zero-pad x and h so that the temporal replicas are spread further apart, and thus, overlapping would not occur

### FFT Algorithms. Chapter 6. Contents 6.1

Chapter 6 FFT Algorithms Contents Efficient computation of the DFT............................................ 6.2 Applications of FFT................................................... 6.6 Computing DFT

### Discrete Fourier Series & Discrete Fourier Transform Chapter Intended Learning Outcomes

Discrete Fourier Series & Discrete Fourier Transform Chapter Intended Learning Outcomes (i) Understanding the relationships between the transform, discrete-time Fourier transform (DTFT), discrete Fourier

### The Discrete Fourier Transform

The Discrete Fourier Transform Introduction The discrete Fourier transform (DFT) is a fundamental transform in digital signal processing, with applications in frequency analysis, fast convolution, image

### Polynomials and the Fast Fourier Transform (FFT) Battle Plan

Polynomials and the Fast Fourier Transform (FFT) Algorithm Design and Analysis (Wee 7) 1 Polynomials Battle Plan Algorithms to add, multiply and evaluate polynomials Coefficient and point-value representation

### Department of Electronics and Communication Engineering 1

DHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING III Year ECE / V Semester EC 6502 PRINCIPLES OF DIGITAL SIGNAL PROCESSING QUESTION BANK Department of

### Chapter 3 Discrete-Time Fourier Series. by the French mathematician Jean Baptiste Joseph Fourier in the early 1800 s. The

Chapter 3 Discrete-Time Fourier Series 3.1 Introduction The Fourier series and Fourier transforms are mathematical correlations between the time and frequency domains. They are the result of the heat-transfer

### SGN-1158 Introduction to Signal Processing Test. Solutions

SGN-1158 Introduction to Signal Processing Test. Solutions 1. Convolve the function ( ) with itself and show that the Fourier transform of the result is the square of the Fourier transform of ( ). (Hints:

### Difference Equations

Difference Equations Andrew W H House 10 June 004 1 The Basics of Difference Equations Recall that in a previous section we saw that IIR systems cannot be evaluated using the convolution sum because it

### Chapter 6. Orthogonality

6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

### Notes on Determinant

ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without

### Digital image processing

Digital image processing The two-dimensional discrete Fourier transform and applications: image filtering in the frequency domain Introduction Frequency domain filtering modifies the brightness values

### Fast Fourier Transform: Theory and Algorithms

Fast Fourier Transform: Theory and Algorithms Lecture Vladimir Stojanović 6.973 Communication System Design Spring 006 Massachusetts Institute of Technology Discrete Fourier Transform A review Definition

### Bits Superposition Quantum Parallelism

7-Qubit Quantum Computer Typical Ion Oscillations in a Trap Bits Qubits vs Each qubit can represent both a or at the same time! This phenomenon is known as Superposition. It leads to Quantum Parallelism

### Solution based on matrix technique Rewrite. ) = 8x 2 1 4x 1x 2 + 5x x1 2x 2 2x 1 + 5x 2

8.2 Quadratic Forms Example 1 Consider the function q(x 1, x 2 ) = 8x 2 1 4x 1x 2 + 5x 2 2 Determine whether q(0, 0) is the global minimum. Solution based on matrix technique Rewrite q( x1 x 2 = x1 ) =

### 5. Orthogonal matrices

L Vandenberghe EE133A (Spring 2016) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal

### The continuous and discrete Fourier transforms

FYSA21 Mathematical Tools in Science The continuous and discrete Fourier transforms Lennart Lindegren Lund Observatory (Department of Astronomy, Lund University) 1 The continuous Fourier transform 1.1

### ADVANCED LINEAR ALGEBRA FOR ENGINEERS WITH MATLAB. Sohail A. Dianat. Rochester Institute of Technology, New York, U.S.A. Eli S.

ADVANCED LINEAR ALGEBRA FOR ENGINEERS WITH MATLAB Sohail A. Dianat Rochester Institute of Technology, New York, U.S.A. Eli S. Saber Rochester Institute of Technology, New York, U.S.A. (g) CRC Press Taylor

### Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

Notes on Orthogonal and Symmetric Matrices MENU, Winter 201 These notes summarize the main properties and uses of orthogonal and symmetric matrices. We covered quite a bit of material regarding these topics,

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### A Tutorial on Fourier Analysis

A Tutorial on Fourier Analysis Douglas Eck University of Montreal NYU March 26 1.5 A fundamental and three odd harmonics (3,5,7) fund (freq 1) 3rd harm 5th harm 7th harmm.5 1 2 4 6 8 1 12 14 16 18 2 1.5

### 0.1 Phase Estimation Technique

Phase Estimation In this lecture we will describe Kitaev s phase estimation algorithm, and use it to obtain an alternate derivation of a quantum factoring algorithm We will also use this technique to design

### PROPERTIES AND EXAMPLES OF Z-TRANSFORMS

PROPERTIES AD EXAMPLES OF Z-TRASFORMS I. Introduction In the last lecture we reviewed the basic properties of the z-transform and the corresponding region of convergence. In this lecture we will cover

### Frequency Response of FIR Filters

Frequency Response of FIR Filters Chapter 6 This chapter continues the study of FIR filters from Chapter 5, but the emphasis is frequency response, which relates to how the filter responds to an input

### Module 4. Contents. Digital Filters - Implementation and Design. Signal Flow Graphs. Digital Filter Structures. FIR and IIR Filter Design Techniques

Module 4 Digital Filters - Implementation and Design Digital Signal Processing. Slide 4.1 Contents Signal Flow Graphs Basic filtering operations Digital Filter Structures Direct form FIR and IIR filters

### MATRICES AND LINEAR ALGEBRA

MATRICES AND LINEAR ALGEBRA Linear Algebra Matrix manipulation is the original essence of Matlab; hence the name MATrix LABoratory. In this section we will cover the basics of linear algebra, the ways

### 4 Solving Systems of Equations by Reducing Matrices

Math 15 Sec S0601/S060 4 Solving Systems of Equations by Reducing Matrices 4.1 Introduction One of the main applications of matrix methods is the solution of systems of linear equations. Consider for example

### Inner Product Spaces

Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and

### THE FAST FOURIER TRANSFORM

THE FAST FOURIER TRASFORM LOG CHE ABSTRACT. Fast Fourier transform (FFT) is a fast algorithm to compute the discrete Fourier transform in O( log ) operations for an array of size 2 J. It is based on the

### Lecture 11 Fast Fourier Transform (FFT)

Lecture 11 Fast Fourier Transform (FFT) Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn

### Curve Fitting. Next: Numerical Differentiation and Integration Up: Numerical Analysis for Chemical Previous: Optimization.

Next: Numerical Differentiation and Integration Up: Numerical Analysis for Chemical Previous: Optimization Subsections Least-Squares Regression Linear Regression General Linear Least-Squares Nonlinear

### 2.5 Elementary Row Operations and the Determinant

2.5 Elementary Row Operations and the Determinant Recall: Let A be a 2 2 matrtix : A = a b. The determinant of A, denoted by det(a) c d or A, is the number ad bc. So for example if A = 2 4, det(a) = 2(5)

### DSP Laboratory Work S. Laboratory exercises with TMS320C5510 DSK

DSP Laboratory Work 521485S Laboratory exercises with TMS320C5510 DSK Jari Hannuksela Information Processing Laboratory Dept. of Electrical and Information Engineering, University of Oulu ovember 14, 2008

### L6: Short-time Fourier analysis and synthesis

L6: Short-time Fourier analysis and synthesis Overview Analysis: Fourier-transform view Analysis: filtering view Synthesis: filter bank summation (FBS) method Synthesis: overlap-add (OLA) method STFT magnitude

### We seek a factorization of a square matrix A into the product of two matrices which yields an

LU Decompositions We seek a factorization of a square matrix A into the product of two matrices which yields an efficient method for solving the system where A is the coefficient matrix, x is our variable

### Analysis/resynthesis with the short time Fourier transform

Analysis/resynthesis with the short time Fourier transform summer 2006 lecture on analysis, modeling and transformation of audio signals Axel Röbel Institute of communication science TU-Berlin IRCAM Analysis/Synthesis

### Week 7: Divide and Conquer

Agenda: Divide and Conquer technique Multiplication of large integers Exponentiation Matrix multiplication 1 2- Divide and Conquer : To solve a problem we can break it into smaller subproblems, solve each

### 3.1 State Space Models

31 State Space Models In this section we study state space models of continuous-time linear systems The corresponding results for discrete-time systems, obtained via duality with the continuous-time models,

### 1. True/False: Circle the correct answer. No justifications are needed in this exercise. (1 point each)

Math 33 AH : Solution to the Final Exam Honors Linear Algebra and Applications 1. True/False: Circle the correct answer. No justifications are needed in this exercise. (1 point each) (1) If A is an invertible

### Chapter 17. Orthogonal Matrices and Symmetries of Space

Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length

### Difference Equations and Digital Filters

SIGNALS AND SYSTEMS: PAPER C HANDOUT 8. Dr David Corrigan. Electronic and Electrical Engineering Dept. corrigad@tcd.ie www.mee.tcd.ie/ corrigad Difference Equations and Digital Filters The last topic discussed

### UNIVERSITY OF CALIFORNIA, SAN DIEGO Electrical & Computer Engineering Department ECE 101 - Fall 2009 Linear Systems Fundamentals

UNIVERSITY OF CALIFORNIA, SAN DIEGO Electrical & Computer Engineering Department ECE 101 - Fall 2009 Linear Systems Fundamentals MIDTERM EXAM You are allowed one 2-sided sheet of notes. No books, no other

### Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round \$200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

### UNIT 2 MATRICES - I 2.0 INTRODUCTION. Structure

UNIT 2 MATRICES - I Matrices - I Structure 2.0 Introduction 2.1 Objectives 2.2 Matrices 2.3 Operation on Matrices 2.4 Invertible Matrices 2.5 Systems of Linear Equations 2.6 Answers to Check Your Progress

### Final Year Project Progress Report. Frequency-Domain Adaptive Filtering. Myles Friel. Supervisor: Dr.Edward Jones

Final Year Project Progress Report Frequency-Domain Adaptive Filtering Myles Friel 01510401 Supervisor: Dr.Edward Jones Abstract The Final Year Project is an important part of the final year of the Electronic

### α = u v. In other words, Orthogonal Projection

Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v

### Fourier Transform and Image Filtering. CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010

Fourier Transform and Image Filtering CS/BIOEN 6640 Lecture Marcel Prastawa Fall 2010 The Fourier Transform Fourier Transform Forward, mapping to frequency domain: Backward, inverse mapping to time domain:

### 1.7 Cylindrical and Spherical Coordinates

56 CHAPTER 1. VECTORS AND THE GEOMETRY OF SPACE 1.7 Cylindrical and Spherical Coordinates 1.7.1 Review: Polar Coordinates The polar coordinate system is a two-dimensional coordinate system in which the

### Chapter 4 - Systems of Equations and Inequalities

Math 233 - Spring 2009 Chapter 4 - Systems of Equations and Inequalities 4.1 Solving Systems of equations in Two Variables Definition 1. A system of linear equations is two or more linear equations to

### Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction

### MATH 289 PROBLEM SET 4: NUMBER THEORY

MATH 289 PROBLEM SET 4: NUMBER THEORY 1. The greatest common divisor If d and n are integers, then we say that d divides n if and only if there exists an integer q such that n = qd. Notice that if d divides

### Examples of Functions

Examples of Functions In this document is provided examples of a variety of functions. The purpose is to convince the beginning student that functions are something quite different than polynomial equations.

### Discrete-Time Signals and Systems

2 Discrete-Time Signals and Systems 2.0 INTRODUCTION The term signal is generally applied to something that conveys information. Signals may, for example, convey information about the state or behavior

### Operation Count; Numerical Linear Algebra

10 Operation Count; Numerical Linear Algebra 10.1 Introduction Many computations are limited simply by the sheer number of required additions, multiplications, or function evaluations. If floating-point

### Design of FIR Filters

Design of FIR Filters Elena Punskaya www-sigproc.eng.cam.ac.uk/~op205 Some material adapted from courses by Prof. Simon Godsill, Dr. Arnaud Doucet, Dr. Malcolm Macleod and Prof. Peter Rayner 68 FIR as

### MATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform

MATH 433/533, Fourier Analysis Section 11, The Discrete Fourier Transform Now, instead of considering functions defined on a continuous domain, like the interval [, 1) or the whole real line R, we wish

### Solutions to Linear Algebra Practice Problems

Solutions to Linear Algebra Practice Problems. Find all solutions to the following systems of linear equations. (a) x x + x 5 x x x + x + x 5 (b) x + x + x x + x + x x + x + 8x Answer: (a) We create the

### Principal Component Analysis Application to images

Principal Component Analysis Application to images Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics Center for Machine Perception http://cmp.felk.cvut.cz/

### A matrix over a field F is a rectangular array of elements from F. The symbol

Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F) denotes the collection of all m n matrices over F Matrices will usually be denoted

### There are four common ways of finding the inverse z-transform:

Inverse z-transforms and Difference Equations Preliminaries We have seen that given any signal x[n], the two-sided z-transform is given by n x[n]z n and X(z) converges in a region of the complex plane

### Chapter 4: Systems of Equations and Ineq. Lecture notes Math 1010

Section 4.1: Systems of Equations Systems of equations A system of equations consists of two or more equations involving two or more variables { ax + by = c dx + ey = f A solution of such a system is an

### 1 Example of Time Series Analysis by SSA 1

1 Example of Time Series Analysis by SSA 1 Let us illustrate the 'Caterpillar'-SSA technique [1] by the example of time series analysis. Consider the time series FORT (monthly volumes of fortied wine sales

### Diagonalisation. Chapter 3. Introduction. Eigenvalues and eigenvectors. Reading. Definitions

Chapter 3 Diagonalisation Eigenvalues and eigenvectors, diagonalisation of a matrix, orthogonal diagonalisation fo symmetric matrices Reading As in the previous chapter, there is no specific essential

### FIR Filter Design. FIR Filters and the z-domain. The z-domain model of a general FIR filter is shown in Figure 1. Figure 1

FIR Filters and the -Domain FIR Filter Design The -domain model of a general FIR filter is shown in Figure. Figure Each - box indicates a further delay of one sampling period. For example, the input to

### The Characteristic Polynomial

Physics 116A Winter 2011 The Characteristic Polynomial 1 Coefficients of the characteristic polynomial Consider the eigenvalue problem for an n n matrix A, A v = λ v, v 0 (1) The solution to this problem

### Iterative Techniques in Matrix Algebra. Jacobi & Gauss-Seidel Iterative Techniques II

Iterative Techniques in Matrix Algebra Jacobi & Gauss-Seidel Iterative Techniques II Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin

### Additional Topics in Linear Algebra Supplementary Material for Math 540. Joseph H. Silverman

Additional Topics in Linear Algebra Supplementary Material for Math 540 Joseph H Silverman E-mail address: jhs@mathbrownedu Mathematics Department, Box 1917 Brown University, Providence, RI 02912 USA Contents

### University of Lille I PC first year list of exercises n 7. Review

University of Lille I PC first year list of exercises n 7 Review Exercise Solve the following systems in 4 different ways (by substitution, by the Gauss method, by inverting the matrix of coefficients

### 1 2 3 1 1 2 x = + x 2 + x 4 1 0 1

(d) If the vector b is the sum of the four columns of A, write down the complete solution to Ax = b. 1 2 3 1 1 2 x = + x 2 + x 4 1 0 0 1 0 1 2. (11 points) This problem finds the curve y = C + D 2 t which

### LS.6 Solution Matrices

LS.6 Solution Matrices In the literature, solutions to linear systems often are expressed using square matrices rather than vectors. You need to get used to the terminology. As before, we state the definitions

### Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain

Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain 1. Orthogonal matrices and orthonormal sets An n n real-valued matrix A is said to be an orthogonal

### Linear algebra and the geometry of quadratic equations. Similarity transformations and orthogonal matrices

MATH 30 Differential Equations Spring 006 Linear algebra and the geometry of quadratic equations Similarity transformations and orthogonal matrices First, some things to recall from linear algebra Two

### MATH 551 - APPLIED MATRIX THEORY

MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points

### A Second Course in Elementary Differential Equations: Problems and Solutions. Marcel B. Finan Arkansas Tech University c All Rights Reserved

A Second Course in Elementary Differential Equations: Problems and Solutions Marcel B. Finan Arkansas Tech University c All Rights Reserved Contents 8 Calculus of Matrix-Valued Functions of a Real Variable

### 1 Eigenvalues and Eigenvectors

Math 20 Chapter 5 Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors. Definition: A scalar λ is called an eigenvalue of the n n matrix A is there is a nontrivial solution x of Ax = λx. Such an x

### General Framework for an Iterative Solution of Ax b. Jacobi s Method

2.6 Iterative Solutions of Linear Systems 143 2.6 Iterative Solutions of Linear Systems Consistent linear systems in real life are solved in one of two ways: by direct calculation (using a matrix factorization,

### 3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials

3. Interpolation Closing the Gaps of Discretization... Beyond Polynomials Closing the Gaps of Discretization... Beyond Polynomials, December 19, 2012 1 3.3. Polynomial Splines Idea of Polynomial Splines

### by the matrix A results in a vector which is a reflection of the given

Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

### Solving Linear Diophantine Matrix Equations Using the Smith Normal Form (More or Less)

Solving Linear Diophantine Matrix Equations Using the Smith Normal Form (More or Less) Raymond N. Greenwell 1 and Stanley Kertzner 2 1 Department of Mathematics, Hofstra University, Hempstead, NY 11549

### Geometric Transformations

Geometric Transformations Definitions Def: f is a mapping (function) of a set A into a set B if for every element a of A there exists a unique element b of B that is paired with a; this pairing is denoted

### Notes for STA 437/1005 Methods for Multivariate Data

Notes for STA 437/1005 Methods for Multivariate Data Radford M. Neal, 26 November 2010 Random Vectors Notation: Let X be a random vector with p elements, so that X = [X 1,..., X p ], where denotes transpose.

### Algebraic and Combinatorial Circuits

C H A P T E R Algebraic and Combinatorial Circuits Algebraic circuits combine operations drawn from an algebraic system. In this chapter we develop algebraic and combinatorial circuits for a variety of

### 4. Factor polynomials over complex numbers, describe geometrically, and apply to real-world situations. 5. Determine and apply relationships among syn

I The Real and Complex Number Systems 1. Identify subsets of complex numbers, and compare their structural characteristics. 2. Compare and contrast the properties of real numbers with the properties of

### Understand the principles of operation and characterization of digital filters

Digital Filters 1.0 Aim Understand the principles of operation and characterization of digital filters 2.0 Learning Outcomes You will be able to: Implement a digital filter in MATLAB. Investigate how commercial

### BX in ( u, v) basis in two ways. On the one hand, AN = u+

1. Let f(x) = 1 x +1. Find f (6) () (the value of the sixth derivative of the function f(x) at zero). Answer: 7. We expand the given function into a Taylor series at the point x = : f(x) = 1 x + x 4 x

### Linear Algebra and TI 89

Linear Algebra and TI 89 Abdul Hassen and Jay Schiffman This short manual is a quick guide to the use of TI89 for Linear Algebra. We do this in two sections. In the first section, we will go over the editing

### Lecture 4: Polynomial Algorithms

Lecture 4: Polynomial Algorithms Piotr Sankowski Stefano Leonardi sankowski@dis.uniroma1.it leon@dis.uniroma1.it Theoretical Computer Science 29.10.2009 - p. 1/39 Lecture Overview Introduction Point Polynomial

### Mathematics of Cryptography Modular Arithmetic, Congruence, and Matrices. A Biswas, IT, BESU SHIBPUR

Mathematics of Cryptography Modular Arithmetic, Congruence, and Matrices A Biswas, IT, BESU SHIBPUR McGraw-Hill The McGraw-Hill Companies, Inc., 2000 Set of Integers The set of integers, denoted by Z,

### Linear Equations and Inverse Matrices

Chapter 4 Linear Equations and Inverse Matrices 4. Two Pictures of Linear Equations The central problem of linear algebra is to solve a system of equations. Those equations are linear, which means that

### The Complex Fourier Transform

CHAPTER 31 The Complex Fourier Transform Although complex numbers are fundamentally disconnected from our reality, they can be used to solve science and engineering problems in two ways. First, the parameters

### Jones and Bartlett Publishers, LLC. NOT FOR SALE OR DISTRIBUTION

8498_CH08_WilliamsA.qxd 11/13/09 10:35 AM Page 347 Jones and Bartlett Publishers, LLC. NOT FOR SALE OR DISTRIBUTION C H A P T E R Numerical Methods 8 I n this chapter we look at numerical techniques for

### Markov Chains, Stochastic Processes, and Advanced Matrix Decomposition

Markov Chains, Stochastic Processes, and Advanced Matrix Decomposition Jack Gilbert Copyright (c) 2014 Jack Gilbert. Permission is granted to copy, distribute and/or modify this document under the terms

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

### Linear Programming. March 14, 2014

Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1

### Solving Systems of Linear Equations

LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how

### a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.

Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given

### Piecewise Cubic Splines

280 CHAP. 5 CURVE FITTING Piecewise Cubic Splines The fitting of a polynomial curve to a set of data points has applications in CAD (computer-assisted design), CAM (computer-assisted manufacturing), and

### Section 9.5: Equations of Lines and Planes

Lines in 3D Space Section 9.5: Equations of Lines and Planes Practice HW from Stewart Textbook (not to hand in) p. 673 # 3-5 odd, 2-37 odd, 4, 47 Consider the line L through the point P = ( x, y, ) that

### Discrete Fourier transform

CUUK852-Mandal & Asif November 7, 26 5:5 CHAPTER 2 Discrete Fourier transform In Chapter, we introduced the discrete-time Fourier transform (DTFT) that provides us with alternative representations for