MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

Similar documents
by the matrix A results in a vector which is a reflection of the given

Similarity and Diagonalization. Similar Matrices

Orthogonal Diagonalization of Symmetric Matrices

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MAT 242 Test 2 SOLUTIONS, FORM T

MATH APPLIED MATRIX THEORY

Chapter 6. Orthogonality

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

Linearly Independent Sets and Linearly Dependent Sets

Methods for Finding Bases

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION

Linear Algebra Review. Vectors

These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = i.

Brief Introduction to Vectors and Matrices

Section Inner Products and Norms

Similar matrices and Jordan form

Recall that two vectors in are perpendicular or orthogonal provided that their dot

13 MATH FACTS a = The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

Solutions to Math 51 First Exam January 29, 2015

x + y + z = 1 2x + 3y + 4z = 0 5x + 6y + 7z = 3

x = + x 2 + x

LINEAR ALGEBRA W W L CHEN

160 CHAPTER 4. VECTOR SPACES

Review Jeopardy. Blue vs. Orange. Review Jeopardy

18.06 Problem Set 4 Solution Due Wednesday, 11 March 2009 at 4 pm in Total: 175 points.

Recall the basic property of the transpose (for any A): v A t Aw = v w, v, w R n.

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

Notes on Determinant

University of Lille I PC first year list of exercises n 7. Review

LINEAR ALGEBRA. September 23, 2010

Lecture Notes 2: Matrices as Systems of Linear Equations

[1] Diagonal factorization

Chapter 20. Vector Spaces and Bases

r (t) = 2r(t) + sin t θ (t) = r(t) θ(t) + 1 = 1 1 θ(t) Write the given system in matrix form x = Ax + f ( ) sin(t) x y z = dy cos(t)

Numerical Analysis Lecture Notes

Introduction to Matrix Algebra

Name: Section Registered In:

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.

Inner Product Spaces and Orthogonality

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

a 11 x 1 + a 12 x a 1n x n = b 1 a 21 x 1 + a 22 x a 2n x n = b 2.

Examination paper for TMA4115 Matematikk 3

( ) which must be a vector

1 Sets and Set Notation.

Inner products on R n, and more

Math 550 Notes. Chapter 7. Jesse Crawford. Department of Mathematics Tarleton State University. Fall 2010

Arithmetic and Algebra of Matrices

A =

Vector Spaces 4.4 Spanning and Independence

Linear Algebra Notes

Section Continued

MATH2210 Notebook 1 Fall Semester 2016/ MATH2210 Notebook Solving Systems of Linear Equations... 3

DATA ANALYSIS II. Matrix Algorithms

NOTES ON LINEAR TRANSFORMATIONS

Systems of Linear Equations

October 3rd, Linear Algebra & Properties of the Covariance Matrix

6. Cholesky factorization

Math 312 Homework 1 Solutions

SALEM COMMUNITY COLLEGE Carneys Point, New Jersey COURSE SYLLABUS COVER SHEET. Action Taken (Please Check One) New Course Initiated

Chapter 17. Orthogonal Matrices and Symmetries of Space

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components

1 VECTOR SPACES AND SUBSPACES

α = u v. In other words, Orthogonal Projection

Math 215 HW #6 Solutions

T ( a i x i ) = a i T (x i ).

Applied Linear Algebra I Review page 1

Lecture 5: Singular Value Decomposition SVD (1)

MATH1231 Algebra, 2015 Chapter 7: Linear maps

Numerical Methods I Eigenvalue Problems

Subspaces of R n LECTURE Subspaces

Vector and Matrix Norms

Linear Algebra I. Ronald van Luijk, 2012

Linear algebra and the geometry of quadratic equations. Similarity transformations and orthogonal matrices

Solving Systems of Linear Equations

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007)

1 Introduction to Matrices

System of First Order Differential Equations

Inner Product Spaces

Lecture 1: Schur s Unitary Triangularization Theorem

4 MT210 Notebook Eigenvalues and Eigenvectors Definitions; Graphical Illustrations... 3

Zero: If P is a polynomial and if c is a number such that P (c) = 0 then c is a zero of P.

Reduced echelon form: Add the following conditions to conditions 1, 2, and 3 above:

On the representability of the bi-uniform matroid

Data Mining: Algorithms and Applications Matrix Math Review

Linear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

Continuity of the Perron Root

Modélisation et résolutions numérique et symbolique

Inner product. Definition of inner product

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

Lecture 4: Partitioned Matrices and Determinants

JUST THE MATHS UNIT NUMBER 1.8. ALGEBRA 8 (Polynomials) A.J.Hobson

Solutions to Homework Section 3.7 February 18th, 2005

Linear Algebra and TI 89

5 Homogeneous systems

8 Square matrices continued: Determinants

Math Lecture 33 : Positive Definite Matrices

Direct Methods for Solving Linear Systems. Matrix Factorization

Transcription:

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors Jordan canonical form (continued)

Jordan canonical form A Jordan block is a square matrix of the form λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0 0 0 λ 1 0 0 0 0 λ A square matrix B is in the Jordan canonical form if it has diagonal block structure J 1 O O O J B = 2 O, O O where each diagonal block J i is a Jordan block J k

Consider an n n Jordan block λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0 0 0 λ 1 0 0 0 0 λ Multiplication by J λi acts on the standard basis by a chain rule: 0 e 1 e 2 e n 1 e n

2 1 0 0 0 0 0 2 0 0 0 0 0 0 3 0 0 0 Consider a matrix B = 0 0 0 3 1 0 0 0 0 0 3 1 0 0 0 0 0 3 This matrix is in Jordan canonical form Vectors from the standard basis are organized in several chains Multiplication by B 2I: 0 e 1 e 2 Multiplication by B 3I: 0 e 3 0 e 4 e 5 e 6

Generalized eigenvectors Let L : V V be a linear operator on a vector space V Definition A nonzero vector v is called a generalized eigenvector of L associated with an eigenvalue λ if (L λi) k (v) = 0 for some integer k 1 (here I denotes the identity map on V) The set of all generalized eigenvectors for a particular λ along with the zero vector is called the generalized eigenspace and denoted K λ The generalized eigenvectors and eigenspaces of an n n matrix A are those of the operator L A (x) = Ax on F n

Properties of generalized eigenvectors Let L : V V be a linear operator on a vector space V Theorem (i) K λ is a subspace of V containing the eigenspace E λ and invariant under the operator L (ii) If v 1,v 2,,v m are generalized eigenvectors associated with distinct eigenvalues, then they are linearly independent (iii) If dim V < and the characteristic polynomial of L splits into linear factors, then V = K λ1 K λ2 K λm, where λ 1,λ 2,,λ m are eigenvalues of L Remarks A Jordan canonical basis for the operator L (ie, a basis β such that the matrix [L] β is in Jordan canonical form) must consist of generalized eigenvectors Not every basis of generalized eigenvectors is a Jordan canonical basis However such a basis can always be transformed into a Jordan canonical basis

Problem Find the Jordan canonical form and the corresponding Jordan canonical basis for the matrix 1 0 0 0 0 1 2 0 1 1 0 1 0 0 1 1 0 0 A = 0 0 0 1 0 0 0 0 0 0 1 0 1 0 0 0 0 1 Characteristic polynomial: 1 λ 0 0 0 0 1 2 λ 1 1 0 1 0 0 1 λ 1 0 0 p(λ) = 0 0 0 1 λ 0 0 0 0 0 0 1 λ 0 1 0 0 0 0 1 λ We expand the determinant by the 5th column, then by the 2nd column:

p(λ) = λ(1 λ) 1 λ 0 0 1 0 1 λ 1 0 0 0 1 λ 0 1 0 0 1 λ Expand the determinant by the 3rd row, then by the 2nd column: 1 λ 0 1 p(λ) = λ(1 λ) 2 0 1 λ 0 1 0 1 λ = λ(1 λ) 3 1 λ 1 1 1 λ = λ(1 λ) 3( ( 1 λ)(1 λ) + 1 ) = λ 3 (λ 1) 3 The eigenvalues are 0 and 1, both of multiplicity 3

To find N(A), we convert A to reduced row echelon form: 1 0 0 0 0 1 1 0 0 0 0 1 2 0 1 1 0 1 0 0 1 1 0 1 0 0 1 1 0 0 0 0 1 1 0 0 A = 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 1 0 0 0 0 1 1 0 0 0 0 1 1 0 0 0 0 0 0 0 1 1 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 1 0 1 0 0 0 0 0 1 Hence (x 1, x 2, x 3, x 4, x 5, x 6 ) N(A) if x 1 = x 3 = x 4 = x 5 = x 6 = 0 The eigenspace associated to the eigenvalue 0 is one-dimensional, spanned by v 1 = (0, 1, 0, 0, 0, 0)

The Jordan canonical form of A will contain only one Jordan block with the eigenvalue 0 Also, v 1 can be extended to a chain of generalized eigenvectors in a Jordan canonical basis The other two vectors v 2 and v 3 in the chain should satisfy Av 2 = v 1 and Av 3 = v 2 The equation Ax = v 1 is equivalent to a system of scalar linear equations General solution: x = (1, 0, 0, 0, 0, 1) + t(0, 1, 0, 0, 0, 0), t R We can take v 2 = (1, 0, 0, 0, 0, 1) Further, the general solution of the equation Ax = v 2 is x = (1, 0, 0, 0, 0, 2) + t(0, 1, 0, 0, 0, 0), t R We can take v 3 = (1, 0, 0, 0, 0, 2)

To find the eigenspace N(A I), we convert the matrix A I to reduced row echelon form: 2 0 0 0 0 1 2 1 1 1 0 1 0 0 0 1 0 0 A I = 1 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 2 1 1 1 0 1 0 1 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 2 0 0 0 0 1 0 0 0 0 0 1 Hence (x 1, x 2, x 3, x 4, x 5, x 6 ) N(A I) if x 1 = x 2 + x 3 = x 4 = x 6 = 0 We obtain that dim N(A I) = 2 The eigenspace N(A I) is spanned by w 1 = (0, 1, 1, 0, 0, 0) and w 2 = (0, 0, 0, 0, 1, 0)

Since dim N(A I) = 2, the Jordan canonical form of A will contain two Jordan blocks with the eigenvalue 1 Since the multiplicity of 1 as a root of the characteristic polynomial of A is 3, there will be one block of dimensions 1 1 and one block of dimensions 2 2 For the Jordan canonical basis, we need an eigenvector that can be extended to a chain of length 2 However one cannot guarantee that w 1 or w 2 is such a vector We are going to build the 2-chain from the beginning rather than backwards To this end, we find the null-space of the matrix (A I) 2 2 2 0 0 0 0 1 3 0 0 0 0 2 2 1 1 1 0 1 5 1 1 0 0 3 0 0 0 1 0 0 = 1 0 0 0 0 0 2 0 0 0 0 1

3 0 0 0 0 2 5 1 1 0 0 3 Row reduction: (A I) 2 = 2 0 0 0 0 1 1 0 0 0 0 0 1 0 0 0 0 0 5 1 1 0 0 3 0 1 1 0 0 0 0 0 0 0 0 1 2 0 0 0 0 1 Hence (x 1, x 2, x 3, x 4, x 5, x 6 ) N((A I) 2 ) if x 1 = x 2 + x 3 = x 6 = 0 General solution of the equation (A I) 2 x = 0: x = t(0, 1, 1, 0, 0, 0) + s(0, 0, 0, 1, 0, 0) + r(0, 0, 0, 0, 1, 0) We know that vectors w 1 = (0, 1, 1, 0, 0, 0) and w 2 = (0, 0, 0, 0, 1, 0) form a basis for N(A I) The vector w 3 = (0, 0, 0, 1, 0, 0) extends it to a basis for N((A I) 2 )

Since w 3 = (0, 0, 0, 1, 0, 0) is in N((A I) 2 ) but not in N(A I), the vectors u 1 = (A I)w 3 and u 2 = w 3 form a chain in a Jordan canonical basis for A We obtain that u 1 = (0, 1, 1, 0, 0, 0) = w 1 The last vector u 3 for the Jordan canonical basis should extend the set {u 1,u 2 } to a basis for N((A I) 2 ) We can take u 3 = w 2 = (0, 0, 0, 0, 1, 0) Multiplication by A: 0 v 1 v 2 v 3 Multiplication by A I: 0 u 1 u 2 0 u 3

Jordan canonical basis: v 1 = (0, 1, 0, 0, 0, 0), v 2 = (1, 0, 0, 0, 0, 1), v 3 = (1, 0, 0, 0, 0, 2), u 1 = (0, 1, 1, 0, 0, 0), u 2 = (0, 0, 0, 1, 0, 0), u 3 = (0, 0, 0, 0, 1, 0) We have A = UBU 1, where 0 1 0 0 0 0 0 1 1 0 0 0 0 0 1 0 0 0 1 0 0 1 0 0 0 0 0 1 0 0 B =, U = 0 0 0 1 1 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 1 0 1 2 0 0 0 Here B is the Jordan canonical form of the matrix A while U is the transition matrix from the Jordan canonical basis to the standard basis

1 0 0 0 0 1 2 0 1 1 0 1 Problem Let A = 0 0 1 1 0 0 0 0 0 1 0 0 Find An 0 0 0 0 1 0 1 0 0 0 0 1 Since A = UBU 1, we have A n = UB n U 1 Hence the problem is reduced to the computation of B n The matrix B has diagonal block structure: J 1 = J 2 = B = J 1 O O O J 2 O = B n = O O J 3 ( ) ( ) 0 1 0 0 0 1 0 0 1, J1 2 = 0 0 0 ( 1 1 0 1 ), J 2 2 = ( 1 2 0 1 ), J 3 2 = Finally, J 3 = (1) = J n 3 = (1) Jn 1 O O O J n 2 O O O J n 3, J 3 1 = O ( ) 1 3, J 0 1 2 n = ( ) 1 n 0 1