Lecture 11. Shuanglin Shao. October 2nd and 7th, 2013

Similar documents
Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = i.

Lecture 4: Partitioned Matrices and Determinants

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

Notes on Determinant

Using row reduction to calculate the inverse and the determinant of a square matrix

8 Square matrices continued: Determinants

DETERMINANTS TERRY A. LORING

1 Determinants and the Solvability of Linear Systems

160 CHAPTER 4. VECTOR SPACES

Unit 18 Determinants

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

The Characteristic Polynomial

Solving Linear Systems, Continued and The Inverse of a Matrix

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

Similarity and Diagonalization. Similar Matrices

Name: Section Registered In:

Matrices 2. Solving Square Systems of Linear Equations; Inverse Matrices

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

The Determinant: a Means to Calculate Volume

NOTES ON LINEAR TRANSFORMATIONS

Lecture 14: Section 3.3

Systems of Linear Equations

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

Matrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.

Methods for Finding Bases

University of Lille I PC first year list of exercises n 7. Review

Linear Algebra Notes for Marsden and Tromba Vector Calculus

a 11 x 1 + a 12 x a 1n x n = b 1 a 21 x 1 + a 22 x a 2n x n = b 2.

Chapter 7. Matrices. Definition. An m n matrix is an array of numbers set out in m rows and n columns. Examples. (

Lecture 3: Finding integer solutions to systems of linear equations

T ( a i x i ) = a i T (x i ).

Math 312 Homework 1 Solutions

1 Sets and Set Notation.

MATH APPLIED MATRIX THEORY

13 MATH FACTS a = The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

Lectures notes on orthogonal matrices (with exercises) Linear Algebra II - Spring 2004 by D. Klain

4.5 Linear Dependence and Linear Independence

LINEAR ALGEBRA. September 23, 2010

Solution to Homework 2

Chapter 17. Orthogonal Matrices and Symmetries of Space

Matrix Differentiation

GENERATING SETS KEITH CONRAD

Notes on Linear Algebra. Peter J. Cameron

Lecture 2 Matrix Operations

Direct Methods for Solving Linear Systems. Matrix Factorization

Chapter 7. Permutation Groups

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Recall the basic property of the transpose (for any A): v A t Aw = v w, v, w R n.

Inner products on R n, and more

1.2 Solving a System of Linear Equations

Solving Systems of Linear Equations

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007)

Chapter 6. Linear Transformation. 6.1 Intro. to Linear Transformation

7 Gaussian Elimination and LU Factorization

Continued Fractions and the Euclidean Algorithm

8.2. Solution by Inverse Matrix Method. Introduction. Prerequisites. Learning Outcomes

Orthogonal Projections

Chapter 19. General Matrices. An n m matrix is an array. a 11 a 12 a 1m a 21 a 22 a 2m A = a n1 a n2 a nm. The matrix A has n row vectors

Question 2: How do you solve a matrix equation using the matrix inverse?

6. Cholesky factorization

Factorization Theorems

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

Subspaces of R n LECTURE Subspaces

Solving simultaneous equations using the inverse matrix

MAT188H1S Lec0101 Burbulla

SF2940: Probability theory Lecture 8: Multivariate Normal Distribution

MATHEMATICS FOR ENGINEERS BASIC MATRIX THEORY TUTORIAL 2

Chapter 6. Orthogonality

Linear Algebra Notes

Section Inner Products and Norms

Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix multiplication).

Solutions to Math 51 First Exam January 29, 2015

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

Inner product. Definition of inner product

DETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison


Chapter 2 Determinants, and Linear Independence

SF2940: Probability theory Lecture 8: Multivariate Normal Distribution

Row Echelon Form and Reduced Row Echelon Form

4.6 Linear Programming duality

[1] Diagonal factorization

1 Introduction to Matrices

( ) which must be a vector

LS.6 Solution Matrices

Lecture 1: Systems of Linear Equations

1 VECTOR SPACES AND SUBSPACES

Recall that two vectors in are perpendicular or orthogonal provided that their dot

3. Let A and B be two n n orthogonal matrices. Then prove that AB and BA are both orthogonal matrices. Prove a similar result for unitary matrices.

DERIVATIVES AS MATRICES; CHAIN RULE

LINEAR ALGEBRA W W L CHEN

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION

Lecture 1: Schur s Unitary Triangularization Theorem

by the matrix A results in a vector which is a reflection of the given

The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression

(67902) Topics in Theory and Complexity Nov 2, Lecture 7

Modélisation et résolutions numérique et symbolique

MA106 Linear Algebra lecture notes

Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs

Transcription:

Lecture 11 Shuanglin Shao October 2nd and 7th, 2013

Matrix determinants: addition. Determinants: multiplication. Adjoint of a matrix. Cramer s rule to solve a linear system.

Recall that from the previous section, if a single row of A is multiplied by k, then for the resulting matrix, det(b) = k det(a). If the matrix B = ka, i.e., every entries in A are multiplied by the constant k, then we iterated the previous theorem det(b) = k n det(a).

Example: det(a + B) det(a) + det(b). Consider A = [ 1 2 2 5 ] [ 3 1, B = 1 3 ] [ 4 3?A + B == 3 8 We have det(a) = 1, det(b) = 8, and det(a + B) = 23. Thus det(a + B) det(a) + det(b). ].

Theorem. Let A, B and C be n n matrices that differ only in a single row, say the r-th row, and assume that the r-th row can be obtained by adding corresponding entries in the r-th row of A and B, then det(c) = det(a) + det(b). This is proved by row expansion of determinants along the r-th row of C. Suppose that... A = a r1 a r2 a rn ; B =... b r1 b r2 b rn,...... and... C = a r1 + b r1 a r2 + b r2 a rn + b rn,... where the rest entires are the same.

We first observe that, if fixing the (r, j)-entry in either A, B or C, then the cofactors are the same, i.e., C rj is identical for A, B and C. det(c) = = n (a rj + b rj )C rj j=1 n a rj C rj + j=1 n b rj C rj j=1 = det(a) + det(b). Note that A + B is not the same as C: A + B is obtained by adding the corresponding entries.

Example. 1 7 5 2 0 3 1 + 0 4 + 1 7 + ( 1) = 1 7 5 2 0 3 1 4 7 + 1 7 5 2 0 3 0 1 1.

Determinants of a product. Lemma 2.3.2. If B is an n n matrix and E is an n n elementary matrix, then det(eb) = det(e) det(b). Let E be an elementary matrix. If we multiply B by E from the left, EB is the matrix obtained by performing an elementary row operation on B. Case 1. If E is obtained from I n by multiplying k to a row, then EB is the matrix that is obtained by multiplying k to the same row. because det(e) = k. det(eb) = k det(b) = det(e) det(b)

Case 2. If E is obtained from I n by exchanging two rows, then EB is the matrix that is obtained by exchanging the same two rows: because det(e) = 1. det(eb) = det(b) = det(e) det(b) Case 3. If E is obtained from I n by adding k times a row to another row, then EB is the matrix that is obtained by adding k times the same row to the same another row: because det(e) = 1. det(eb) = det(b) = det(e) det(b)

Remark. If B is an n n matrix and E 1, E 2,, E r are n n elementary matrices, then det(e 1 E 2 E r B) = det(e 1 ) det(e 2 ) det(e r ) det(b).

Determinant test for invertibility Theorem. det(a) 0. A square matrix A is invertible if and only if Proof. If A is invertible, then A is expressed as a product of elementary matrices: A = E 1 E 2 E r. Then det(a) = det(e 1 ) det(e 2 ) det(e r ). Since for each elementary matrix E, det(e) 0. Thus det(a) 0.

Cont. On the other hand, suppose det(a) 0. We apply elementary row operations to reduce A to reduced row echelon form R. That is to say, R = E 1 E 2 E r A. Then This implies det(r) = det(e 1 ) det(e 2 ) det(e r ) det(a) 0. det(r) 0. Since R is a square matrix and is in reduced row echelon form, R is the identity matrix. In other words, A reduces to I n after a series of elementary row operations. Hence A is invertible.

Example. Let A = A is proportional, Hence A is not invertible. 1 2 3 1 0 1 2 4 6. Since the first and third rows of det(a) = 0.

If A and B are square matrices of the same size, then det(ab) = det(a) det(b). Case 1. If A is not invertible, det(a) = 0. It also follows that AB is not invertible, which implies that det(ab) = 0. Thus det(ab) = 0 = det(a) B. Case 2. If A is invertible, then A is a product of elementary matrices, E 1, E 2,, E r : A = E 1 E 2 E r B.

Thus det(ab) = det(e 1 E 2 E r B) = det(e 1 ) det(e 2 ) det(e r ) det(b). Since det(a) = det(e 1 ) det(e 2 ) det(e r ), det(ab) = det(a) det(b).

[ 3 1 Consider A = 2 1 The product We verify that ] [ 1 3, B = 5 8 AB = [ 2 17 3 14 ]. ]. det(a) = 1, det(b) = 23, det(ab) = 23. Thus det(ab) = det(a) det(b).

A corollary to the theorem is Theorem. If A is invertible, then det(a 1 ) = 1 det(a). This is because Thus I n = A A 1. 1 = det(i n ) = det(a) det(a 1 ).

Def. If A is any n n matrix, and C ij is the cofactor of a ij, then the matrix C 11 C 21 C n1 C 12 C 22 C n2... C 1n C 2n C nn is called the adjoint of the matrix A, denoted by adj(a). Recall that C ij = ( 1) i+j M ij, and M ij is the determinant of the (n 1) (n 1) matrix obtained from A by removing the i-th row and the j-th column of A.

Example. Let The adjoint of A is A = adj(a) = 3 2 1 1 6 3 2 4 0. 12 4 12 6 2 10 16 16 16. We compute C 21 = ( 1) 2+1 2 1 4 0 = 4.

Inverse of a matrix using its adjoint. Theorem. If A is an invertible matrix, then A 1 = 1 det(a) adj(a). Proof. We show that A adj(a) = det(a)i n. Let B = A adj(a) = [b ij ]. The (i, j)-entry b ij of the product matrix A adj(a) is coming from the i-th row of A and the j-th column of adj(a). Note that the j-th column of adj(a) is the cofactor of the entry a jk of the matrix A, 1 k n. b ij = n a ik C jk = a i1 C j1 + a i2 C j2 + + a in C jn. k=1

Fixing i. We discuss two cases. Case 1. matrices, When j = i, by the definition of determinants of b ij = det(a). Case 2. When j i, we prove that b ij = 0. Suppose that i < j; the proof for i > j is similar. We construct a matrix that differs from the matrix A only in the j-th row: the j-th row is the same as the i-th row.... a i1 a i2 a in D =.... a i1 a i2 a in...

Since D contains two identical rows, det(d) = 0. We expand the determinant along the j-th row: det(d) = 0 = a i1 C j1 + a i2 C j2 + a in C jn. Since D only differs from A in the j-th row, C jk = C jk. So b ij = 0, for i j. Hence the matrix B is det(a)i n. This proves the theorem.

Using the adjoint to find an inverse matrix. Example. A = 3 2 1 1 6 3 2 4 0. From the previous example, the adjoint of A is computed. By the theorem, the inverse of A is 12 4 12 1 6 2 10. det(a) 16 16 16 The determinant of A, det(a) = 64. So the inverse is 12 64 6 64 16 64 4 12 64 64 2 64 10 64 16 16 64 64.

Cramer s rule. Theorem. If Ax = b is a system of n linear equations in n unknowns such that det(a) 0, then the system has a unique solution. This solution is x 1 = det(a 1) det(a), x 2 = det(a 2) det(a),, x n = det(a n) det(a) when A j is the matrix obtained by replacing the entries in the j-th column of A by the entires in the matrix b 1 b 2 b =.. b n

If det(a) 0, then A is invertible. We multiply Ax = b by A 1 to obtain C 11 C 21 C n1 b 1 C 12 C 22 C n2 b 2 x = A 1 b = 1 det(a)... C 1n C 2n C nn. b n. We multiply the matrices on the right hand side out to obtain the i-th entry. b 1 C 1i + b 2 C 2i + + b n C ni.

This is precisely the determinant of the following matrix expanding along the i-th column: a 11 b 1 a 1n a 21 b 2 a 2n..... a n1 b n a nn where the i-th column of A is replaced by the column vector. So x i = det(a i) det(a).

Using Cramer s rule to solve a linear system. Use the Cramer s rule to solve x 1 + 2x 3 = 6, 3x 1 + 4x 2 + 6x 3 = 30, x 1 2x 2 + 3x 3 = 8.

and A = A 2 = 1 0 2 3 4 6 1 2 3 1 6 2 3 30 6 1 8 3, A 1 =, A 3 = 6 0 2 30 4 6 8 2 3 1 0 6 3 4 30 1 2 8 The complexity here is to compute the determinants here.

Therefore and x 1 = det(a 1) det(a) = 10 11, x 2 = det(a 2) det(a) = 18 11. x 3 = det(a 3) det(a) = 38 11. We usually use the elementary row operations to compute the determinants of matrices.

Homework and Reading. Homework. Ex. #4, #6,#8, #10, #16, #18, #20,#24, #30, and the True-False exercise on page 116. Reading. Section 3.1.