Math 110, Spring 2015: Homework 10 Solutions

Size: px
Start display at page:

Download "Math 110, Spring 2015: Homework 10 Solutions"

Transcription

1 Math 0, Spring 205: Homework 0 Solutions Section 7 Exercise 73: Let T be a linear operator on a finite-dimensional vector space V such that the characteristic polynomial of T splits, and let λ, λ 2,, λ k be the distinct eigenvalues of T For each i, let J i be the Jordan canonical form of the restriction of T to K λi Prove that is the Jordan canonical form of T J = J J 2 J k Remark: The statement of the exercise in the book directs you to prove that J is the Jordan canonical form of J Although that statement actually makes sense (it amounts to saying, Prove that the matrix J is in Jordan canonical form ), I m guessing the book intended to state the Jordan canonical form of T The question is also somewhat confusing because it refers to the Jordan canonical form, while the uniqueness of the Jordan canonical form up to ordering of Jordan blocks is not established until the next section of the text Proof We first observe that the matrix J is in Jordan canonical form (cf the remark above) Indeed, by the definition of the direct sum of square matrices on page 320, J is block diagonal with diagonal blocks J i By definition, each J i is in Jordan canonical form; thus, each J i is itself block diagonal with Jordan diagonal blocks So by refining the block-diagonal decomposition of J we see that J is a block-diagonal matrix with Jordan diagonal blocks (Alternatively (and equivalently), note that each J i, being in Jordan canonical form, is a direct sum of Jordan blocks in the sense defined on page 320 Thus J is a direct sum of Jordan blocks and is thus in Jordan canonical form Strictly speaking, one ought to observe that the direct sum of square matrices is an associative operation, so that (A B) C = A B C) It remains to show that J is a matrix representation of T, ie, J = [T] β for some ordered basis β of V For each i k, let β k be a Jordan canonical basis of K λi with respect to which J i is the matrix representation of the restriction of T to K λi We claim β = β β k is the desired basis of V : We first observe that β is in fact a basis of V By Theorem 78 (which was proven in lecture), we have V = k K λi i= Theorem 50(d) then shows that β is a basis of V That J = [T] β then follows from Theorem 525 (Writing out a proof of Theorem 525 in terms of the entry-by-entry definition of page 320 is somewhat instructive but quite tedious At the least, you should be able to explain to someone in words why that theorem is true)

2 Section 72 Exercise 723: Let T be a linear operator on a finite-dimensional vector space V with Jordan canonical form (a) Find the characteristic polynomial of T Solution: Let J denote the Jordan canonical form above; noting that J ti is upper triangular, so that its determinant is simply the product of its diagonal entries, we have p T (t) = det(j ti) = (2 t) 5 (3 t) 2 (b) Find the dot diagram corresponding to each eigenvalue of T Solution: The eigenvalues of T are λ = 2 and λ 2 = 3 The dot diagram for each eigenvalue λ has a column corresponding to each λ-jordan block (in decreasing order of block length from left to right), with each block having a number of dots equal to the length of the corresponding Jordan block In this case, the dot diagrams are λ = 2 λ 2 = 3 (c) For which eigenvalues λ i, if any, does E λi = K λi? Solution: One can read this off from the matrix by looking for eigenvalues whose Jordan blocks are all of length ; that condition is equivalent to the dot diagram s having only one row This holds (only) for the eigenvalue λ = 3 (d) For each eigenvalue λ i, find the smallest positive integer p i for which K λi = N ( (T λ i I) p i) Solution: The integer p i is the maximum length of a λ i -Jordan block in the Jordan canonical form of T; equivalently, it s the number of rows in the dot diagram for λ i (ie the maximum length of a column in the dot diagram) So in this case p = 3 and p 2 = 2

3 (e) Compute rank(u i ), rank(u 2 i ), nullity(u i ), and nullity(u 2 i ) for each i, where U i denotes the restriction of T λ i I to K λi Solution: By Theorem 79, the number of dots in the first r rows of the dot diagram for λ i is equal to nullity(u r i ) So we have nullity(u ) = 2, nullity(u 2 ) = 2 nullity(u 2 ) = 4, nullity(u 2 2) = 2 Noting that dim(k λi ) is the total number of dots in the dot diagram for λ i, we can apply the Dimension Theorem to obtain rank(u ) = 3, rank(u 2 ) = 0 rank(u 2 ) =, rank(u 2 2) = 0 (Note, however, that it s a bit silly to use dot-diagram reasoning to get the results for U 2 ; indeed, U 2 is the zero operator on K 3 ) Exercise 724: For each of the matrices A that follow, find a Jordan canonical form J and an invertible matrix Q such that J = Q AQ Remark: The solutions for this exercise demonstrate certain shortcut techniques that can be used in the following two scenarios for an eigenvalue λ of an operator T (or a matrix A): dim(e λ ) = dim(k λ ), so that the dot diagram for λ consists of one row 2 dim(e λ ) =, so that the dot diagram for λ consists of one column (b) A = Solution: The characteristic polynomial of A is p A (t) = ( t)(2 t) 2, so the eigenvalues of A are λ = and λ 2 = 2 By Theorem 74(c), we know that the dimension of each generalized eigenspace is the multiplicity of its corresponding eigenvalue as a root of p A (t); that is, dim(k ) =, dim(k 2 ) = 2 Note that dim(k λi ) gives the number of dots in the dot diagram for λ i From this it s clear that the dot diagram of λ = consists of one dot To find the dot diagram of λ 2 = 2, we begin by computing the dimension of the eigenspace E 2 = N(A 2I), which will give us the number of columns in the dot diagram (or equivalently the number of associated Jordan blocks in the Jordan canonical form of A) It s quite easy in this case to show that dim(e 2 ) = 2 = dim(k 2 ) So that tells us that the dot diagram for λ 2 = 2 consists of one row of two dots All in all, we have λ = λ 2 = 2 3

4 From this dot diagram, we can immediately write down a Jordan canonical form of A: 0 0 J = To find a matrix Q such that J = Q AQ, we simply find a Jordan canonical basis β for A Then we can take Q to be the change-of-coordinates matrix Q = [I] γ β, where I : R 3 R 2 is the identity transformation and γ is the standard basis of R 3 In general, to find a Jordan canonical basis, we just have to find a basis for each generalized eigenspace consisting of a disjoint union of cycles; the dot diagram for each eigenvalue guides us by telling us the length of the cycles that will appear In this case, since K λ = E λ for both eigenvalues λ, we just find bases of the eigenspaces E and E 2 Using techniques from Math 54, we can find bases 0 β = 2, β 2 = 2, 0 for E and E 2, respectively Taking the ordered basis β = β β 2, we can take Q to be the changeof-coordinates matrix 0 Q = (c) A = Solution: Once again, p A (t) = ( t)(2 t) 2, so the eigenvalues are λ = and λ 2 = 2, with dim(k ) = and dim(k 2 ) = 2 Again the dot diagram for λ = consists of one dot, and in particular we have K = E Using Math 54, one can find a basis 0 β = for E = K Again appealing to Math 54, one can see that dim(e 2 ) =, so the dot diagram for λ 2 = 2 must be λ 2 = 2 4

5 The basis for K 2 contributing to a Jordan canonical basis of R 3 for A will thus consist of one cycle; any cycle of length 2 will do To find such a cycle, we just find a nonzero 2-eigenvector x of A by solving the equation (A 2I)x = 0 One such eigenvector is x = which we take to be the initial vector of our cycle We can then find the end vector v by solving (A 2I)v = x = = v = 3 2, 5 for example So our cycle basis for K 2 is β 2 = { (A 2I)v, v }, and our Jordan canonical basis is β β 2 = 0 3,, 3, So taking Q to be the change-of-coordinates matrix 0 Q = 2, 3 5 we have J = Q AQ, where J is the Jordan canonical form 0 0 J =

6 Exercise 725: For each linear operator T, find a Jordan canonical form J of T and a Jordan canonical basis β for T (b) T is the linear operator on P 3 (R) defined by T ( f(x) ) = xf (x) Solution: We begin by computing the matrix representation of T with respect to a convenient basis for V = P 3 (R), say the standard basis β 0 = {, x, x 2, x 3 }: A := [T] β0 = From this we can see that λ = 0 is the only eigenvalue of T, with multiplicity m = 4 With a view toward determining the dot diagram for λ = 0, we also note that A 2 = (A 0I) 2 = , A3 = (A 0I) 3 = 0 With all this information in hand, we see that the dot diagram has dim(k 0 ) = m = 4 dots, the number of columns is dim(e 0 ) = nullity(t 0 I) = dim(v ) rank(a) = 4 2 = 2, and the number of dots in the second row is rank(a) rank(a 2 ) = So the dot diagram must be (T 0 I) 2 v (T 0 I)v v w where we have labeled the dots in each column as vectors in a cycle contributing to the desired Jordan canonical basis β To find the cycle corresponding to the first column, it suffices to find a suitable end vector v; note that v is the end vector of a cycle of length 3 if and only if (T 0 I) 3 v = 0 but (T 0 I) 2 v 0 Since we computed above that A 3 = 0, we know that every vector v V = P 3 (R) satisfies (T 0 I) 3 v = 0 One can either compute T 2( f(x) ) = f (x) + xf (x) or examine the matrix A 2 above to see that (T 0 I) 2 v 0 if and only if v P 3 (R) is a polynomial with nonzero cubic term So if we take v = x 3, we obtain a cycle { (T 0 I) 2 v, (T 0 I)v, v } = { 2x, 6x 2, x 3} Finally, to find an appropriate cycle {w} of length, we just need to find a 0-eigenvector w that s linearly independent of the the cycle we just found Either by directly examining the operator T or by solving the matrix equation Aw = 0, we can see that E 0 = ker(t) = span{, x}, 6

7 so we can just take w = Thus the Jordan canonical form of T is J = 0 0 0, and a Jordan canonical basis is β = {2x, 6x 2, x 3, } (e) T is the linear operator on M 2 2 (R) defined by ( ) 3 T(A) = (A A t ) 0 3 Solution: Taking β 0 = {E, E 2, E 2, E 22 } to be the usual standard basis of V = M 2 2 (R), we have 0 0 B = [T] β0 = From this we can compute the characteristic polynomial p T (t) = t 3 (t 6), which yields eigenvalues λ = 0 and λ 2 = 6, with multiplicities m = dim(k 0 ) = 3 and m 2 = dim(k 6 ) =, respectively We first deal with the eigenvalue λ = 0 It s fairly easy to see from the matrix B above that rank(t) =, so dim(e 0 ) = dim ( ker(t) ) = 4 = 3 = dim(k 0 ) Thus, every generalized 0-eigenvector of T is in fact a 0-eigenvector; in other words, every cycle corresponding to λ = 0 has length, and so the Jordan canonical form of T will have three Jordan blocks length corresponding to the eigenvalue λ = 0 To find a basis for K 0 consisting of cycles, we may simply take any basis for E 0 Again examining the matrix B and solving the equation Bx = 0, we can see that a basis for E 0 is β = {( ) 0, 0 0 ( ) 0, 0 ( )} ( ) 3 (Alternatively, note that because is invertible, we have T(A) = 0 if and only if A = A 0 3 t So it s not surprising that β is the usual basis for the symmetric matrices) Next, we consider the eigenvalue λ 2 = 6 Since dim(k 6 ) =, we have K 6 = E 6, and the Jordan canonical form of T will contain one Jordan block of length corresponding to λ 2 = 6 To find a basis for K 6 = E 6 consisting of cycles, it suffices to find any 6-eigenvector of T; working in β 0 -coordinates and solving the matrix equation (B 6I)x = 0, we see that we may take {( )} 3 β 2 = 3 0 7

8 as our basis for K 6 Thus, the Jordan canonical form of T is and a Jordan canonical basis is β = β β 2 = J = {( ) 0, ( ) 0, 0, ( ) ( 0 0 3, (f) V is the vector space of polynomial functions in two real variables x and y of degree at most 2, as defined in Example 4, and T is the linear operator on V defined by T ( f(x, y) ) = x f(x, y) + f(x, y) y )} Solution: Take the basis α = {, x, y, x 2, y 2, xy} for V as in Example 4; then A := [T] α = So the only eigenvalue of T is λ = 0; its multiplicity is m = dim(k 0 ) = 6, so the dot diagram will consist of 6 dots Examining the matrix A can show further that the number of columns in the dot diagram is dim(e 0 ) = dim(ker T) = 6 rank A = 3 We can further refine our understanding of the dot diagram by considering (T 0 I) 2 = 2 x x y + 2 y 2 (where we ve used equality of mixed partials), or equivalently its matrix representation A 2 = We see that rank ( (T 0 I) 2) =, so the second row of the dot diagram contains rank(t 0 I) rank(t 0 I) 2 = 3 = 2 8

9 dots Thus, the dot diagram for λ = 0 must be (T 0 I) 2 v (T 0 I)w u (T 0 I)v v w Proceeding as in part (b), we first find v such that T 2 v 0; we may take v = x 2, which gives the cycle β = { (T 0 I) 2 v, (T 0 I)v, v } = { 2, 2x, x 2} Next, to find a cycle {(T 0 I)w, w} of length two, we find w such that (T 0 I) 2 w = 0 but (T 0 I)w 0, taking care to ensure that the resulting cycle is linearly independent of the previously constructed cycle One might be tempted to guess w = y, which will generate a cycle of length 2; however, the initial vector of the resulting cycle would be, which is not linearly independent of the previous cycle However, taking w = x 2 y 2 yields the cycle β 2 = { (T 0 I)w, w } = { 2x 2y, x 2 y 2}, which does the job Finally, to get our last cycle of length we just need a 0-eigenvector of T that is linearly independent of the previously collected vectors Examining the matrix A (or using Math 54 techniques to find its nullspace), we see that we can take β 3 = {u} = {2xy x 2 y 2 } Putting all of this together, we obtain the Jordan canonical form and a Jordan canonical basis J = β = β β 2 β 3 = {2, 2x, x 2, 2x 2y, x 2 y 2, 2xy x 2 y 2 } 9

10 Exercise 727: Let A be an n n matrix whose characteristic polynomial splits, γ be a cycle of generalized eigenvectors corresponding to an eigenvalue λ, and W be the subspace spanned by γ Define γ to be the ordered set obtained from γ by reversing the order of the vectors in γ (a) Prove that [T W ] γ = ( [T W ] γ ) t Solution: (Presumably here T = L A : F n F n ) Informally, [T W ] γ is obtained by first reversing the order of the columns of [T W ] γ and then reversing the order of the rows of the resulting matrix More formally, write C = [T W ] γ and B = [T W ] γ Write γ = {v,, v k } and γ = {u,, u k }, so that u j = v k+ j for all j k What we want to prove is that B ij = C ji for all i, j k But since γ is a cycle, A is a Jordan block; ie, if j = i + C ji = λ if j = i 0 otherwise To phrase this in terms of T, note that for l k we have while T(v ) = λv But this means v l = (T λ I)v l+ T(v l+ ) = v l + λv l+, T(u j ) = T(v k+ j ) = { uj+ + λu j if j k λu j if j = k By the definition of the matrix representation B = [T W ] γ of T W with respect to the basis γ if i = j + B ij = λ if i = j 0 otherwise = C ji (b) Let J be the Jordan canonical form of A Use (a) to prove that J and J t are similar Solution: Again, let T = L A : F n F n (where F is the base field over which the characteristic polynomial of A splits) It follows from part (a) that if β is a Jordan canonical basis for T and β is the basis of F n obtained by reversing the ordering of β, then [T] β = ( [T] β ) t = J t But then taking Q to be the change-of-coordinates matrix Q = [I] β β, we have so J is similar to J t (c) Use (b) to prove that A and A t are similar Q JQ = Q [T] β Q = [T] β = J t, Solution: Let P be the matrix whose columns are the vectors of a Jordan canonical basis for T = L A Then P JP = A, which also shows J t = (P t ) A t (P t ) So with denoting similarity, we have A J J t A 2, where the middle similarity is part (b) Since similarity is an equivalence relation, A A t 0

11 Exercise 728: Let T be a linear operator on a finite-dimensional vector space, and suppose that the characteristic polynomial of T splits Let β be a Jordan canonical basis for T (a) Prove that for any nonzero scalar c, {cx x β} is a Jordan canonical basis for T Solution: Write β = {cx x β}; it s easy to see that because β is a basis, so is β Indeed, the change-of-coordinates matrix [I] β β is just ci But then if J is the Jordan canonical form of T, so that [T] β = J, we have [T] β = [I] β β [T] β[i] β β = (ci) J(cI) = (c c)j = J So the matrix representation of T with respect to β is in Jordan canonical form; ie, β is a Jordan canonical basis for T (b) Suppose that γ is one of the cycles of generalized eigenvectors that forms β, and suppose that γ corresponds to the eigenvalue λ and has length greater than Let x be the end vector of γ, and let y be a nonzero vector in E λ Let γ be the ordered set obtained from γ by replacing x by x + y Prove that γ is a cycle of generalized eigenvectors corresponding to λ, and that if γ replaces γ in the union that defines β, then the new union is also a Jordan canonical basis for T Solution: We first prove that γ is a cycle of generalized λ-eigenvectors Suppose γ has length k, so that γ = {(T λ I) k x,, (T λ I)x, x} Since y is an eigenvector of T with eigenvalue λ, we have (T λ I) q y = 0 for all q N Thus (T λ I) q (x + y) = (T λ I) q x for all q N, in particular, k is the minimal natural number such that (T λ I) k (x + y) = 0 Thus, γ = {(T λ I) k x,, (T λ I)x, x + y} = {(T λ I) k (x + y),, (T λ I)(x + y), x + y} is a cycle Note that this also shows γ is disjoint from all of the other cycles appearing in β: If x + y appeared in some other cycle δ, then we would also have (T λ I)(x + y) = (T λ I)x δ γ, which would mean γ and δ were not disjoint to begin with Now let β denote the new union Thus far we have shown that β is a disjoint union of cycles; therefore, if β is a basis, then it must be a Jordan canonical basis for T By construction, β contains dim(v ) vectors, so it suffices to show that β spans V Because β is a basis of V, it further suffices to show that β span(β ), and because x is the only vector in β not contained in β, we may reduce further still to showing that x span(β ) But since the initial vectors of the cycles corresponding to λ in β (and hence in β ) form a basis of E λ, we must have y span(β ), and so (x + y) y = x span(β )

12 Exercise 720: Let T be a linear operator whose characteristic polynomial splits, and let λ be an eigenvalue of T (a) Prove that dim(k λ ) is the sum of the lengths of all the blocks corresponding to λ in the Jordan canonical form of T Solution: It follows from Theorem 79 that the number of dots in the dot diagram of T Kλ is dim(k λ ) But the total number of dots in the diagram is the sum of the numbers of dots in each column, which in turn is the sum of the lengths of cycles corresponding to λ in a Jordan canonical basis for T, which in turn is the sum of the lengths of the Jordan blocks corresponding to λ in the Jordan canonical form of T (b) Deduce that E λ = K λ if and only if all the Jordan blocks corresponding to λ are matrices Solution: By the Corollary to Theorem 79 on page 499, dim(e λ ) is equal to the number of Jordan blocks corresponding to λ So E λ = K λ if and only if dim(e λ ) = dim(k λ ), which in turn occurs if and only if the number of Jordan blocks corresponding to λ is equal to the sum of the lengths of all the Jordan blocks corresponding to λ, which in turn occurs if and only if the length of each Jordan block corresponding to λ is, which finally in turn occurs if and only if each such Jordan block is a matrix Exercise 729: Let F = C and J = λ λ λ λ be the m m Jordan block corresponding to λ, and let N = J λi m Prove the following results: (a) N m = 0, and for r < m, N r ij = { if j = i + r 0 otherwise Solution: In my opinion, the cleanest way to phrase this and to think about it is by considering the action of N by left multiplication on the standard basis vectors in C m Note that the j th column of N is just Ne j ; thus, we see that { 0 if j = Ne j = e j if 2 j m Repeating this r times, we see N r e j = { 0 if j r e j r if r + j m Since N r ij is the ith entry in the column vector N r e j, the desired formulas follow immediately 2

13 (b) For any integer r m, J = r(r )(r m+2) λ r m+ r(r ) (r m+3) λ r m+2 λ r rλ r r(r ) 2! λ r 2 (m )! 0 λ r rλ r (m 2)! λ r Solution: Recall the binomial formula for powers of sums of two numbers (real or complex): here C(n, k) = (a + b) n = n C(n, k)a k b n k ; k=0 n! n(n ) (n k + ) = k!(n k)! k! is ( the binomial coefficient, read as n choose k (You may well be more familiar with the notation n ) k ; the only reason I ve avoided that notation here is to prevent confusion with matrices) If you think about the proof of this formula (you can prove it by induction), all it relies upon are purely combinatorial counting arguments and the associative, distributive, and commutative properties of multiplication and addition of numbers The point is that although matrix multiplication is not commutative in general, if A and B are two commuting m m matrices, ie AB = BA, then we can apply the binomial formula to take powers of their sum: (A + B) r = r C(n, k)a k B n k, k=0 with the convention that A 0 = I, the m m identity matrix Now note that we can write J = N + λi Both N and λi behave nicely with respect to taking powers, and they commute (everything commutes with the identity); the prospect of using the binomial formula motivates making this decomposition So, noting that N k = 0 for k m, we have J r = (N + λi) r = r C(r, k)n k (λi) r k = k=0 m k=0 C(r, k)λ r k N k Noting that, from part (a), the matrix N k has all entries zero except for s on the k th superdiagonal, we see that J r has the desired form 3

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued). MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors Jordan canonical form (continued) Jordan canonical form A Jordan block is a square matrix of the form λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0

More information

Similarity and Diagonalization. Similar Matrices

Similarity and Diagonalization. Similar Matrices MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

More information

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively. Chapter 7 Eigenvalues and Eigenvectors In this last chapter of our exploration of Linear Algebra we will revisit eigenvalues and eigenvectors of matrices, concepts that were already introduced in Geometry

More information

Orthogonal Diagonalization of Symmetric Matrices

Orthogonal Diagonalization of Symmetric Matrices MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding

More information

T ( a i x i ) = a i T (x i ).

T ( a i x i ) = a i T (x i ). Chapter 2 Defn 1. (p. 65) Let V and W be vector spaces (over F ). We call a function T : V W a linear transformation form V to W if, for all x, y V and c F, we have (a) T (x + y) = T (x) + T (y) and (b)

More information

NOTES ON LINEAR TRANSFORMATIONS

NOTES ON LINEAR TRANSFORMATIONS NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all

More information

Section 6.1 - Inner Products and Norms

Section 6.1 - Inner Products and Norms Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,

More information

by the matrix A results in a vector which is a reflection of the given

by the matrix A results in a vector which is a reflection of the given Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

More information

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i.

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i. Math 5A HW4 Solutions September 5, 202 University of California, Los Angeles Problem 4..3b Calculate the determinant, 5 2i 6 + 4i 3 + i 7i Solution: The textbook s instructions give us, (5 2i)7i (6 + 4i)(

More information

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1. MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column

More information

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column

More information

1 Sets and Set Notation.

1 Sets and Set Notation. LINEAR ALGEBRA MATH 27.6 SPRING 23 (COHEN) LECTURE NOTES Sets and Set Notation. Definition (Naive Definition of a Set). A set is any collection of objects, called the elements of that set. We will most

More information

Math 312 Homework 1 Solutions

Math 312 Homework 1 Solutions Math 31 Homework 1 Solutions Last modified: July 15, 01 This homework is due on Thursday, July 1th, 01 at 1:10pm Please turn it in during class, or in my mailbox in the main math office (next to 4W1) Please

More information

Similar matrices and Jordan form

Similar matrices and Jordan form Similar matrices and Jordan form We ve nearly covered the entire heart of linear algebra once we ve finished singular value decompositions we ll have seen all the most central topics. A T A is positive

More information

Name: Section Registered In:

Name: Section Registered In: Name: Section Registered In: Math 125 Exam 3 Version 1 April 24, 2006 60 total points possible 1. (5pts) Use Cramer s Rule to solve 3x + 4y = 30 x 2y = 8. Be sure to show enough detail that shows you are

More information

Solution to Homework 2

Solution to Homework 2 Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

More information

LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

More information

Methods for Finding Bases

Methods for Finding Bases Methods for Finding Bases Bases for the subspaces of a matrix Row-reduction methods can be used to find bases. Let us now look at an example illustrating how to obtain bases for the row space, null space,

More information

Solutions to Math 51 First Exam January 29, 2015

Solutions to Math 51 First Exam January 29, 2015 Solutions to Math 5 First Exam January 29, 25. ( points) (a) Complete the following sentence: A set of vectors {v,..., v k } is defined to be linearly dependent if (2 points) there exist c,... c k R, not

More information

Chapter 6. Orthogonality

Chapter 6. Orthogonality 6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

More information

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION 4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION STEVEN HEILMAN Contents 1. Review 1 2. Diagonal Matrices 1 3. Eigenvectors and Eigenvalues 2 4. Characteristic Polynomial 4 5. Diagonalizability 6 6. Appendix:

More information

Matrix Representations of Linear Transformations and Changes of Coordinates

Matrix Representations of Linear Transformations and Changes of Coordinates Matrix Representations of Linear Transformations and Changes of Coordinates 01 Subspaces and Bases 011 Definitions A subspace V of R n is a subset of R n that contains the zero element and is closed under

More information

LINEAR ALGEBRA. September 23, 2010

LINEAR ALGEBRA. September 23, 2010 LINEAR ALGEBRA September 3, 00 Contents 0. LU-decomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................

More information

Inner Product Spaces and Orthogonality

Inner Product Spaces and Orthogonality Inner Product Spaces and Orthogonality week 3-4 Fall 2006 Dot product of R n The inner product or dot product of R n is a function, defined by u, v a b + a 2 b 2 + + a n b n for u a, a 2,, a n T, v b,

More information

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007)

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007) MAT067 University of California, Davis Winter 2007 Linear Maps Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007) As we have discussed in the lecture on What is Linear Algebra? one of

More information

Notes on Determinant

Notes on Determinant ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without

More information

Linear Algebra Notes for Marsden and Tromba Vector Calculus

Linear Algebra Notes for Marsden and Tromba Vector Calculus Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of

More information

LEARNING OBJECTIVES FOR THIS CHAPTER

LEARNING OBJECTIVES FOR THIS CHAPTER CHAPTER 2 American mathematician Paul Halmos (1916 2006), who in 1942 published the first modern linear algebra book. The title of Halmos s book was the same as the title of this chapter. Finite-Dimensional

More information

CONTROLLABILITY. Chapter 2. 2.1 Reachable Set and Controllability. Suppose we have a linear system described by the state equation

CONTROLLABILITY. Chapter 2. 2.1 Reachable Set and Controllability. Suppose we have a linear system described by the state equation Chapter 2 CONTROLLABILITY 2 Reachable Set and Controllability Suppose we have a linear system described by the state equation ẋ Ax + Bu (2) x() x Consider the following problem For a given vector x in

More information

Introduction to Matrix Algebra

Introduction to Matrix Algebra Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary

More information

α = u v. In other words, Orthogonal Projection

α = u v. In other words, Orthogonal Projection Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v

More information

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

More information

MATH1231 Algebra, 2015 Chapter 7: Linear maps

MATH1231 Algebra, 2015 Chapter 7: Linear maps MATH1231 Algebra, 2015 Chapter 7: Linear maps A/Prof. Daniel Chan School of Mathematics and Statistics University of New South Wales danielc@unsw.edu.au Daniel Chan (UNSW) MATH1231 Algebra 1 / 43 Chapter

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +

More information

Inner Product Spaces

Inner Product Spaces Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and

More information

Math 333 - Practice Exam 2 with Some Solutions

Math 333 - Practice Exam 2 with Some Solutions Math 333 - Practice Exam 2 with Some Solutions (Note that the exam will NOT be this long) Definitions (0 points) Let T : V W be a transformation Let A be a square matrix (a) Define T is linear (b) Define

More information

Lecture 3: Finding integer solutions to systems of linear equations

Lecture 3: Finding integer solutions to systems of linear equations Lecture 3: Finding integer solutions to systems of linear equations Algorithmic Number Theory (Fall 2014) Rutgers University Swastik Kopparty Scribe: Abhishek Bhrushundi 1 Overview The goal of this lecture

More information

Solving Linear Systems, Continued and The Inverse of a Matrix

Solving Linear Systems, Continued and The Inverse of a Matrix , Continued and The of a Matrix Calculus III Summer 2013, Session II Monday, July 15, 2013 Agenda 1. The rank of a matrix 2. The inverse of a square matrix Gaussian Gaussian solves a linear system by reducing

More information

MATH 551 - APPLIED MATRIX THEORY

MATH 551 - APPLIED MATRIX THEORY MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points

More information

Solving Systems of Linear Equations

Solving Systems of Linear Equations LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how

More information

1 0 5 3 3 A = 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0

1 0 5 3 3 A = 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0 Solutions: Assignment 4.. Find the redundant column vectors of the given matrix A by inspection. Then find a basis of the image of A and a basis of the kernel of A. 5 A The second and third columns are

More information

Linear Algebra Notes

Linear Algebra Notes Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note

More information

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set. MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set. Vector space A vector space is a set V equipped with two operations, addition V V (x,y) x + y V and scalar

More information

MA106 Linear Algebra lecture notes

MA106 Linear Algebra lecture notes MA106 Linear Algebra lecture notes Lecturers: Martin Bright and Daan Krammer Warwick, January 2011 Contents 1 Number systems and fields 3 1.1 Axioms for number systems......................... 3 2 Vector

More information

Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction

More information

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013 Notes on Orthogonal and Symmetric Matrices MENU, Winter 201 These notes summarize the main properties and uses of orthogonal and symmetric matrices. We covered quite a bit of material regarding these topics,

More information

Linear Algebra I. Ronald van Luijk, 2012

Linear Algebra I. Ronald van Luijk, 2012 Linear Algebra I Ronald van Luijk, 2012 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents 1. Vector spaces 3 1.1. Examples 3 1.2. Fields 4 1.3. The field of complex numbers. 6 1.4.

More information

160 CHAPTER 4. VECTOR SPACES

160 CHAPTER 4. VECTOR SPACES 160 CHAPTER 4. VECTOR SPACES 4. Rank and Nullity In this section, we look at relationships between the row space, column space, null space of a matrix and its transpose. We will derive fundamental results

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

4.5 Linear Dependence and Linear Independence

4.5 Linear Dependence and Linear Independence 4.5 Linear Dependence and Linear Independence 267 32. {v 1, v 2 }, where v 1, v 2 are collinear vectors in R 3. 33. Prove that if S and S are subsets of a vector space V such that S is a subset of S, then

More information

The Characteristic Polynomial

The Characteristic Polynomial Physics 116A Winter 2011 The Characteristic Polynomial 1 Coefficients of the characteristic polynomial Consider the eigenvalue problem for an n n matrix A, A v = λ v, v 0 (1) The solution to this problem

More information

Vector and Matrix Norms

Vector and Matrix Norms Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty

More information

Linear Algebra Review. Vectors

Linear Algebra Review. Vectors Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

More information

3. Let A and B be two n n orthogonal matrices. Then prove that AB and BA are both orthogonal matrices. Prove a similar result for unitary matrices.

3. Let A and B be two n n orthogonal matrices. Then prove that AB and BA are both orthogonal matrices. Prove a similar result for unitary matrices. Exercise 1 1. Let A be an n n orthogonal matrix. Then prove that (a) the rows of A form an orthonormal basis of R n. (b) the columns of A form an orthonormal basis of R n. (c) for any two vectors x,y R

More information

13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions. 3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in three-space, we write a vector in terms

More information

University of Lille I PC first year list of exercises n 7. Review

University of Lille I PC first year list of exercises n 7. Review University of Lille I PC first year list of exercises n 7 Review Exercise Solve the following systems in 4 different ways (by substitution, by the Gauss method, by inverting the matrix of coefficients

More information

Recall that two vectors in are perpendicular or orthogonal provided that their dot

Recall that two vectors in are perpendicular or orthogonal provided that their dot Orthogonal Complements and Projections Recall that two vectors in are perpendicular or orthogonal provided that their dot product vanishes That is, if and only if Example 1 The vectors in are orthogonal

More information

Lecture Notes 2: Matrices as Systems of Linear Equations

Lecture Notes 2: Matrices as Systems of Linear Equations 2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably

More information

THE DIMENSION OF A VECTOR SPACE

THE DIMENSION OF A VECTOR SPACE THE DIMENSION OF A VECTOR SPACE KEITH CONRAD This handout is a supplementary discussion leading up to the definition of dimension and some of its basic properties. Let V be a vector space over a field

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Linear equations Ax D b come from steady state problems. Eigenvalues have their greatest importance in dynamic problems. The solution

More information

3. INNER PRODUCT SPACES

3. INNER PRODUCT SPACES . INNER PRODUCT SPACES.. Definition So far we have studied abstract vector spaces. These are a generalisation of the geometric spaces R and R. But these have more structure than just that of a vector space.

More information

2 Polynomials over a field

2 Polynomials over a field 2 Polynomials over a field A polynomial over a field F is a sequence (a 0, a 1, a 2,, a n, ) where a i F i with a i = 0 from some point on a i is called the i th coefficient of f We define three special

More information

Chapter 17. Orthogonal Matrices and Symmetries of Space

Chapter 17. Orthogonal Matrices and Symmetries of Space Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length

More information

Chapter 20. Vector Spaces and Bases

Chapter 20. Vector Spaces and Bases Chapter 20. Vector Spaces and Bases In this course, we have proceeded step-by-step through low-dimensional Linear Algebra. We have looked at lines, planes, hyperplanes, and have seen that there is no limit

More information

[1] Diagonal factorization

[1] Diagonal factorization 8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:

More information

MAT 242 Test 2 SOLUTIONS, FORM T

MAT 242 Test 2 SOLUTIONS, FORM T MAT 242 Test 2 SOLUTIONS, FORM T 5 3 5 3 3 3 3. Let v =, v 5 2 =, v 3 =, and v 5 4 =. 3 3 7 3 a. [ points] The set { v, v 2, v 3, v 4 } is linearly dependent. Find a nontrivial linear combination of these

More information

BANACH AND HILBERT SPACE REVIEW

BANACH AND HILBERT SPACE REVIEW BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but

More information

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation

More information

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components The eigenvalues and eigenvectors of a square matrix play a key role in some important operations in statistics. In particular, they

More information

Recall the basic property of the transpose (for any A): v A t Aw = v w, v, w R n.

Recall the basic property of the transpose (for any A): v A t Aw = v w, v, w R n. ORTHOGONAL MATRICES Informally, an orthogonal n n matrix is the n-dimensional analogue of the rotation matrices R θ in R 2. When does a linear transformation of R 3 (or R n ) deserve to be called a rotation?

More information

Applied Linear Algebra I Review page 1

Applied Linear Algebra I Review page 1 Applied Linear Algebra Review 1 I. Determinants A. Definition of a determinant 1. Using sum a. Permutations i. Sign of a permutation ii. Cycle 2. Uniqueness of the determinant function in terms of properties

More information

Vector Spaces 4.4 Spanning and Independence

Vector Spaces 4.4 Spanning and Independence Vector Spaces 4.4 and Independence October 18 Goals Discuss two important basic concepts: Define linear combination of vectors. Define Span(S) of a set S of vectors. Define linear Independence of a set

More information

Math 550 Notes. Chapter 7. Jesse Crawford. Department of Mathematics Tarleton State University. Fall 2010

Math 550 Notes. Chapter 7. Jesse Crawford. Department of Mathematics Tarleton State University. Fall 2010 Math 550 Notes Chapter 7 Jesse Crawford Department of Mathematics Tarleton State University Fall 2010 (Tarleton State University) Math 550 Chapter 7 Fall 2010 1 / 34 Outline 1 Self-Adjoint and Normal Operators

More information

Notes on Symmetric Matrices

Notes on Symmetric Matrices CPSC 536N: Randomized Algorithms 2011-12 Term 2 Notes on Symmetric Matrices Prof. Nick Harvey University of British Columbia 1 Symmetric Matrices We review some basic results concerning symmetric matrices.

More information

Polynomial Invariants

Polynomial Invariants Polynomial Invariants Dylan Wilson October 9, 2014 (1) Today we will be interested in the following Question 1.1. What are all the possible polynomials in two variables f(x, y) such that f(x, y) = f(y,

More information

Classification of Cartan matrices

Classification of Cartan matrices Chapter 7 Classification of Cartan matrices In this chapter we describe a classification of generalised Cartan matrices This classification can be compared as the rough classification of varieties in terms

More information

Section 5.3. Section 5.3. u m ] l jj. = l jj u j + + l mj u m. v j = [ u 1 u j. l mj

Section 5.3. Section 5.3. u m ] l jj. = l jj u j + + l mj u m. v j = [ u 1 u j. l mj Section 5. l j v j = [ u u j u m ] l jj = l jj u j + + l mj u m. l mj Section 5. 5.. Not orthogonal, the column vectors fail to be perpendicular to each other. 5..2 his matrix is orthogonal. Check that

More information

a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.

a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2. Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given

More information

The Method of Partial Fractions Math 121 Calculus II Spring 2015

The Method of Partial Fractions Math 121 Calculus II Spring 2015 Rational functions. as The Method of Partial Fractions Math 11 Calculus II Spring 015 Recall that a rational function is a quotient of two polynomials such f(x) g(x) = 3x5 + x 3 + 16x x 60. The method

More information

Quotient Rings and Field Extensions

Quotient Rings and Field Extensions Chapter 5 Quotient Rings and Field Extensions In this chapter we describe a method for producing field extension of a given field. If F is a field, then a field extension is a field K that contains F.

More information

I. GROUPS: BASIC DEFINITIONS AND EXAMPLES

I. GROUPS: BASIC DEFINITIONS AND EXAMPLES I GROUPS: BASIC DEFINITIONS AND EXAMPLES Definition 1: An operation on a set G is a function : G G G Definition 2: A group is a set G which is equipped with an operation and a special element e G, called

More information

( ) which must be a vector

( ) which must be a vector MATH 37 Linear Transformations from Rn to Rm Dr. Neal, WKU Let T : R n R m be a function which maps vectors from R n to R m. Then T is called a linear transformation if the following two properties are

More information

Matrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.

Matrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Matrix Algebra A. Doerr Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Some Basic Matrix Laws Assume the orders of the matrices are such that

More information

Brief Introduction to Vectors and Matrices

Brief Introduction to Vectors and Matrices CHAPTER 1 Brief Introduction to Vectors and Matrices In this chapter, we will discuss some needed concepts found in introductory course in linear algebra. We will introduce matrix, vector, vector-valued

More information

Orthogonal Projections

Orthogonal Projections Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors

More information

Factorization Theorems

Factorization Theorems Chapter 7 Factorization Theorems This chapter highlights a few of the many factorization theorems for matrices While some factorization results are relatively direct, others are iterative While some factorization

More information

DERIVATIVES AS MATRICES; CHAIN RULE

DERIVATIVES AS MATRICES; CHAIN RULE DERIVATIVES AS MATRICES; CHAIN RULE 1. Derivatives of Real-valued Functions Let s first consider functions f : R 2 R. Recall that if the partial derivatives of f exist at the point (x 0, y 0 ), then we

More information

The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression

The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression The SVD is the most generally applicable of the orthogonal-diagonal-orthogonal type matrix decompositions Every

More information

Chapter 3. Distribution Problems. 3.1 The idea of a distribution. 3.1.1 The twenty-fold way

Chapter 3. Distribution Problems. 3.1 The idea of a distribution. 3.1.1 The twenty-fold way Chapter 3 Distribution Problems 3.1 The idea of a distribution Many of the problems we solved in Chapter 1 may be thought of as problems of distributing objects (such as pieces of fruit or ping-pong balls)

More information

26. Determinants I. 1. Prehistory

26. Determinants I. 1. Prehistory 26. Determinants I 26.1 Prehistory 26.2 Definitions 26.3 Uniqueness and other properties 26.4 Existence Both as a careful review of a more pedestrian viewpoint, and as a transition to a coordinate-independent

More information

15.062 Data Mining: Algorithms and Applications Matrix Math Review

15.062 Data Mining: Algorithms and Applications Matrix Math Review .6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop

More information

DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II. Matrix Algorithms DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

More information

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A = MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

More information

Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs

Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs CSE599s: Extremal Combinatorics November 21, 2011 Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs Lecturer: Anup Rao 1 An Arithmetic Circuit Lower Bound An arithmetic circuit is just like

More information

Linear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University

Linear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University Linear Algebra Done Wrong Sergei Treil Department of Mathematics, Brown University Copyright c Sergei Treil, 2004, 2009, 2011, 2014 Preface The title of the book sounds a bit mysterious. Why should anyone

More information

is in plane V. However, it may be more convenient to introduce a plane coordinate system in V.

is in plane V. However, it may be more convenient to introduce a plane coordinate system in V. .4 COORDINATES EXAMPLE Let V be the plane in R with equation x +2x 2 +x 0, a two-dimensional subspace of R. We can describe a vector in this plane by its spatial (D)coordinates; for example, vector x 5

More information

8 Square matrices continued: Determinants

8 Square matrices continued: Determinants 8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You

More information

Examination paper for TMA4115 Matematikk 3

Examination paper for TMA4115 Matematikk 3 Department of Mathematical Sciences Examination paper for TMA45 Matematikk 3 Academic contact during examination: Antoine Julien a, Alexander Schmeding b, Gereon Quick c Phone: a 73 59 77 82, b 40 53 99

More information

x1 x 2 x 3 y 1 y 2 y 3 x 1 y 2 x 2 y 1 0.

x1 x 2 x 3 y 1 y 2 y 3 x 1 y 2 x 2 y 1 0. Cross product 1 Chapter 7 Cross product We are getting ready to study integration in several variables. Until now we have been doing only differential calculus. One outcome of this study will be our ability

More information

1 VECTOR SPACES AND SUBSPACES

1 VECTOR SPACES AND SUBSPACES 1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such

More information