DETERMINANTS. b 2. x 2
|
|
- Bernadette Allen
- 7 years ago
- Views:
Transcription
1 DETERMINANTS 1 Systems of two equations in two unknowns A system of two equations in two unknowns has the form a 11 x 1 + a 12 x 2 = b 1 a 21 x 1 + a 22 x 2 = b 2 This can be written more concisely in matrix notation [ ] [ ] [ ] a11 a 12 x1 b1 = a 21 a 22 or simply Ax = b Let s try to work out a general formula for the solution to such a system To solve for x 1, you need to eliminate x 2 Multiplying the first equation by a 22 and the second by a 12, and subtracting gives x 2 b 2 (a 11 a 22 a 12 a 21 )x 1 = a 22 b 1 a 12 b 2 If the coefficient of x 1 on the left is non-zero, this gives x 1 = a 22b 1 a 12 b 2 a 11 a 22 a 12 a 21 A similar method can be used to solve for x 2 To eliminate x 1, multiply the first equation by a 21 and the second by a 11 and subtract, obtaining (a 11 a 22 a 12 a 21 )x 2 = a 11 b 2 a 21 b 1 If the coefficient of x 2 on the left is non-zero, you get x 2 = a 11b 2 a 21 b 1 a 11 a 22 a 12 a 21 Notice that the number we had to divide by to solve for either x 1 or x 2, namely a 11 a 22 a 12 a 21, was the same This number is called the erminant of the matrix [ a11 a A = 12 a 21 a 22 It is denoted by either A or A Roughly speaking, it is the ] number you must divide by to solve the system Ax = b Notice that there is a theorem implicit in the above calculations As long as the erminant A is non-zero, the above calculations can be carried out, leading to a unique solution Theorem 1 The 2 2 system Ax = b has a unique solution if A 0, and therefore the coefficient matrix A is invertible The proof of the following complementary result is left as an exercise Theorem 2 If A = 0 then A is not invertible, so the system Ax = b either has no solutions or it has infinitely many solutions Our goal in the following sections is to develop an analogous theory of erminants for square matrices of arbitrary size 1
2 DETERMINANTS 2 2 Permutations 21 What is a permutation? A permutation of the numbers {1, 2,, n} is an arrangement of those numbers in a particular order There are two permutations of the numbers {1, 2}, namely, (1, 2) and (2, 1) There are six permutations of the numbers {1, 2, 3}, namely, (1, 2, 3), (1, 3, 2), (2, 1, 3), (2, 3, 1), (3, 1, 2), and (3, 2, 1) There are 24 permutations of the numbers {1, 2, 3, 4}, which you may list if you care to In general, the number of permutations of the numbers {1, 2,, n} is n! 22 Parity A inversion in a permutation is an occurrence of a larger number before a smaller one Thus the permutation (3, 1, 2) contains two inversions, since 3 precedes the smaller numbers 1 and 2 The permutation (3, 2, 1) contains three inversions, since 3 precedes 1 and 2, and 2 precedes 1 A permutation is called even if it contains an even number of inversions, and odd if it contains an odd number of inversions Thus the permutations (1, 2, 3), (2, 3, 1), and (3, 1, 2) are even, while the permutations (1, 3, 2), (3, 1, 2), and (2, 1, 3) are odd The sign of a permutation J = (j 1, j 2,, j n ), denoted sgn(j), is 1 if J is even and 1 if J is odd Thus sgn(1, 2, 3) = sgn(2, 3, 1) = sgn(3, 1, 2) = 1 and sgn(1, 3, 2) = sgn(3, 2, 1) = sgn(2, 1, 3) = 1 What happens to the parity of a permutation if you interchange two entries? For example, the permutation (2, 3, 1) is even If you switch the first and third entry, you get (1, 3, 2), which is odd, so the parity reverses This always happens Theorem 3 If the permutation J is obtained from J by interchanging two entries, then J and J have opposite parities: sgn(j ) = sgn(j) Proof: Consider first the case when the two entries that are exchanged are adjacent, say j k and j k+1 There are two cases to consider If j k < j k+1, then interchanging them will increase the number of of inversions by 1, thus reversing the parity On the other hand, if j k > j k+1, then interchanging them will decrease the number of inversions by 1, again reversing the parity Now consider the case of interchanging two entries that are separated by l other entries This can be accomplished by repeatedly interchanging adjacent entries Let s count the number of interchanges of adjacent entries that are required First, take one of the two entries to be exchanged, and move it past each of the l inbetween entries, so that it becomes adjacent to the other entry that is to be moved This requires exactly l interchanges of adjacent entries Now move the other entry to be moved to its final destination, by exchanging it past the one you ve already moved, and then past the l intermediate entries This requires exactly l + 1 interchanges of adjacent entries Thus the total number of interchanges of adjacent entries is l + (l + 1) = 2l + 1 Since this number is odd, the number of parity changes is odd, and so the parity is reversed
3 DETERMINANTS 3 3 Determinants of n n matrices 31 The 3 3 case The erminant of a 3 3 matrix A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 is A = a 11 a 22 a 33 + a 12 a 23 a 31 + a 13 a 21 a 32 a 13 a 22 a 31 a 11 a 23 a 32 a 12 a 21 a 33 Notice that each term is of the form ±a 1j1 a 2j2 a 3j3, where (j 1, j 2, j 3 ) is a permutation of {1, 2, 3}, and the sign is the sign of the permutation Thus we can write A = sgn(j 1, j 2, j 3 )a 1j1 a 2j2 a 3j3 where the sum runs over the six permutations (j 1, j 2, j 3 ) of {1, 2, 3} 32 The general case The definition of the erminant of an n n matrix follows the same pattern as a 3 3 matrix: (1) A = sgn(j)a 1j1 a 2j2 a njn where the sum runs over all permutations J = (j 1, j 2, j n ) of the numbers {1, 2,, n} 1 Before proceeding, you should note that this definition does not provide a practical method for calculating erminants of large matrices The calculation of each term in the sum requires n 1 multiplications, and since there are n! terms, the number of multiplications required is n!(n 1) This number grows very rapidly as n increases If you could perform one million multiplications each second, it would take about 15 million years to calculate the erminant of a matrix directly from the definition 4 Properties of erminants 41 Primitive properties There are three primitive properties of erminants that are deduced directly from the definition Other properties are derived from these three primitive properties Property (i):the erminant function depends linearly on each individual row when the other rows are held fixed To be explicit, write the n n matrix A as a column of row vectors A = and suppose that the ith row is a linear combination of two other row vectors:, A i = t A i + t A i 1 You should check that this is consistent with the definition given previously for 2 2 matrices
4 DETERMINANTS 4 Then A = t A i + t A i To verify Property (i), write = t A i + t A i A i = [a i1 a i2 a in] and A i = [a i1 a i2 a in] so that the ith row of A is A i = t A i +t A i From the definition of the erminant, A = sgn(j)a 1j1 (t a ij i + t a ij i ) a nj n = ( t sgn(j)a 1j1 a ij i a njn + t sgn(j)a 1j1 a ij i a njn ) = t sgn(j)a 1j1 a ij i a njn + t sgn(j)a 1j1 a ij i a njn = t A i + t A i Property (ii): A square matrix with two equal rows has erminant 0 To verify property (ii), let A be a square matrix with two equal rows, say rows k and l For each permutation J, let J be the permutation obtained by switching the entries in positions k and l Since rows k and l are equal, we have a kjk = a ljk = a lj l, while a iji = a ij i when i is not equal to k or l Therefore, the terms in (1) corresponding to the permutations J and J are the same, except for the factors sgn(j) and sgn(j ), which have opposite sign by Theorem 3 Therefore, these two terms sum to 0 Thus the terms of (1) can be paired into terms that sum to 0 Property (iii):the erminant of the n n identity matrix is 1 To verify Property (iii), let δ ij be the entries of I n, so that δ ij = 0 if i j, and δ ii = 1 From the definition of the erminant, I = sgn(j)δ 1j1 δ njn However, if j i i for even one value of i, then the corresponding term in the above sum has a factor of 0, and so the product is 0 Therefore, the only non-zero term comes from the permutation (1, 2,, n), so I = sgn(1, 2,, n)δ 11 δ nn = 1
5 DETERMINANTS 5 42 Derived properties Let s now deduce some additional properties of erminants from the three primitive properties above Property (iv)multiplying a row of A by a constant c changes the erminant by a factor of c This is really just a special case of Property (i) Property (v):if A has a row consisting entirely of zeroes, then A = 0 To see this, notice that multiplying the row of zeroes by 0 has no effect on the matrix, and therefor no effect on its erminant On the other hand, Property (iv) says that the erminant changes by a factor of 0, so A = 0 Property (vi):if B is obtained from A by interchanging two rows, then B = A This is a consequence of Property (ii) Suppose B is obtained from A by interchanging rows k and l with k < l Write By Property (ii), A = A l + A l + A l = 0 Applying Property (i) twice, once in row k and again in row l, we obtain + A l + A l + A l A l = 0 By Property (ii), the first and last terms in this sum are 0, while the second and third are A and B, respectively We have therefore shown that A + B = 0, so B = A
6 DETERMINANTS 6 Property (vii):adding a multiple of one row of A to another row of A will not change the erminant To verify this, let,, be the row vectors of A, and let B be the matrix obtained by adding a multiple of row k of A to row i, with i k Thus row i of B can be written B i = A i + t, while the other rows of B are the same as the corresponding rows of A By Property (i), we have B = A i + t = A i + t Notice that the first term on the right is just A, while the second term is t times the erminant of a matrix with two equal rows, which is zero by Property (ii) Thus the right hand side reduces to A 5 The effect of elementary row operations Properties (iv), (vi) and (vii) tell you how elementary row operations affect the erminant Theorem 4 Let A be an n n matrix (1) If B is obtained from A by multiplying a single row of A by a non-zero constant λ, then B = λ A (2) If B is obtained from A by interchanging two rows, then B = A (3) If B is obtained from A by adding a multiple of one row to another row, then B = A Notice in every case, an elementary row operation changes the erminant by a non-zero multiple It follows that a sequence of several elementary row operations changes the erminant by a non-zero multiple, so we obtain Corollary 5 If B is row equivalent to A, then B = c A for some non-zero scalar c In particular, the above corollary applies when B is the reduced row echelon form of A Let s examine two cases If A is invertible, then the reduced row echelon form of A is an identity matrix, which has erminant 1 by Property (iii) Thus, in this case, the corollary gives A = c I = c 0 On the other hand, if A is singular, the reduced row echelon form E of A contains a row of zeroes, and Property (v) gives A = c E = c 0 = 0 Therefore you get Theorem 6 A is invertible if and only if A 0 51 Calculating erminants using EROs In principle, Theorems 4 and 6 give you a new way to calculate erminants using elementary row operations You can reduce to reduced row echelon form, keeping track of the effect on the erminant using Theorem 4, and then plug in the value of the erminant of the reduced matrix using either Property (iii) (if the reduced matrix is an identity matrix) or Property (v) (if the reduced matrix has a row of zeroes) In practice, you can avoid the necessity of completely reducing the matrix by first working out the erminant of an upper triangular matrix The result is
7 DETERMINANTS 7 Theorem 7 The erminant of an upper triangular matrix is the product of its diagonal entries Proof Let s first consider the case when one of the diagonal entries is zero In this case, the assertion is that A = 0, so we want to show that any upper triangular matrix A with a zero on the diagonal must have erminant zero By Theorem 6, it s enough to show that A is singular For this, consider the homogeneous system Ax = 0 Let a ii be the first zero on the diagonal Then the variable x i does not occur from the ith equation on Set x i = 1 and x k = 0 for k > i, and ermine x 1,, x i 1 by back substitution in the first i 1 equations Then x is a non-trivial solution to the homogeneous system Ax = 0, and since the system has a non-trivial solution, its coefficient matrix A is singular It remains to consider the case when all diagonal entries are non-zero In this case, by applying Property (i) to each row in succession, we obtain (2) A = a 11 a 22 a nn B where the entries of B are b ij = a ij /a ii In particular, B has a zero in every position where A has one, so B is also triangular Moreover, B has all ones along the diagonal It follows that B can be row reduced to an identity matrix I using only the operation of adding multiples of rows to other rows Since this type of elementary row operation does not affect the erminant, it follows that B = I = 1, so (2) gives A = a 11 a 22 a nn, as required The procedure for calculating erminants using elementary row operations is now the following (1) Perform elementary row operations to reduce A to an upper triangular matrix, using Theorem 4 to keep track of the effect on the erminant (2) Calculate the erminant of the resulting upper triangular matrix by multiplying its diagonal entries This method us usually much more efficient than calculating from the definition of erminants We refer to your textbook for examples illustrating the technique The goal in this section is to establish 6 Determinants of products Theorem 8 Let A and B be n n matrices Then (AB) = ( A)( B) We begin with some facts about elementary matrices Recall that an elementary matrix is one obtained from an identity matrix by a single elementary row operation Determinants of elementary matrices can be read off from Theorem 4 and the fact that the erminant of an identity matrix is 1 (Property (iii)) Lemma 9 (1) If E is obtained by multiplying a row of an identity matrix by the scalar λ, then E = λ (2) If E is obtained by exchanging two rows of an identity matrix, then E = 1 (3) If E is obtained by adding a multiple of a row of an identity matrix to another row, then E = 1 In view of Lemma 9, we can reformulate Theorem 4 as follows: Lemma 10 If B is an n n matrix, and E is an elementary n n matrix, then (EB) = ( E)( B)
8 DETERMINANTS 8 Iterating this result gives Lemma 11 If B is an n n matrix and E 1,, E K are elementary n n matrices, then (E 1 E K B) = ( E 1 ) ( E K )( B) In particular, when B = I n, we obtain Corollary 12 If E 1,, E K are elementary n n matrices, then (E 1 E K ) = ( E 1 ) ( E K ) Proof of Theorem 8 Consider first the case when the first factor A is singular In this case, the product AB is also singular, so by Theorem 6, it follows that (AB) = 0 and A = 0 Therefore (AB) = 0 = 0 B = ( A)( B), so the theorem holds in this case To complete the proof, we must establish the theorem when A is invertible In this case, we can write A as a product of elementary matrices: A = E 1 E K By Lemma 11 and Corollary 12, we obtain (AB) = (E 1 E K B) = ( E 1 ) ( E K )( B) = ((E 1 E K ))( B) = ( A)( B) and the theorem is proved As a special case of Theorem 8, suppose A is invertible, and take B = A 1 We obtain 1 = I = (AA 1 ) = ( A)( A 1 ) Dividing by A gives Corollary 13 If A is invertible, then (A 1 ) = 1 A In this section, we establish 7 Transposition Theorem 14 For any n n matrix A, we have (A t ) = A We begin with some special cases First, if A is singular, then A t is also singular, so both A and A t have erminant 0: Lemma 15 If A is singular, then A t = A = 0 For elementary matrices, we have Lemma 16 If E is an elementary matrix, then (E t ) = E Proof There are three types of elementary matrices We ll take them one at a time If E is obtained from an identity matrix by adding a multiple of row k to row l, then E = 1, by Theorem 4 But E t is obtained by adding a multiple of row
9 DETERMINANTS 9 l of an identity matrix to row k, so (E t ) = 1, again by Theorem 4 Therefore (E t ) = 1 = E If E is obtained by multiplying a row of the identity matrix by a constant, then E is diagonal, and hence symmetric, so E t = E, and so (E t ) = (E) Finally, if E is obtained by switching rows k and l of an identity matrix, then the only non-zero off diagonal entries of E are ones in positions (k, l) and (l, k), and therefore E is symmetric, so again (E t ) = E Proof of Theorem 14 In view of Lemma 15, we may assume that A is invertible Therefore, A can be expressed as a product of elementary matrices: Theorem 8 and Lemma 16, you get A = E 1 E 2 E K A t = ((E 1 E 2 E K ) t ) = (E t K E t 1) = (E t K) (E t 1) = (E K ) (E 1 ) = (E 1 ) (E K ) = (E 1 E K ) = A 71 Consequences of the Transposition Theorem Theorem 14 allows us to immediately deduce transposed forms of results we have already discussed For example, transposing Theorem 7 gives Theorem 17 The erminant of a lower triangular matrix is the product of the diagonal entries In addition, the properties of erminants that we have formulated for rows have analogues for columns In particular, Theorem 4 has an exact analogue for elementary column operations, so you can use both row and column operations in erminant calculations 8 Cofactor expansions Let A be an n n matrix The minor M ij is the (n 1) (n 1) matrix obtained by deleting the ith row and jth column of A The cofactors of A are the scalars For example, the 3 3 matrix cof ij (A) = ( 1) i+j M ij A = has nine minors and nine cofactors A typical minor is [ ] 4 6 M 12 = 7 9 The corresponding cofactor is, cof 12 (A) = ( 1) 1+2 M 12 = (36 42) = 6 Theorem 18 Let A be an n n matrix (1) (Cofactor expansion along the ith row) For any fixed i we have A = a ij cof ij (A) = ( 1) i+j a ij M ij j=1 j=1
10 DETERMINANTS 10 (2) (Cofactor expansion along the jth column) For any fixed j we have A = a ij cof ij (A) = ( 1) i+j a ij M ij i=1 We will omit a ailed proof, giving instead a brief sketch The diligent reader can supply ails herself First, let δ(a) be the cofactor expansion of A along the first column: δ(a) = ( 1) i+1 a i1 M i1 i=1 Using the properties of erminants that have already been established, one checks that the function δ satisfies the primitive properties (i)-(iii) of erminants However, we have already observed that these three properties uniquely ermine the erminant function, so we must have δ(a) = A This establishes the validity of the cofactor expansion along the first column Next, we use the fact that the erminant is invariant under transposition to establish the validity of the cofactor expansion along the first row To establish the validity of the cofactor expansion along the ith row, shift the ith row up to the first (changing the erminant by the factor ( 1) i 1 in the process), and then apply a cofactor expansion along the first row Finally, the validity of a cofactor expansion along the jth column can be established by transposition i=1 9 The adjoint formula and Cramer s Rule 91 Adjoints For any n n matrix A, the cofactors cof ij (A) themselves form and n n matrix called the cofactor matrix of A The transpose of the cofactor matrix is the adjoint matrix of A, denoted adj(a) Let s calculate the product matrix A adj(a) The entry in position ij is (3) a ik cof jk (A) k=1 We will consider separately the cases i = j and i j When i = j, the formula (3) becomes a ik cof ik (A), k=1 which is just a cofactor expansion along the ith row for A Thus we have established that the diagonal entries of the product A adj(a) are all equal to A It remains to calculate the off diagonal entries When i j, the formula (3) may be viewed as a cofactor expansion for the matrix A obtained by replacing row j of A by row i Thus we have, for the ij entry of A adj(a), a ik cof jk (A) = A k=1 But rows i and j of A are equal, so by Property (vi) of erminants, A = 0 Thus, we have shown that the diagonal entries of A adj(a) are all equal to A, and the off diagonal entries are all 0 In other words, we have proved
11 DETERMINANTS 11 Theorem 19 (Adjoint Formula) For any n n matrix A we have A adj(a) = ( A)I n If A 0, dividing through by A gives a formula for the inverse of A Corollary 20 If A 0 then A 1 = 1 A adj(a) We will finish our discussion of erminants by applying the above corollary to the solution of an n n system of equations Consider the system Ax = b, where the coefficient matrix A is invertible Then the unique solution is x = A 1 B = adj(a)b A In particular, this gives n j=1 x i = cof ji(a)b j A But the sum in the numerator on the right may be viewed as a cofactor expansion along the ith column of the matrix A i obtained by replacing the ith column of A by b Therefore, we have established Theorem 21 (Cramer s Rule) Consider the n n system Ax = b, with invertible coefficient matrix A The unique solution is given by x i = A i A, where A i is the matrix obtained by replacing the ith column of A with b Let s write out Cramer s Rule explicitly for the 2 2 system a 11 x 1 + a 12 x 2 = b 1 a 21 x 1 + a 22 x 2 = b 2 We have [ ] [ ] b1 a 12 a11 b 1 b 2 a 22 a 21 b 2 x 1 = [ ], x 2 = [ ] a11 a 12 a11 a 12 a 21 a 22 a 21 a 22 You should check that this is consistent with the formulas obtained in Section 1 for solutions to 2 2 systems You should view Cramer s Rule as a generalization of those formulas to n n systems Finally, it should be noted that, although Cramer s Rule is of theoretical interest, it is rarely an efficient method for solving linear systems Except for very small systems, Gaussian elimination is usually much more computationally efficient
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationNotes on Determinant
ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without
More informationMATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.
MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column
More informationSolving Linear Systems, Continued and The Inverse of a Matrix
, Continued and The of a Matrix Calculus III Summer 2013, Session II Monday, July 15, 2013 Agenda 1. The rank of a matrix 2. The inverse of a square matrix Gaussian Gaussian solves a linear system by reducing
More informationSystems of Linear Equations
Systems of Linear Equations Beifang Chen Systems of linear equations Linear systems A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where a, a,, a n and
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationThe Characteristic Polynomial
Physics 116A Winter 2011 The Characteristic Polynomial 1 Coefficients of the characteristic polynomial Consider the eigenvalue problem for an n n matrix A, A v = λ v, v 0 (1) The solution to this problem
More informationa 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.
Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given
More informationAu = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.
Chapter 7 Eigenvalues and Eigenvectors In this last chapter of our exploration of Linear Algebra we will revisit eigenvalues and eigenvectors of matrices, concepts that were already introduced in Geometry
More informationSolution to Homework 2
Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if
More informationMatrices 2. Solving Square Systems of Linear Equations; Inverse Matrices
Matrices 2. Solving Square Systems of Linear Equations; Inverse Matrices Solving square systems of linear equations; inverse matrices. Linear algebra is essentially about solving systems of linear equations,
More informationMath 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i.
Math 5A HW4 Solutions September 5, 202 University of California, Los Angeles Problem 4..3b Calculate the determinant, 5 2i 6 + 4i 3 + i 7i Solution: The textbook s instructions give us, (5 2i)7i (6 + 4i)(
More informationGENERATING SETS KEITH CONRAD
GENERATING SETS KEITH CONRAD 1 Introduction In R n, every vector can be written as a unique linear combination of the standard basis e 1,, e n A notion weaker than a basis is a spanning set: a set of vectors
More information1 Introduction to Matrices
1 Introduction to Matrices In this section, important definitions and results from matrix algebra that are useful in regression analysis are introduced. While all statements below regarding the columns
More informationLecture 3: Finding integer solutions to systems of linear equations
Lecture 3: Finding integer solutions to systems of linear equations Algorithmic Number Theory (Fall 2014) Rutgers University Swastik Kopparty Scribe: Abhishek Bhrushundi 1 Overview The goal of this lecture
More informationDirect Methods for Solving Linear Systems. Matrix Factorization
Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011
More informationSimilarity and Diagonalization. Similar Matrices
MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that
More informationUniversity of Lille I PC first year list of exercises n 7. Review
University of Lille I PC first year list of exercises n 7 Review Exercise Solve the following systems in 4 different ways (by substitution, by the Gauss method, by inverting the matrix of coefficients
More informationLinear Algebra Notes for Marsden and Tromba Vector Calculus
Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of
More information7 Gaussian Elimination and LU Factorization
7 Gaussian Elimination and LU Factorization In this final section on matrix factorization methods for solving Ax = b we want to take a closer look at Gaussian elimination (probably the best known method
More information8 Square matrices continued: Determinants
8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You
More informationAbstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix multiplication).
MAT 2 (Badger, Spring 202) LU Factorization Selected Notes September 2, 202 Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix
More informationDecember 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS
December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation
More informationIntroduction to Matrix Algebra
Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary
More informationNOTES ON LINEAR TRANSFORMATIONS
NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all
More informationUnit 18 Determinants
Unit 18 Determinants Every square matrix has a number associated with it, called its determinant. In this section, we determine how to calculate this number, and also look at some of the properties of
More informationLS.6 Solution Matrices
LS.6 Solution Matrices In the literature, solutions to linear systems often are expressed using square matrices rather than vectors. You need to get used to the terminology. As before, we state the definitions
More information26. Determinants I. 1. Prehistory
26. Determinants I 26.1 Prehistory 26.2 Definitions 26.3 Uniqueness and other properties 26.4 Existence Both as a careful review of a more pedestrian viewpoint, and as a transition to a coordinate-independent
More informationI. GROUPS: BASIC DEFINITIONS AND EXAMPLES
I GROUPS: BASIC DEFINITIONS AND EXAMPLES Definition 1: An operation on a set G is a function : G G G Definition 2: A group is a set G which is equipped with an operation and a special element e G, called
More informationUsing row reduction to calculate the inverse and the determinant of a square matrix
Using row reduction to calculate the inverse and the determinant of a square matrix Notes for MATH 0290 Honors by Prof. Anna Vainchtein 1 Inverse of a square matrix An n n square matrix A is called invertible
More information1 Determinants and the Solvability of Linear Systems
1 Determinants and the Solvability of Linear Systems In the last section we learned how to use Gaussian elimination to solve linear systems of n equations in n unknowns The section completely side-stepped
More informationRow Echelon Form and Reduced Row Echelon Form
These notes closely follow the presentation of the material given in David C Lay s textbook Linear Algebra and its Applications (3rd edition) These notes are intended primarily for in-class presentation
More informationLinear Algebra: Determinants, Inverses, Rank
D Linear Algebra: Determinants, Inverses, Rank D 1 Appendix D: LINEAR ALGEBRA: DETERMINANTS, INVERSES, RANK TABLE OF CONTENTS Page D.1. Introduction D 3 D.2. Determinants D 3 D.2.1. Some Properties of
More information6. Cholesky factorization
6. Cholesky factorization EE103 (Fall 2011-12) triangular matrices forward and backward substitution the Cholesky factorization solving Ax = b with A positive definite inverse of a positive definite matrix
More informationSolution of Linear Systems
Chapter 3 Solution of Linear Systems In this chapter we study algorithms for possibly the most commonly occurring problem in scientific computing, the solution of linear systems of equations. We start
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More information13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.
3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in three-space, we write a vector in terms
More informationMethods for Finding Bases
Methods for Finding Bases Bases for the subspaces of a matrix Row-reduction methods can be used to find bases. Let us now look at an example illustrating how to obtain bases for the row space, null space,
More informationInner products on R n, and more
Inner products on R n, and more Peyam Ryan Tabrizian Friday, April 12th, 2013 1 Introduction You might be wondering: Are there inner products on R n that are not the usual dot product x y = x 1 y 1 + +
More information1 Sets and Set Notation.
LINEAR ALGEBRA MATH 27.6 SPRING 23 (COHEN) LECTURE NOTES Sets and Set Notation. Definition (Naive Definition of a Set). A set is any collection of objects, called the elements of that set. We will most
More information160 CHAPTER 4. VECTOR SPACES
160 CHAPTER 4. VECTOR SPACES 4. Rank and Nullity In this section, we look at relationships between the row space, column space, null space of a matrix and its transpose. We will derive fundamental results
More information1 VECTOR SPACES AND SUBSPACES
1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such
More informationLecture 2 Matrix Operations
Lecture 2 Matrix Operations transpose, sum & difference, scalar multiplication matrix multiplication, matrix-vector product matrix inverse 2 1 Matrix transpose transpose of m n matrix A, denoted A T or
More informationSection 6.1 - Inner Products and Norms
Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,
More informationSYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison
SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections
More informationv w is orthogonal to both v and w. the three vectors v, w and v w form a right-handed set of vectors.
3. Cross product Definition 3.1. Let v and w be two vectors in R 3. The cross product of v and w, denoted v w, is the vector defined as follows: the length of v w is the area of the parallelogram with
More informationThe Determinant: a Means to Calculate Volume
The Determinant: a Means to Calculate Volume Bo Peng August 20, 2007 Abstract This paper gives a definition of the determinant and lists many of its well-known properties Volumes of parallelepipeds are
More informationElementary Matrices and The LU Factorization
lementary Matrices and The LU Factorization Definition: ny matrix obtained by performing a single elementary row operation (RO) on the identity (unit) matrix is called an elementary matrix. There are three
More information7.4. The Inverse of a Matrix. Introduction. Prerequisites. Learning Style. Learning Outcomes
The Inverse of a Matrix 7.4 Introduction In number arithmetic every number a 0 has a reciprocal b written as a or such that a ba = ab =. Similarly a square matrix A may have an inverse B = A where AB =
More informationName: Section Registered In:
Name: Section Registered In: Math 125 Exam 3 Version 1 April 24, 2006 60 total points possible 1. (5pts) Use Cramer s Rule to solve 3x + 4y = 30 x 2y = 8. Be sure to show enough detail that shows you are
More informationMAT188H1S Lec0101 Burbulla
Winter 206 Linear Transformations A linear transformation T : R m R n is a function that takes vectors in R m to vectors in R n such that and T (u + v) T (u) + T (v) T (k v) k T (v), for all vectors u
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More informationMATH 551 - APPLIED MATRIX THEORY
MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points
More informationby the matrix A results in a vector which is a reflection of the given
Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that
More informationFactorization Theorems
Chapter 7 Factorization Theorems This chapter highlights a few of the many factorization theorems for matrices While some factorization results are relatively direct, others are iterative While some factorization
More information1.2 Solving a System of Linear Equations
1.. SOLVING A SYSTEM OF LINEAR EQUATIONS 1. Solving a System of Linear Equations 1..1 Simple Systems - Basic De nitions As noticed above, the general form of a linear system of m equations in n variables
More informationMath 312 Homework 1 Solutions
Math 31 Homework 1 Solutions Last modified: July 15, 01 This homework is due on Thursday, July 1th, 01 at 1:10pm Please turn it in during class, or in my mailbox in the main math office (next to 4W1) Please
More informationDETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH
DETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH CHRISTOPHER RH HANUSA AND THOMAS ZASLAVSKY Abstract We investigate the least common multiple of all subdeterminants,
More informationMatrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.
Matrix Algebra A. Doerr Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Some Basic Matrix Laws Assume the orders of the matrices are such that
More informationLINEAR ALGEBRA. September 23, 2010
LINEAR ALGEBRA September 3, 00 Contents 0. LU-decomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................
More informationVector and Matrix Norms
Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationDETERMINANTS TERRY A. LORING
DETERMINANTS TERRY A. LORING 1. Determinants: a Row Operation By-Product The determinant is best understood in terms of row operations, in my opinion. Most books start by defining the determinant via formulas
More information5.3 The Cross Product in R 3
53 The Cross Product in R 3 Definition 531 Let u = [u 1, u 2, u 3 ] and v = [v 1, v 2, v 3 ] Then the vector given by [u 2 v 3 u 3 v 2, u 3 v 1 u 1 v 3, u 1 v 2 u 2 v 1 ] is called the cross product (or
More informationLecture notes on linear algebra
Lecture notes on linear algebra David Lerner Department of Mathematics University of Kansas These are notes of a course given in Fall, 2007 and 2008 to the Honors sections of our elementary linear algebra
More informationMATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.
MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column
More informationLinear Codes. Chapter 3. 3.1 Basics
Chapter 3 Linear Codes In order to define codes that we can encode and decode efficiently, we add more structure to the codespace. We shall be mainly interested in linear codes. A linear code of length
More informationChapter 2 Determinants, and Linear Independence
Chapter 2 Determinants, and Linear Independence 2.1 Introduction to Determinants and Systems of Equations Determinants can be defined and studied independently of matrices, though when square matrices
More informationChapter 7. Matrices. Definition. An m n matrix is an array of numbers set out in m rows and n columns. Examples. ( 1 1 5 2 0 6
Chapter 7 Matrices Definition An m n matrix is an array of numbers set out in m rows and n columns Examples (i ( 1 1 5 2 0 6 has 2 rows and 3 columns and so it is a 2 3 matrix (ii 1 0 7 1 2 3 3 1 is a
More informationLinear Equations ! 25 30 35$ & " 350 150% & " 11,750 12,750 13,750% MATHEMATICS LEARNING SERVICE Centre for Learning and Professional Development
MathsTrack (NOTE Feb 2013: This is the old version of MathsTrack. New books will be created during 2013 and 2014) Topic 4 Module 9 Introduction Systems of to Matrices Linear Equations Income = Tickets!
More informationLinear Programming. March 14, 2014
Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1
More informationLinear Algebra Review. Vectors
Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length
More informationSolving simultaneous equations using the inverse matrix
Solving simultaneous equations using the inverse matrix 8.2 Introduction The power of matrix algebra is seen in the representation of a system of simultaneous linear equations as a matrix equation. Matrix
More informationLecture Notes 2: Matrices as Systems of Linear Equations
2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably
More information5 Homogeneous systems
5 Homogeneous systems Definition: A homogeneous (ho-mo-jeen -i-us) system of linear algebraic equations is one in which all the numbers on the right hand side are equal to : a x +... + a n x n =.. a m
More informationMATH2210 Notebook 1 Fall Semester 2016/2017. 1 MATH2210 Notebook 1 3. 1.1 Solving Systems of Linear Equations... 3
MATH0 Notebook Fall Semester 06/07 prepared by Professor Jenny Baglivo c Copyright 009 07 by Jenny A. Baglivo. All Rights Reserved. Contents MATH0 Notebook 3. Solving Systems of Linear Equations........................
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More information4.5 Linear Dependence and Linear Independence
4.5 Linear Dependence and Linear Independence 267 32. {v 1, v 2 }, where v 1, v 2 are collinear vectors in R 3. 33. Prove that if S and S are subsets of a vector space V such that S is a subset of S, then
More informationMatrix Representations of Linear Transformations and Changes of Coordinates
Matrix Representations of Linear Transformations and Changes of Coordinates 01 Subspaces and Bases 011 Definitions A subspace V of R n is a subset of R n that contains the zero element and is closed under
More information8.2. Solution by Inverse Matrix Method. Introduction. Prerequisites. Learning Outcomes
Solution by Inverse Matrix Method 8.2 Introduction The power of matrix algebra is seen in the representation of a system of simultaneous linear equations as a matrix equation. Matrix algebra allows us
More informationT ( a i x i ) = a i T (x i ).
Chapter 2 Defn 1. (p. 65) Let V and W be vector spaces (over F ). We call a function T : V W a linear transformation form V to W if, for all x, y V and c F, we have (a) T (x + y) = T (x) + T (y) and (b)
More information[1] Diagonal factorization
8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:
More informationCITY UNIVERSITY LONDON. BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION
No: CITY UNIVERSITY LONDON BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION ENGINEERING MATHEMATICS 2 (resit) EX2005 Date: August
More informationLecture 4: Partitioned Matrices and Determinants
Lecture 4: Partitioned Matrices and Determinants 1 Elementary row operations Recall the elementary operations on the rows of a matrix, equivalent to premultiplying by an elementary matrix E: (1) multiplying
More informationMA106 Linear Algebra lecture notes
MA106 Linear Algebra lecture notes Lecturers: Martin Bright and Daan Krammer Warwick, January 2011 Contents 1 Number systems and fields 3 1.1 Axioms for number systems......................... 3 2 Vector
More informationSimilar matrices and Jordan form
Similar matrices and Jordan form We ve nearly covered the entire heart of linear algebra once we ve finished singular value decompositions we ll have seen all the most central topics. A T A is positive
More informationQuestion 2: How do you solve a matrix equation using the matrix inverse?
Question : How do you solve a matrix equation using the matrix inverse? In the previous question, we wrote systems of equations as a matrix equation AX B. In this format, the matrix A contains the coefficients
More informationMATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform
MATH 433/533, Fourier Analysis Section 11, The Discrete Fourier Transform Now, instead of considering functions defined on a continuous domain, like the interval [, 1) or the whole real line R, we wish
More information7. LU factorization. factor-solve method. LU factorization. solving Ax = b with A nonsingular. the inverse of a nonsingular matrix
7. LU factorization EE103 (Fall 2011-12) factor-solve method LU factorization solving Ax = b with A nonsingular the inverse of a nonsingular matrix LU factorization algorithm effect of rounding error sparse
More informationDeterminants in the Kronecker product of matrices: The incidence matrix of a complete graph
FPSAC 2009 DMTCS proc (subm), by the authors, 1 10 Determinants in the Kronecker product of matrices: The incidence matrix of a complete graph Christopher R H Hanusa 1 and Thomas Zaslavsky 2 1 Department
More informationSolutions to Math 51 First Exam January 29, 2015
Solutions to Math 5 First Exam January 29, 25. ( points) (a) Complete the following sentence: A set of vectors {v,..., v k } is defined to be linearly dependent if (2 points) there exist c,... c k R, not
More information15.062 Data Mining: Algorithms and Applications Matrix Math Review
.6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop
More informationISOMETRIES OF R n KEITH CONRAD
ISOMETRIES OF R n KEITH CONRAD 1. Introduction An isometry of R n is a function h: R n R n that preserves the distance between vectors: h(v) h(w) = v w for all v and w in R n, where (x 1,..., x n ) = x
More informationPYTHAGOREAN TRIPLES KEITH CONRAD
PYTHAGOREAN TRIPLES KEITH CONRAD 1. Introduction A Pythagorean triple is a triple of positive integers (a, b, c) where a + b = c. Examples include (3, 4, 5), (5, 1, 13), and (8, 15, 17). Below is an ancient
More information( ) which must be a vector
MATH 37 Linear Transformations from Rn to Rm Dr. Neal, WKU Let T : R n R m be a function which maps vectors from R n to R m. Then T is called a linear transformation if the following two properties are
More informationOrthogonal Projections
Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors
More informationα = u v. In other words, Orthogonal Projection
Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v
More informationLecture 1: Systems of Linear Equations
MTH Elementary Matrix Algebra Professor Chao Huang Department of Mathematics and Statistics Wright State University Lecture 1 Systems of Linear Equations ² Systems of two linear equations with two variables
More informationTypical Linear Equation Set and Corresponding Matrices
EWE: Engineering With Excel Larsen Page 1 4. Matrix Operations in Excel. Matrix Manipulations: Vectors, Matrices, and Arrays. How Excel Handles Matrix Math. Basic Matrix Operations. Solving Systems of
More information