Lecture 5: Matrix Algebra


 Agnes Hines
 10 months ago
 Views:
Transcription
1 Lecture 5: Matrix Algebra In Song Kim September 7, Matrix Algebra 11 Definition Matrix: A matrix is an array of mn real numbers arranged in m rows by n columns a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn Vectors are special cases of matrices; a column vector of length k is a k 1 matrix, while a row vector of the same length is a 1 k matrix You can also think of larger matrices as being made up of a collection of row or column vectors For example, 12 Properties of Matrices A = ( a 1 a 2 a m ) Matrix Addition: Let A and B be two m n matrices Then a 11 + b 11 a 12 + b 12 a 1n + b 1n a 21 + b 21 a 22 + b 22 a 2n + b 2n A + B = a m1 + b m1 a m2 + b m2 a mn + b mn Matrices A and B must be the same size, allowing them to be conformable for addition Example A =, B = A + B = Please do not distribute without permission PhD candidate, Department of Politics, Princeton University, Princeton NJ
2 Scalar Multiplication: Given the scalar k, the scalar multiplication of ka is a 11 a 12 a 1n ka 11 ka 12 ka 1n a 21 a 22 a 2n ka = k = ka 21 ka 22 ka 2n a m1 a m2 a mn ka m1 ka m2 ka mn Example k = 3, A = ka = Matrix Multiplication: If A is an m k matrix and B is a k n matrix, then their product C = AB is the m n matrix where Example a c e c ij = a i1 b 1j + a i2 b 2j + + a ik b kj b aa + bc d A B = ca + dc C D f ea + fc = ab + bd cb + dd eb + fd 1( 2) + 2(4) 1(2) 1(5) + 2( 3) 1(1) = 3( 2) + 1(4) + 4(2) 3(5) + 1( 3) + 4(1) The number of columns of the first matrix must equal the number of rows of the second matrix If so they are conformable for multiplication The sizes of the matrices (including the resulting product) must be (m k)(k n) = (m n) NOTE HOW THE INSIDE DIMENSIONS ARE THE SAME!! Example 4 [ ] Example 5 Example 6 [ ] [ ]
3 13 Matrix Algebra Laws Laws of Matrix Algebra: 1 Associative (A + B) + C = A + (B + C) (AB)C = A(BC) 2 Commutative A + B = B + A 3 Distributive A(B + C) = AB + AC (A + B)C = AC + BC Commutative law for multiplication does not hold the order of multiplication matters: AB BA Have class calculate the following, which is the reverse of above example [ ] [ ] Example A =, B = AB =, BA = Transpose Transpose: The transpose of the m n matrix A is the n m matrix A T (sometimes written A ) obtained by interchanging the rows and columns of A Examples: A =, A T = B = 3, B T = ( ) As class exercize: A = , transpose: The following rules apply for transposed matrices: 1 (A + B) T = A T + B T 2 (A T ) T = A 3 (sa) T = sa T 3
4 Example 8 4 (AB) T = B T A T Example of (AB) T = B T A T : A = , B = T 1 (AB) T = B T A T = = = Proposition 21 (AB) T = B T A T It is important to understand that Ax combines the columns of A while x T A T combines the rows of A T (show example) Many times in statistics we will make use of this sort of fact If we have a mathematical object x T A T that is is multiplied by other terms, we might want to express it as Ax in order to simplify it with some other part of the equation Example 9 Calculate A + 2B, AB, and BA using the following matrices [ ] A =, B = 4 3, Square Matrices Square matrices have the same number of rows and columns; a k k square matrix is referred to as a matrix of order k The diagonal of a square matrix is the vector of matrix elements that have the same subscripts If A is a square matrix of order k, then its diagonal is [a 11, a 22,, a kk ] Trace: The trace of a square matrix A is the sum of the diagonal elements: tr(a) = a 11 + a a kk Properties of the trace operator: If A and B are square matrices of order k, then 1 tr(a + B) = tr(a) + tr(b) 2 tr(a T ) = tr(a) 4
5 3 tr(sa) = str(a) 4 tr(ab) = tr(ba) Example , trace: Here are some examples of the square matrix: 1 Symmetric Matrix: A matrix A is symmetric if A = A T ; this implies that a ij = a ji for all i and j Examples: A = = A T, B = = B Diagonal Matrix: A matrix A is diagonal if all of its nondiagonal entries are zero; formally, if a ij = 0 for all i j Examples: A = , B = Triangular Matrix: A matrix is triangular one of two cases If all entries below the diagonal are zero (a ij = 0 for all i > j), it is upper triangular Conversely, if all entries above the diagonal are zero (a ij = 0 for all i < j), it is lower triangular Examples: A LT = 4 2 0, A UT = Identity Matrix: The n n identity matrix I n is the matrix whose diagonal elements are 1 and all offdiagonal elements are 0 Examples: I 2 =, I = The Inverse of a Matrix From elementary algebra, we define an inverse of a as 1 a such that a 1 a = 1 THIS IS DIFFERENT FROM THE INVERSE OF A FUNCTION!! A similar property is important in matrix algebra Definition 1 Identity Matrix: An n n with all values off the diagonal equal to 0 and all on diagonal values equal to Example 11 I 2 = 0 1 5
6 Definition 2 Inverse Matrix: An n n matrix A is invertible if there exists an n n matrix A 1 such that AA 1 = A 1 A = I n A 1 is the inverse of A If there is no such A 1, then A is noninvertible (another term for this is singular ) Example 12 Let Since A = , B = AB = BA = I n we conclude that B is the inverse, A 1, of A and that A is nonsingular Theorem 41 (Uniqueness of Inverse) The inverse of a matrix, if it exists, is unique denote the unique inverse of A by A 1 We Theorem 42 (Properties of Inverse) Let A and B be nonsingular n n matrices 1 AB is nonsingular and (AB) 1 = B 1 A 1 2 A 1 is nonsingular and (A 1 ) 1 = A 3 (A ) 1 = (A 1 ) One application of inverting a matrix is to solve a system of linear equations In fact, matrices can be motivated in terms of linear equations Consider a set of m linear equations of the form y 1 = a 11 x 1 + a 12 x a 1n x n y 2 = a 21 x 1 + a 22 x a 2n x n y m = a m1 x 1 + a m2 x a mn x n Then, its matrix representation is Y = AX where a 11 a 12 a 1n a 21 a 22 a 2n A =, X = a m1 a m2 a mn x 1 x 2 x m, Y = We call A a coefficient matrix With this notation, we can see that A 1 (provided that A is nonsingular) solves this system since we obtain X = A 1 Y by premultiplying the equation by A 1 y 1 y 2 y m 6
7 Example 13 Confirm that [ ] 1 = [ solve the following system of linear equations by using the inverse of matrix Class examples: Show B is inverse of A: A = [ ] 1 2, B = 1 1 2x 1 + 3x 2 = 1 2x 1 + 2x 2 = 2 [ ] [ ] 1 4 Find the inverse of the matrix A, A = 1 3 [ ] a b It turns out that there is a shortcut for 2x2 matrices that are invertible: A =, then c d [ ] A 1 = 1 d b ad bc Show this c a 5 Finding the inverse of a matrix We know that if B is the inverse of A, then AB = BA = I n Looking only at the first and last parts of this AB = I n Solving for B is equivalent to solving for n linear systems, where each column of B is solved for the corresponding column in I n In performing GaussJordan elimination for each individual system, the same row operations will be performed on A regardless of the column of B and I n Hence, we can solve the systems simultaneously by augmenting A with I n and performing GaussJordan elimination on A Note that for the square matrix A, GaussJordan elimination should result in A becoming row equivalent to I n Therefore, if GaussJordan elimination on [A I n ] results in [I n B], then B is the inverse of A Otherwise, A is singular To summarize: To calculate the inverse of A 1 Form the augmented matrix [A I n ] 2 Using elementary row operations, transform the augmented matrix to reduced row echelon form 3 The result of step 2 is an augmented matrix [C B] (a) If C = I n, then B = A 1 (b) If C I n, then C has a row of zeros A is singular and A 1 does not exist Exercise 1 Find the inverse of A = ] 7
8 6 Properties of matrices In our discussion of systems of equations we said that there were three possible cases: one solution (intersecting lines or planes), no solutions (parallel lines or planes), or infinite solutions (identical lines or planes) In matrix algebra we can identify which case a matrix fall into by identifying certain mathematical properties of the matrix There are three key pieces of information 1 the number of equations m, 2 the number of unknowns n, 3 the rank of the matrix representing the linear system Definition 3 Rank: The rank of a matrix is the number of nonzero rows in its row echelon form The rank corresponds to the maximum number of linearly independent row or column vectors in the matrix Properties of rank: For an i, j matrix, rank(a) min(i, j); rank(ab) min(ranka, rankb) Existence of Solutions: 1 One solution: Necessary condition for a system to have a unique solution is that there are exactly as many equations as unknowns 2 Infinite solutions: If a system has a solution and has more unknowns than equations, then it has infinitely many solutions 3 No solution: There is a row with all 0 s in RREF form ASIDE: You will often hear the expression degrees of freedom problem in statistical analyses At the extreme, this is a problem where you have more independent variables than observations In this case, there does not exist a solution and you will not get anything out of your computer software that performs the estimation More generally, consider the equation x+y = 7 This has one degree of freedom Once we fix x then y is now no longer free to vary Find the rank and solution to each system of equations 1 x 3y = 3 2x + y = 8 2 x + 2y + 3z = 6 2x 3y + 2z = 14 3x + y z = 2 8
9 3 x + 2y 3z = 4 2x + y 3z = 4 4 x + 2y + 3z + 4w = 5 x + 3y + 5z + 7w = 11 x z 2w = 6 7 Solving and Simplifying Linear Systems with Inverses In elementary algebra we often multiplied by inverses to simplify equations We will also do this often with matrix algebra Matrix representation of a linear system Ax = b If A is an n n matrix,then Ax = b is a system of n equations in n unknowns If A is invertible then A 1 exists To solve this system, we can left multiply each side by A 1 (must be left multiplication on both sides!!) A 1 (Ax) = A 1 b (A 1 A)x = A 1 b I n x x = A 1 b = A 1 b Hence, given A and b and given that A is nonsingular, then x = A 1 b is a unique solution to this system Notice also that the requirements for A to be nonsingular correspond to the requirements for a linear system to have a unique solution: ranka =rowsa =columnsa 8 Determinants Finding the inverse of a particular matrix can be a pain, though there are some short cuts you could use that we won t cover here Alternatively, we can make use of another property, the determinant If the determinant is nonzero then the matrix is invertible For a 1 1 matrix A = a the determinant is simply a We want the determinant to equal zero when the inverse does not exist Since the inverse of a, 1/a, does not exist when a = 0 a = a a11 a For a 2 2 matrix A = 12, the determinant is defined as a 21 a 22 a 11 a 12 a 21 a 22 = det A = a 11 a 22 a 12 a 21 == a 11 a 22 a 12 a 21 Notice that with matrices the verticle bars mean the determinant, not the absolut value 9
10 81 Extension to larger matrices Things get a bit more cumbersome once we start dealing with larger matrices In particular: 1 Deteriminant of 3 3 matrix: a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 = a 11 a 22 a 23 a 32 a 33 a 12 a 21 a 23 a 31 a 33 + a 13 a 21 a 22 a 31 a 32 2 Deteriminant of n n matrix Let A ij be the (n 1) (n 1) submatrix of A obtained by deleting row i and column j Let the (i, j)th minor of A be Then for any n n matrix A M ij = A ij A = a 11 M 11 a 12 M ( 1) n+1 a 1n M 1n Example: Does the following matrix have an inverse? A = Calculate its determinant A = = 1(2 15) 1(0 15) + 1(0 10) = = 8 2 Since A 0, we conclude that A has an inverse There is nothing complicated here, just keep track of all the addition and substraction, etc Definition 4 Let A be an n n matrix 1 Let M ij be the (n 1) (n 1) submatrix of A obtained by deleting the ith row and jth column of A Then, M ij is called the (i, j)th minor of A 2 The cofactor of A ij of A is defined as C ij = ( 1) i+j M ij Now, the following theorem gives us a new method to compute determinants Theorem 81 (Cofactor Expansion) Let A be an n n matrix Then, for any i and j, A = n j=1 a ijc ij, where a ij is the (i, j) the element of A 10
11 82 Special matrices and their determinants Then Triangular or Diagonal Matrices: For any uppertriangular, lowertriangular, or diagonal matrix, the determinant is just the product of the diagonal terms Suppose we have the following square matrix in row echelon form (ie, upper triangular) r 11 r 12 r 13 R = 0 r 22 r r 33 r R = r 22 r r 33 = r 11r 22 r 33 Notice how the 0 terms let us cancel things out Think about this in the diagonalized case!! 83 Properties of determinants Properties of Determinants: 1 A = A T 2 Interchanging rows changes the sign of the determinant 3 If two rows of A are exactly the same, then det A =0 4 If a row of A has all 0 then det A =0 5 If c 0 is some constant then A = ca 6 Performing elementary row operations on a matrix does not change the determinant other than by a scalar 7 A square matrix is nonsingular iff its determinant is 0 8 AB = A B 84 Bringing it together: Relationship between rank, inverse, determinant, and solutions: Consider the following matrix equations that uses a non square matrix which has more rows than columns Ie, we have more observations than we have variables a 11 a 12 b 1 [ ] a 21 a 22 X = b 2 x1 where X = x a 31 a 32 b 2 3 We want to find X = [ x1 x 2 ] to make this work This matrix could be reduced using elementary row operations to zero out the last row Thus, we would get a new matrix where the b 3 would have been transformed to something because of the application of the row operations to zero out a 31, a 32 Lets call this new value of b 3, s + b 3, where s is just some scalar 11
12 a 11 a 12 b 1 Then we have: a 21 a 22 X = b s + b 3 Performing matrix multiplication we obtain the following system of equations: a 11 x 1 + a 12 x 2 = b 1 a 21 x 1 + a 22 x 2 = b 2 0x 1 + 0x 2 = sb 3 Now notice that no matter what we put into the equation for x 1, x 2 we could never satisfy the third equation (this could happen if b 3 = 0, which means that no information at all is in the row and it should have just been dropped from the matrix in the first place) Thus we have no solutions to this system of equations Consider now the case of when we have more variables than observations, ie, m < n [ ] [ ] x a11 a 12 a 1 13 b1 X = where X = x a 21 a 22 a 23 b 2 2 x 3 Matrix multiplication gives us: a 11 x 1 + a 12 x 2 + a 13 x 3 = b 1 a 21 x 1 + a 22 x 2 + a 23 x 3 = b 2 Elementary row operations will allow us to zero out two of the entries in the matrix, and will in doing so put new coefficients on the a terms and will add something to the b terms So lets just use new variables to represent these transformed variables c 11 x 1 + 0x 2 + c 13 x 3 = d 1 0x 1 + c 22 x 2 + c 23 x 3 = d 2 Now notice that there is nothing we could do to zero out an entry in the third column without losing the zero we obtained in the row we were trying to put a zero in the third column Thus the best we can do is to rewrite things as: Which we can first manipulate to give us: c 11 x 1 = d 1 c 13 x 3 c 22 x 2 = d 2 c 23 x 3 12
13 x 1 = d 1 c 11 c 13x 3 c 11 x 2 = d 2 c 22 c 23x 3 c 22 And here we see why we have an infinite number of solutions Consider the first equation, x 1 = d 1 c 11 c 13x 3 c 11 We have c 13 c 11 in this expression Lets say the value of this that we needed to solve the equation was c 13 c 11 = 5 But, we can get a 5 from this ratio in an infinite number of ways Eg, c 11 = 2 and c 13 = 10, 10 2 Thus there are an infinite number of values for c 11 and c 13 that would solve our system of equations Assuming that our matrix A is in reduced echelong form, When m > n then we have no solution and our rank is less than the number of rows, ie, rank(a)<rows(a) When m < n we have an infinite number of solutions and rank(a)<columns(a) Only when m = n do we have a single solution, and rank(a)=row(a)=row(b) Furthermore, only when rank(a)=row(a)=row(b) is the matrix invertible 13
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationMATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix.
MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix. Inverse matrix Definition. Let A be an n n matrix. The inverse of A is an n n matrix, denoted
More informationUNIT 2 MATRICES  I 2.0 INTRODUCTION. Structure
UNIT 2 MATRICES  I Matrices  I Structure 2.0 Introduction 2.1 Objectives 2.2 Matrices 2.3 Operation on Matrices 2.4 Invertible Matrices 2.5 Systems of Linear Equations 2.6 Answers to Check Your Progress
More information(a) The transpose of a lower triangular matrix is upper triangular, and the transpose of an upper triangular matrix is lower triangular.
Theorem.7.: (Properties of Triangular Matrices) (a) The transpose of a lower triangular matrix is upper triangular, and the transpose of an upper triangular matrix is lower triangular. (b) The product
More informationMATH 304 Linear Algebra Lecture 4: Matrix multiplication. Diagonal matrices. Inverse matrix.
MATH 304 Linear Algebra Lecture 4: Matrix multiplication. Diagonal matrices. Inverse matrix. Matrices Definition. An mbyn matrix is a rectangular array of numbers that has m rows and n columns: a 11
More information1.5 Elementary Matrices and a Method for Finding the Inverse
.5 Elementary Matrices and a Method for Finding the Inverse Definition A n n matrix is called an elementary matrix if it can be obtained from I n by performing a single elementary row operation Reminder:
More information1 Introduction to Matrices
1 Introduction to Matrices In this section, important definitions and results from matrix algebra that are useful in regression analysis are introduced. While all statements below regarding the columns
More informationMathematics Notes for Class 12 chapter 3. Matrices
1 P a g e Mathematics Notes for Class 12 chapter 3. Matrices A matrix is a rectangular arrangement of numbers (real or complex) which may be represented as matrix is enclosed by [ ] or ( ) or Compact form
More information( % . This matrix consists of $ 4 5 " 5' the coefficients of the variables as they appear in the original system. The augmented 3 " 2 2 # 2 " 3 4&
Matrices define matrix We will use matrices to help us solve systems of equations. A matrix is a rectangular array of numbers enclosed in parentheses or brackets. In linear algebra, matrices are important
More information4. MATRICES Matrices
4. MATRICES 170 4. Matrices 4.1. Definitions. Definition 4.1.1. A matrix is a rectangular array of numbers. A matrix with m rows and n columns is said to have dimension m n and may be represented as follows:
More information2.1: MATRIX OPERATIONS
.: MATRIX OPERATIONS What are diagonal entries and the main diagonal of a matrix? What is a diagonal matrix? When are matrices equal? Scalar Multiplication 45 Matrix Addition Theorem (pg 0) Let A, B, and
More informationTopic 1: Matrices and Systems of Linear Equations.
Topic 1: Matrices and Systems of Linear Equations Let us start with a review of some linear algebra concepts we have already learned, such as matrices, determinants, etc Also, we shall review the method
More informationDecember 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS
December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in twodimensional space (1) 2x y = 3 describes a line in twodimensional space The coefficients of x and y in the equation
More information9 Matrices, determinants, inverse matrix, Cramer s Rule
AAC  Business Mathematics I Lecture #9, December 15, 2007 Katarína Kálovcová 9 Matrices, determinants, inverse matrix, Cramer s Rule Basic properties of matrices: Example: Addition properties: Associative:
More informationSolving Linear Systems, Continued and The Inverse of a Matrix
, Continued and The of a Matrix Calculus III Summer 2013, Session II Monday, July 15, 2013 Agenda 1. The rank of a matrix 2. The inverse of a square matrix Gaussian Gaussian solves a linear system by reducing
More informationMatrices, Determinants and Linear Systems
September 21, 2014 Matrices A matrix A m n is an array of numbers in rows and columns a 11 a 12 a 1n r 1 a 21 a 22 a 2n r 2....... a m1 a m2 a mn r m c 1 c 2 c n We say that the dimension of A is m n (we
More informationDeterminants. Dr. Doreen De Leon Math 152, Fall 2015
Determinants Dr. Doreen De Leon Math 52, Fall 205 Determinant of a Matrix Elementary Matrices We will first discuss matrices that can be used to produce an elementary row operation on a given matrix A.
More informationHelpsheet. Giblin Eunson Library MATRIX ALGEBRA. library.unimelb.edu.au/libraries/bee. Use this sheet to help you:
Helpsheet Giblin Eunson Library ATRIX ALGEBRA Use this sheet to help you: Understand the basic concepts and definitions of matrix algebra Express a set of linear equations in matrix notation Evaluate determinants
More information= [a ij ] 2 3. Square matrix A square matrix is one that has equal number of rows and columns, that is n = m. Some examples of square matrices are
This document deals with the fundamentals of matrix algebra and is adapted from B.C. Kuo, Linear Networks and Systems, McGraw Hill, 1967. It is presented here for educational purposes. 1 Introduction In
More informationIntroduction to Matrix Algebra I
Appendix A Introduction to Matrix Algebra I Today we will begin the course with a discussion of matrix algebra. Why are we studying this? We will use matrix algebra to derive the linear regression model
More informationMATH36001 Background Material 2015
MATH3600 Background Material 205 Matrix Algebra Matrices and Vectors An ordered array of mn elements a ij (i =,, m; j =,, n) written in the form a a 2 a n A = a 2 a 22 a 2n a m a m2 a mn is said to be
More informationThe Solution of Linear Simultaneous Equations
Appendix A The Solution of Linear Simultaneous Equations Circuit analysis frequently involves the solution of linear simultaneous equations. Our purpose here is to review the use of determinants to solve
More informationDiagonal, Symmetric and Triangular Matrices
Contents 1 Diagonal, Symmetric Triangular Matrices 2 Diagonal Matrices 2.1 Products, Powers Inverses of Diagonal Matrices 2.1.1 Theorem (Powers of Matrices) 2.2 Multiplying Matrices on the Left Right by
More informationLecture 2 Matrix Operations
Lecture 2 Matrix Operations transpose, sum & difference, scalar multiplication matrix multiplication, matrixvector product matrix inverse 2 1 Matrix transpose transpose of m n matrix A, denoted A T or
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 205/6 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationCalculus and linear algebra for biomedical engineering Week 4: Inverse matrices and determinants
Calculus and linear algebra for biomedical engineering Week 4: Inverse matrices and determinants Hartmut Führ fuehr@matha.rwthaachen.de Lehrstuhl A für Mathematik, RWTH Aachen October 30, 2008 Overview
More informationBasics Inversion and related concepts Random vectors Matrix calculus. Matrix algebra. Patrick Breheny. January 20
Matrix algebra January 20 Introduction Basics The mathematics of multiple regression revolves around ordering and keeping track of large arrays of numbers and solving systems of equations The mathematical
More informationMatrix Algebra and Applications
Matrix Algebra and Applications Dudley Cooke Trinity College Dublin Dudley Cooke (Trinity College Dublin) Matrix Algebra and Applications 1 / 49 EC2040 Topic 2  Matrices and Matrix Algebra Reading 1 Chapters
More information1 Determinants. Definition 1
Determinants The determinant of a square matrix is a value in R assigned to the matrix, it characterizes matrices which are invertible (det 0) and is related to the volume of a parallelpiped described
More informationMATH 240 Fall, Chapter 1: Linear Equations and Matrices
MATH 240 Fall, 2007 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 9th Ed. written by Prof. J. Beachy Sections 1.1 1.5, 2.1 2.3, 4.2 4.9, 3.1 3.5, 5.3 5.5, 6.1 6.3, 6.5, 7.1 7.3 DEFINITIONS
More informationMatrix Inverse and Determinants
DM554 Linear and Integer Programming Lecture 5 and Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1 2 3 4 and Cramer s rule 2 Outline 1 2 3 4 and
More informationB such that AB = I and BA = I. (We say B is an inverse of A.) Definition A square matrix A is invertible (or nonsingular) if matrix
Matrix inverses Recall... Definition A square matrix A is invertible (or nonsingular) if matrix B such that AB = and BA =. (We say B is an inverse of A.) Remark Not all square matrices are invertible.
More informationHomework: 2.1 (page 56): 7, 9, 13, 15, 17, 25, 27, 35, 37, 41, 46, 49, 67
Chapter Matrices Operations with Matrices Homework: (page 56):, 9, 3, 5,, 5,, 35, 3, 4, 46, 49, 6 Main points in this section: We define a few concept regarding matrices This would include addition of
More informationNotes on Determinant
ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 918/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without
More informationMATH10212 Linear Algebra. Systems of Linear Equations. Definition. An ndimensional vector is a row or a column of n numbers (or letters): a 1.
MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0534405967. Systems of Linear Equations Definition. An ndimensional vector is a row or a column
More information2.5 Elementary Row Operations and the Determinant
2.5 Elementary Row Operations and the Determinant Recall: Let A be a 2 2 matrtix : A = a b. The determinant of A, denoted by det(a) c d or A, is the number ad bc. So for example if A = 2 4, det(a) = 2(5)
More informationa 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.
Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given
More informationMAT188H1S Lec0101 Burbulla
Winter 206 Linear Transformations A linear transformation T : R m R n is a function that takes vectors in R m to vectors in R n such that and T (u + v) T (u) + T (v) T (k v) k T (v), for all vectors u
More informationMath 2331 Linear Algebra
2.2 The Inverse of a Matrix Math 2331 Linear Algebra 2.2 The Inverse of a Matrix Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/ jiwenhe/math2331 Jiwen He, University
More informationLecture 6. Inverse of Matrix
Lecture 6 Inverse of Matrix Recall that any linear system can be written as a matrix equation In one dimension case, ie, A is 1 1, then can be easily solved as A x b Ax b x b A 1 A b A 1 b provided that
More informationChapter 1  Matrices & Determinants
Chapter 1  Matrices & Determinants Arthur Cayley (August 16, 1821  January 26, 1895) was a British Mathematician and Founder of the Modern British School of Pure Mathematics. As a child, Cayley enjoyed
More informationThe basic unit in matrix algebra is a matrix, generally expressed as: a 11 a 12. a 13 A = a 21 a 22 a 23
(copyright by Scott M Lynch, February 2003) Brief Matrix Algebra Review (Soc 504) Matrix algebra is a form of mathematics that allows compact notation for, and mathematical manipulation of, highdimensional
More informationDETERMINANTS. b 2. x 2
DETERMINANTS 1 Systems of two equations in two unknowns A system of two equations in two unknowns has the form a 11 x 1 + a 12 x 2 = b 1 a 21 x 1 + a 22 x 2 = b 2 This can be written more concisely in
More informationEC9A0: Presessional Advanced Mathematics Course
University of Warwick, EC9A0: Presessional Advanced Mathematics Course Peter J. Hammond & Pablo F. Beker 1 of 55 EC9A0: Presessional Advanced Mathematics Course Slides 1: Matrix Algebra Peter J. Hammond
More informationMath 313 Lecture #10 2.2: The Inverse of a Matrix
Math 1 Lecture #10 2.2: The Inverse of a Matrix Matrix algebra provides tools for creating many useful formulas just like real number algebra does. For example, a real number a is invertible if there is
More informationMatrix Algebra LECTURE 1. Simultaneous Equations Consider a system of m linear equations in n unknowns: y 1 = a 11 x 1 + a 12 x 2 + +a 1n x n,
LECTURE 1 Matrix Algebra Simultaneous Equations Consider a system of m linear equations in n unknowns: y 1 a 11 x 1 + a 12 x 2 + +a 1n x n, (1) y 2 a 21 x 1 + a 22 x 2 + +a 2n x n, y m a m1 x 1 +a m2 x
More informationInverses and powers: Rules of Matrix Arithmetic
Contents 1 Inverses and powers: Rules of Matrix Arithmetic 1.1 What about division of matrices? 1.2 Properties of the Inverse of a Matrix 1.2.1 Theorem (Uniqueness of Inverse) 1.2.2 Inverse Test 1.2.3
More informationMatrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc.
2 Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Theorem 8: Let A be a square matrix. Then the following statements are equivalent. That is, for a given A, the statements are either all true
More informationAPPLICATIONS OF MATRICES. Adj A is nothing but the transpose of the cofactor matrix [A ij ] of A.
APPLICATIONS OF MATRICES ADJOINT: Let A = [a ij ] be a square matrix of order n. Let Aij be the cofactor of a ij. Then the n th order matrix [A ij ] T is called the adjoint of A. It is denoted by adj
More informationDefinition A square matrix M is invertible (or nonsingular) if there exists a matrix M 1 such that
0. Inverse Matrix Definition A square matrix M is invertible (or nonsingular) if there exists a matrix M such that M M = I = M M. Inverse of a 2 2 Matrix Let M and N be the matrices: a b d b M =, N = c
More informationThe Inverse of a Matrix
The Inverse of a Matrix 7.4 Introduction In number arithmetic every number a ( 0) has a reciprocal b written as a or such that a ba = ab =. Some, but not all, square matrices have inverses. If a square
More informationUsing row reduction to calculate the inverse and the determinant of a square matrix
Using row reduction to calculate the inverse and the determinant of a square matrix Notes for MATH 0290 Honors by Prof. Anna Vainchtein 1 Inverse of a square matrix An n n square matrix A is called invertible
More informationINTRODUCTORY LINEAR ALGEBRA WITH APPLICATIONS B. KOLMAN, D. R. HILL
SOLUTIONS OF THEORETICAL EXERCISES selected from INTRODUCTORY LINEAR ALGEBRA WITH APPLICATIONS B. KOLMAN, D. R. HILL Eighth Edition, Prentice Hall, 2005. Dr. Grigore CĂLUGĂREANU Department of Mathematics
More informationLinear Dependence Tests
Linear Dependence Tests The book omits a few key tests for checking the linear dependence of vectors. These short notes discuss these tests, as well as the reasoning behind them. Our first test checks
More informationMatrices, transposes, and inverses
Matrices, transposes, and inverses Math 40, Introduction to Linear Algebra Wednesday, February, 202 Matrixvector multiplication: two views st perspective: A x is linear combination of columns of A 2 4
More informationAdvanced Techniques for Mobile Robotics Compact Course on Linear Algebra. Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz
Advanced Techniques for Mobile Robotics Compact Course on Linear Algebra Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Vectors Arrays of numbers Vectors represent a point in a n dimensional
More information13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.
3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in threespace, we write a vector in terms
More informationMATH 2030: SYSTEMS OF LINEAR EQUATIONS. ax + by + cz = d. )z = e. while these equations are not linear: xy z = 2, x x = 0,
MATH 23: SYSTEMS OF LINEAR EQUATIONS Systems of Linear Equations In the plane R 2 the general form of the equation of a line is ax + by = c and that the general equation of a plane in R 3 will be we call
More informationChapter 7. Matrices. Definition. An m n matrix is an array of numbers set out in m rows and n columns. Examples. ( 1 1 5 2 0 6
Chapter 7 Matrices Definition An m n matrix is an array of numbers set out in m rows and n columns Examples (i ( 1 1 5 2 0 6 has 2 rows and 3 columns and so it is a 2 3 matrix (ii 1 0 7 1 2 3 3 1 is a
More informationLINEAR ALGEBRA. September 23, 2010
LINEAR ALGEBRA September 3, 00 Contents 0. LUdecomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................
More information2.1: Determinants by Cofactor Expansion. Math 214 Chapter 2 Notes and Homework. Evaluate a Determinant by Expanding by Cofactors
2.1: Determinants by Cofactor Expansion Math 214 Chapter 2 Notes and Homework Determinants The minor M ij of the entry a ij is the determinant of the submatrix obtained from deleting the i th row and the
More informationCofactor Expansion: Cramer s Rule
Cofactor Expansion: Cramer s Rule MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Today we will focus on developing: an efficient method for calculating
More information4. Matrix inverses. left and right inverse. linear independence. nonsingular matrices. matrices with linearly independent columns
L. Vandenberghe EE133A (Spring 2016) 4. Matrix inverses left and right inverse linear independence nonsingular matrices matrices with linearly independent columns matrices with linearly independent rows
More informationEconomics 102C: Advanced Topics in Econometrics 2  Tooling Up: The Basics
Economics 102C: Advanced Topics in Econometrics 2  Tooling Up: The Basics Michael Best Spring 2015 Outline The Evaluation Problem Matrix Algebra Matrix Calculus OLS With Matrices The Evaluation Problem:
More informationSolution to Homework 2
Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if
More informationSYSTEMS OF EQUATIONS AND MATRICES WITH THE TI89. by Joseph Collison
SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationNON SINGULAR MATRICES. DEFINITION. (Non singular matrix) An n n A is called non singular or invertible if there exists an n n matrix B such that
NON SINGULAR MATRICES DEFINITION. (Non singular matrix) An n n A is called non singular or invertible if there exists an n n matrix B such that AB = I n = BA. Any matrix B with the above property is called
More information8 Square matrices continued: Determinants
8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You
More informationMatrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.
Matrix Algebra A. Doerr Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Some Basic Matrix Laws Assume the orders of the matrices are such that
More informationChapter 8. Matrices II: inverses. 8.1 What is an inverse?
Chapter 8 Matrices II: inverses We have learnt how to add subtract and multiply matrices but we have not defined division. The reason is that in general it cannot always be defined. In this chapter, we
More informationLecture Notes 2: Matrices as Systems of Linear Equations
2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably
More informationAPPENDIX QA MATRIX ALGEBRA. a 11 a 12 a 1K A = [a ik ] = [A] ik = 21 a 22 a 2K. a n1 a n2 a nk
Greene2140242 book December 1, 2010 8:8 APPENDIX QA MATRIX ALGEBRA A.1 TERMINOLOGY A matrix is a rectangular array of numbers, denoted a 11 a 12 a 1K A = [a ik ] = [A] ik = a 21 a 22 a 2K. a n1 a n2 a
More information1 Vector Spaces and Matrix Notation
1 Vector Spaces and Matrix Notation De nition 1 A matrix: is rectangular array of numbers with n rows and m columns. 1 1 1 a11 a Example 1 a. b. c. 1 0 0 a 1 a The rst is square with n = and m = ; the
More informationA matrix over a field F is a rectangular array of elements from F. The symbol
Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F) denotes the collection of all m n matrices over F Matrices will usually be denoted
More informationSystems of Linear Equations
Systems of Linear Equations Beifang Chen Systems of linear equations Linear systems A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where a, a,, a n and
More informationIntroduction to Matrices for Engineers
Introduction to Matrices for Engineers C.T.J. Dodson, School of Mathematics, Manchester Universit 1 What is a Matrix? A matrix is a rectangular arra of elements, usuall numbers, e.g. 1 08 4 01 1 0 11
More informationSolving a System of Equations
11 Solving a System of Equations 111 Introduction The previous chapter has shown how to solve an algebraic equation with one variable. However, sometimes there is more than one unknown that must be determined
More informationLecture 23: The Inverse of a Matrix
Lecture 23: The Inverse of a Matrix Winfried Just, Ohio University March 9, 2016 The definition of the matrix inverse Let A be an n n square matrix. The inverse of A is an n n matrix A 1 such that A 1
More informationIntroduction to Matrix Algebra
Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra  1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary
More informationSergei Silvestrov, Christopher Engström, Karl Lundengård, Johan Richter, Jonas Österberg. November 13, 2014
Sergei Silvestrov,, Karl Lundengård, Johan Richter, Jonas Österberg November 13, 2014 Analysis Todays lecture: Course overview. Repetition of matrices elementary operations. Repetition of solvability of
More informationMatrix Differentiation
1 Introduction Matrix Differentiation ( and some other stuff ) Randal J. Barnes Department of Civil Engineering, University of Minnesota Minneapolis, Minnesota, USA Throughout this presentation I have
More informationLecture 10: Invertible matrices. Finding the inverse of a matrix
Lecture 10: Invertible matrices. Finding the inverse of a matrix Danny W. Crytser April 11, 2014 Today s lecture Today we will Today s lecture Today we will 1 Single out a class of especially nice matrices
More informationUsing determinants, it is possible to express the solution to a system of equations whose coefficient matrix is invertible:
Cramer s Rule and the Adjugate Using determinants, it is possible to express the solution to a system of equations whose coefficient matrix is invertible: Theorem [Cramer s Rule] If A is an invertible
More informationLinear Algebra Notes for Marsden and Tromba Vector Calculus
Linear Algebra Notes for Marsden and Tromba Vector Calculus ndimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of
More informationLecture 21: The Inverse of a Matrix
Lecture 21: The Inverse of a Matrix Winfried Just, Ohio University October 16, 2015 Review: Our chemical reaction system Recall our chemical reaction system A + 2B 2C A + B D A + 2C 2D B + D 2C If we write
More information1 Determinants and the Solvability of Linear Systems
1 Determinants and the Solvability of Linear Systems In the last section we learned how to use Gaussian elimination to solve linear systems of n equations in n unknowns The section completely sidestepped
More informationLecture Notes: Matrix Inverse. 1 Inverse Definition
Lecture Notes: Matrix Inverse Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk Inverse Definition We use I to represent identity matrices,
More informationLinear Algebra Notes
Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note
More informationLinear Systems. Singular and Nonsingular Matrices. Find x 1, x 2, x 3 such that the following three equations hold:
Linear Systems Example: Find x, x, x such that the following three equations hold: x + x + x = 4x + x + x = x + x + x = 6 We can write this using matrixvector notation as 4 {{ A x x x {{ x = 6 {{ b General
More information1 Introduction. 2 Matrices: Definition. Matrix Algebra. Hervé Abdi Lynne J. Williams
In Neil Salkind (Ed.), Encyclopedia of Research Design. Thousand Oaks, CA: Sage. 00 Matrix Algebra Hervé Abdi Lynne J. Williams Introduction Sylvester developed the modern concept of matrices in the 9th
More informationMathQuest: Linear Algebra. 1. Which of the following matrices does not have an inverse?
MathQuest: Linear Algebra Matrix Inverses 1. Which of the following matrices does not have an inverse? 1 2 (a) 3 4 2 2 (b) 4 4 1 (c) 3 4 (d) 2 (e) More than one of the above do not have inverses. (f) All
More informationMath 312 Homework 1 Solutions
Math 31 Homework 1 Solutions Last modified: July 15, 01 This homework is due on Thursday, July 1th, 01 at 1:10pm Please turn it in during class, or in my mailbox in the main math office (next to 4W1) Please
More information1. LINEAR EQUATIONS. A linear equation in n unknowns x 1, x 2,, x n is an equation of the form
1. LINEAR EQUATIONS A linear equation in n unknowns x 1, x 2,, x n is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b, where a 1, a 2,..., a n, b are given real numbers. For example, with x and
More informationMATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.
MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set. Vector space A vector space is a set V equipped with two operations, addition V V (x,y) x + y V and scalar
More informationSolution. Area(OABC) = Area(OAB) + Area(OBC) = 1 2 det( [ 5 2 1 2. Question 2. Let A = (a) Calculate the nullspace of the matrix A.
Solutions to Math 30 Takehome prelim Question. Find the area of the quadrilateral OABC on the figure below, coordinates given in brackets. [See pp. 60 63 of the book.] y C(, 4) B(, ) A(5, ) O x Area(OABC)
More informationEC327: Advanced Econometrics, Spring 2007
EC327: Advanced Econometrics, Spring 2007 Wooldridge, Introductory Econometrics (3rd ed, 2006) Appendix D: Summary of matrix algebra Basic definitions A matrix is a rectangular array of numbers, with m
More informationLecture Notes 1: Matrix Algebra Part B: Determinants and Inverses
University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 57 Lecture Notes 1: Matrix Algebra Part B: Determinants and Inverses Peter J. Hammond email: p.j.hammond@warwick.ac.uk Autumn 2012,
More informationWe know a formula for and some properties of the determinant. Now we see how the determinant can be used.
Cramer s rule, inverse matrix, and volume We know a formula for and some properties of the determinant. Now we see how the determinant can be used. Formula for A We know: a b d b =. c d ad bc c a Can we
More information