# A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form

Save this PDF as:

Size: px
Start display at page:

Download "A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form"

## Transcription

1 Section 1.3 Matrix Products A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form (scalar #1)(quantity #1) + (scalar #2)(quantity #2) (scalar #n)(quantity #n) This pattern of a sum of products arises so frequently we give it a special name. Definition The dot product or inner product of two n-vectors of scalars a= a a a and b= b b b is 1 2 n 1 2 n n a b= ab 11+ a2b2+ + anbn = ab j j. j= 1

2 Example An instructor gives four exams worth 20%, 25%, 25% and 30% respectively. A student gets the following scores out of 100; 78, 65, 85, 82. Determine the course average using dot products. Example Find the dot product of each of the following pairs of vectors. a) v= 7 2 1, w = b) v= , w = 1 2 \$ #

3 Every linear combination of vectors can be written as a product in a special way. Many times we will be using a linear combination of columns like 2 5 c1 3 + c2 7 2# 0 # \$ \$ # Lets show how to write this as a special kind of product. Definition Let A be an m n matrix and c a column vector with n entries, then the matrix-vector product Ac is the linear combination c 1col1( A) + c 2 col2( A) + + c n coln( A) and the entries of Ac can be computed directly as dot products using row A c 1( ) row A c Ac = 2( ). rown( A) c# \$

4 Example Let A = 3 6 1\$ # and c = Write Ac as a linear combination of columns of A. Write Ac in terms of dot products. \$ #

5 Every system of equations can be written as a matrix equation involvng a matrix-vector product. 5x1 3x2+ x3 = 1 4x1+ 2x2+ 6x3 = 8

6 We can form the product of a pair of matrices under certain circumstances. Definition Let A = [a ij ] be an m n matrix and B = [b ij ] an n p matrix. Then the product of matrices A and B, denoted AB, is the m p matrix C = [c ij ] where c ij = row i (A) col j (B) = a a a i1 i2 in b b b 1j 2j nj \$ # n k= 1 a b 1 i m and 1 j p. (Product AB is defined only when the number of columns of A equals the number of rows of B.) Figure 1 illustrates a matrix product AB, where A is m n and B is n p. = ik kj Figure 1.

7 Examples: Form the following products, if possible A = B= C= D= E= F= 0 5 \$ # \$ # # 2 0\$ # 0 1 # \$ # \$ # AB BF AD EA

8 Products of Matrices vs. Products of Real Numbers Example 6 in the text illustrates several major distinctions between multiplication of matrices and multiplication of scalars. 1. Multiplication of matrices is not defined for all pairs of matrices. The number of columns of the first matrix must equal the number of rows of the second matrix. 2. Matrix multiplication is not commutative; that is, AB need not equal BA. 3. The product of two matrices can be zero when neither of the matrices consists of all zeros.

9 Special Terminology The definition of a matrix product includes row-by-column products as a 1 n matrix times an n 1 matrix and it also includes matrix-vector products as an m n matrix times an n 1 matrix. Thus we will only refer to matrix products from here on, except when we want to emphasize the nature of a product as one of these special cases. In addition note that C= AB= A col1( B) col2( B) colp( B) = Acol1( B) Acol2( B) Acolp( B) which says that col j (AB) is a linear combination of the columns of A with scalars from col j (B) since Acol (B) = b col ( A) + b col ( A) + + b col ( A) j 1j 1 2j 2 nj n Hence linear combinations are the fundamental building blocks of matrix products.

10 Matrix Powers If A is a square matrix, then products of A with itself like AA, AAA,... are defined and we denote them as powers of the matrix A in the form AA = A 2, AAA = A 3,... If p is a positive integer, then we define p = p factors A AA A For an n n matrix A we define A 0 = I n, the n n identity matrix. For nonnegative integers p and q, matrix powers obey familiar rules for exponents, namely A p A q = A p+q and (A p ) q = A pq. However, since matrix multiplication is not commutative, for general square matrices (AB) p A p B p..

11 Example A government employee at an obscure warehouse keeps busy by shifting portions of stock between two rooms. Each week two-thirds of the stock from room R1 is shifted to room R2 and two-fifths of the stock from R2 to R1. The following transition matrix T provides a model for this activity: Entry t ij is the fraction of stock that is shipped to Ri from Rj each week. If R1 contains 3000 items and R2 contains 9000 items, at the end of the week the stock in a room is the amount that remains in the room plus the amount that is shipped in from the other room. We have 1/3(stock in R1) + 2/5(stock in R2) = 1/3(3000) + 2/5(9000) = /3(stock in R1) + 3/5(stock in R2) = 2/3(3000) + 3/5(9000) = 7400 So the new stock in each room is a linear combination of the stocks at the start of the week and this can be computed as the product of the transition matrix and S 0 = \$# first week is TS, the original stock vector. Thus the stock vector at the end of the 4600 = S = computed as TS T S S 1 \$# = =. The stock vector at the end of the second week is \$# = 3 and it follows that S3 TS2 T S 0 = = = \$# (We have rounded the entries of the stock vectors to whole numbers.) The table is a portion of the records that the employee keeps. Original stock Stock at end of week #1 Stock at end of week #2 Stock at end of week #3 Stock at end of week #4 Stock at end of week #

12 We see that in just a few weeks the employee can claim to do the shifting of the stock without actually performing the task since the number of items in each room does not change after the third week. We say the process has reached a steady state. This type of iterative process is called a Markov chain or Markov process. The basic question that we pose for such a process is to determine the limiting behavior of the sequence of vectors S0, S1, S2, S3, We show later that the ultimate behavior depends upon the information contained in the transition matrix and we show how to determine the steady state, if it exists.

13 Properties of Matrix Products Property of Scalar Multiplication and Matrix Products. Let r be a scalar and A and B be matrices. Then r(ab) = (ra)b = A(rB). Properties of Matrix Products and Linear Combinations. Let A, B, and C be matrices, x and y be vectors, and r and s be scalars. Then A(B + C) = AB + AC and A(rx + sy) = rax + say. Each of these properties is called a distributive rule. Property of Matrix Products and the Transpose. If A and B are matrices, then (AB) T = B T A T.

14 The Angle Between 2-vectors. The dot product of a pair of n-vectors provided us with an algebraic tool for computing matrix-vector products and matrix products. However, the dot product is more than just an algebraic construction, it arises naturally when we determine the angle between geometric n-vectors; see Section 1.1. Here we show how a b is related to the angle between the 2-vectors a = [a 1 a 2 ] and b = [b 1 b 2 ]. Using the geometric representation for 2-vectors given in Section 1.1 we can view vectors a and b as shown in Figure 2 where α is the angle between vector a and the horizontal axis and β is the angle between vector b and the horizontal axis.hence the angle between vectors a and b shown in Figure 2 is α-β. Figure 2. From basic trigonometric relationships we have cos( α) = sin( α) = a 1 a1 2 + a2 2 a 2 a1 2 + a2 2 cos( β) = sin( β) = b 1 b1 2 + b2 2 b 2 b1 2 + b2 2 From the trigonometric identity cos(α-β) = cos(α)cos(β) + sin(α)sin(β) it follows that

15 cos( α - β ) = = = = ab ab 1 1+ a2b a + a b + b a + a b + b a b a + a b + b a b a a b b + a b 2 2 a + a b + b Thus the cosine of the angle between 2-vectors a and b has been expressed in terms of dot products. Later we generalize this result to a pair of n-vectors.

16 Application: Path Lengths In Section 1.1 we introduced an incidence matrix as a mathematical representation of a graph. The graph in Figure 3 is represented by the incidence matrix A = \$ #. We say there is a path between nodes P i and P j if we can move along edges of the graph to go from P i to P j. For example, there is a path between P 1 and P 4 in Figure 3; traverse the edge from P 1 to P 3 and then from P 3 to P 4. However, there is no edge from P 1 to P 4. For the graph in Figure 3, there is a path connecting every pair of nodes. This is not always the case; see Figure 4. There is no path between P 1 and P 4. The graph in Figure 4 has two separate, or disjoint, pieces. In some applications that can be modeled by using a graph there can be more than one edge between a pair of nodes. For the graph in Figure 5 there are two edges between P 2 and P 3. In this case the incidence matrix is B = \$ #. We use the term path of length 1 to mean that there are no intervening nodes of the graph between the ends of the path. (The term length here does not mean a measure of the actual distance between nodes, rather it is a count of the number of edges traversed between the starting node and the ending node

17 of a path.) The entries of the incidence matrix of a graph count the number of paths of length 1 between a pair of nodes. In certain applications it is important to determine the number of paths of a certain length k between each pair of nodes of a graph. Also, one frequently must calculate the longest path length that will ever be needed to travel between any pair of nodes. Both of these problems can be solved by manipulating the incidence matrix associated with a graph. Our manipulation tools will be matrix addition and multiplication. Since the incidence matrix A of a graph is square, its powers A 2, A 3, etc. are defined. We have We know that ij i j i1 1j i2 2j in nj ent A = row A col A = a a + a a + + a a. a i1 = number of paths of length 1 from P i to P 1 a 1j = number of paths of length 1 from P 1 to P j so the only way there could be a path from P i to P j through node P 1 is if both a i1 and a 1j are not zero. Thus product a i1 a 1j is the number of paths of length two between P i and P j through P 1. Similarly, a is a sj is the number of paths of length 2 between P i and P j through P s. Hence the dot product row i (A) col j (A) gives the total number of paths of length 2 between P i and P j. It follows that matrix A 2 provides a mathematical model whose entries count the number of paths of length 2 between nodes of the graph. By corresponding arguments, the number of paths of length k from P i to P j will be given by the (i,j)-entry of matrix A k. In order to calculate the longest path length that will ever be required to travel between any pair of nodes in a graph, we proceed as follows. The (i,j)-entry of matrix A + A 2 is the number of paths of length less than or equal to 2 from P i to P j. Similarly, the entries of A + A 2 + A 3 are the number of paths of length less than or equal to 3 between nodes of the graph. We continue this process until we find a value of k such that all the nondiagonal entries of A + A 2 + A A k are nonzero. This implies that there is a path of length k or less between distinct nodes of the graph. (Why can the diagonal entries be ignored?) The value of k

18 determined in this way is the length of the longest path we would ever need to traverse to go from one node of the graph to any other node of the graph.

19 True/False Review Questions 1. If x and y are both 3x1 matrices then x y is the same as x T y. 2. If A is 3x2 and x is 2x1 then Ax is a linear combination of the columns of A. 3. If A is 4x2 and B is 2x4, then AB = BA. 4. If A is 10x7 and B is 7x8, then ent 5,2 (AB) = row 5 (A)col 2 (B). 5. Matrix multiplication is commutative. 6. If A is 3x3 and b is 3x1 so that Ab = a zero column \$ # then either A is a zero matrix or b is 7. If A and B are the same size, then AB = BA. 8. Powers of a matrix are really successive matrix products. 9. The dot product of a pair of real n-vectors x and y is commutative; that is, x y = y x. 10. Let x =[1 1 1], then (x T x) 2 = 3x T x.

20 Terminology Dot product; inner product. Matrix-vector product. Matrix product. Markov chain; steady state. Row-by-column-product. Matrix equation. Matrix powers. Angle between 2-vectors. There is a connection between some of the terms listed above. Understanding and being able to explicitly state such connections is important in later sections. For practice with the concepts of this section formulate responses to the following questions and statements in your own words. How are dot products and row-by-column products related? Describe how matrix-vector products are computed using dot products. Explain how we to compute a matrix-vector product as a linear combination of columns. Explain how we formulate every linear system of equations as a matrix equation. (Explicitly describe all matrices used in the equation.) Explain how to express the matrix product AB in terms of matrix-vector products. Explain how to express the matrix product AB in terms of dot products. For what type of matrix A can we compute powers, A 2, A 3,, etc. Explain why there is such a restriction. What do we mean when we say that matrix multiplication distributes over matrix addition? Complete the following: The transpose of a product of two matrices is. Explain what we mean by the steady state of a Markov chain. (Express this relationship in words and using a matrix equation.)

### MATH 304 Linear Algebra Lecture 4: Matrix multiplication. Diagonal matrices. Inverse matrix.

MATH 304 Linear Algebra Lecture 4: Matrix multiplication. Diagonal matrices. Inverse matrix. Matrices Definition. An m-by-n matrix is a rectangular array of numbers that has m rows and n columns: a 11

### Lecture 2 Matrix Operations

Lecture 2 Matrix Operations transpose, sum & difference, scalar multiplication matrix multiplication, matrix-vector product matrix inverse 2 1 Matrix transpose transpose of m n matrix A, denoted A T or

### Diagonal, Symmetric and Triangular Matrices

Contents 1 Diagonal, Symmetric Triangular Matrices 2 Diagonal Matrices 2.1 Products, Powers Inverses of Diagonal Matrices 2.1.1 Theorem (Powers of Matrices) 2.2 Multiplying Matrices on the Left Right by

### Linear Algebra Notes for Marsden and Tromba Vector Calculus

Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of

### UNIT 2 MATRICES - I 2.0 INTRODUCTION. Structure

UNIT 2 MATRICES - I Matrices - I Structure 2.0 Introduction 2.1 Objectives 2.2 Matrices 2.3 Operation on Matrices 2.4 Invertible Matrices 2.5 Systems of Linear Equations 2.6 Answers to Check Your Progress

### MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix.

MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix. Inverse matrix Definition. Let A be an n n matrix. The inverse of A is an n n matrix, denoted

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

### Notes on Matrix Multiplication and the Transitive Closure

ICS 6D Due: Wednesday, February 25, 2015 Instructor: Sandy Irani Notes on Matrix Multiplication and the Transitive Closure An n m matrix over a set S is an array of elements from S with n rows and m columns.

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +

### 4. Matrix inverses. left and right inverse. linear independence. nonsingular matrices. matrices with linearly independent columns

L. Vandenberghe EE133A (Spring 2016) 4. Matrix inverses left and right inverse linear independence nonsingular matrices matrices with linearly independent columns matrices with linearly independent rows

### Introduction to Matrix Algebra I

Appendix A Introduction to Matrix Algebra I Today we will begin the course with a discussion of matrix algebra. Why are we studying this? We will use matrix algebra to derive the linear regression model

### 9 Matrices, determinants, inverse matrix, Cramer s Rule

AAC - Business Mathematics I Lecture #9, December 15, 2007 Katarína Kálovcová 9 Matrices, determinants, inverse matrix, Cramer s Rule Basic properties of matrices: Example: Addition properties: Associative:

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

### 4. MATRICES Matrices

4. MATRICES 170 4. Matrices 4.1. Definitions. Definition 4.1.1. A matrix is a rectangular array of numbers. A matrix with m rows and n columns is said to have dimension m n and may be represented as follows:

### The Inverse of a Matrix

The Inverse of a Matrix 7.4 Introduction In number arithmetic every number a ( 0) has a reciprocal b written as a or such that a ba = ab =. Some, but not all, square matrices have inverses. If a square

### Solution: 2. Sketch the graph of 2 given the vectors and shown below.

7.4 Vectors, Operations, and the Dot Product Quantities such as area, volume, length, temperature, and speed have magnitude only and can be completely characterized by a single real number with a unit

### Chapter 7. Matrices. Definition. An m n matrix is an array of numbers set out in m rows and n columns. Examples. ( 1 1 5 2 0 6

Chapter 7 Matrices Definition An m n matrix is an array of numbers set out in m rows and n columns Examples (i ( 1 1 5 2 0 6 has 2 rows and 3 columns and so it is a 2 3 matrix (ii 1 0 7 1 2 3 3 1 is a

### Basics Inversion and related concepts Random vectors Matrix calculus. Matrix algebra. Patrick Breheny. January 20

Matrix algebra January 20 Introduction Basics The mathematics of multiple regression revolves around ordering and keeping track of large arrays of numbers and solving systems of equations The mathematical

### December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation

### Solution to Homework 2

Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

### (a) The transpose of a lower triangular matrix is upper triangular, and the transpose of an upper triangular matrix is lower triangular.

Theorem.7.: (Properties of Triangular Matrices) (a) The transpose of a lower triangular matrix is upper triangular, and the transpose of an upper triangular matrix is lower triangular. (b) The product

### Chapter 6. Orthogonality

6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

### Matrix Algebra LECTURE 1. Simultaneous Equations Consider a system of m linear equations in n unknowns: y 1 = a 11 x 1 + a 12 x 2 + +a 1n x n,

LECTURE 1 Matrix Algebra Simultaneous Equations Consider a system of m linear equations in n unknowns: y 1 a 11 x 1 + a 12 x 2 + +a 1n x n, (1) y 2 a 21 x 1 + a 22 x 2 + +a 2n x n, y m a m1 x 1 +a m2 x

### Mathematics Notes for Class 12 chapter 3. Matrices

1 P a g e Mathematics Notes for Class 12 chapter 3. Matrices A matrix is a rectangular arrangement of numbers (real or complex) which may be represented as matrix is enclosed by [ ] or ( ) or Compact form

### The basic unit in matrix algebra is a matrix, generally expressed as: a 11 a 12. a 13 A = a 21 a 22 a 23

(copyright by Scott M Lynch, February 2003) Brief Matrix Algebra Review (Soc 504) Matrix algebra is a form of mathematics that allows compact notation for, and mathematical manipulation of, high-dimensional

### Matrices, transposes, and inverses

Matrices, transposes, and inverses Math 40, Introduction to Linear Algebra Wednesday, February, 202 Matrix-vector multiplication: two views st perspective: A x is linear combination of columns of A 2 4

### row row row 4

13 Matrices The following notes came from Foundation mathematics (MATH 123) Although matrices are not part of what would normally be considered foundation mathematics, they are one of the first topics

### Inverses and powers: Rules of Matrix Arithmetic

Contents 1 Inverses and powers: Rules of Matrix Arithmetic 1.1 What about division of matrices? 1.2 Properties of the Inverse of a Matrix 1.2.1 Theorem (Uniqueness of Inverse) 1.2.2 Inverse Test 1.2.3

### The Solution of Linear Simultaneous Equations

Appendix A The Solution of Linear Simultaneous Equations Circuit analysis frequently involves the solution of linear simultaneous equations. Our purpose here is to review the use of determinants to solve

### Chapter 5 Polar Coordinates; Vectors 5.1 Polar coordinates 1. Pole and polar axis

Chapter 5 Polar Coordinates; Vectors 5.1 Polar coordinates 1. Pole and polar axis 2. Polar coordinates A point P in a polar coordinate system is represented by an ordered pair of numbers (r, θ). If r >

### Linear Algebra: Vectors

A Linear Algebra: Vectors A Appendix A: LINEAR ALGEBRA: VECTORS TABLE OF CONTENTS Page A Motivation A 3 A2 Vectors A 3 A2 Notational Conventions A 4 A22 Visualization A 5 A23 Special Vectors A 5 A3 Vector

### 13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in three-space, we write a vector in terms

### Chapter 8. Matrices II: inverses. 8.1 What is an inverse?

Chapter 8 Matrices II: inverses We have learnt how to add subtract and multiply matrices but we have not defined division. The reason is that in general it cannot always be defined. In this chapter, we

### A matrix over a field F is a rectangular array of elements from F. The symbol

Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F) denotes the collection of all m n matrices over F Matrices will usually be denoted

### Linear Algebra Notes

Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note

### Linear Algebra Review. Vectors

Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

### 2.1: MATRIX OPERATIONS

.: MATRIX OPERATIONS What are diagonal entries and the main diagonal of a matrix? What is a diagonal matrix? When are matrices equal? Scalar Multiplication 45 Matrix Addition Theorem (pg 0) Let A, B, and

### Lecture L3 - Vectors, Matrices and Coordinate Transformations

S. Widnall 16.07 Dynamics Fall 2009 Lecture notes based on J. Peraire Version 2.0 Lecture L3 - Vectors, Matrices and Coordinate Transformations By using vectors and defining appropriate operations between

### ( % . This matrix consists of \$ 4 5 " 5' the coefficients of the variables as they appear in the original system. The augmented 3 " 2 2 # 2 " 3 4&

Matrices define matrix We will use matrices to help us solve systems of equations. A matrix is a rectangular array of numbers enclosed in parentheses or brackets. In linear algebra, matrices are important

### Rotation Matrices and Homogeneous Transformations

Rotation Matrices and Homogeneous Transformations A coordinate frame in an n-dimensional space is defined by n mutually orthogonal unit vectors. In particular, for a two-dimensional (2D) space, i.e., n

### Helpsheet. Giblin Eunson Library MATRIX ALGEBRA. library.unimelb.edu.au/libraries/bee. Use this sheet to help you:

Helpsheet Giblin Eunson Library ATRIX ALGEBRA Use this sheet to help you: Understand the basic concepts and definitions of matrix algebra Express a set of linear equations in matrix notation Evaluate determinants

### Homework: 2.1 (page 56): 7, 9, 13, 15, 17, 25, 27, 35, 37, 41, 46, 49, 67

Chapter Matrices Operations with Matrices Homework: (page 56):, 9, 3, 5,, 5,, 35, 3, 4, 46, 49, 6 Main points in this section: We define a few concept regarding matrices This would include addition of

### 1.5 Elementary Matrices and a Method for Finding the Inverse

.5 Elementary Matrices and a Method for Finding the Inverse Definition A n n matrix is called an elementary matrix if it can be obtained from I n by performing a single elementary row operation Reminder:

### A Brief Primer on Matrix Algebra

A Brief Primer on Matrix Algebra A matrix is a rectangular array of numbers whose individual entries are called elements. Each horizontal array of elements is called a row, while each vertical array is

### Matrix Inverse and Determinants

DM554 Linear and Integer Programming Lecture 5 and Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1 2 3 4 and Cramer s rule 2 Outline 1 2 3 4 and

### Lecture 21: The Inverse of a Matrix

Lecture 21: The Inverse of a Matrix Winfried Just, Ohio University October 16, 2015 Review: Our chemical reaction system Recall our chemical reaction system A + 2B 2C A + B D A + 2C 2D B + D 2C If we write

### geometric transforms

geometric transforms 1 linear algebra review 2 matrices matrix and vector notation use column for vectors m 11 =[ ] M = [ m ij ] m 21 m 12 m 22 =[ ] v v 1 v = [ ] T v 1 v 2 2 3 matrix operations addition

### Matrix Algebra and Applications

Matrix Algebra and Applications Dudley Cooke Trinity College Dublin Dudley Cooke (Trinity College Dublin) Matrix Algebra and Applications 1 / 49 EC2040 Topic 2 - Matrices and Matrix Algebra Reading 1 Chapters

### Lecture 23: The Inverse of a Matrix

Lecture 23: The Inverse of a Matrix Winfried Just, Ohio University March 9, 2016 The definition of the matrix inverse Let A be an n n square matrix. The inverse of A is an n n matrix A 1 such that A 1

### Chapter 17. Orthogonal Matrices and Symmetries of Space

Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length

### Math 018 Review Sheet v.3

Math 018 Review Sheet v.3 Tyrone Crisp Spring 007 1.1 - Slopes and Equations of Lines Slopes: Find slopes of lines using the slope formula m y y 1 x x 1. Positive slope the line slopes up to the right.

### 5.3 The Cross Product in R 3

53 The Cross Product in R 3 Definition 531 Let u = [u 1, u 2, u 3 ] and v = [v 1, v 2, v 3 ] Then the vector given by [u 2 v 3 u 3 v 2, u 3 v 1 u 1 v 3, u 1 v 2 u 2 v 1 ] is called the cross product (or

### Topic 1: Matrices and Systems of Linear Equations.

Topic 1: Matrices and Systems of Linear Equations Let us start with a review of some linear algebra concepts we have already learned, such as matrices, determinants, etc Also, we shall review the method

### Matrix Solution of Equations

Contents 8 Matrix Solution of Equations 8.1 Solution by Cramer s Rule 2 8.2 Solution by Inverse Matrix Method 13 8.3 Solution by Gauss Elimination 22 Learning outcomes In this Workbook you will learn to

### We know a formula for and some properties of the determinant. Now we see how the determinant can be used.

Cramer s rule, inverse matrix, and volume We know a formula for and some properties of the determinant. Now we see how the determinant can be used. Formula for A We know: a b d b =. c d ad bc c a Can we

### Announcements. CompSci 230 Discrete Math for Computer Science. Test 1

CompSci 230 Discrete Math for Computer Science Sep 26, 2013 Announcements Exam 1 is Tuesday, Oct. 1 No class, Oct 3, No recitation Oct 4-7 Prof. Rodger is out Sep 30-Oct 4 There is Recitation: Sept 27-30.

### Introduction to Matrices for Engineers

Introduction to Matrices for Engineers C.T.J. Dodson, School of Mathematics, Manchester Universit 1 What is a Matrix? A matrix is a rectangular arra of elements, usuall numbers, e.g. 1 0-8 4 0-1 1 0 11

### by the matrix A results in a vector which is a reflection of the given

Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections

### Chapter 19. General Matrices. An n m matrix is an array. a 11 a 12 a 1m a 21 a 22 a 2m A = a n1 a n2 a nm. The matrix A has n row vectors

Chapter 9. General Matrices An n m matrix is an array a a a m a a a m... = [a ij]. a n a n a nm The matrix A has n row vectors and m column vectors row i (A) = [a i, a i,..., a im ] R m a j a j a nj col

### Math 315: Linear Algebra Solutions to Midterm Exam I

Math 35: Linear Algebra s to Midterm Exam I # Consider the following two systems of linear equations (I) ax + by = k cx + dy = l (II) ax + by = 0 cx + dy = 0 (a) Prove: If x = x, y = y and x = x 2, y =

### NOTES on LINEAR ALGEBRA 1

School of Economics, Management and Statistics University of Bologna Academic Year 205/6 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura

### Section 1.1. Introduction to R n

The Calculus of Functions of Several Variables Section. Introduction to R n Calculus is the study of functional relationships and how related quantities change with each other. In your first exposure to

### Introduction to Matrix Algebra

Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary

### Matrices Worksheet. Adding the results together, using the matrices, gives

Matrices Worksheet This worksheet is designed to help you increase your confidence in handling MATRICES. This worksheet contains both theory and exercises which cover. Introduction. Order, Addition and

### Relations Graphical View

Relations Slides by Christopher M. Bourke Instructor: Berthe Y. Choueiry Introduction Recall that a relation between elements of two sets is a subset of their Cartesian product (of ordered pairs). A binary

### = [a ij ] 2 3. Square matrix A square matrix is one that has equal number of rows and columns, that is n = m. Some examples of square matrices are

This document deals with the fundamentals of matrix algebra and is adapted from B.C. Kuo, Linear Networks and Systems, McGraw Hill, 1967. It is presented here for educational purposes. 1 Introduction In

### Physics 235 Chapter 1. Chapter 1 Matrices, Vectors, and Vector Calculus

Chapter 1 Matrices, Vectors, and Vector Calculus In this chapter, we will focus on the mathematical tools required for the course. The main concepts that will be covered are: Coordinate transformations

### MAT188H1S Lec0101 Burbulla

Winter 206 Linear Transformations A linear transformation T : R m R n is a function that takes vectors in R m to vectors in R n such that and T (u + v) T (u) + T (v) T (k v) k T (v), for all vectors u

### 1 2 3 1 1 2 x = + x 2 + x 4 1 0 1

(d) If the vector b is the sum of the four columns of A, write down the complete solution to Ax = b. 1 2 3 1 1 2 x = + x 2 + x 4 1 0 0 1 0 1 2. (11 points) This problem finds the curve y = C + D 2 t which

### MATHEMATICS (CLASSES XI XII)

MATHEMATICS (CLASSES XI XII) General Guidelines (i) All concepts/identities must be illustrated by situational examples. (ii) The language of word problems must be clear, simple and unambiguous. (iii)

### Solving Simultaneous Equations and Matrices

Solving Simultaneous Equations and Matrices The following represents a systematic investigation for the steps used to solve two simultaneous linear equations in two unknowns. The motivation for considering

Facts About Eigenvalues By Dr David Butler Definitions Suppose A is an n n matrix An eigenvalue of A is a number λ such that Av = λv for some nonzero vector v An eigenvector of A is a nonzero vector v

### Overview. Essential Questions. Precalculus, Quarter 3, Unit 3.4 Arithmetic Operations With Matrices

Arithmetic Operations With Matrices Overview Number of instruction days: 6 8 (1 day = 53 minutes) Content to Be Learned Use matrices to represent and manipulate data. Perform arithmetic operations with

### Presentation 3: Eigenvalues and Eigenvectors of a Matrix

Colleen Kirksey, Beth Van Schoyck, Dennis Bowers MATH 280: Problem Solving November 18, 2011 Presentation 3: Eigenvalues and Eigenvectors of a Matrix Order of Presentation: 1. Definitions of Eigenvalues

### Definition A square matrix M is invertible (or nonsingular) if there exists a matrix M 1 such that

0. Inverse Matrix Definition A square matrix M is invertible (or nonsingular) if there exists a matrix M such that M M = I = M M. Inverse of a 2 2 Matrix Let M and N be the matrices: a b d b M =, N = c

### Linear Programming. March 14, 2014

Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1

### A Primer on Index Notation

A Primer on John Crimaldi August 28, 2006 1. Index versus Index notation (a.k.a. Cartesian notation) is a powerful tool for manipulating multidimensional equations. However, there are times when the more

### C A R I B B E A N E X A M I N A T I O N S C O U N C I L REPORT ON CANDIDATES WORK IN THE SECONDARY EDUCATION CERTIFICATE EXAMINATION MAY/JUNE 2011

C A R I B B E A N E X A M I N A T I O N S C O U N C I L REPORT ON CANDIDATES WORK IN THE SECONDARY EDUCATION CERTIFICATE EXAMINATION MAY/JUNE 2011 MATHEMATICS GENERAL PROFICIENCY EXAMINATION Copyright

### Introduction to Flocking {Stochastic Matrices}

Supelec EECI Graduate School in Control Introduction to Flocking {Stochastic Matrices} A. S. Morse Yale University Gif sur - Yvette May 21, 2012 CRAIG REYNOLDS - 1987 BOIDS The Lion King CRAIG REYNOLDS

### Matrices provide a compact notation for expressing systems of equations or variables. For instance, a linear function might be written as: b k

MATRIX ALGEBRA FOR STATISTICS: PART 1 Matrices provide a compact notation for expressing systems of equations or variables. For instance, a linear function might be written as: y = x 1 b 1 + x 2 + x 3

### Undergraduate Matrix Theory. Linear Algebra

Undergraduate Matrix Theory and Linear Algebra a 11 a 12 a 1n a 21 a 22 a 2n a m1 a m2 a mn John S Alin Linfield College Colin L Starr Willamette University December 15, 2015 ii Contents 1 SYSTEMS OF LINEAR

### MATH36001 Background Material 2015

MATH3600 Background Material 205 Matrix Algebra Matrices and Vectors An ordered array of mn elements a ij (i =,, m; j =,, n) written in the form a a 2 a n A = a 2 a 22 a 2n a m a m2 a mn is said to be

### Matrix Multiplication

Matrix Multiplication CPS343 Parallel and High Performance Computing Spring 2016 CPS343 (Parallel and HPC) Matrix Multiplication Spring 2016 1 / 32 Outline 1 Matrix operations Importance Dense and sparse

### Linear transformations Affine transformations Transformations in 3D. Graphics 2011/2012, 4th quarter. Lecture 5: linear and affine transformations

Lecture 5 Linear and affine transformations Vector transformation: basic idea Definition Examples Finding matrices Compositions of transformations Transposing normal vectors Multiplication of an n n matrix

### Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc.

2 Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Theorem 8: Let A be a square matrix. Then the following statements are equivalent. That is, for a given A, the statements are either all true

### Vectors, Gradient, Divergence and Curl.

Vectors, Gradient, Divergence and Curl. 1 Introduction A vector is determined by its length and direction. They are usually denoted with letters with arrows on the top a or in bold letter a. We will use

### 5. Orthogonal matrices

L Vandenberghe EE133A (Spring 2016) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal

### MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors Jordan canonical form (continued) Jordan canonical form A Jordan block is a square matrix of the form λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0

### Vector and Matrix Norms

Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty

### 1 Determinants and the Solvability of Linear Systems

1 Determinants and the Solvability of Linear Systems In the last section we learned how to use Gaussian elimination to solve linear systems of n equations in n unknowns The section completely side-stepped

### 10. Graph Matrices Incidence Matrix

10 Graph Matrices Since a graph is completely determined by specifying either its adjacency structure or its incidence structure, these specifications provide far more efficient ways of representing a

### MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column

### PROVING STATEMENTS IN LINEAR ALGEBRA

Mathematics V2010y Linear Algebra Spring 2007 PROVING STATEMENTS IN LINEAR ALGEBRA Linear algebra is different from calculus: you cannot understand it properly without some simple proofs. Knowing statements

### Determinants. Dr. Doreen De Leon Math 152, Fall 2015

Determinants Dr. Doreen De Leon Math 52, Fall 205 Determinant of a Matrix Elementary Matrices We will first discuss matrices that can be used to produce an elementary row operation on a given matrix A.

### Section 1.2. Angles and the Dot Product. The Calculus of Functions of Several Variables

The Calculus of Functions of Several Variables Section 1.2 Angles and the Dot Product Suppose x = (x 1, x 2 ) and y = (y 1, y 2 ) are two vectors in R 2, neither of which is the zero vector 0. Let α and

### Unified Lecture # 4 Vectors

Fall 2005 Unified Lecture # 4 Vectors These notes were written by J. Peraire as a review of vectors for Dynamics 16.07. They have been adapted for Unified Engineering by R. Radovitzky. References [1] Feynmann,