# Vector Spaces and Subspaces

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Chapter 5 Vector Spaces and Subspaces 5. The Column Space of a Matrix To a newcomer, matrix calculations involve a lot of numbers. To you, they involve vectors. The columns of Av and AB are linear combinations of n vectors the columns of A. This chapter moves from numbers and vectors to a third level of understanding (the highest level). Instead of individual columns, we look at spaces of vectors. Without seeing vector spaces and their subspaces, you haven t understood everything about Av D b. Since this chapter goes a little deeper, it may seem a little harder. That is natural. We are looking inside the calculations, to find the mathematics. The author s job is to make it clear. Section 5.5 will present the Fundamental Theorem of Linear Algebra. We begin with the most important vector spaces. They are denoted by R, R, R 3, R 4, : : :. Each space R n consists of a whole collection of vectors. R 5 contains all column vectors with five components. This is called 5-dimensional space. DEFINITION The space R n consists of all column vectors v with n components. The components of v are real numbers, which is the reason for the letter R. When the n components are complex numbers, v lies in the space C n. The vector space R is represented by the usual xy plane. Each vector v in R has two components. The word space asks us to think of all those vectors the whole plane. Each vector gives the x and y coordinates of a point in the plane : v D.x; y/. Similarly the vectors in R 3 correspond to points.x; y; z/ in three-dimensional space. The one-dimensional space R is a line (like the x axis). As before, we print vectors as a column between brackets, or along a line using commas and parentheses : 4 C i is in R ;.; ; ; ; / is in R 5 ; is in C i : The great thing about linear algebra is that it deals easily with five-dimensional space. We don t draw the vectors, we just need the five numbers (or n numbers).

2 5 Chapter 5. Vector Spaces and Subspaces To multiply v by 7, multiply every component by 7. Here 7 is a scalar. To add vectors in R 5, add them a component at a time : five additions. The two essential vector operations go on inside the vector space, and they produce linear combinations : We can add any vectors in R n, and we can multiply any vector v by any scalar c. Inside the vector space means that the result stays in the space : This is crucial. If v is in R 4 with components ; ; ;, then v is the vector in R 4 with components ; ; ;. (In this case is the scalar.) A whole series of properties can be verified in R n. The commutative law is v C w D w C v; the distributive law is c.v C w/ D cv C cw. Every vector space has a unique zero vector satisfying Cv D v. Those are three of the eight conditions listed in the Chapter 5 Notes. These eight conditions are required of every vector space. There are vectors other than column vectors, and there are vector spaces other than R n. All vector spaces have to obey the eight reasonable rules. A real vector space is a set of vectors together with rules for vector addition and multiplication by real numbers. The addition and the multiplication must produce vectors that are in the space. And the eight conditions must be satisfied (which is usually no problem). You need to see three vector spaces other than R n : M Y Z The vector space of all real by matrices. The vector space of all solutions y.t/ to Ay C By C Cy D. The vector space that consists only of a zero vector. In M the vectors are really matrices. In Y the vectors are functions of t, like y D e st. In Z the only addition is C D. In each space we can add : matrices to matrices, functions to functions, zero vector to zero vector. We can multiply a matrix by 4 or a function by 4 or the zero vector by 4. The result is still in M or Y or Z. The space R 4 is four-dimensional, and so is the space M of by matrices. Vectors in those spaces are determined by four numbers. The solution space Y is two-dimensional, because second order differential equations have two independent solutions. Section 5.4 will pin down those key words, independence of vectors and dimension of a space. The space Z is zero-dimensional (by any reasonable definition of dimension). It is the smallest possible vector space. We hesitate to call it R, which means no components you might think there was no vector. The vector space Z contains exactly one vector. No space can do without that zero vector. Each space has its own zero vector the zero matrix, the zero function, the vector.; ; / in R 3. Subspaces At different times, we will ask you to think of matrices and functions as vectors. But at all times, the vectors that we need most are ordinary column vectors. They are vectors with n components but maybe not all of the vectors with n components. There are important vector spaces inside R n. Those are subspaces of R n.

3 5.. The Column Space of a Matrix 53 z R 3 P.; ; / L y Figure 5.: 4-dimensional matrix space M. 3 subspaces of R 3 : plane P, line L, point Z. x Start with the usual three-dimensional space R 3. Choose a plane through the origin.; ; /. That plane is a vector space in its own right. If we add two vectors in the plane, their sum is in the plane. If we multiply an in-plane vector by or 5, it is still in the plane. A plane in three-dimensional space is not R (even if it looks like R /. The vectors have three components and they belong to R 3. The plane P is a vector space inside R 3. This illustrates one of the most fundamental ideas in linear algebra. The plane going through.; ; / is a subspace of the full vector space R 3. DEFINITION A subspace of a vector space is a set of vectors (including ) that satisfies two requirements : If v and w are vectors in the subspace and c is any scalar, then (i) v C w is in the subspace and (ii) cv is in the subspace. In other words, the set of vectors is closed under addition v C w and multiplication cv (and d w). Those operations leave us in the subspace. We can also subtract, because w is in the subspace and its sum with v is v w. In short, all linear combinations cv C dw stay in the subspace. First fact : Every subspace contains the zero vector. The plane in R 3 has to go through.; ; /. We mention this separately, for extra emphasis, but it follows directly from rule (ii). Choose c D, and the rule requires v to be in the subspace. Planes that don t contain the origin fail those tests. When v is on such a plane, v and v are not on the plane. A plane that misses the origin is not a subspace. Lines through the origin are also subspaces. When we multiply by 5, or add two vectors on the line, we stay on the line. But the line must go through.; ; /. Another subspace is all of R 3. The whole space is a subspace (of itself ). That is a fourth subspace in the figure. Here is a list of all the possible subspaces of R 3 :.L/ Any line through.; ; /.R 3 / The whole space.p/ Any plane through.; ; /.Z/ The single vector.; ; /

4 54 Chapter 5. Vector Spaces and Subspaces If we try to keep only part of a plane or line, the requirements for a subspace don t hold. Look at these examples in R. Example Keep only the vectors.x; y/ whose components are positive or zero (this is a quarter-plane). The vector.; 3/ is included but. ; 3/ is not. So rule (ii) is violated when we try to multiply by c D. The quarter-plane is not a subspace. Example Include also the vectors whose components are both negative. Now we have two quarter-planes. Requirement (ii) is satisfied; we can multiply by any c. But rule (i) now fails. The sum of v D.; 3/ and w D. 3; / is. ; /, which is outside the quarter-planes. Two quarter-planes don t make a subspace. Rules (i) and (ii) involve vector addition v C w and multiplication by scalars like c and d. The rules can be combined into a single requirement the rule for subspaces : A subspace containing v and w must contain all linear combinations cv C dw. Example 3 Inside the vector space M of all by matrices, here are two subspaces : a b a.u/ All upper triangular matrices.d/ All diagonal matrices : d d Add any two matrices in U, and the sum is in U. Add diagonal matrices, and the sum is diagonal. In this case D is also a subspace of U! The zero matrix alone is also a subspace, when a, b, and d all equal zero. For a smaller subspace of diagonal matrices, we could require a D d. The matrices are multiples of the identity matrix I. These ai form a line of matrices in M and U and D. Is the matrix I a subspace by itself? Certainly not. Only the zero matrix is. Your mind will invent more subspaces of by matrices write them down for Problem 6. The Column Space of A The most important subspaces are tied directly to a matrix A. We are trying to solve Av D b. If A is not invertible, the system is solvable for some b and not solvable for other b. We want to describe the good right sides b the vectors that can be written as A times v. Those b s form the column space of A. Remember that Av is a combination of the columns of A. To get every possible b, we use every possible v. Start with the columns of A, and take all their linear combinations. This produces the column space of A. It contains not just the n columns of A! DEFINITION The column space consists of all combinations of the columns: The combinations are all possible vectors Av. They fill the column space C.A/. This column space is crucial to the whole book, and here is why. To solve Av D b is to express b as a combination of the columns. The right side b has to be in the column space produced by A on the left side. If b is not in C.A/, Av D b has no solution.

5 5.. The Column Space of a Matrix 55 The system Av D b is solvable if and only if b is in the column space of A. When b is in the column space, it is a combination of the columns. The coefficients in that combination give us a solution v to the system Av D b. Suppose A is an m by n matrix. Its columns have m components (not n/. So the columns belong to R m. The column space of A is a subspace of R m (not R n ). The set of all column combinations Ax satisfies rules (i) and (ii) for a subspace : When we add linear combinations or multiply by scalars, we still produce combinations of the columns. The word subspace is always justified by taking all linear combinations. Here is a 3 by matrix A, whose column space is a subspace of R 3. The column space of A is a plane in Figure b A D b D v 445 C v Plane D C.A/ D all vectors Av Figure 5.: The column space C.A/ is a plane containing the two columns of A. Av D b is solvable when b is on that plane. Then b is a combination of the columns. We drew one particular b (a combination of the columns). This b D Av lies on the plane. The plane has zero thickness, so most right sides b in R 3 are not in the column space. For most b there is no solution to our 3 equations in unknowns. Of course.; ; / is in the column space. The plane passes through the origin. There is certainly a solution to Av D. That solution, always available, is v D. To repeat, the attainable right sides b are exactly the vectors in the column space. One possibility is the first column itself take v D and v D. Another combination is the second column take v D and v D. The new level of understanding is to see all combinations the whole subspace is generated by those two columns. Notation The column space of A is denoted by C.A/. Start with the columns and take all their linear combinations. We might get the whole R m or only a small subspace.

6 56 Chapter 5. Vector Spaces and Subspaces Important Instead of columns in R m, we could start with any set of vectors in a vector space V. To get a subspace SS of V, we take all combinations of the vectors in that set : S D set of vectors s in V (S is probably not a subspace) SS D all combinations of vectors in S (SS is a subspace) SS D all c s C C c N s N D the subspace of V spanned by S When S is the set of columns, SS is the column space. When there is only one nonzero vector v in S, the subspace SS is the line through v. Always SS is the smallest subspace containing S. This is a fundamental way to create subspaces and we will come back to it. The subspace SS is the span of S, containing all combinations of vectors in S. Example 4 Describe the column spaces (they are subspaces of R ) for these matrices : 3 I D and A D and B D : 4 4 Solution The column space of I is the whole space R. Every vector is a combination of the columns of I. In vector space language, C.I/ equals R. The column space of A is only a line. The second column.; 4/ is a multiple of the first column.; /. Those vectors are different, but our eye is on vector spaces. The column space contains.; / and.; 4/ and all other vectors.c; c/ along that line. The equation Av D b is only solvable when b is on the line. For the third matrix (with three columns) the column space C.B/ is all of R. Every b is attainable. The vector b D.5; 4/ is column plus column 3, so v can be.; ; /. The same vector.5; 4/ is also (column ) C column 3, so another possible v is.; ; /. This matrix has the same column space as I any b is allowed. But now v has extra components and Av D b has more solutions more combinations that give b. The next section creates the nullspace N.A/, to describe all the solutions of Av D. This section created the column space C.A/, to describe all the attainable right sides b. REVIEW OF THE KEY IDEAS. R n contains all column vectors with n real components.. M ( by matrices) and Y (functions) and Z (zero vector alone) are vector spaces. 3. A subspace containing v and w must contain all their combinations cv C d w. 4. The combinations of the columns of A form the column space C.A/. Then the column space is spanned by the columns.

7 5.. The Column Space of a Matrix Av D b has a solution exactly when b is in the column space of A. WORKED EXAMPLES 5. A We are given three different vectors b ; b ; b 3. Construct a matrix so that the equations Av D b and Av D b are solvable, but Av D b 3 is not solvable. How can you decide if this is possible? How could you construct A? Solution We want to have b and b in the column space of A. Then Av D b and Av D b will be solvable. The quickest way is to make b and b the two columns of A. Then the solutions are v D.; / and v D.; /. Also, we don t want Av D b 3 to be solvable. So don t make the column space any larger! Keeping only the columns b and b, the question is : Do we already have b 3? Is Av D b b v D b v 3 solvable? Is b 3 a combination of b and b? If the answer is no, we have the desired matrix A. If b 3 is a combination of b and b, then it is not possible to construct A. The column space C.A/ will have to contain b 3. 5: B Describe a subspace S of each vector space V, and then a subspace SS of S. V 3 D all combinations of.; ; ; / and.; ; ; / and.; ; ; / V D all vectors v perpendicular to u D.; ; /; so u v D V 4 D all solutions y.x/ to the equation d 4 y=dx 4 D Describe each V two ways : () All combinations of.... () All solutions of.... Solution V 3 starts with three vectors. A subspace S comes from all combinations of the first two vectors.; ; ; / and.; ; ; /. A subspace SS of S comes from all multiples.c; c; ; / of the first vector. So many possibilities. A subspace S of V is the line through.; ; /. This line is perpendicular to u. The zero vector z D.; ; / is in S. The smallest subspace SS is Z. V 4 contains all cubic polynomials y D a C bx C cx C dx 3, with d 4 y=dx 4 D. The quadratic polynomials (without an x 3 term) give a subspace S. The linear polynomials are one choice of SS. The constants y D a could be SSS. In all three parts we could take S D V itself, and SS D the zero subspace Z. Each V can be described as all combinations of.... and as all solutions of.... : V 3 D all combinations of the 3 vectors V 3 D all solutions of v v D : V D all combinations of.; ; / and.; ; / V D all solutions of u v D : V 4 D all combinations of ; x; x ; x 3 V 4 D all solutions to d 4 y=dx 4 D :

8 58 Chapter 5. Vector Spaces and Subspaces Problem Set 5. Questions are about the subspace requirements : v C w and cv (and then all linear combinations cv C d w) stay in the subspace. One requirement can be met while the other fails. Show this by finding (a) A set of vectors in R for which v C w stays in the set but v may be outside. (b) A set of vectors in R (other than two quarter-planes) for which every cv stays in the set but v C w may be outside. Which of the following subsets of R 3 are actually subspaces? (a) The plane of vectors.b ; b ; b 3 / with b D b. (b) The plane of vectors with b D. (c) The vectors with b b b 3 D. (d) All linear combinations of v D.; 4; / and w D.; ; /. (e) All vectors that satisfy b C b C b 3 D. (f) All vectors with b b b 3. 3 Describe the smallest subspace of the matrix space M that contains (a) and (b) (c) and 4 Let P be the plane in R 3 with equation x C y z D 4. The origin.; ; / is not in P! Find two vectors in P and check that their sum is not in P. 5 Let P be the plane through.; ; / parallel to the previous plane P. What is the equation for P? Find two vectors in P and check that their sum is in P. 6 The subspaces of R 3 are planes, lines, R 3 itself, or Z containing only.; ; /. (a) Describe the three types of subspaces of R. (b) Describe all subspaces of D, the space of by diagonal matrices. 7 (a) The intersection of two planes through.; ; / is probably a but it could be a. It can t be Z! (b) The intersection of a plane through.; ; / with a line through.; ; / is probably a but it could be a. (c) If S and T are subspaces of R 5, prove that their intersection S \ T is a subspace of R 5. Here S \ T consists of the vectors that lie in both subspaces. Check the requirements on v C w and cv. 8 Suppose P is a plane through.; ; / and L is a line through.; ; /. The smallest vector space P C L containing both P and L is either or..

9 5.. The Column Space of a Matrix 59 9 (a) Show that the set of invertible matrices in M is not a subspace. (b) Show that the set of singular matrices in M is not a subspace. True or false (check addition in each case by an example) : (a) The symmetric matrices in M (with A T D A/ form a subspace. (b) The skew-symmetric matrices in M (with A T D A/ form a subspace. (c) The unsymmetric matrices in M (with A T A/ form a subspace. Questions 9 are about column spaces C.A/ and the equation Av D b. Describe the column spaces (lines or planes) of these particular matrices : A D 4 5 B D 4 5 C D 4 5 : For which right sides (find a condition on b ; b ; b 3 ) are these systems solvable? (a) v 3 v 5 D 4 b 3 b 5 (b) v D 4 b 3 b v v 3 b 3 3 Adding row of A to row produces B. Adding column to column produces C. Which matrices have the same column space? Which have the same row space? A D and B D and C D : For which vectors.b ; b ; b 3 / do these systems have a solution? x 3 x 5 D 4 b 3 b 5 and x 3 x 5 D 4 b 3 b 5 x 3 b 3 x 3 b 3 and x 3 x 5 D 4 b 3 b 5 : x 3 b 3 5 (Recommended) If we add an extra column b to a matrix A, then the column space gets larger unless. Give an example where the column space gets larger and an example where it doesn t. Why is Av D b solvable exactly when the column space doesn t get larger? Then it is the same for A and A b. 6 The columns of AB are combinations of the columns of A. This means : The column space of AB is contained in (possibly equal to) the column space of A. Give an example where the column spaces of A and AB are not equal. b 3

10 6 Chapter 5. Vector Spaces and Subspaces 7 Suppose Av D b and Aw D b are both solvable. Then Az D b C b is solvable. What is z? This translates into : If b and b are in the column space C.A/, then b C b is also in C.A/. 8 If A is any 5 by 5 invertible matrix, then its column space is. Why? 9 True or false (with a counterexample if false) : (a) The vectors b that are not in the column space C.A/ form a subspace. (b) If C.A/ contains only the zero vector, then A is the zero matrix. (c) The column space of A equals the column space of A. (d) The column space of A I equals the column space of A (test this). Construct a 3 by 3 matrix whose column space contains.; ; / and.; ; / but not.; ; /. Construct a 3 by 3 matrix whose column space is only a line. If the 9 by system Av D b is solvable for every b, then C.A/ must be. Challenge Problems Suppose S and T are two subspaces of a vector space V. The sum S C T contains all sums s C t of a vector s in S and a vector t in T. Then S C T is a vector space. If S and T are lines in R m, what is the difference between S C T and S [ T? That union contains all vectors from S and all vectors from T. Explain this statement : The span of S [ T is S C T. 3 If S is the column space of A and T is C.B/, then S C T is the column space of what matrix M? The columns of A and B and M are all in R m. (I don t think A C B is always a correct M.) 4 Show that the matrices A and A AB (this has extra columns) have the same column space. But find a square matrix with C.A / smaller than C.A/. 5 An n by n matrix has C.A/ D R n exactly when A is an matrix.

### MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set. Vector space A vector space is a set V equipped with two operations, addition V V (x,y) x + y V and scalar

### Solutions to Math 51 First Exam January 29, 2015

Solutions to Math 5 First Exam January 29, 25. ( points) (a) Complete the following sentence: A set of vectors {v,..., v k } is defined to be linearly dependent if (2 points) there exist c,... c k R, not

### 1 2 3 1 1 2 x = + x 2 + x 4 1 0 1

(d) If the vector b is the sum of the four columns of A, write down the complete solution to Ax = b. 1 2 3 1 1 2 x = + x 2 + x 4 1 0 0 1 0 1 2. (11 points) This problem finds the curve y = C + D 2 t which

### 2.1: MATRIX OPERATIONS

.: MATRIX OPERATIONS What are diagonal entries and the main diagonal of a matrix? What is a diagonal matrix? When are matrices equal? Scalar Multiplication 45 Matrix Addition Theorem (pg 0) Let A, B, and

### Linear Algebra Notes for Marsden and Tromba Vector Calculus

Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of

### LINEAR ALGEBRA. September 23, 2010

LINEAR ALGEBRA September 3, 00 Contents 0. LU-decomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................

### 1 Introduction to Matrices

1 Introduction to Matrices In this section, important definitions and results from matrix algebra that are useful in regression analysis are introduced. While all statements below regarding the columns

### MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

### Name: Section Registered In:

Name: Section Registered In: Math 125 Exam 3 Version 1 April 24, 2006 60 total points possible 1. (5pts) Use Cramer s Rule to solve 3x + 4y = 30 x 2y = 8. Be sure to show enough detail that shows you are

### by the matrix A results in a vector which is a reflection of the given

Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

### MA 242 LINEAR ALGEBRA C1, Solutions to Second Midterm Exam

MA 4 LINEAR ALGEBRA C, Solutions to Second Midterm Exam Prof. Nikola Popovic, November 9, 6, 9:3am - :5am Problem (5 points). Let the matrix A be given by 5 6 5 4 5 (a) Find the inverse A of A, if it exists.

### 1 0 5 3 3 A = 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0

Solutions: Assignment 4.. Find the redundant column vectors of the given matrix A by inspection. Then find a basis of the image of A and a basis of the kernel of A. 5 A The second and third columns are

### Linear Dependence Tests

Linear Dependence Tests The book omits a few key tests for checking the linear dependence of vectors. These short notes discuss these tests, as well as the reasoning behind them. Our first test checks

### Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

Chapter 7 Eigenvalues and Eigenvectors In this last chapter of our exploration of Linear Algebra we will revisit eigenvalues and eigenvectors of matrices, concepts that were already introduced in Geometry

### These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

DEFINITION: A vector space is a nonempty set V of objects, called vectors, on which are defined two operations, called addition and multiplication by scalars (real numbers), subject to the following axioms

### Introduction to Matrix Algebra

Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary

### MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column

### Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

### 4. MATRICES Matrices

4. MATRICES 170 4. Matrices 4.1. Definitions. Definition 4.1.1. A matrix is a rectangular array of numbers. A matrix with m rows and n columns is said to have dimension m n and may be represented as follows:

### Vector and Matrix Norms

Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty

### 18.06 Problem Set 4 Solution Due Wednesday, 11 March 2009 at 4 pm in 2-106. Total: 175 points.

806 Problem Set 4 Solution Due Wednesday, March 2009 at 4 pm in 2-06 Total: 75 points Problem : A is an m n matrix of rank r Suppose there are right-hand-sides b for which A x = b has no solution (a) What

### Matrix Algebra and Applications

Matrix Algebra and Applications Dudley Cooke Trinity College Dublin Dudley Cooke (Trinity College Dublin) Matrix Algebra and Applications 1 / 49 EC2040 Topic 2 - Matrices and Matrix Algebra Reading 1 Chapters

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +

### Diagonalisation. Chapter 3. Introduction. Eigenvalues and eigenvectors. Reading. Definitions

Chapter 3 Diagonalisation Eigenvalues and eigenvectors, diagonalisation of a matrix, orthogonal diagonalisation fo symmetric matrices Reading As in the previous chapter, there is no specific essential

### MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors Jordan canonical form (continued) Jordan canonical form A Jordan block is a square matrix of the form λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0

### Vector Math Computer Graphics Scott D. Anderson

Vector Math Computer Graphics Scott D. Anderson 1 Dot Product The notation v w means the dot product or scalar product or inner product of two vectors, v and w. In abstract mathematics, we can talk about

### 1 VECTOR SPACES AND SUBSPACES

1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such

### Math 4310 Handout - Quotient Vector Spaces

Math 4310 Handout - Quotient Vector Spaces Dan Collins The textbook defines a subspace of a vector space in Chapter 4, but it avoids ever discussing the notion of a quotient space. This is understandable

### 2x + y = 3. Since the second equation is precisely the same as the first equation, it is enough to find x and y satisfying the system

1. Systems of linear equations We are interested in the solutions to systems of linear equations. A linear equation is of the form 3x 5y + 2z + w = 3. The key thing is that we don t multiply the variables

### Recall that two vectors in are perpendicular or orthogonal provided that their dot

Orthogonal Complements and Projections Recall that two vectors in are perpendicular or orthogonal provided that their dot product vanishes That is, if and only if Example 1 The vectors in are orthogonal

### α = u v. In other words, Orthogonal Projection

Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v

### Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain

Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain 1. Orthogonal matrices and orthonormal sets An n n real-valued matrix A is said to be an orthogonal

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

### Math 312 Homework 1 Solutions

Math 31 Homework 1 Solutions Last modified: July 15, 01 This homework is due on Thursday, July 1th, 01 at 1:10pm Please turn it in during class, or in my mailbox in the main math office (next to 4W1) Please

### Eigenvalues and Eigenvectors

Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Linear equations Ax D b come from steady state problems. Eigenvalues have their greatest importance in dynamic problems. The solution

### Adding vectors We can do arithmetic with vectors. We ll start with vector addition and related operations. Suppose you have two vectors

1 Chapter 13. VECTORS IN THREE DIMENSIONAL SPACE Let s begin with some names and notation for things: R is the set (collection) of real numbers. We write x R to mean that x is a real number. A real number

### Linear Algebra I. Ronald van Luijk, 2012

Linear Algebra I Ronald van Luijk, 2012 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents 1. Vector spaces 3 1.1. Examples 3 1.2. Fields 4 1.3. The field of complex numbers. 6 1.4.

### 4. Matrix inverses. left and right inverse. linear independence. nonsingular matrices. matrices with linearly independent columns

L. Vandenberghe EE133A (Spring 2016) 4. Matrix inverses left and right inverse linear independence nonsingular matrices matrices with linearly independent columns matrices with linearly independent rows

### 1 Eigenvalues and Eigenvectors

Math 20 Chapter 5 Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors. Definition: A scalar λ is called an eigenvalue of the n n matrix A is there is a nontrivial solution x of Ax = λx. Such an x

### Sec 4.1 Vector Spaces and Subspaces

Sec 4. Vector Spaces and Subspaces Motivation Let S be the set of all solutions to the differential equation y + y =. Let T be the set of all 2 3 matrices with real entries. These two sets share many common

### SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections

### 4.6 Null Space, Column Space, Row Space

NULL SPACE, COLUMN SPACE, ROW SPACE Null Space, Column Space, Row Space In applications of linear algebra, subspaces of R n typically arise in one of two situations: ) as the set of solutions of a linear

### [1] Diagonal factorization

8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:

### 4.5 Linear Dependence and Linear Independence

4.5 Linear Dependence and Linear Independence 267 32. {v 1, v 2 }, where v 1, v 2 are collinear vectors in R 3. 33. Prove that if S and S are subsets of a vector space V such that S is a subset of S, then

### Similar matrices and Jordan form

Similar matrices and Jordan form We ve nearly covered the entire heart of linear algebra once we ve finished singular value decompositions we ll have seen all the most central topics. A T A is positive

### Systems of Linear Equations

Systems of Linear Equations Beifang Chen Systems of linear equations Linear systems A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where a, a,, a n and

### 8 Square matrices continued: Determinants

8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You

### Solving Systems of Linear Equations

LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how

### 4.3 Least Squares Approximations

18 Chapter. Orthogonality.3 Least Squares Approximations It often happens that Ax D b has no solution. The usual reason is: too many equations. The matrix has more rows than columns. There are more equations

### Matrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.

Matrix Algebra A. Doerr Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Some Basic Matrix Laws Assume the orders of the matrices are such that

### December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation

### LEARNING OBJECTIVES FOR THIS CHAPTER

CHAPTER 2 American mathematician Paul Halmos (1916 2006), who in 1942 published the first modern linear algebra book. The title of Halmos s book was the same as the title of this chapter. Finite-Dimensional

### Vector Spaces 4.4 Spanning and Independence

Vector Spaces 4.4 and Independence October 18 Goals Discuss two important basic concepts: Define linear combination of vectors. Define Span(S) of a set S of vectors. Define linear Independence of a set

### Lecture 6. Inverse of Matrix

Lecture 6 Inverse of Matrix Recall that any linear system can be written as a matrix equation In one dimension case, ie, A is 1 1, then can be easily solved as A x b Ax b x b A 1 A b A 1 b provided that

### Matrix Representations of Linear Transformations and Changes of Coordinates

Matrix Representations of Linear Transformations and Changes of Coordinates 01 Subspaces and Bases 011 Definitions A subspace V of R n is a subset of R n that contains the zero element and is closed under

### 5.4 The Quadratic Formula

Section 5.4 The Quadratic Formula 481 5.4 The Quadratic Formula Consider the general quadratic function f(x) = ax + bx + c. In the previous section, we learned that we can find the zeros of this function

### Orthogonal Diagonalization of Symmetric Matrices

MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding

### Orthogonal Projections

Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors

### Solution. Area(OABC) = Area(OAB) + Area(OBC) = 1 2 det( [ 5 2 1 2. Question 2. Let A = (a) Calculate the nullspace of the matrix A.

Solutions to Math 30 Take-home prelim Question. Find the area of the quadrilateral OABC on the figure below, coordinates given in brackets. [See pp. 60 63 of the book.] y C(, 4) B(, ) A(5, ) O x Area(OABC)

### Polynomial Invariants

Polynomial Invariants Dylan Wilson October 9, 2014 (1) Today we will be interested in the following Question 1.1. What are all the possible polynomials in two variables f(x, y) such that f(x, y) = f(y,

### Lecture 2 Matrix Operations

Lecture 2 Matrix Operations transpose, sum & difference, scalar multiplication matrix multiplication, matrix-vector product matrix inverse 2 1 Matrix transpose transpose of m n matrix A, denoted A T or

### Images and Kernels in Linear Algebra By Kristi Hoshibata Mathematics 232

Images and Kernels in Linear Algebra By Kristi Hoshibata Mathematics 232 In mathematics, there are many different fields of study, including calculus, geometry, algebra and others. Mathematics has been

### The Inverse of a Matrix

The Inverse of a Matrix 7.4 Introduction In number arithmetic every number a ( 0) has a reciprocal b written as a or such that a ba = ab =. Some, but not all, square matrices have inverses. If a square

### THE DIMENSION OF A VECTOR SPACE

THE DIMENSION OF A VECTOR SPACE KEITH CONRAD This handout is a supplementary discussion leading up to the definition of dimension and some of its basic properties. Let V be a vector space over a field

### Linearly Independent Sets and Linearly Dependent Sets

These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation

### NOTES ON LINEAR TRANSFORMATIONS

NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all

### Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday.

Math 312, Fall 2012 Jerry L. Kazdan Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday. In addition to the problems below, you should also know how to solve

### Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.

Chapter 1 Vocabulary identity - A statement that equates two equivalent expressions. verbal model- A word equation that represents a real-life problem. algebraic expression - An expression with variables.

### ISOMETRIES OF R n KEITH CONRAD

ISOMETRIES OF R n KEITH CONRAD 1. Introduction An isometry of R n is a function h: R n R n that preserves the distance between vectors: h(v) h(w) = v w for all v and w in R n, where (x 1,..., x n ) = x

### L1-2. Special Matrix Operations: Permutations, Transpose, Inverse, Augmentation 12 Aug 2014

L1-2. Special Matrix Operations: Permutations, Transpose, Inverse, Augmentation 12 Aug 2014 Unfortunately, no one can be told what the Matrix is. You have to see it for yourself. -- Morpheus Primary concepts:

### Helpsheet. Giblin Eunson Library MATRIX ALGEBRA. library.unimelb.edu.au/libraries/bee. Use this sheet to help you:

Helpsheet Giblin Eunson Library ATRIX ALGEBRA Use this sheet to help you: Understand the basic concepts and definitions of matrix algebra Express a set of linear equations in matrix notation Evaluate determinants

### INTRODUCTORY LINEAR ALGEBRA WITH APPLICATIONS B. KOLMAN, D. R. HILL

SOLUTIONS OF THEORETICAL EXERCISES selected from INTRODUCTORY LINEAR ALGEBRA WITH APPLICATIONS B. KOLMAN, D. R. HILL Eighth Edition, Prentice Hall, 2005. Dr. Grigore CĂLUGĂREANU Department of Mathematics

### Section 6.1 - Inner Products and Norms

Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,

### a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.

Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given

### Section 1.1. Introduction to R n

The Calculus of Functions of Several Variables Section. Introduction to R n Calculus is the study of functional relationships and how related quantities change with each other. In your first exposure to

### Diagonal, Symmetric and Triangular Matrices

Contents 1 Diagonal, Symmetric Triangular Matrices 2 Diagonal Matrices 2.1 Products, Powers Inverses of Diagonal Matrices 2.1.1 Theorem (Powers of Matrices) 2.2 Multiplying Matrices on the Left Right by

### 5.3 The Cross Product in R 3

53 The Cross Product in R 3 Definition 531 Let u = [u 1, u 2, u 3 ] and v = [v 1, v 2, v 3 ] Then the vector given by [u 2 v 3 u 3 v 2, u 3 v 1 u 1 v 3, u 1 v 2 u 2 v 1 ] is called the cross product (or

### Lecture 1: Systems of Linear Equations

MTH Elementary Matrix Algebra Professor Chao Huang Department of Mathematics and Statistics Wright State University Lecture 1 Systems of Linear Equations ² Systems of two linear equations with two variables

### Linear Algebra Notes

Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note

### WHICH LINEAR-FRACTIONAL TRANSFORMATIONS INDUCE ROTATIONS OF THE SPHERE?

WHICH LINEAR-FRACTIONAL TRANSFORMATIONS INDUCE ROTATIONS OF THE SPHERE? JOEL H. SHAPIRO Abstract. These notes supplement the discussion of linear fractional mappings presented in a beginning graduate course

### DETERMINANTS. b 2. x 2

DETERMINANTS 1 Systems of two equations in two unknowns A system of two equations in two unknowns has the form a 11 x 1 + a 12 x 2 = b 1 a 21 x 1 + a 22 x 2 = b 2 This can be written more concisely in

### MATH10212 Linear Algebra B Homework 7

MATH22 Linear Algebra B Homework 7 Students are strongly advised to acquire a copy of the Textbook: D C Lay, Linear Algebra and its Applications Pearson, 26 (or other editions) Normally, homework assignments

### Solution to Homework 2

Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

### Brief Introduction to Vectors and Matrices

CHAPTER 1 Brief Introduction to Vectors and Matrices In this chapter, we will discuss some needed concepts found in introductory course in linear algebra. We will introduce matrix, vector, vector-valued

### Solutions to Review Problems

Chapter 1 Solutions to Review Problems Chapter 1 Exercise 42 Which of the following equations are not linear and why: (a x 2 1 + 3x 2 2x 3 = 5. (b x 1 + x 1 x 2 + 2x 3 = 1. (c x 1 + 2 x 2 + x 3 = 5. (a

### MATH2210 Notebook 1 Fall Semester 2016/2017. 1 MATH2210 Notebook 1 3. 1.1 Solving Systems of Linear Equations... 3

MATH0 Notebook Fall Semester 06/07 prepared by Professor Jenny Baglivo c Copyright 009 07 by Jenny A. Baglivo. All Rights Reserved. Contents MATH0 Notebook 3. Solving Systems of Linear Equations........................

### Linear Algebra Review. Vectors

Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

### (January 14, 2009) End k (V ) End k (V/W )

(January 14, 29) [16.1] Let p be the smallest prime dividing the order of a finite group G. Show that a subgroup H of G of index p is necessarily normal. Let G act on cosets gh of H by left multiplication.

### 1 Determinants and the Solvability of Linear Systems

1 Determinants and the Solvability of Linear Systems In the last section we learned how to use Gaussian elimination to solve linear systems of n equations in n unknowns The section completely side-stepped

### 15.062 Data Mining: Algorithms and Applications Matrix Math Review

.6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop

### Lecture Notes 2: Matrices as Systems of Linear Equations

2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably

### Vector Spaces. Chapter 2. 2.1 R 2 through R n

Chapter 2 Vector Spaces One of my favorite dictionaries (the one from Oxford) defines a vector as A quantity having direction as well as magnitude, denoted by a line drawn from its original to its final

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

### Math 115A - Week 1 Textbook sections: 1.1-1.6 Topics covered: What is a vector? What is a vector space? Span, linear dependence, linear independence

Math 115A - Week 1 Textbook sections: 1.1-1.6 Topics covered: What is Linear algebra? Overview of course What is a vector? What is a vector space? Examples of vector spaces Vector subspaces Span, linear

### Introduction to Matrix Algebra I

Appendix A Introduction to Matrix Algebra I Today we will begin the course with a discussion of matrix algebra. Why are we studying this? We will use matrix algebra to derive the linear regression model

### 9.4. The Scalar Product. Introduction. Prerequisites. Learning Style. Learning Outcomes

The Scalar Product 9.4 Introduction There are two kinds of multiplication involving vectors. The first is known as the scalar product or dot product. This is so-called because when the scalar product of

### Functions and Equations

Centre for Education in Mathematics and Computing Euclid eworkshop # Functions and Equations c 014 UNIVERSITY OF WATERLOO Euclid eworkshop # TOOLKIT Parabolas The quadratic f(x) = ax + bx + c (with a,b,c

### LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,