Row Space, Column Space, and the

Similar documents
Solving Linear Systems, Continued and The Inverse of a Matrix

Methods for Finding Bases

160 CHAPTER 4. VECTOR SPACES

NOTES ON LINEAR TRANSFORMATIONS

Solutions to Math 51 First Exam January 29, 2015

( ) which must be a vector

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MATH1231 Algebra, 2015 Chapter 7: Linear maps

Lecture Notes 2: Matrices as Systems of Linear Equations

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

Systems of Linear Equations

A =

Section Continued

Solving Systems of Linear Equations

Solving Systems of Linear Equations Using Matrices

by the matrix A results in a vector which is a reflection of the given

These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

MAT 242 Test 2 SOLUTIONS, FORM T

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

Section 8.2 Solving a System of Equations Using Matrices (Guassian Elimination)

4.5 Linear Dependence and Linear Independence

Recall that two vectors in are perpendicular or orthogonal provided that their dot

Orthogonal Diagonalization of Symmetric Matrices

Name: Section Registered In:

Linear Algebra Notes

Vector Spaces 4.4 Spanning and Independence

Linearly Independent Sets and Linearly Dependent Sets

LINEAR ALGEBRA W W L CHEN

Subspaces of R n LECTURE Subspaces

MATH2210 Notebook 1 Fall Semester 2016/ MATH2210 Notebook Solving Systems of Linear Equations... 3

Linear Algebra Review. Vectors

T ( a i x i ) = a i T (x i ).

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

Lecture 2: Homogeneous Coordinates, Lines and Conics

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

1 Introduction to Matrices

Chapter 19. General Matrices. An n m matrix is an array. a 11 a 12 a 1m a 21 a 22 a 2m A = a n1 a n2 a nm. The matrix A has n row vectors

1 Sets and Set Notation.

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

1.2 Solving a System of Linear Equations

Math 215 HW #6 Solutions

Similarity and Diagonalization. Similar Matrices

Inner Product Spaces

18.06 Problem Set 4 Solution Due Wednesday, 11 March 2009 at 4 pm in Total: 175 points.

THE DIMENSION OF A VECTOR SPACE

MATH APPLIED MATRIX THEORY

5 Homogeneous systems

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Lecture 5: Singular Value Decomposition SVD (1)

Solving Systems of Linear Equations

Math 312 Homework 1 Solutions

x + y + z = 1 2x + 3y + 4z = 0 5x + 6y + 7z = 3

Notes on Determinant

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Row Echelon Form and Reduced Row Echelon Form

a 11 x 1 + a 12 x a 1n x n = b 1 a 21 x 1 + a 22 x a 2n x n = b 2.

CS3220 Lecture Notes: QR factorization and orthogonal transformations

Finite Dimensional Hilbert Spaces and Linear Inverse Problems

Homogeneous systems of algebraic equations. A homogeneous (ho-mo-geen -ius) system of linear algebraic equations is one in which

1 VECTOR SPACES AND SUBSPACES

3. INNER PRODUCT SPACES

Inner Product Spaces and Orthogonality

Linear Algebra Notes for Marsden and Tromba Vector Calculus

Section Inner Products and Norms

LS.6 Solution Matrices

Math Practice Exam 2 with Some Solutions

2.2/2.3 - Solving Systems of Linear Equations

Matrix Representations of Linear Transformations and Changes of Coordinates

r (t) = 2r(t) + sin t θ (t) = r(t) θ(t) + 1 = 1 1 θ(t) Write the given system in matrix form x = Ax + f ( ) sin(t) x y z = dy cos(t)

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

MA106 Linear Algebra lecture notes

Orthogonal Projections and Orthonormal Bases

Section 1.4. Lines, Planes, and Hyperplanes. The Calculus of Functions of Several Variables

Lectures notes on orthogonal matrices (with exercises) Linear Algebra II - Spring 2004 by D. Klain

4: SINGLE-PERIOD MARKET MODELS

Chapter 20. Vector Spaces and Bases

CHAPTER 2. Eigenvalue Problems (EVP s) for ODE s

Orthogonal Projections

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.

Applied Math 245 Midterm Exam: Winter 2007

LEARNING OBJECTIVES FOR THIS CHAPTER

University of Lille I PC first year list of exercises n 7. Review

Vector and Matrix Norms

Section 4.4 Inner Product Spaces

MAT 242 Test 3 SOLUTIONS, FORM A

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007)

What is Linear Programming?

Linear Codes. Chapter Basics

Cross product and determinants (Sect. 12.4) Two main ways to introduce the cross product

1.5 SOLUTION SETS OF LINEAR SYSTEMS

Polynomial Invariants

Linear Equations in Linear Algebra

Row Ideals and Fibers of Morphisms

13 MATH FACTS a = The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

Systems of Linear Equations

Numerical Analysis Lecture Notes

Problem Set 5 Due: In class Thursday, Oct. 18 Late papers will be accepted until 1:00 PM Friday.

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison

Linear Equations ! $ & " % & " 11,750 12,750 13,750% MATHEMATICS LEARNING SERVICE Centre for Learning and Professional Development

Transcription:

Col, Row Column Row, Column, the Calculus III Summer 2013, Session II Monday, July 22, 2013

Col, Agenda Row Column 1. Row Column 2.

Col, Row Column Motivation Say S is a subspace of R n with basis {v 1, v 2,..., v n }. What operations can we perform on the basis while preserving its span linear independence? Swap two elements (or shuffle them in any way) E.g. {v 1, v 2, v 3 } {v 2, v 1, v 3 } Multiply one element by a nonzero scalar E.g. {v 1, v 2, v 3 } {v 1, 5v 2, v 3 } Add a scalar multiple of one element to another E.g. {v 1, v 2, v 3 } {v 1, v 2, v 3 + 2v 2 } If we make the v 1,..., v n the rows of a matrix, these operations are just the familiar elementary row ops.

Col, Row space Row Column Definition If A is an m n matrix with real entries, the row space of A is the subspace of R n spanned by its rows. Remarks 1. Elementary row ops do not change the row space. 2. In general, the rows of a matrix may not be linearly independent. nonzero rows of any row-echelon form of A is a basis for its row space.

Col, Row Column Determine a basis for the row space of 1 1 1 3 2 A = 2 1 1 5 1 3 1 1 7 0. 0 1 1 1 3 Reduce A to the row-echelon form 1 1 1 3 2 0 1 1 1 3 0 0 0 0 0. 0 0 0 0 0 Example refore, the row space of A is the 2-dimensional subspace of R 5 with basis { (1, 1, 1, 3, 2), (0, 1, 1, 1, 3) }.

Col, Column space Row Column We can do the same thing for columns. Definition If A is an m n matrix with real entries, the column space of A is the subspace of R m spanned by its columns. Obviously, the column space of A equals the row space of A T, so a basis can be computed by reducing A T to row-echelon form. However, this is not the best way.

Col, Row Column Determine a basis for the column space of 1 2 1 2 0 A = 2 4 1 1 0 3 6 1 4 1 = [ ] a 1 a 2 a 3 a 4 a 5. 0 0 1 5 0 Reduce A to the reduced row-echelon form 1 2 0 3 0 E = 0 0 1 5 0 0 0 0 0 1 = [ ] e 1 e 2 e 3 e 4 e 5. 0 0 0 0 0 Example e 2 = 2e 1 a 2 = 2a 1 e 4 = 3e 1 + 5e 3 a 4 = 3a 1 + 5a 3 refore, {a 1, a 3, a 5 } is a basis for the column space of A.

Col, Column space Row Column We don t need to go all the way to RREF; we can see where the leading ones will be just from REF. If A is an m n matrix with real entries, the set of column vectors of A corresponding to those columns containing leading ones in any row-echelon form of A is a basis for the column space of A. Another point of view column space of an m n matrix A is the subspace of R m consisting of the vectors v R m such that the linear system Ax = v is consistent.

Col, Relation to rank Row Column If A is an m n matrix, to determine bases for the row space column space of A, we reduce A to a row-echelon form E. 1. rows of E containing leading ones form a basis for the row space. 2. columns of A corresponding to columns of E with leading ones form a basis for the column space. dim (rowspace(a)) = rank(a) = dim (colspace(a))

Col, Row Column If A is an m n matrix, we noted that in the linear system Ax = v, Segue rank(a), functioning as dim (colspace(a)), represents the degrees of freedom in v while keeping the system consistent. degrees of freedom in x while keeping v constant is the number of free variables in the system. We know this to be n rank(a), since rank(a) is the number of bound variables. Freedom in choosing x comes from the null space of A, since if Ax = v Ay = 0 then A(x + y) = Ax + Ay = v + 0 = v. Hence, the degrees of freedom in x should be equal to dim (nullspace(a)).

Col, Row Column Definition When A is an m n matrix, recall that the null space of A is nullspace(a) = {x R n : Ax = 0}. Its dimension is referred to as the nullity of A. ( ) For any m n matrix A, rank(a) + nullity(a) = n.

Col, Row Column We re now going to examine the geometry of the solution set of a linear system. Consider the linear system where A is m n. Ax = b, If b = 0, the system is called homogeneous. In this case, the solution set is simply the null space of A. Any homogeneous system has the solution x = 0, which is called the trivial solution. Geometrically, this means that the solution set passes through the origin. Furthermore, we have shown that the solution set of a homogeneous system is in fact a subspace of R n.

Col, Structure of a homogeneous solution set Row Column If rank(a) = n, then Ax = 0 has only the trivial solution x = 0, so nullspace(a) = {0}. If rank(a) = r < n, then Ax = 0 has an infinite number of solutions, all of which are of the form x = c 1 x 1 + c 2 x 2 + + c n r x n r, where {x 1, x 2,..., x n r } is a basis for nullspace(a). Remark Such an expression is called the general solution to the homogeneous linear system.

Col, Row Column Now consider a nonhomogeneous linear system Ax = b where A be an m n matrix b is not necessarily 0. If b is not in colspace(a), then the system is inconsistent. If b colspace(a), then the system is consistent has a unique solution if only if rank(a) = n. an infinite number of solutions if only if rank(a) < n. Geometrically, a nonhomogeneous solution set is just the corresponding homogeneous solution set that has been shifted away from the origin.

Col, Row Column Structure of a nonhomogeneous solution set In the case where rank(a) = r < n b colspace(a), then all solutions are of the form x = c } 1 x 1 + c 2 x 2 + + c {{ n r x n r + x } p, = x c + x p where x p is any particular solution to Ax = b {x 1, x 2,..., x n r } is a basis for nullspace(a). Remark above expression is the general solution to a nonhomogeneous linear system. It has two components: the complementary solution, x c, the particular solution, x p.