Rank and linear transformations

Similar documents
NOTES ON LINEAR TRANSFORMATIONS

MATH1231 Algebra, 2015 Chapter 7: Linear maps

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

Orthogonal Diagonalization of Symmetric Matrices

Methods for Finding Bases

( ) which must be a vector

Linearly Independent Sets and Linearly Dependent Sets

LINEAR ALGEBRA W W L CHEN

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

T ( a i x i ) = a i T (x i ).

Recall that two vectors in are perpendicular or orthogonal provided that their dot

Lecture Notes 2: Matrices as Systems of Linear Equations

160 CHAPTER 4. VECTOR SPACES

Math Practice Exam 2 with Some Solutions

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

A =

by the matrix A results in a vector which is a reflection of the given

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

These axioms must hold for all vectors ū, v, and w in V and all scalars c and d.

Solutions to Math 51 First Exam January 29, 2015

Chapter 6. Linear Transformation. 6.1 Intro. to Linear Transformation

Similarity and Diagonalization. Similar Matrices

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Linear Maps. Isaiah Lankham, Bruno Nachtergaele, Anne Schilling (February 5, 2007)

Vector Spaces 4.4 Spanning and Independence

1 Sets and Set Notation.

Solving Linear Systems, Continued and The Inverse of a Matrix

MAT 242 Test 2 SOLUTIONS, FORM T

MA106 Linear Algebra lecture notes

Name: Section Registered In:

4.5 Linear Dependence and Linear Independence

MATH APPLIED MATRIX THEORY

Chapter 6. Orthogonality

Systems of Linear Equations

α = u v. In other words, Orthogonal Projection

Linear Algebra Notes

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

MATH2210 Notebook 1 Fall Semester 2016/ MATH2210 Notebook Solving Systems of Linear Equations... 3

MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.

Examination paper for TMA4115 Matematikk 3

Linear Equations in Linear Algebra

x + y + z = 1 2x + 3y + 4z = 0 5x + 6y + 7z = 3

Applied Linear Algebra I Review page 1

Inner Product Spaces

Section Continued

Matrix Representations of Linear Transformations and Changes of Coordinates

1.5 SOLUTION SETS OF LINEAR SYSTEMS

Lectures notes on orthogonal matrices (with exercises) Linear Algebra II - Spring 2004 by D. Klain

Linear Algebra Review. Vectors

Numerical Analysis Lecture Notes

1 VECTOR SPACES AND SUBSPACES

ISOMETRIES OF R n KEITH CONRAD

Solving Systems of Linear Equations

Inner Product Spaces and Orthogonality

Inner product. Definition of inner product

4 MT210 Notebook Eigenvalues and Eigenvectors Definitions; Graphical Illustrations... 3

BANACH AND HILBERT SPACE REVIEW

THE DIMENSION OF A VECTOR SPACE

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION

Math 312 Homework 1 Solutions

Row Echelon Form and Reduced Row Echelon Form

MAT 242 Test 3 SOLUTIONS, FORM A

Subspaces of R n LECTURE Subspaces

Brief Introduction to Vectors and Matrices

1 Introduction to Matrices

Inner Product Spaces. 7.1 Inner Products

University of Lille I PC first year list of exercises n 7. Review

Chapter 20. Vector Spaces and Bases

Orthogonal Projections and Orthonormal Bases

LINEAR ALGEBRA. September 23, 2010

Notes on Determinant

Chapter 19. General Matrices. An n m matrix is an array. a 11 a 12 a 1m a 21 a 22 a 2m A = a n1 a n2 a nm. The matrix A has n row vectors

18.06 Problem Set 4 Solution Due Wednesday, 11 March 2009 at 4 pm in Total: 175 points.

x = + x 2 + x

8 Square matrices continued: Determinants

5. Linear algebra I: dimension

MAT188H1S Lec0101 Burbulla

Numerical Analysis Lecture Notes

Linear Algebra and TI 89

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

CONTROLLABILITY. Chapter Reachable Set and Controllability. Suppose we have a linear system described by the state equation

Notes on Symmetric Matrices

Section 4.4 Inner Product Spaces

Section Inner Products and Norms

Solving Systems of Linear Equations

Linear Algebra. A vector space (over R) is an ordered quadruple. such that V is a set; 0 V ; and the following eight axioms hold:

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components

MATH 304 Linear Algebra Lecture 20: Inner product spaces. Orthogonal sets.

Lecture 5: Singular Value Decomposition SVD (1)

Chapter 17. Orthogonal Matrices and Symmetries of Space

Math 215 HW #6 Solutions

Matrices and Linear Algebra

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = i.

The cover SU(2) SO(3) and related topics

Linear Algebra Notes for Marsden and Tromba Vector Calculus

Linear Codes. Chapter Basics

BILINEAR FORMS KEITH CONRAD

r (t) = 2r(t) + sin t θ (t) = r(t) θ(t) + 1 = 1 1 θ(t) Write the given system in matrix form x = Ax + f ( ) sin(t) x y z = dy cos(t)

Solving Systems of Linear Equations Using Matrices

17. Inner product spaces Definition Let V be a real vector space. An inner product on V is a function

Transcription:

Rank and linear transformations Math 4, Introduction to Linear Algebra Friday, February, Recall from Wednesday... Important characteristic of a basis Theorem. Given a basis B {v,...,v k } of subspace S, there is a unique way to epress any v S as a linear combination of basis vectors v,...,v k. Proof sketch. Suppose span(b) S v c v + c v + + c k v k for scalars c i,d i v d v + d v + + d k v k Then (c d )v +(c d )v + +(c k d k )v k c d c d.. c k d k c i d i i linearly independent

Recall from Wednesday... Eample of matri subspaces bases 3 4 5 A 6 7 8 9 3 4 5 3 A EROs R 3 4 basis for row(a) 3, 3 4 basis for col(a) 6, 7 Eample of matri subspaces bases 3 4 5 A 6 7 8 9 3 4 5 3 4 3 5 + 3 +3 4 +4 5 3, 4, 5 free 3 A EROs R 3 4 basis for null(a) 3, 3, 4 3 + 4 +3 5 3 3 4 3 3 4 4 5 3 4 3 + 3 4 + 4 5 5 5

Dimensions of fundamental subspaces For the 3 5 matri from the last eample, we have basis for row(a) 3, 3 4 3 basis for 6, 7 basis for col(a) null(a), 3, 4 Note that dim(row(a)) dim(col(a)) dim(null(a)) 3 row rank of A column rank of A nullity of A Question: Is it a coincidence that row rank of A column rank of A? Question: Is it a coincidence that nullity of A + row/col rank of A # of cols of A? Rank of a matri Theorem. For any matri A, # of nonzero rows of RREF of A row rank of A column rank of A. rank of A # of leading s in RREF of A Consequence: rank(a) rank(a T ) Theorem (Rank Theorem). For any m n matri A, nullity(a) + rank(a) n. # of columns without leading s in RREF of A # of columns with leading s in RREF of A

Fundamental Theorem of Invertible Matrices (etended) Theorem. Let A be an n n matri. The following statements are equivalent: A is invertible. A b has a unique solution for all b. A has only the trivial solution. The RREF of A is I. A is the product of elementary matrices. rank(a) n. nullity(a). Columns of A are linearly independent. Columns of A span. Columns of A form a basis for. Rows of A are linearly independent. Rows of A span. Rows of A form a basis for. Eamples of vector spaces and subspaces R 3, under vector addition and scalar multiplication (scalars: R) S a b : a, b R vector spaces, under vector addition and scalar multiplication (scalars: R) span (v,v,...,v k ) subspaces

Thinking beyond Euclidean vectors: more eamples of vector spaces and subspaces set of m n matrices with entries from C, under matri addition and scalar multiplication (scalars: C) set of n n diagonal matrices set of all functions from R to R, under function addition and scalar multiplication (scalars: R) vector spaces set of all differentiable functions set of all continuous functions set of all polynomials of degree at most 3 with real coefficients, with addition and scalar mult. defined in usual way (scalars: R) set of all polynomials of degree at most w/real coefficients subspaces A central idea of linear algebra: linear transformations Definition A function T : R m is a linear transformation if u,v and scalars c, T (u + v) T (u)+t (v), and T (cv) ct(v). { streamlined as T (c u + c v) c T (u)+c T (v) Eample T 6 T T : R 3 R and T y z domain T 3 codomain R 3 3 y T R

A central idea of linear algebra: linear transformations Definition A function T : R m is a linear transformation if u,v and scalars c, T (u + v) T (u)+t (v), and T (cv) ct(v). { streamlined as T (c u + c v) c T (u)+c T (v) Non-eample T : R R and T y + y y Consider T T 4 4 T Kernel and range of linear transformation Let T : R m be a linear transformation. Definition The kernel or null space of T is ker(t ){v : T (v) }. set of all images under T The image or range of T is range(t ){ w R m : w T (v) for some v }. T R m ker(t) range(t)

Looking closer at an eample Eample T : R 3 R and T y z y ker(t ) v R 3 : T (v) : z R span z For any,y R, T y y so range(t )R subspaces! Remarks on linear transformations T R m ker(t) range(t) For any linear transformation T, T(), ker(t) is a subspace of, R m range(t) is a subspace of. We define nullity(t) dim(ker(t)) rank(t) dim(range(t)) Theorem (Rank Thm for linear transformations). For a linear transformation T : R m, rank(t ) + nullity(t ) dim( )n.

Matri multiplication as a linear transformation Primary eample of a linear transformation matri multiplication Given an m n matri A, define T () A for. Then T is a linear transformation. Astounding! Matri multiplication defines a linear transformation. This new perspective gives a dynamic view of a matri (it transforms vectors into other vectors) and is a key to building math models to physical systems that evolve over time (so-called dynamical systems). Matri multiplication as a mapping (or function) Given an m n matri A, define T () A for. Verify that T is a linear transformation. We have T (u + v) A(u + v) Au + Av T (u)+t(v) and T (cv) A(cv) c(av) ct(v) What is range of T? range(t ) set of all vectors b R m such that T () b for some set of all vectors b R m such that A b for some col(a) Similarly, ker(t ) null(a)

A linear transformation as matri multiplication Theorem. Every linear transformation T : R m can be represented by an m n matri A so that, T () A. More astounding! Question Given T, how do we find A? Transformation T is completely determined by its action on basis vectors. Consider standard basis vectors for : e.,...,e n. Compute T (e ),T(e ),...,T(e n ). Standard matri of a linear transformation Question Given T, how do we find A? Transformation T is completely determined by its action on basis vectors. Consider standard basis vectors for : e.,...,e n. Compute T (e ),T(e ),...,T(e n ). Then A T (e ) T (e ) T (e n ) is called the standard matri for T.

Standard matri for an eample Eample T : R 3 R and T y y z T T T A A 5 What is T 5? 5 5