A Review of Linear Algebra. Gerald Recktenwald Portland State University Mechanical Engineering Department
|
|
- Laurel Carter
- 7 years ago
- Views:
Transcription
1 A Review of Linear Algebra Gerald Recktenwald Portland State University Mechanical Engineering Department
2 These slides are a supplement to the book Numerical Methods with Matlab: Implementations and Applications, by Gerald W. Recktenwald, c , Prentice-Hall, Upper Saddle River, NJ. These slides are copyright c Gerald W. Recktenwald. The PDF version of these slides may be downloaded or stored or printed only for noncommercial, educational use. The repackaging or sale of these slides in any form, without written consent of the author, is prohibited. The latest version of this PDF file, along with other supplemental material for the book, can be found at or web.cecs.pdx.edu/~gerry/nmm/. Version 0.99 August, 00 page 1
3 Primary Topics Vectors Matrices Mathematical Properties of Vectors and Matrices Special Matrices NMM: A Review of Linear Algebra page
4 Notation Variable type Typographical Convention Example scalar lower case Greek σ, α, β vector lower case Roman u, v, x, y, b matrix upper case Roman A, B, C NMM: A Review of Linear Algebra page
5 Defining Vectors in Matlab Assign any expression that evaluates to a vector >> v = [1 5 ] >> w = [; ; ; 8] >> x = linspace(0,10,5); >> y = 0:0:180 >> z = sin(y*pi/180); Distinquish between row and column vectors >> r = [1 ]; % row vector >> s = [1 ] ; % column vector >> r - s??? Error using ==> - Matrix dimensions must agree. Although r and s have the same elements, they are not the same vector. Furthermore, operations involving r and s are bound by the rules of linear algebra. NMM: A Review of Linear Algebra page
6 Vector Operations Addition and Subtraction Multiplication by a scalar Transpose Linear Combinations of Vectors Inner Product Outer Product Vector Norms NMM: A Review of Linear Algebra page 5
7 Vector Addition and Subtraction Addition and subtraction are element-by-element operations c = a + b c i = a i + b i i =1,...,n d = a b d i = a i b i i =1,...,n Example: 1 a = 5 b = 5 1 a + b = 5 a b = 0 5 NMM: A Review of Linear Algebra page
8 Multiplication by a Scalar Multiplication by a scalar involves multiplying each element in the vector by the scalar: b = σa b i = σa i i =1,...,n Example: a = 5 b = a = 5 8 NMM: A Review of Linear Algebra page
9 Vector Transpose The transpose of a row vector is a column vector: u = ˆ1,, then u T = 1 5 Likewise if v is the column vector v = 55 then v T = ˆ, 5, NMM: A Review of Linear Algebra page 8
10 Linear Combinations (1) Combine scalar multiplication with addition α u 1 u. u m 5 + β v 1 v. v m 5 = αu 1 + βv 1 αu + βv. αu m + βv m 5 = w 1 w. w m 5 Example: r = 1 5 s = 1 05 t =r +s = = NMM: A Review of Linear Algebra page 9
11 Linear Combinations () Any one vector can be created from an infinite combination of other suitable vectors. Example: w =» =» 1 + 0» 0 1 w =» 1 0» 1 1 w =»» 1 1 w =»» 1 0» 0 1 NMM: A Review of Linear Algebra page 10
12 Linear Combinations () [,] [1,-1] [,] [-1,1] 1 0 [1,0] [0,1] [1,1] Graphical interpretation: Vector tails can be moved to convenient locations Magnitude and direction of vectors is preserved NMM: A Review of Linear Algebra page 11
13 Vector Inner Product (1) In physics, analytical geometry, and engineering, the dot product has a geometric interpretation nx σ = x y σ = x i y i i=1 x y = x y cos θ NMM: A Review of Linear Algebra page 1
14 Vector Inner Product () The rules of linear algebra impose compatibility requirements on the inner product. The inner product of x and y requires that x be a row vector y be a column vector y 1 ˆx1 x x x y y 5 = x 1y 1 + x y + x y + x y y NMM: A Review of Linear Algebra page 1
15 Vector Inner Product () For two n-element column vectors, u and v, the inner product is σ = u T v σ = nx u i v i i=1 The inner product is commutative so that (for two column vectors) u T v = v T u NMM: A Review of Linear Algebra page 1
16 Computing the Inner Product in Matlab The * operator performs the inner product if two vectors are compatible. >> u = (0:) ; % u and v are >> v = (:-1:0) ; % column vectors >> s = u*v??? Error using ==> * Inner matrix dimensions must agree. >> s = u *v s = >> t = v *u t = NMM: A Review of Linear Algebra page 15
17 Vector Outer Product The inner product results in a scalar. The outer product creates a rank-one matrix: A = uv T a i,j = u i v j Example: Outer product of two - element column vectors uv T = = u 1 u ˆv1 u 5 v v v u u 1 v 1 u 1 v u 1 v u 1 v u v 1 u v u v u v u v 1 u v u v u v 5 u v 1 u v u v u v NMM: A Review of Linear Algebra page 1
18 Computing the Outer Product in Matlab The * operator performs the outer product if two vectors are compatible. u = (0:) ; v = (:-1:0) ; A = u*v A = NMM: A Review of Linear Algebra page 1
19 Vector Norms (1) Compare magnitude of scalars with the absolute value α > β Compare magnitude of vectors with norms x > y There are several ways to compute x. In other words the size of two vectors can be compared with different norms. NMM: A Review of Linear Algebra page 18
20 Vector Norms () Consider two element vectors, which lie in a plane b = (,) a = (,) c = (,1) a = (,) Use geometric lengths to represent the magnitudes of the vectors l a = p + = 0, l b = p + = 0, l c = p +1 = 5 We conclude that or l a = l b and l a >l c a = b and a > c NMM: A Review of Linear Algebra page 19
21 The L Norm The notion of a geometric length for D or D vectors can be extended vectors with arbitrary numbers of elements. The result is called the Euclidian or L norm: x = `x 1 + x x n 1/ = nx i=1 x i! 1/ The L norm can also be expressed in terms of the inner product x = x x = x T x NMM: A Review of Linear Algebra page 0
22 p-norms For any integer p x p = ` x 1 p + x p x n p 1/p The L 1 norm is sum of absolute values x 1 = x 1 + x x n = nx x i i=1 The L norm or max norm is x = max ( x 1, x,..., x n ) = max i ( x i ) Although p can be any positive number, p =1,, are most commonly used. NMM: A Review of Linear Algebra page 1
23 Application of Norms (1) Are two vectors (nearly) equal? Floating point comparison of two scalars with absolute value: α β <δ α where δ is a small tolerance. Comparison of two vectors with norms: y z z <δ NMM: A Review of Linear Algebra page
24 Application of Norms () Notice that is not equivalent to y z <δ z y z <δ. z This comparison is important in convergence tests for sequences of vectors. See Example. in the textbook. NMM: A Review of Linear Algebra page
25 Application of Norms () Creating a Unit Vector Given u =[u 1,u,...,u m ] T, the unit vector in the direction of u is û = u u Proof: û = u u = 1 u u =1 The following are not unit vectors u u 1 u u NMM: A Review of Linear Algebra page
26 Orthogonal Vectors From geometric interpretation of the inner product u v = u v cos θ cos θ = u v u v = u T v u v Two vectors are orthogonal when θ = π/ or u v =0. In other words if and only if u and v are orthogonal. u T v =0 NMM: A Review of Linear Algebra page 5
27 Orthonormal Vectors Orthonormal vectors are unit vectors that are orthogonal. A unit vector has an L norm of one. The unit vector in the direction of u is û = u u Since u = u u it follows that u u =1if u is a unit vector. NMM: A Review of Linear Algebra page
28 Matrices Columns and Rows of a Matrix are Vectors Addition and Subtraction Multiplication by a scalar Transpose Linear Combinations of Vectors Matrix Vector Product Matrix Matrix Product Matrix Norms NMM: A Review of Linear Algebra page
29 Notation The matrix A with m rows and n columns looks like: a 11 a 1 a 1n A = a 1 a a n.. 5 a m1 a mn a ij = element in row i, andcolumn j In Matlab we can define a matrix with >> A = [... ;... ;... ] where semicolons separate lists of row elements. The a, element of the Matlab matrix A is A(,). NMM: A Review of Linear Algebra page 8
30 Matrices Consist of Row and Column Vectors As a collection of column vectors A = a (1) a () a (n) 5 As a collection of row vectors A = a (1) a (). a (m) 5 A prime is used to designate a row vector on this and the following pages. NMM: A Review of Linear Algebra page 9
31 Preview of the Row and Column View Matrix and vector operations Row and column Element-by-element operations operations NMM: A Review of Linear Algebra page 0
32 Matrix Operations Addition and subtraction Multiplication by a Scalar Matrix Transpose Matrix Vector Multiplication Vector Matrix Multiplication Matrix Matrix Multiplication NMM: A Review of Linear Algebra page 1
33 Matrix Operations Addition and subtraction C = A + B or c i,j = a i,j + b i,j i =1,...,m; j =1,...,n Multiplication by a Scalar B = σa or b i,j = σa i,j i =1,...,m; j =1,...,n Note: Commas in subscripts are necessary when the subscripts are assigned numerical values. For example, a, is the row, column element of matrix A, whereas a is the rd element of vector a. When variables appear in indices, such as a ij or a i,j, the comma is optional NMM: A Review of Linear Algebra page
34 Matrix Transpose or B = A T b i,j = a j,i i =1,...,m; j =1,...,n In Matlab >> A = [0 0 0; 0 0 0; 1 ; 0 0 0] A = >> B = A B = NMM: A Review of Linear Algebra page
35 Matrix Vector Product The Column View gives mathematical insight The Row View easy to do by hand The Vector View A square matrice rotates and stretches a vector NMM: A Review of Linear Algebra page
36 Column View of Matrix Vector Product (1) Consider a linear combination of a set of column vectors {a (1),a (),...,a (n) }. Each a (j) has m elements Let x i be a set (a vector) of scalar multipliers or Expand the (hidden) row index x 1 a 11 a 1. a m1 x 1 a (1) + x a () x n a (n) = b 5 + x nx a (j) x j = b j=1 a 1 a. a m x n a 1n a n. a mn 5 = b 1 b. b m 5 NMM: A Review of Linear Algebra page 5
37 Column View of Matrix Vector Product () Form a matrix with the a (j) as columns a (1) a () a (n) 5 x 1 x. x n 5 = b 5 Or, writing out the elements a 11 a 1 a 1n a 1 a a n... a m1 a m a mn 5 x 1 x. x n 5 = b 1 b. b m 5 NMM: A Review of Linear Algebra page
38 Column View of Matrix Vector Product () Thus, the matrix-vector product is a 11 a 1 a 1n a 1 a a n x 1 x = 5 x n a m1 a m a mn b 1 b. b m 5 Save space with matrix notation Ax = b NMM: A Review of Linear Algebra page
39 Column View of Matrix Vector Product () The matrix vector product b = Ax produces a vector b from a linear combination of the columns in A. where x and b are column vectors b = Ax b i = nx a ij x j j=1 NMM: A Review of Linear Algebra page 8
40 Column View of Matrix Vector Product (5) Algorithm.1 initialize: b = zeros(m, 1) for j =1,...,n for i =1,...,m b(i) =A(i, j)x(j) +b(i) end end NMM: A Review of Linear Algebra page 9
41 Compatibility Requirement Inner dimensions must agree A x = b [m n] [n 1] = [m 1] NMM: A Review of Linear Algebra page 0
42 Row View of Matrix Vector Product (1) Consider the following matrix vector product written out as a linear combination of matrix columns = This is the column view. NMM: A Review of Linear Algebra page 1
43 Row View of Matrix Vector Product () Now, group the multiplication and addition operations by row: = (5)() + (0)() + (0)( ) + ( 1)( 1) ( )() + ()() + ( )( ) + (1)( 1) 5 = (1)() + ()() + ()( ) + ()( 1) Final result is identical to that obtained with the column view. NMM: A Review of Linear Algebra page
44 Row View of Matrix Vector Product () Product of a matrix, A, with a 1 vector, x, looks like a (1) x 1 a (1) a x () x 5 = x a () x 5 = 5 x a () x a () b 1 b 5 b where a (1), a (),anda (),aretherow vectors constituting the A matrix. The matrix vector product b = Ax produces elements in b by forming inner products of the rows of A with x. NMM: A Review of Linear Algebra page
45 Row View of Matrix Vector Product () i = i a' (i) x y i NMM: A Review of Linear Algebra page
46 Vector View of Matrix Vector Product If A is square, the product Ax has the effect of stretching and rotating x. Pure stretching of the column vector = Pure rotation of the column vector = NMM: A Review of Linear Algebra page 5
47 Vector Matrix Product Matrix vector product = m n n 1 m 1 Vector Matrix product = 1 m m n 1 n NMM: A Review of Linear Algebra page
48 Vector Matrix Product Compatibility Requirement: Inner dimensions must agree u A = v [1 m] [m n] = [1 n] NMM: A Review of Linear Algebra page
49 Matrix Matrix Product Computations can be organized in six different ways We ll focus on just two Column View extension of column view of matrix vector product Row View inner product algorithm, extension of column view of matrix vector product NMM: A Review of Linear Algebra page 8
50 Column View of Matrix Matrix Product The product AB produces a matrix C. The columns of C are linear combinations of the columns of A. AB = C c (j) = Ab (j) c (j) and b (j) are column vectors. i j = j r A b ( j ) c ( j ) The column view of the matrix matrix product AB = C is helpful because it shows the relationship between the columns of A and the columns of C. NMM: A Review of Linear Algebra page 9
51 Inner Product (Row) View of Matrix Matrix Product The product AB produces a matrix C. Thec ij element is the inner product of row i of A and column j of B. a (i) is a row vector, b (j) isacolumnvector. AB = C c ij = a (i) b (j) i j = j i c ij r a' (i ) b ( j ) c ij The inner product view of the matrix matrix product is easier to use for hand calculations. NMM: A Review of Linear Algebra page 50
52 Matrix Matrix Product Summary (1) The Matrix vector product looks like: 5 5 = 5 The vector Matrix product looks like: ˆ 5 = ˆ NMM: A Review of Linear Algebra page 51
53 Matrix Matrix Product Summary () The Matrix Matrix product looks like: 5 5 = 5 NMM: A Review of Linear Algebra page 5
54 Matrix Matrix Product Summary () Compatibility Requirement A B = C [m r] [r n] = [m n] Inner dimensions must agree Also, in general AB BA NMM: A Review of Linear Algebra page 5
55 Matrix Norms The Frobenius norm treats a matrix like a vector: just add up the sum of squares of the matrix elements.» X m nx 1/ A F = a ij i=1 j=1 More useful norms account for the affect that the matrix has on a vector. A = max x =1 Ax L or spectral norm A 1 = max 1 j n mx a ij column sum norm i=1 A = max 1 i m nx a ij row sum norm j=1 NMM: A Review of Linear Algebra page 5
56 Mathematical Properties of Vectors and Matrices Linear Independence Vector Spaces Subspaces associated with matrices Matrix Rank Matrix Determinant NMM: A Review of Linear Algebra page 55
57 Linear Independence (1) Two vectors lying along the same line are not independent 1 u = 15 and v = u = 1 5 Any two independent vectors, for example, v = 5 and w = define a plane. Any other vector in this plane of v and w can be represented by x = αv + βw x is linearly dependent on v and w because it can be formed by a linear combination of v and w. NMM: A Review of Linear Algebra page 5
58 Linear Independence () A set of vectors is linearly independent if it is impossible to use a linear combination of vectors in the set to create another vector in the set. Linear independence is easy to see for vectors that are orthogonal, for example, , 0 5, are linearly independent. NMM: A Review of Linear Algebra page 5
59 Linear Independence () Consider two linearly independent vectors, u and v. If a third vector, w, cannot be expressed as a linear combination of u and v, then the set {u, v, w} is linearly independent. In other words, if {u, v, w} is linearly independent then can be true only if α = β = δ =0. More generally, if the only solution to αu + βv = δw α 1 v (1) + α v () + + α n v (n) =0 (1) is α 1 = α =... = α n =0,thentheset{v (1),v (),...,v (n) } is linearly independent. Conversely, if equation (1) is satisfied by at least one nonzero α i, then the set of vectors is linearly dependent. NMM: A Review of Linear Algebra page 58
60 Linear Independence () Let the set of vectors {v (1),v (),...,v (n) } be organized as the columns of a matrix. Then the condition of linear independence is v (1) v () v (n) 5 α 1 α. α n 0 5 = () The columns of the m n matrix, A, are linearly independent if and only if x = (0, 0,...,0) T is the only n element column vector that satisfies Ax =0. NMM: A Review of Linear Algebra page 59
61 Vector Spaces Spaces and Subspaces Span of a Subspace Basis of a Subspace Subspaces associated with Matrices NMM: A Review of Linear Algebra page 0
62 Spaces and Subspaces Group vectors according to number of elements they have. Vectors from these different groups cannot be mixed. R 1 = Space of all vectors with one element. These vectors define the points along a line. R = Space of all vectors with two elements. These vectors define the points in a plane. R n = Space of all vectors with n elements. These vectors define the points in an n- dimensional space (hyperplane). NMM: A Review of Linear Algebra page 1
63 Subspaces The three vectors 1 u = 5, v = 0 1 5, w = 1 5, 5 [-,1,] T lie in the same plane. The vectors have three elements each, so they belong to R, but they span a subspace of R. 0-5 [1,,0] T y axis [,1,-] T 0 - x axis - NMM: A Review of Linear Algebra page
64 Span of a Subspace If w can be created by the linear combination β 1 v (1) + β v () + + β n v (n) = w where β i are scalars, then w is said to be in the subspace that is spanned by {v (1),v (),...,v (n) }. If the v i have m elements, then the subspace spanned by the v (i) is a subspace of R m.if n m it is possible, though not guaranteed, that the v (i) could span R m. NMM: A Review of Linear Algebra page
65 Basis and Dimension of a Subspace A basis for a subspace is a set of linearly independent vectors that span the subspace. Since a basis set must be linearly independent, it also must have the smallest number of vectors necessary to span the space. (Each vector makes a unique contribution to spanning some other direction in the space.) The number of vectors in a basis set is equal to the dimension of the subspace that these vectors span. Mutually orthogonal vectors (an orthogonal set) form convenient basis sets, but basis sets need not be orthogonal. NMM: A Review of Linear Algebra page
66 Subspaces Associated with Matrices The matrix vector product y = Ax creates y from a linear combination of the columns of A The column vectors of A form a basis for the column space or range of A. NMM: A Review of Linear Algebra page 5
67 Matrix Rank The rank of a matrix, A, is the number of linearly independent columns in A. rank(a) is the dimension of the column space of A. Numerical computation of rank(a) is tricky due to roundoff. Consider u = v = w = Do these vectors span R? What if u = ε m? NMM: A Review of Linear Algebra page
68 Matrix Rank () We can use Matlab s built-in rank function for exploratory calculations on (relatively) small matrices Example: >> A = [1 0 0; 0 1 0; 0 0 1e-5] % A(,) is small A = >> rank(a) ans = NMM: A Review of Linear Algebra page
69 Matrix Rank () Repeat numerical calculation of rank with smaller diagonal entry >> A(,) = eps/ % A(,) is even smaller A = >> rank(a) ans = Even though A(,) is not identically zero, it is small enough that the matrix is numerically rank-deficient NMM: A Review of Linear Algebra page 8
70 Matrix Determinant (1) Only square matrices have determinants. The determinant of a (square) matrix is a scalar. If det(a) =0,thenA is singular, and A 1 does not exist. det(i) =1for any identity matrix I. det(ab) = det(a) det(b). det(a T ) = det(a). Cramer s rule uses (many!) determinants to express the the solution to Ax = b. The matrix determinant has a number of useful properties: NMM: A Review of Linear Algebra page 9
71 Matrix Determinant () det(a) is not useful for numerical computation Computation of det(a) is expensive Computation of det(a) can cause overflow For diagonal and triangular matrices, det(a) is the product of diagonal elements The built in det computes the determinant of a matrix by first factoring it into A = LU, and then computing det(a) = det(l)det(u) = `l 11 l...l nn `u11 u...u nn NMM: A Review of Linear Algebra page 0
72 Special Matrices Diagonal Matrices Tridiagonal Matrices The Identity Matrix The Matrix Inverse Symmetric Matrices Positive Definite Matrices Orthogonal Matrices Permutation Matrices NMM: A Review of Linear Algebra page 1
73 Diagonal Matrices (1) Diagonal matrices have non-zero elements only on the main diagonal. c C = diag (c 1,c,...,c n )= 0 c c n The diag function is used to either create a diagonal matrix from a vector, or and extract the diagonal entries of a matrix. >> x = [1-5 ]; >> A = diag(x) A = NMM: A Review of Linear Algebra page
74 Diagonal Matrices () The diag function can also be used to create a matrix with elements only on a specified super-diagonal or sub-diagonal. Doing so requires using the two-parameter form of diag: >> diag([1 ],1) ans = >> diag([ 5 ],-1) ans = NMM: A Review of Linear Algebra page
75 Identity Matrices (1) An identity matrix is a square matrix with ones on the main diagonal. Example: The identity matrix I = An identity matrix is special because AI = A and IA = A for any compatible matrix A. This is like multiplying by one in scalar arithmetic. NMM: A Review of Linear Algebra page
76 Identity Matrices () Identity matrices can be created with the built-in eye function. >> I = eye() I = Sometimes I n is used to designate an identity matrix with n rows and n columns. For example, I = NMM: A Review of Linear Algebra page 5
77 Identity Matrices () A non-square, identity-like matrix can be created with the two-parameter form of the eye function: >> J = eye(,5) J = >> K = eye(,) K = J and K are not identity matrices! NMM: A Review of Linear Algebra page
78 Matrix Inverse (1) Let A be a square (i.e. n n) with real elements. The inverse of A is designated A 1, and has the property that A 1 A = I and AA 1 = I The formal solution to Ax = b is x = A 1 b. Ax = b A 1 Ax = A 1 b Ix = A 1 b x = A 1 b NMM: A Review of Linear Algebra page
79 Matrix Inverse () Although the formal solution to Ax = b is x = A 1 b, it is considered bad practice to evaluate x this way. The recommended procedure for solving Ax = b is Gaussian elimination (or one of its variants) with backward substitution. This procedure is described in detail in Chapter 8. Solving Ax = b by computing x = A 1 b requires more work (more floating point operations) than Gaussian elimination. Even if the extra work does not cause a problem with execution speed, the extra computations increase the roundoff errors in the result. If A is small (say or less) and well conditioned, the penalty for computing A 1 b will probably not be significant. Nonetheless, Gaussian elimination is preferred. NMM: A Review of Linear Algebra page 8
80 Functions to Create Special Matrices Matrix Diagonal Tridiagonal Identity Inverse Matlab function diag tridiags (NMM Toolbox) eye inv NMM: A Review of Linear Algebra page 9
81 Symmetric Matrices If A = A T,thenA is called a symmetric matrix. Example: Note: B = A T A is symmetric for any (real) matrix A. NMM: A Review of Linear Algebra page 80
82 Tridiagonal Matrices Example: The diagonal elements need not be equal. The general form of a tridiagonal matrix is a 1 b 1 c a b c a b A = c n 1 a n 1 b n 1 5 c n a n NMM: A Review of Linear Algebra page 81
83 To Do Add slides on: Tridiagonal Matrices Positive Definite Matrices Orthogonal Matrices Permutation Matrices NMM: A Review of Linear Algebra page 8
Linear Algebra Review. Vectors
Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length
More informationLINEAR ALGEBRA. September 23, 2010
LINEAR ALGEBRA September 3, 00 Contents 0. LU-decomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................
More information13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.
3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in three-space, we write a vector in terms
More informationSolving Linear Systems of Equations. Gerald Recktenwald Portland State University Mechanical Engineering Department gerry@me.pdx.
Solving Linear Systems of Equations Gerald Recktenwald Portland State University Mechanical Engineering Department gerry@me.pdx.edu These slides are a supplement to the book Numerical Methods with Matlab:
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationCS3220 Lecture Notes: QR factorization and orthogonal transformations
CS3220 Lecture Notes: QR factorization and orthogonal transformations Steve Marschner Cornell University 11 March 2009 In this lecture I ll talk about orthogonal matrices and their properties, discuss
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationLinear Algebra: Determinants, Inverses, Rank
D Linear Algebra: Determinants, Inverses, Rank D 1 Appendix D: LINEAR ALGEBRA: DETERMINANTS, INVERSES, RANK TABLE OF CONTENTS Page D.1. Introduction D 3 D.2. Determinants D 3 D.2.1. Some Properties of
More informationVector and Matrix Norms
Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty
More informationIntroduction to Matrix Algebra
Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary
More information1 Introduction to Matrices
1 Introduction to Matrices In this section, important definitions and results from matrix algebra that are useful in regression analysis are introduced. While all statements below regarding the columns
More informationInner Product Spaces and Orthogonality
Inner Product Spaces and Orthogonality week 3-4 Fall 2006 Dot product of R n The inner product or dot product of R n is a function, defined by u, v a b + a 2 b 2 + + a n b n for u a, a 2,, a n T, v b,
More informationLinear Algebra Notes for Marsden and Tromba Vector Calculus
Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of
More information8 Square matrices continued: Determinants
8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You
More informationLecture 5: Singular Value Decomposition SVD (1)
EEM3L1: Numerical and Analytical Techniques Lecture 5: Singular Value Decomposition SVD (1) EE3L1, slide 1, Version 4: 25-Sep-02 Motivation for SVD (1) SVD = Singular Value Decomposition Consider the system
More information1 VECTOR SPACES AND SUBSPACES
1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such
More informationSimilarity and Diagonalization. Similar Matrices
MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that
More informationDirect Methods for Solving Linear Systems. Matrix Factorization
Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011
More informationApplied Linear Algebra I Review page 1
Applied Linear Algebra Review 1 I. Determinants A. Definition of a determinant 1. Using sum a. Permutations i. Sign of a permutation ii. Cycle 2. Uniqueness of the determinant function in terms of properties
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationLecture 2 Matrix Operations
Lecture 2 Matrix Operations transpose, sum & difference, scalar multiplication matrix multiplication, matrix-vector product matrix inverse 2 1 Matrix transpose transpose of m n matrix A, denoted A T or
More informationEigenvalues and Eigenvectors
Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Linear equations Ax D b come from steady state problems. Eigenvalues have their greatest importance in dynamic problems. The solution
More informationx1 x 2 x 3 y 1 y 2 y 3 x 1 y 2 x 2 y 1 0.
Cross product 1 Chapter 7 Cross product We are getting ready to study integration in several variables. Until now we have been doing only differential calculus. One outcome of this study will be our ability
More informationSection 5.3. Section 5.3. u m ] l jj. = l jj u j + + l mj u m. v j = [ u 1 u j. l mj
Section 5. l j v j = [ u u j u m ] l jj = l jj u j + + l mj u m. l mj Section 5. 5.. Not orthogonal, the column vectors fail to be perpendicular to each other. 5..2 his matrix is orthogonal. Check that
More information5. Orthogonal matrices
L Vandenberghe EE133A (Spring 2016) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal
More informationChapter 17. Orthogonal Matrices and Symmetries of Space
Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length
More informationDecember 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS
December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation
More informationSolution of Linear Systems
Chapter 3 Solution of Linear Systems In this chapter we study algorithms for possibly the most commonly occurring problem in scientific computing, the solution of linear systems of equations. We start
More informationReview Jeopardy. Blue vs. Orange. Review Jeopardy
Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?
More informationSOLVING LINEAR SYSTEMS
SOLVING LINEAR SYSTEMS Linear systems Ax = b occur widely in applied mathematics They occur as direct formulations of real world problems; but more often, they occur as a part of the numerical analysis
More informationAu = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.
Chapter 7 Eigenvalues and Eigenvectors In this last chapter of our exploration of Linear Algebra we will revisit eigenvalues and eigenvectors of matrices, concepts that were already introduced in Geometry
More informationNotes on Determinant
ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without
More informationRecall the basic property of the transpose (for any A): v A t Aw = v w, v, w R n.
ORTHOGONAL MATRICES Informally, an orthogonal n n matrix is the n-dimensional analogue of the rotation matrices R θ in R 2. When does a linear transformation of R 3 (or R n ) deserve to be called a rotation?
More informationMath 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i.
Math 5A HW4 Solutions September 5, 202 University of California, Los Angeles Problem 4..3b Calculate the determinant, 5 2i 6 + 4i 3 + i 7i Solution: The textbook s instructions give us, (5 2i)7i (6 + 4i)(
More informationOperation Count; Numerical Linear Algebra
10 Operation Count; Numerical Linear Algebra 10.1 Introduction Many computations are limited simply by the sheer number of required additions, multiplications, or function evaluations. If floating-point
More informationOctober 3rd, 2012. Linear Algebra & Properties of the Covariance Matrix
Linear Algebra & Properties of the Covariance Matrix October 3rd, 2012 Estimation of r and C Let rn 1, rn, t..., rn T be the historical return rates on the n th asset. rn 1 rṇ 2 r n =. r T n n = 1, 2,...,
More informationInner Product Spaces
Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and
More informationby the matrix A results in a vector which is a reflection of the given
Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that
More informationMATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.
MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column
More information3. INNER PRODUCT SPACES
. INNER PRODUCT SPACES.. Definition So far we have studied abstract vector spaces. These are a generalisation of the geometric spaces R and R. But these have more structure than just that of a vector space.
More informationOrthogonal Diagonalization of Symmetric Matrices
MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding
More informationISOMETRIES OF R n KEITH CONRAD
ISOMETRIES OF R n KEITH CONRAD 1. Introduction An isometry of R n is a function h: R n R n that preserves the distance between vectors: h(v) h(w) = v w for all v and w in R n, where (x 1,..., x n ) = x
More informationOrthogonal Projections
Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors
More informationSolving Linear Systems, Continued and The Inverse of a Matrix
, Continued and The of a Matrix Calculus III Summer 2013, Session II Monday, July 15, 2013 Agenda 1. The rank of a matrix 2. The inverse of a square matrix Gaussian Gaussian solves a linear system by reducing
More informationUsing row reduction to calculate the inverse and the determinant of a square matrix
Using row reduction to calculate the inverse and the determinant of a square matrix Notes for MATH 0290 Honors by Prof. Anna Vainchtein 1 Inverse of a square matrix An n n square matrix A is called invertible
More informationa 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.
Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given
More information15.062 Data Mining: Algorithms and Applications Matrix Math Review
.6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop
More information3 Orthogonal Vectors and Matrices
3 Orthogonal Vectors and Matrices The linear algebra portion of this course focuses on three matrix factorizations: QR factorization, singular valued decomposition (SVD), and LU factorization The first
More informationAbstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix multiplication).
MAT 2 (Badger, Spring 202) LU Factorization Selected Notes September 2, 202 Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix
More informationLectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain
Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain 1. Orthogonal matrices and orthonormal sets An n n real-valued matrix A is said to be an orthogonal
More informationLinear Algebra Notes
Linear Algebra Notes Chapter 19 KERNEL AND IMAGE OF A MATRIX Take an n m matrix a 11 a 12 a 1m a 21 a 22 a 2m a n1 a n2 a nm and think of it as a function A : R m R n The kernel of A is defined as Note
More informationLecture 4: Partitioned Matrices and Determinants
Lecture 4: Partitioned Matrices and Determinants 1 Elementary row operations Recall the elementary operations on the rows of a matrix, equivalent to premultiplying by an elementary matrix E: (1) multiplying
More information3. Let A and B be two n n orthogonal matrices. Then prove that AB and BA are both orthogonal matrices. Prove a similar result for unitary matrices.
Exercise 1 1. Let A be an n n orthogonal matrix. Then prove that (a) the rows of A form an orthonormal basis of R n. (b) the columns of A form an orthonormal basis of R n. (c) for any two vectors x,y R
More informationLecture 3: Finding integer solutions to systems of linear equations
Lecture 3: Finding integer solutions to systems of linear equations Algorithmic Number Theory (Fall 2014) Rutgers University Swastik Kopparty Scribe: Abhishek Bhrushundi 1 Overview The goal of this lecture
More information1 Determinants and the Solvability of Linear Systems
1 Determinants and the Solvability of Linear Systems In the last section we learned how to use Gaussian elimination to solve linear systems of n equations in n unknowns The section completely side-stepped
More informationMATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set.
MATH 304 Linear Algebra Lecture 9: Subspaces of vector spaces (continued). Span. Spanning set. Vector space A vector space is a set V equipped with two operations, addition V V (x,y) x + y V and scalar
More information6. Cholesky factorization
6. Cholesky factorization EE103 (Fall 2011-12) triangular matrices forward and backward substitution the Cholesky factorization solving Ax = b with A positive definite inverse of a positive definite matrix
More informationSection 6.1 - Inner Products and Norms
Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,
More informationMatrix Algebra. Some Basic Matrix Laws. Before reading the text or the following notes glance at the following list of basic matrix algebra laws.
Matrix Algebra A. Doerr Before reading the text or the following notes glance at the following list of basic matrix algebra laws. Some Basic Matrix Laws Assume the orders of the matrices are such that
More informationThe Determinant: a Means to Calculate Volume
The Determinant: a Means to Calculate Volume Bo Peng August 20, 2007 Abstract This paper gives a definition of the determinant and lists many of its well-known properties Volumes of parallelepipeds are
More informationMAT188H1S Lec0101 Burbulla
Winter 206 Linear Transformations A linear transformation T : R m R n is a function that takes vectors in R m to vectors in R n such that and T (u + v) T (u) + T (v) T (k v) k T (v), for all vectors u
More informationThe Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression
The Singular Value Decomposition in Symmetric (Löwdin) Orthogonalization and Data Compression The SVD is the most generally applicable of the orthogonal-diagonal-orthogonal type matrix decompositions Every
More informationSystems of Linear Equations
Systems of Linear Equations Beifang Chen Systems of linear equations Linear systems A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where a, a,, a n and
More informationLinear Algebra: Vectors
A Linear Algebra: Vectors A Appendix A: LINEAR ALGEBRA: VECTORS TABLE OF CONTENTS Page A Motivation A 3 A2 Vectors A 3 A2 Notational Conventions A 4 A22 Visualization A 5 A23 Special Vectors A 5 A3 Vector
More informationMATH 551 - APPLIED MATRIX THEORY
MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points
More informationT ( a i x i ) = a i T (x i ).
Chapter 2 Defn 1. (p. 65) Let V and W be vector spaces (over F ). We call a function T : V W a linear transformation form V to W if, for all x, y V and c F, we have (a) T (x + y) = T (x) + T (y) and (b)
More informationNotes on Orthogonal and Symmetric Matrices MENU, Winter 2013
Notes on Orthogonal and Symmetric Matrices MENU, Winter 201 These notes summarize the main properties and uses of orthogonal and symmetric matrices. We covered quite a bit of material regarding these topics,
More information1 0 5 3 3 A = 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0
Solutions: Assignment 4.. Find the redundant column vectors of the given matrix A by inspection. Then find a basis of the image of A and a basis of the kernel of A. 5 A The second and third columns are
More informationDETERMINANTS TERRY A. LORING
DETERMINANTS TERRY A. LORING 1. Determinants: a Row Operation By-Product The determinant is best understood in terms of row operations, in my opinion. Most books start by defining the determinant via formulas
More informationLinear Algebraic Equations, SVD, and the Pseudo-Inverse
Linear Algebraic Equations, SVD, and the Pseudo-Inverse Philip N. Sabes October, 21 1 A Little Background 1.1 Singular values and matrix inversion For non-smmetric matrices, the eigenvalues and singular
More information7 Gaussian Elimination and LU Factorization
7 Gaussian Elimination and LU Factorization In this final section on matrix factorization methods for solving Ax = b we want to take a closer look at Gaussian elimination (probably the best known method
More informationSYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison
SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections
More informationUnit 18 Determinants
Unit 18 Determinants Every square matrix has a number associated with it, called its determinant. In this section, we determine how to calculate this number, and also look at some of the properties of
More informationLecture notes on linear algebra
Lecture notes on linear algebra David Lerner Department of Mathematics University of Kansas These are notes of a course given in Fall, 2007 and 2008 to the Honors sections of our elementary linear algebra
More informationIntroduction to Matrices for Engineers
Introduction to Matrices for Engineers C.T.J. Dodson, School of Mathematics, Manchester Universit 1 What is a Matrix? A matrix is a rectangular arra of elements, usuall numbers, e.g. 1 0-8 4 0-1 1 0 11
More informationChapter 6. Orthogonality
6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be
More informationMatrix Differentiation
1 Introduction Matrix Differentiation ( and some other stuff ) Randal J. Barnes Department of Civil Engineering, University of Minnesota Minneapolis, Minnesota, USA Throughout this presentation I have
More informationLinear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University
Linear Algebra Done Wrong Sergei Treil Department of Mathematics, Brown University Copyright c Sergei Treil, 2004, 2009, 2011, 2014 Preface The title of the book sounds a bit mysterious. Why should anyone
More informationα = u v. In other words, Orthogonal Projection
Orthogonal Projection Given any nonzero vector v, it is possible to decompose an arbitrary vector u into a component that points in the direction of v and one that points in a direction orthogonal to v
More informationNumerical Methods I Eigenvalue Problems
Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 September 30th, 2010 A. Donev (Courant Institute)
More informationLecture Notes 2: Matrices as Systems of Linear Equations
2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably
More informationNumerical Analysis Lecture Notes
Numerical Analysis Lecture Notes Peter J. Olver 6. Eigenvalues and Singular Values In this section, we collect together the basic facts about eigenvalues and eigenvectors. From a geometrical viewpoint,
More informationFigure 1.1 Vector A and Vector F
CHAPTER I VECTOR QUANTITIES Quantities are anything which can be measured, and stated with number. Quantities in physics are divided into two types; scalar and vector quantities. Scalar quantities have
More informationBindel, Spring 2012 Intro to Scientific Computing (CS 3220) Week 3: Wednesday, Feb 8
Spaces and bases Week 3: Wednesday, Feb 8 I have two favorite vector spaces 1 : R n and the space P d of polynomials of degree at most d. For R n, we have a canonical basis: R n = span{e 1, e 2,..., e
More informationVectors Math 122 Calculus III D Joyce, Fall 2012
Vectors Math 122 Calculus III D Joyce, Fall 2012 Vectors in the plane R 2. A vector v can be interpreted as an arro in the plane R 2 ith a certain length and a certain direction. The same vector can be
More informationLinearly Independent Sets and Linearly Dependent Sets
These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation
More informationNOTES ON LINEAR TRANSFORMATIONS
NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all
More informationMATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.
MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column
More informationSection 1.1. Introduction to R n
The Calculus of Functions of Several Variables Section. Introduction to R n Calculus is the study of functional relationships and how related quantities change with each other. In your first exposure to
More informationFactorization Theorems
Chapter 7 Factorization Theorems This chapter highlights a few of the many factorization theorems for matrices While some factorization results are relatively direct, others are iterative While some factorization
More informationVector Math Computer Graphics Scott D. Anderson
Vector Math Computer Graphics Scott D. Anderson 1 Dot Product The notation v w means the dot product or scalar product or inner product of two vectors, v and w. In abstract mathematics, we can talk about
More informationModélisation et résolutions numérique et symbolique
Modélisation et résolutions numérique et symbolique via les logiciels Maple et Matlab Jeremy Berthomieu Mohab Safey El Din Stef Graillat Mohab.Safey@lip6.fr Outline Previous course: partial review of what
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationMATH 304 Linear Algebra Lecture 20: Inner product spaces. Orthogonal sets.
MATH 304 Linear Algebra Lecture 20: Inner product spaces. Orthogonal sets. Norm The notion of norm generalizes the notion of length of a vector in R n. Definition. Let V be a vector space. A function α
More informationName: Section Registered In:
Name: Section Registered In: Math 125 Exam 3 Version 1 April 24, 2006 60 total points possible 1. (5pts) Use Cramer s Rule to solve 3x + 4y = 30 x 2y = 8. Be sure to show enough detail that shows you are
More informationu = [ 2 4 5] has one row with three components (a 3 v = [2 4 5] has three rows separated by semicolons (a 3 w = 2:5 generates the row vector w = [ 2 3
MATLAB Tutorial You need a small numb e r of basic commands to start using MATLAB. This short tutorial describes those fundamental commands. You need to create vectors and matrices, to change them, and
More informationMath 215 HW #6 Solutions
Math 5 HW #6 Solutions Problem 34 Show that x y is orthogonal to x + y if and only if x = y Proof First, suppose x y is orthogonal to x + y Then since x, y = y, x In other words, = x y, x + y = (x y) T
More informationElementary Matrices and The LU Factorization
lementary Matrices and The LU Factorization Definition: ny matrix obtained by performing a single elementary row operation (RO) on the identity (unit) matrix is called an elementary matrix. There are three
More informationMatrix Multiplication
Matrix Multiplication CPS343 Parallel and High Performance Computing Spring 2016 CPS343 (Parallel and HPC) Matrix Multiplication Spring 2016 1 / 32 Outline 1 Matrix operations Importance Dense and sparse
More informationMatrices and Linear Algebra
Chapter 2 Matrices and Linear Algebra 2. Basics Definition 2... A matrix is an m n array of scalars from a given field F. The individual values in the matrix are called entries. Examples. 2 3 A = 2 4 2
More information