UNCOUPLING THE PERRON EIGENVECTOR PROBLEM

Size: px
Start display at page:

Download "UNCOUPLING THE PERRON EIGENVECTOR PROBLEM"

Transcription

1 UNCOUPLING THE PERRON EIGENVECTOR PROBLEM Carl D Meyer INTRODUCTION Foranonnegative irreducible matrix m m with spectral radius ρ,afundamental problem concerns the determination of the unique normalized Perron vector π m which satisfies m π = ρπ, π > 0, π i = For relatively small values of m, this is not a difficult problem to solve using adaptations of standard techniques for solving systems of linear equations However, there exist many applications for which m is too large to be comfortably handled by standard methods For large scale problems, it is only natural to attempt to somehow uncouple the original matrix into two or more smaller matrices say P, P 2,, P k oforder r,r 2,,r k, respectively, where k i= r i = m Ideally, this sequence of smaller matrices should have the following properties i= Each smaller matrix P i should also be nonnegative and irreducible so that each P i has a unique normalized Perron vector π (i) Each smaller matrix P i should have the same spectral radius ρ as the original matrix It should be possible to determine the π (i) s completely independent of each other For modern parallel computer architectures it is desirable to be able to execute the computation of the π (i) s in parallel Finally, it must be possible to easily couple the smaller normalized Perron vectors π (i) back together in order to produce the normalized Perron vector π for the original nonnegative matrix This paper is dedicated to showing how to accomplish the above four goals 2 PERRON COMPLEMENTTION The purpose of this section is to introduce the concept of a Perron complement in a nonnegative irreducible matrix and to develop some of the basic properties of Perron complementation The concept of Perron complementation will be the cornerstone for the entire development which follows Unless otherwise stated, will denote an m m nonnegative irreducible matrix with spectral radius ρ and will be partitioned as = k Center for Research in Scientific Computation & Department of Mathematics, North Carolina State University, Box 8205, Raleigh, NC This work was supported in part by the National Science Foundation under Grant DMS-85254

2 C D Meyer Uncoupling Perron Vectors Page 2 where all diagonal blocks are square It is well known that ρi is a singular M -matrix of rank m and that every principal submatrix of ρi of order m orsmaller is a nonsingular M -matrix See Berman and Plemmons [979, pg 56] In particular, if i denotes the principal submatrix of obtained by deleting the i th row and i th column of blocks from the partitioned form of, then each ρi i is a nonsingular M -matrix Therefore, (ρi i ) 0 (2) so that the following terms are well defined DEFINITION 2 Let be an m m nonnegative irreducible matrix with spectral radius ρ and let have a k -level partition = k in which all diagonal blocks are square For a given index i, let i denote the principal block submatrix of obtained by deleting the i th row and i th column of blocks from and let i and i designate i =( i i2 i,i i,i+ ik ) and i = i i,i i+,i ki That is, i is the i th row ofblocks with ii removed and i is the i th column of blocks with ii removed The Perron complement of ii in is defined to be the matrix P ii = ii + i (ρi i ) i For example, the Perron complement of 22 in = is given by ( ρi P 22 = 22 +( 2 23 ) 3 3 ρi 33 ) ( 2 32 ) The reason for the terminology Perron complement will become clear as later developments unfold lthough the concept of Perron complementation as defined above is not the same as the well known concept

3 C D Meyer Uncoupling Perron Vectors Page 3 of Schur complementation, there is an obvious connection For example, consider a 2 -level partition of a nonnegative irreducible matrix = with spectral radius ρ ssuming square diagonal blocks, the Perron complement of is given by P = + 2 (ρi 22 ) 2 and the Perron complement of 22 is P 22 = (ρi ) 2 For this case, it is easy to see that the Perron complement of is in fact [ρi Schur Complement(ρI 22 )] in the matrix ρi and the Perron complement of 22 is [ρi Schur Complement(ρI )] in the matrix ρi The purpose of the following observations stated as technical lemmas is to help prove theorems which will establish the fact that every Perron complement is also a nonnegative irreducible matrix LEMM 2 Let be a m m nonnegative irreducible matrix partitioned as = k in which all diagonal blocks are square and suppose that the m m identity matrix I I I = I k is partitioned accordingly so that each I j and the corresponding jj have the same size If I I j 0 Q(i, j) = 0 I i I k is the elementary permutation matrix obtained by interchanging the i th and j th rows (or columns) of blocks in I, define  to be the matrix  = Q(i, j)q(i, j) The matrix  is also a nonnegative irreducible matrix and if ˆP ii denotes the Perron complement of  ii in Â, then ˆP ii = P jj, ˆP jj = P ii, and ˆP hh = P hh when h i, j

4 C D Meyer Uncoupling Perron Vectors Page 4 PROOF: The proof is conceptually straightforward and follows from the fact that  and agree everywhere except in the i th and j th block rows and i th and j th block columns LEMM 22 If is a nonnegative irreducible matrix with spectral radius ρ and if Q = Q(,i) is the elementary permutation described in Lemma 2 which corresponds to an interchange of the st and i th block positions, let  be the matrix  = QQ If  is re-partitioned into a 2 2 block matrix à as shown below,   2  k - -  =  2  22  2k = à à 2 = à (22) à 2 à 22  k  k2  kk then  = à = ii and the Perron complement of ii in is given by P ii = P = à + à 2 (ρi à 22 ) Ã2 (23) PROOF: The Perron complement of  in  is easily seen to be given by ˆP = P = à + à 2 (ρi à 22 ) Ã2 The desired conclusion follows from Lemma 2 since P ii = ˆP LEMM 23 If = k is a nonnegative irreducible matrix with spectral radius ρ, then the Perron complement of the ii -block in T is the transpose of the Perron complement of the ii -block in Inother words, if P ii is the Perron complement of ii in, then P T ii is the Perron complement of T ii in T PROOF: This is evident from the definition of Perron complementation We are now in a position to develop some of the basic properties of Perron complementation following theorem is the first in the sequence The

5 C D Meyer Uncoupling Perron Vectors Page 5 THEOREM 2 If = k is a nonnegative irreducible matrix with spectral radius ρ, then each Perron complement P ii = ii + i (ρi i ) i is also a nonnegative matrix whose spectral radius is again given by ρ Moreover, if π () π (2) π = > 0 π (k) is a conformably partitioned positive eigenvector for associated with ρ, then P ii π (i) = ρπ (i) (24) That is, π (i) > 0 is a positive eigenvector for P ii associated with the spectral radius ρ PROOF: ssume that has been permuted and re-partitioned as described in Lemma 22 so that à à à = QQ = 2 à 2 à 22 where Q = Q(,i) is the permutation matrix associated with an interchange of the st and i th block positions ccording to (23), the Perron complement of ii in is the same as the Perron complement of à in à That is, P ii = P Since each principal submatrix of ρi (and ρi Ã) oforder m or less is a nonsingular M -matrix, it follows from (2) that (ρi à 22 ) 0 and hence ) P ii = P = à + à 2 (ρi à 22 Ã2 0 Remark: P ii need not be strictly positive an example is given after this proof To prove that P ii π (i) = ρπ (i), define π Q π and write π π = Q π () = π (2) where π () = π (i) Use the facts that π = ρπ and Q 2 = I to conclude that ρ π = ρq π = Q π = QQ 2 π = à π and hence à π () + à 2 π (2) = ρ π () à 2 π () + à 22 π (2) = ρ π (2)

6 C D Meyer Uncoupling Perron Vectors Page 6 It now follows that and therefore π (2) = ( ρi à 22 ) Ã2 π () P ii π (i) = P π () = à π () + à 2 ( ρi à 22 ) Ã2 π () = à π () + à 2 π (2) = ρ π () = ρπ (i) This proves that ρ is an eigenvalue for P ii with an associated positive eigenvector given by π (i) Tosee that ρ is indeed the spectral radius of P ii, suppose instead that r is the spectral radius of P ii and let v T 0 be anonzero left hand eigenvector of P ii associated with r so that v T P ii = ρv T Itfollows that Since v T π (i) 0,itmust be the case that ρ = r ρv T π (i) = v T P ii π (i) = rv T π (i) To see that a Perron complement need not be strictly positive, consider a 4 4 nonnegative irreducible matrix whose partitions and zero pattern are shown below For this configuration, = P = + 2 (ρi 22 ) 2 = [+] ( + + +) = lthough Perron complements can have zero entries, the zeros are always in just the right places so as to guarantee that each P ii is an irreducible matrix THEOREM 22 If = k is a nonnegative irreducible matrix with spectral radius ρ, then each Perron complement P ii = ii + i (ρi i ) i is also a nonnegative irreducible matrix with spectral radius ρ

7 C D Meyer Uncoupling Perron Vectors Page 7 PROOF: Suppose that ii and hence P ii is r r If π () π (2) π = > 0 π (k) is a conformably partitioned positive eigenvector for associated with its spectral radius ρ, then Theorem 2 guarantees that π (i) > 0 is a positive eigenvector for P ii associated with its spectral radius ρ IfD is the r r diagonal matrix D = π (i) π (i) 2 π (i) r then S = D P ii D ρ is a row stochastic matrix For all row stochastic matrices, it is known that the unit eigenvalue has index ie, the unit eigenvalue for S has only linear elementary divisors See Gantmacher [960, Vol 2, pg 84] Therefore, as an eigenvalue of P ii, Index(ρ) = and hence the Jordan form for ρi P ii is J ρi Pii = 0t t 0 0 X r r where t is the algebraic multiplicity of ρ as an eigenvalue of P ii and where X is nonsingular ssume now that has been permuted and re-partitioned as described in Lemma 22 so that à à à = 2 à 2 à 22, and P ii = P By observing ( ) ( I Ã2 (ρi à 22 ) ρi à à 2 I 0 ρi P 0 I à 2 ρi à 22 (ρi à 22 ) = 0 à 2 I 0 ρi à 22 it follows that Rank(ρI Ã) =Rank(ρI P )+Rank(ρI à 22 ) Suppose Ã, Ã, and à 22 have dimensions m m, r r, and q q, respectively, with r + q = m It is well known that à being nonnegative and irreducible implies that Rank(ρI Ã) = m and Rank(ρI à 22 )=q Thus Rank(ρI P ii )=Rank(ρI P )=m q = r This together with (25) produces the conclusion that ρ must in fact be a simple eigenvalue for P ii By virtue of Lemma 23, P T ii is the Perron complement of T ii in T so that Theorem 2 guarantees P T ii also has a positive eigenvector associated with its spectral radius ρ It is known Gantmacher [960, Vol 2, pg 79] that if the spectral radius ρ of a nonnegative matrix is a simple eigenvalue and if the matrix as well as its transpose each possess a positive eigenvector associated with ρ, then the matrix must in fact be irreducible Since this is precisely the situation for the Perron complement P ii, the conclusion is that P ii must be irreducible (25) ),

8 C D Meyer Uncoupling Perron Vectors Page 8 The above proof is purely algebraic in nature However, irreducibility can be viewed strictly as a combinatorial concept because of the fact that a matrix M is irreducible if and only if its directed graph G(M) is strongly connected It is therefore desirable to also argue the irreducibility of a Perron complement from a graph theoretic point of view The author is indebted to C R Johnson for suggesting the following combinatorial proof Combinatorial Proof of Theorem 22: Forany particular Perron complement P ii of size r r, it can be assumed without loss of generality that has been permuted and repartitioned to the form n n = in which is r r and P ii becomes identified with P = + 2 (ρi 22 ) 2 To demonstrate that G(P ) is strongly connected, let h, k {, 2,,r}, and let E( ) denote the set of directed edges in the directed graph of a specified matrix Case : There is a path from node h to node k in G( ) In this case, there must also be a path from node h to node k in G(P ) because E( ) E(P ) Case 2: There is no path from node h to node k in G( ) For this situation, there must be a path from node h to node k in G() but which necessarily passes through at least one node That is, G() contains a sequence of directed edges leading from node h to node k such that i {r +,r+2,,n} h h h p i i q k k t k {(h h ), (h h 2 ),, (h p h p )} E( ), (26) {(k k 2 ), (k 2 k 3 ),, (k t k} E( ), (27) and where φ {i,i 2,,i q } {r +,r+2,,n} In particular, the existence of directed edges h p i i q k in G() guarantees that [ ] 2 q h pk This, together with the fact that 2 (ρi 22 ) 2 = j=0 implies [ 2 (ρi 22 ) 2 ] 2 j 22 2 ρ j+, so that (h p k ) E(P ) Combining this with (26) and (27) together with the fact that E( ) E(P ) leads to the desired conclusion that there is a path from node h to node k in G(P ) h pk 0

9 C D Meyer Uncoupling Perron Vectors Page 9 3 UNCOUPLING ND COUPLING THE PERRON VECTOR dopt the following definition which is consistent with the terminology used in Horn and Johnson [985] DEFINITION 3 For anonnegative irreducible matrix with spectral radius ρ, the unique normalized eigenvector π satisfying the conditions π = ρπ, π > 0, and e T π = where e T =( ) is called the Perron vector for If = k is a nonnegative irreducible matrix with spectral radius ρ, then the results of the previous section guarantee that each Perron complement P ii = ii + i (ρi i ) i is also a nonnegative irreducible matrix which again has spectral radius ρ Furthermore, if π () π (2) π = π (k) is the conformably partitioned Perron vector for, then Theorem 2 guarantees that the vector defined by π (i) p i e T π (i) is the Perron vector for the associated Perron complement P ii Inwhat follows, the normalizing scalar ξ i e T π (i) > 0 will be called the i th coupling factor Observe that the Perron vector for the larger matrix can be written in terms of the Perron vectors of the smaller Perron complements as ξ p ξ 2 p 2 π = (3) ξ k p k This illustrates that at least in theory it is possible to uncouple the Perron eigenvector problem by using Perron complementation If matrix is partitioned to k levels so as to yield k Perron complements

10 C D Meyer Uncoupling Perron Vectors Page 0 one P ii for each diagonal block then the Perron vectors p i for the P ii s can be determined independent of each other and then combined in order to construct the Perron vector π for the larger matrix However, the expressions for the coupling factors ξ i have the form ξ i = e T π (i) = h π (i) h t first glance, this might seem to place the issue in a hopeless circle because prior knowledge of π in the form of the sums h π (i) h isnecessary in order to reconstruct π from the p i s Fortunately, this is not the case The following result shows that the coupling factors ξ i can very easily be determined without prior knowledge of the π (i) s This is a key feature in the uncoupling-coupling technique DEFINITION is partitioned as with square diagonal blocks and let p i 32 Let be a nonnegative irreducible matrix with spectral radius ρ Suppose that = k be the Perron vector for the Perron complement P ii = ii + i (ρi i ) i The coupling matrix associated with is defined to be the k k matrix C =[c ij ] whose entries are given by 3 c ij e T ij p j The reason for this definition willimmediately become apparent The utility of the coupling matrix is realized in the following theorem which demonstrates how the Perron vectors of the individual Perron complements can be easily coupled together by means of the coupling matrix C in order to construct the Perron vector for THEOREM 3 Foranonnegative irreducible matrix = k with spectral radius ρ and conformably partitioned Perron vector π () π π = (2), π (k) 3 Throughout, the size of the vector e T =( ) will always be defined by the context in which it appears

11 C D Meyer Uncoupling Perron Vectors Page the associated k k coupling matrix C is also a nonnegative irreducible matrix whose spectral radius is again given by ρ Furthermore, the Perron vector for C is precisely the vector ξ ξ ξ = 2 whose components are the positive coupling factors defined earlier as ξ k ξ i = e T π (i) The vector ξ is hereafter referred to as the coupling vector associated with the partitioned matrix PROOF: It is clear from the definition of the coupling matrix that C 0 To see that C is irreducible, note that because e T > 0, ij 0, and p j > 0, it must be the case that c ij =0 if and only if ij = 0 Since is irreducible, the preceding statement implies that C must also be irreducible otherwise, if C could be permuted to a block triangular form, then so could Toshow that the coupling vector ξ ξ ξ = 2 is the Perron vector for C, use the fact ξ k p j = π (j) ξ j and compute the i th component of the product C ξ to be (Cξ) i = k c ij ξ j = j= k e T ij p j ξ j j= k = e T ij π (j) = e T ρπ (i) = ρξ i j= Thus C ξ = ρξ so that ρ is a positive eigenvalue for C associated with a positive eigenvector ξ Since C is irreducible, ρ must therefore be the spectral radius of C Because π is a normalized vector, it follows that ξ is indeed the normalized positive eigenvector and hence the Perron vector for C by observing π () k k π ξ i = e T π (i) =(e T e T e T ) = et π = i= i= π (k) By combining the observation of (3) together with Theorem 3, we arrive at the major conclusion of this paper which is summarized below as a formal statement

12 C D Meyer Uncoupling Perron Vectors Page 2 THEOREM 32 (The Coupling Theorem) Let be a nonnegative irreducible matrix with spectral radius ρ and suppose that has a k -level partition = k with square diagonal blocks If p i is the Perron vector for the Perron complement P ii = ii + i (ρi i ) i and if ξ ξ ξ = 2 is the Perron vector for the k k coupling matrix C in which then ξ k c ij = e T ij p j, ξ p ξ π = 2 p 2 ξ k p k is the Perron vector for Conversely, if the Perron vector for is given in the form of a conformably partitioned vector π () π π = (2), π (k) then ξ i = e T π (i) and π (i) ξ i is the Perron vector for the Perron complement P ii The case of a 2 -level partition is of special interest The following corollary shows that it is particularly easy to uncouple and couple the Perron eigenvector problem for these situations COROLLRY partitioned as 3 Let be a nonnegative irreducible matrix with spectral radius ρ If is = where and 22 are square, then the Perron vector for is given by ξ p π = ξ 2 p 2

13 C D Meyer Uncoupling Perron Vectors Page 3 where p and p 2 are the Perron vectors for the Perron complements P = + 2 (ρi 22 ) 2 and P 22 = (ρi ) 2, respectively, and where the coupling factors ξ and ξ 2 are given by ξ = e T 2 p 2 ρ e T p + e T 2 p 2 and ξ 2 = ξ PROOF: Simply verify that the given values of ξ and ξ 2 are the two components of the Perron vector for the coupling matrix e C = T p e T 2 p 2 e T 2 p e T 22 p 2 There is always a balancing act to be performed when uncoupling the Perron eigenvector problem using Perron complementation s k increases and the partition of becomes finer, the sizes of the Perron complements become smaller thus making it easier to determine each of the Perron vectors p i t the same time however, the size of the coupling matrix C k k becomes larger thus making it more difficult to determine the coupling factors ξ i In the two extreme cases when either k = m or k =,there is no uncoupling whatsoever because C = when k = m and P = when k = Furthermore, as the size of a Perron complement becomes smaller, the order of the matrix inversion embedded in the Perron complement becomes larger One must therefore choose the partition which best suits the needs of the underlying application For example, if computation utilizing a particular parallel architecture is the goal, then the specific nature of the hardware and associated software may dictate the partitioning strategy Rather than performing a single uncoupling-coupling operation to a high level partition of,anal- ternative is to execute a fork-join procedure using only 2 -level partitions at each stage Starting with a nonnegative irreducible matrix (with spectral radius ρ ) ofsize m m, partition roughly in half as = to produce two Perron complements, P and P 22, which are each nonnegative irreducible matrices (each having spectral radius ρ )oforder approximately m/2 The Perron complements P and P 22 may in turn be partitioned roughly in half to produce four Perron complements say (P ),(P ) 22,(P 22 ), and (P 22 ) 22 each of which is of order approximately m/4 (again, each has spectral radius ρ ) This process can continue until all Perron complements are sufficiently small in size so as to easily yield a Perron vector The small Perron vectors are then very easy to successively couple according to the rule given in Corollary 3 until the Perron vector π for the original matrix is produced t each stage, all Perron complements have spectral radius ρ so that no eigenvalue computation past the initial determination of ρ is necessary For example, consider the following 8 8 nonnegative irreducible matrix whose spectral radius is ρ 33248

14 C D Meyer Uncoupling Perron Vectors Page = For the indicated partition, the Perron complements of are given by P = and P = with coupling vector ξ = Now, the two Perron complements of P are (P ) = with coupling vector ξ = while the two Perron complements of P 22 are (P 22 ) = and (P ) 22 = and (P 22 ) 22 = ( 60 ) ( 2625 ) with coupling vector ξ 2 = The Perron vector for (P ) is given by and the Perron vector for (P ) 22 so that the Perron vector for P is p = ( 474 ) 4690 = is The arithmetic indicated in this example is not exact Numbers have been rounded to four significant digits

15 C D Meyer Uncoupling Perron Vectors Page 5 Similarly, the Perron vector for (P 22 ) is given by 5878 so that the Perron vector for P is p 2 = ( 4684 ) 5878 = and the Perron vector for (P 22 ) 22 is Therefore, the Perron vector for must be ξ p π = = = ξ 2 p In addition to the fork-join process illustrated above, there are several other variations and hybrid techniques eg, iterative methods which are possible It is clear that the remarks of this section can serve as the basis for a fully parallel algorithm for computing the Perron vector for a nonnegative irreducible matrix However, there are several substantial computational issues which must be addressed and therefore a more detailed discussion concerning parallel implementations will be considered in separate papers 4 PRIMITIVITY ISSUES Primitivity is, of course, an important issue ccordingly, it is worthwhile to make some observations concerning the degree to which primitivity or lack of primitivity in a partitioned matrix is inherited by the smaller Perron complements P ii The first observation to make is that being a primitive matrix is not sufficient to guarantee that all Perron complements are primitive For example, the matrix = is irreducible and primitive because 5 > 0 However, for the indicated partition, the Perron complement is not primitive P = 0 0 Nevertheless, it is true that if a particular diagonal block in is primitive, then the corresponding Perron complement must also be primitive

16 C D Meyer Uncoupling Perron Vectors Page 6 THEOREM 4 Let be anonnegative irreducible matrix partitioned as = k in which all diagonal blocks are square If a particular diagonal block ii Perron complement P ii must also be primitive is primitive, then the corresponding PROOF: Since ii 0 and i (I i ) i 0,itfollows that for each positive integer n, P n ii = [ ii + i (I i ) ] n i = n ii + N where N 0 Therefore, P n ii > 0 whenever n ii > 0 The following theorem explains why all but a special class of Perron complements must be primitive THEOREM 42 If ii has at least one nonzero diagonal entry, then the corresponding Perron complement P ii must be primitive PROOF: If ii has at least one nonzero diagonal entry, then so does P ii Theorems 2 and 22 guarantee that each P ii is always nonnegative and irreducible It is well known see Berman and Plemmons [979, pg 34] that an irreducible nonnegative matrix with a positive trace must be primitive Therefore, P ii must be primitive The converse of Theorem 4 as well as the converse of Theorem 42 is false The matrix = (4) is irreducible but notice that neither, 22, nor itself, is primitive Nevertheless, the corresponding Perron complements P = and P 22 = are each primitive

17 C D Meyer Uncoupling Perron Vectors Page 7 This example indicates another important advantage which Perron complementation can provide The matrix in (4) is not primitive and hence its Perron vector π cannot be computed by the simple iteration 4 x n+ = x n where x 0 is arbitrary ρ However, P and P 22 are each primitive and therefore each P ii yields a Perron vector p i by means of the straightforward iterations p (n+) i = ( Pii ρ ) p (n) i where p (0) i is arbitrary Take note of the fact that the two iterations represented here are completely independent of each other and consequently they can be implemented simultaneously By using the coupling factors described in Corollary 3, it is easy to couple p with p 2 in order to produce the Perron vector for the larger imprimitive matrix 5 SUMMRY Foranonnegative irreducible matrix which is partitioned as a matrix with square diagonal blocks m m = k which has spectral radius ρ and conformably partitioned Perron vector π () π π = (2), π (k) the concept of the Perron complement of ii is introduced to be P ii = ii + i (ρi i ) i, i =, 2,,k Perron complementation is shown to possess the following properties: Each P ii is also a nonnegative and irreducible matrix Each P ii also has spectral radius ρ The Perron vector p i for P ii is the normalized i th segment of π That is, p i = π (i) ξ i normalizing factors (also referred to as the coupling factors) are ξ i = e T π (i) ξ ξ 2 The vector ξ k = ξ k where the is the Perron vector for the k k coupling matrix C which also is a nonnegative irreducible matrix with spectral radius ρ whose entries are defined to be c ij = e T ij p j 4 The spectral radius ρ is included here for the sake of generality Notice that the matrix in (4) is column stochastic so that ρ =

18 C D Meyer Uncoupling Perron Vectors Page 8 These results allow the Perron eigenvector problem to be completely uncoupled in the sense that the Perron vector p i of each small Perron complement P ii can be determined independently from the Perron vectors of the other Perron complements By using the Perron vector ξ for the coupling matrix C, the smaller Perron vectors p i associated with the individual Perron complements can be coupled together to form the Perron vector π for the original large matrix by taking ξ p ξ π = 2 p 2 ξ k p k This work represents a generalization of the results of Meyer [987] in which the concept of stochastic complementation was introduced in order to uncouple finite Markov chain problems

19 C D Meyer Uncoupling Perron Vectors Page 9 REFERENCES Berman and R J Plemmons [979], Nonnegative Matrices In The Mathematical Sciences, cademic Press, New York F R Gantmacher [960], Matrix Theory Vol II, Chelsea, New York R Horn and C Johnson [985], Matrix nalysis, Cambridge University Press, New York C D Meyer [987], Stochastic complementation with applications to uncoupling Markov chains and the Simon-ndo theory of nearly reducible systems, NCSU Center Res Sci Comp Tech Report # 00870

Continuity of the Perron Root

Continuity of the Perron Root Linear and Multilinear Algebra http://dx.doi.org/10.1080/03081087.2014.934233 ArXiv: 1407.7564 (http://arxiv.org/abs/1407.7564) Continuity of the Perron Root Carl D. Meyer Department of Mathematics, North

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +

More information

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1. MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column

More information

7 Gaussian Elimination and LU Factorization

7 Gaussian Elimination and LU Factorization 7 Gaussian Elimination and LU Factorization In this final section on matrix factorization methods for solving Ax = b we want to take a closer look at Gaussian elimination (probably the best known method

More information

Notes on Determinant

Notes on Determinant ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without

More information

Solving Systems of Linear Equations

Solving Systems of Linear Equations LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how

More information

by the matrix A results in a vector which is a reflection of the given

by the matrix A results in a vector which is a reflection of the given Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

More information

Similarity and Diagonalization. Similar Matrices

Similarity and Diagonalization. Similar Matrices MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

More information

Lecture 3: Finding integer solutions to systems of linear equations

Lecture 3: Finding integer solutions to systems of linear equations Lecture 3: Finding integer solutions to systems of linear equations Algorithmic Number Theory (Fall 2014) Rutgers University Swastik Kopparty Scribe: Abhishek Bhrushundi 1 Overview The goal of this lecture

More information

8 Square matrices continued: Determinants

8 Square matrices continued: Determinants 8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You

More information

Systems of Linear Equations

Systems of Linear Equations Systems of Linear Equations Beifang Chen Systems of linear equations Linear systems A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where a, a,, a n and

More information

4.5 Linear Dependence and Linear Independence

4.5 Linear Dependence and Linear Independence 4.5 Linear Dependence and Linear Independence 267 32. {v 1, v 2 }, where v 1, v 2 are collinear vectors in R 3. 33. Prove that if S and S are subsets of a vector space V such that S is a subset of S, then

More information

Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction

More information

The Characteristic Polynomial

The Characteristic Polynomial Physics 116A Winter 2011 The Characteristic Polynomial 1 Coefficients of the characteristic polynomial Consider the eigenvalue problem for an n n matrix A, A v = λ v, v 0 (1) The solution to this problem

More information

Direct Methods for Solving Linear Systems. Matrix Factorization

Direct Methods for Solving Linear Systems. Matrix Factorization Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011

More information

A note on companion matrices

A note on companion matrices Linear Algebra and its Applications 372 (2003) 325 33 www.elsevier.com/locate/laa A note on companion matrices Miroslav Fiedler Academy of Sciences of the Czech Republic Institute of Computer Science Pod

More information

Suk-Geun Hwang and Jin-Woo Park

Suk-Geun Hwang and Jin-Woo Park Bull. Korean Math. Soc. 43 (2006), No. 3, pp. 471 478 A NOTE ON PARTIAL SIGN-SOLVABILITY Suk-Geun Hwang and Jin-Woo Park Abstract. In this paper we prove that if Ax = b is a partial signsolvable linear

More information

1 Solving LPs: The Simplex Algorithm of George Dantzig

1 Solving LPs: The Simplex Algorithm of George Dantzig Solving LPs: The Simplex Algorithm of George Dantzig. Simplex Pivoting: Dictionary Format We illustrate a general solution procedure, called the simplex algorithm, by implementing it on a very simple example.

More information

The Determinant: a Means to Calculate Volume

The Determinant: a Means to Calculate Volume The Determinant: a Means to Calculate Volume Bo Peng August 20, 2007 Abstract This paper gives a definition of the determinant and lists many of its well-known properties Volumes of parallelepipeds are

More information

a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.

a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2. Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given

More information

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

More information

Factorization Theorems

Factorization Theorems Chapter 7 Factorization Theorems This chapter highlights a few of the many factorization theorems for matrices While some factorization results are relatively direct, others are iterative While some factorization

More information

Solving Linear Systems, Continued and The Inverse of a Matrix

Solving Linear Systems, Continued and The Inverse of a Matrix , Continued and The of a Matrix Calculus III Summer 2013, Session II Monday, July 15, 2013 Agenda 1. The rank of a matrix 2. The inverse of a square matrix Gaussian Gaussian solves a linear system by reducing

More information

A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form

A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form Section 1.3 Matrix Products A linear combination is a sum of scalars times quantities. Such expressions arise quite frequently and have the form (scalar #1)(quantity #1) + (scalar #2)(quantity #2) +...

More information

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively.

Au = = = 3u. Aw = = = 2w. so the action of A on u and w is very easy to picture: it simply amounts to a stretching by 3 and 2, respectively. Chapter 7 Eigenvalues and Eigenvectors In this last chapter of our exploration of Linear Algebra we will revisit eigenvalues and eigenvectors of matrices, concepts that were already introduced in Geometry

More information

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i.

Math 115A HW4 Solutions University of California, Los Angeles. 5 2i 6 + 4i. (5 2i)7i (6 + 4i)( 3 + i) = 35i + 14 ( 22 6i) = 36 + 41i. Math 5A HW4 Solutions September 5, 202 University of California, Los Angeles Problem 4..3b Calculate the determinant, 5 2i 6 + 4i 3 + i 7i Solution: The textbook s instructions give us, (5 2i)7i (6 + 4i)(

More information

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued).

MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors. Jordan canonical form (continued). MATH 423 Linear Algebra II Lecture 38: Generalized eigenvectors Jordan canonical form (continued) Jordan canonical form A Jordan block is a square matrix of the form λ 1 0 0 0 0 λ 1 0 0 0 0 λ 0 0 J = 0

More information

Numerical Analysis Lecture Notes

Numerical Analysis Lecture Notes Numerical Analysis Lecture Notes Peter J. Olver 6. Eigenvalues and Singular Values In this section, we collect together the basic facts about eigenvalues and eigenvectors. From a geometrical viewpoint,

More information

COMBINATORIAL PROPERTIES OF THE HIGMAN-SIMS GRAPH. 1. Introduction

COMBINATORIAL PROPERTIES OF THE HIGMAN-SIMS GRAPH. 1. Introduction COMBINATORIAL PROPERTIES OF THE HIGMAN-SIMS GRAPH ZACHARY ABEL 1. Introduction In this survey we discuss properties of the Higman-Sims graph, which has 100 vertices, 1100 edges, and is 22 regular. In fact

More information

Lecture 1: Schur s Unitary Triangularization Theorem

Lecture 1: Schur s Unitary Triangularization Theorem Lecture 1: Schur s Unitary Triangularization Theorem This lecture introduces the notion of unitary equivalence and presents Schur s theorem and some of its consequences It roughly corresponds to Sections

More information

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix.

MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. MATH 304 Linear Algebra Lecture 18: Rank and nullity of a matrix. Nullspace Let A = (a ij ) be an m n matrix. Definition. The nullspace of the matrix A, denoted N(A), is the set of all n-dimensional column

More information

Section 6.1 - Inner Products and Norms

Section 6.1 - Inner Products and Norms Section 6.1 - Inner Products and Norms Definition. Let V be a vector space over F {R, C}. An inner product on V is a function that assigns, to every ordered pair of vectors x and y in V, a scalar in F,

More information

13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions.

13 MATH FACTS 101. 2 a = 1. 7. The elements of a vector have a graphical interpretation, which is particularly easy to see in two or three dimensions. 3 MATH FACTS 0 3 MATH FACTS 3. Vectors 3.. Definition We use the overhead arrow to denote a column vector, i.e., a linear segment with a direction. For example, in three-space, we write a vector in terms

More information

IRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL. 1. Introduction

IRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL. 1. Introduction IRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL R. DRNOVŠEK, T. KOŠIR Dedicated to Prof. Heydar Radjavi on the occasion of his seventieth birthday. Abstract. Let S be an irreducible

More information

DETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH

DETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH DETERMINANTS IN THE KRONECKER PRODUCT OF MATRICES: THE INCIDENCE MATRIX OF A COMPLETE GRAPH CHRISTOPHER RH HANUSA AND THOMAS ZASLAVSKY Abstract We investigate the least common multiple of all subdeterminants,

More information

160 CHAPTER 4. VECTOR SPACES

160 CHAPTER 4. VECTOR SPACES 160 CHAPTER 4. VECTOR SPACES 4. Rank and Nullity In this section, we look at relationships between the row space, column space, null space of a matrix and its transpose. We will derive fundamental results

More information

Math 4310 Handout - Quotient Vector Spaces

Math 4310 Handout - Quotient Vector Spaces Math 4310 Handout - Quotient Vector Spaces Dan Collins The textbook defines a subspace of a vector space in Chapter 4, but it avoids ever discussing the notion of a quotient space. This is understandable

More information

1.2 Solving a System of Linear Equations

1.2 Solving a System of Linear Equations 1.. SOLVING A SYSTEM OF LINEAR EQUATIONS 1. Solving a System of Linear Equations 1..1 Simple Systems - Basic De nitions As noticed above, the general form of a linear system of m equations in n variables

More information

NOTES ON LINEAR TRANSFORMATIONS

NOTES ON LINEAR TRANSFORMATIONS NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all

More information

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation

More information

Row Echelon Form and Reduced Row Echelon Form

Row Echelon Form and Reduced Row Echelon Form These notes closely follow the presentation of the material given in David C Lay s textbook Linear Algebra and its Applications (3rd edition) These notes are intended primarily for in-class presentation

More information

Solution of Linear Systems

Solution of Linear Systems Chapter 3 Solution of Linear Systems In this chapter we study algorithms for possibly the most commonly occurring problem in scientific computing, the solution of linear systems of equations. We start

More information

THE DIMENSION OF A VECTOR SPACE

THE DIMENSION OF A VECTOR SPACE THE DIMENSION OF A VECTOR SPACE KEITH CONRAD This handout is a supplementary discussion leading up to the definition of dimension and some of its basic properties. Let V be a vector space over a field

More information

I. GROUPS: BASIC DEFINITIONS AND EXAMPLES

I. GROUPS: BASIC DEFINITIONS AND EXAMPLES I GROUPS: BASIC DEFINITIONS AND EXAMPLES Definition 1: An operation on a set G is a function : G G G Definition 2: A group is a set G which is equipped with an operation and a special element e G, called

More information

SOLVING LINEAR SYSTEMS

SOLVING LINEAR SYSTEMS SOLVING LINEAR SYSTEMS Linear systems Ax = b occur widely in applied mathematics They occur as direct formulations of real world problems; but more often, they occur as a part of the numerical analysis

More information

1 VECTOR SPACES AND SUBSPACES

1 VECTOR SPACES AND SUBSPACES 1 VECTOR SPACES AND SUBSPACES What is a vector? Many are familiar with the concept of a vector as: Something which has magnitude and direction. an ordered pair or triple. a description for quantities such

More information

DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II. Matrix Algorithms DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

More information

A Spectral Clustering Approach to Validating Sensors via Their Peers in Distributed Sensor Networks

A Spectral Clustering Approach to Validating Sensors via Their Peers in Distributed Sensor Networks A Spectral Clustering Approach to Validating Sensors via Their Peers in Distributed Sensor Networks H. T. Kung Dario Vlah {htk, dario}@eecs.harvard.edu Harvard School of Engineering and Applied Sciences

More information

ELA http://math.technion.ac.il/iic/ela

ELA http://math.technion.ac.il/iic/ela SIGN PATTERNS THAT ALLOW EVENTUAL POSITIVITY ABRAHAM BERMAN, MINERVA CATRAL, LUZ M. DEALBA, ABED ELHASHASH, FRANK J. HALL, LESLIE HOGBEN, IN-JAE KIM, D. D. OLESKY, PABLO TARAZAGA, MICHAEL J. TSATSOMEROS,

More information

THE $25,000,000,000 EIGENVECTOR THE LINEAR ALGEBRA BEHIND GOOGLE

THE $25,000,000,000 EIGENVECTOR THE LINEAR ALGEBRA BEHIND GOOGLE THE $5,,, EIGENVECTOR THE LINEAR ALGEBRA BEHIND GOOGLE KURT BRYAN AND TANYA LEISE Abstract. Google s success derives in large part from its PageRank algorithm, which ranks the importance of webpages according

More information

Similar matrices and Jordan form

Similar matrices and Jordan form Similar matrices and Jordan form We ve nearly covered the entire heart of linear algebra once we ve finished singular value decompositions we ll have seen all the most central topics. A T A is positive

More information

Vector and Matrix Norms

Vector and Matrix Norms Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty

More information

Linear Algebra: Determinants, Inverses, Rank

Linear Algebra: Determinants, Inverses, Rank D Linear Algebra: Determinants, Inverses, Rank D 1 Appendix D: LINEAR ALGEBRA: DETERMINANTS, INVERSES, RANK TABLE OF CONTENTS Page D.1. Introduction D 3 D.2. Determinants D 3 D.2.1. Some Properties of

More information

1 Introduction to Matrices

1 Introduction to Matrices 1 Introduction to Matrices In this section, important definitions and results from matrix algebra that are useful in regression analysis are introduced. While all statements below regarding the columns

More information

SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH

SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH 31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,

More information

Elementary Matrices and The LU Factorization

Elementary Matrices and The LU Factorization lementary Matrices and The LU Factorization Definition: ny matrix obtained by performing a single elementary row operation (RO) on the identity (unit) matrix is called an elementary matrix. There are three

More information

Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs

Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs CSE599s: Extremal Combinatorics November 21, 2011 Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs Lecturer: Anup Rao 1 An Arithmetic Circuit Lower Bound An arithmetic circuit is just like

More information

6. Cholesky factorization

6. Cholesky factorization 6. Cholesky factorization EE103 (Fall 2011-12) triangular matrices forward and backward substitution the Cholesky factorization solving Ax = b with A positive definite inverse of a positive definite matrix

More information

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison

SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89. by Joseph Collison SYSTEMS OF EQUATIONS AND MATRICES WITH THE TI-89 by Joseph Collison Copyright 2000 by Joseph Collison All rights reserved Reproduction or translation of any part of this work beyond that permitted by Sections

More information

Solution to Homework 2

Solution to Homework 2 Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

More information

Linear Codes. Chapter 3. 3.1 Basics

Linear Codes. Chapter 3. 3.1 Basics Chapter 3 Linear Codes In order to define codes that we can encode and decode efficiently, we add more structure to the codespace. We shall be mainly interested in linear codes. A linear code of length

More information

Notes on Factoring. MA 206 Kurt Bryan

Notes on Factoring. MA 206 Kurt Bryan The General Approach Notes on Factoring MA 26 Kurt Bryan Suppose I hand you n, a 2 digit integer and tell you that n is composite, with smallest prime factor around 5 digits. Finding a nontrivial factor

More information

A characterization of trace zero symmetric nonnegative 5x5 matrices

A characterization of trace zero symmetric nonnegative 5x5 matrices A characterization of trace zero symmetric nonnegative 5x5 matrices Oren Spector June 1, 009 Abstract The problem of determining necessary and sufficient conditions for a set of real numbers to be the

More information

A Direct Numerical Method for Observability Analysis

A Direct Numerical Method for Observability Analysis IEEE TRANSACTIONS ON POWER SYSTEMS, VOL 15, NO 2, MAY 2000 625 A Direct Numerical Method for Observability Analysis Bei Gou and Ali Abur, Senior Member, IEEE Abstract This paper presents an algebraic method

More information

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013 Notes on Orthogonal and Symmetric Matrices MENU, Winter 201 These notes summarize the main properties and uses of orthogonal and symmetric matrices. We covered quite a bit of material regarding these topics,

More information

LINEAR ALGEBRA. September 23, 2010

LINEAR ALGEBRA. September 23, 2010 LINEAR ALGEBRA September 3, 00 Contents 0. LU-decomposition.................................... 0. Inverses and Transposes................................. 0.3 Column Spaces and NullSpaces.............................

More information

CONTROLLABILITY. Chapter 2. 2.1 Reachable Set and Controllability. Suppose we have a linear system described by the state equation

CONTROLLABILITY. Chapter 2. 2.1 Reachable Set and Controllability. Suppose we have a linear system described by the state equation Chapter 2 CONTROLLABILITY 2 Reachable Set and Controllability Suppose we have a linear system described by the state equation ẋ Ax + Bu (2) x() x Consider the following problem For a given vector x in

More information

Introduction to Matrix Algebra

Introduction to Matrix Algebra Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary

More information

LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

More information

[1] Diagonal factorization

[1] Diagonal factorization 8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:

More information

3 Orthogonal Vectors and Matrices

3 Orthogonal Vectors and Matrices 3 Orthogonal Vectors and Matrices The linear algebra portion of this course focuses on three matrix factorizations: QR factorization, singular valued decomposition (SVD), and LU factorization The first

More information

10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method

10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method 578 CHAPTER 1 NUMERICAL METHODS 1. ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS As a numerical technique, Gaussian elimination is rather unusual because it is direct. That is, a solution is obtained after

More information

Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix multiplication).

Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix multiplication). MAT 2 (Badger, Spring 202) LU Factorization Selected Notes September 2, 202 Abstract: We describe the beautiful LU factorization of a square matrix (or how to write Gaussian elimination in terms of matrix

More information

Split Nonthreshold Laplacian Integral Graphs

Split Nonthreshold Laplacian Integral Graphs Split Nonthreshold Laplacian Integral Graphs Stephen Kirkland University of Regina, Canada kirkland@math.uregina.ca Maria Aguieiras Alvarez de Freitas Federal University of Rio de Janeiro, Brazil maguieiras@im.ufrj.br

More information

Lecture L3 - Vectors, Matrices and Coordinate Transformations

Lecture L3 - Vectors, Matrices and Coordinate Transformations S. Widnall 16.07 Dynamics Fall 2009 Lecture notes based on J. Peraire Version 2.0 Lecture L3 - Vectors, Matrices and Coordinate Transformations By using vectors and defining appropriate operations between

More information

Modeling and Performance Evaluation of Computer Systems Security Operation 1

Modeling and Performance Evaluation of Computer Systems Security Operation 1 Modeling and Performance Evaluation of Computer Systems Security Operation 1 D. Guster 2 St.Cloud State University 3 N.K. Krivulin 4 St.Petersburg State University 5 Abstract A model of computer system

More information

Applied Linear Algebra I Review page 1

Applied Linear Algebra I Review page 1 Applied Linear Algebra Review 1 I. Determinants A. Definition of a determinant 1. Using sum a. Permutations i. Sign of a permutation ii. Cycle 2. Uniqueness of the determinant function in terms of properties

More information

Practical Guide to the Simplex Method of Linear Programming

Practical Guide to the Simplex Method of Linear Programming Practical Guide to the Simplex Method of Linear Programming Marcel Oliver Revised: April, 0 The basic steps of the simplex algorithm Step : Write the linear programming problem in standard form Linear

More information

Bounds on the spectral radius of a Hadamard product of nonnegative or positive semidefinite matrices

Bounds on the spectral radius of a Hadamard product of nonnegative or positive semidefinite matrices Electronic Journal of Linear Algebra Volume 20 Volume 20 (2010) Article 6 2010 Bounds on the spectral radius of a Hadamard product of nonnegative or positive semidefinite matrices Roger A. Horn rhorn@math.utah.edu

More information

Classification of Cartan matrices

Classification of Cartan matrices Chapter 7 Classification of Cartan matrices In this chapter we describe a classification of generalised Cartan matrices This classification can be compared as the rough classification of varieties in terms

More information

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components

Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components Eigenvalues, Eigenvectors, Matrix Factoring, and Principal Components The eigenvalues and eigenvectors of a square matrix play a key role in some important operations in statistics. In particular, they

More information

Solving Systems of Linear Equations

Solving Systems of Linear Equations LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how

More information

MA106 Linear Algebra lecture notes

MA106 Linear Algebra lecture notes MA106 Linear Algebra lecture notes Lecturers: Martin Bright and Daan Krammer Warwick, January 2011 Contents 1 Number systems and fields 3 1.1 Axioms for number systems......................... 3 2 Vector

More information

General Framework for an Iterative Solution of Ax b. Jacobi s Method

General Framework for an Iterative Solution of Ax b. Jacobi s Method 2.6 Iterative Solutions of Linear Systems 143 2.6 Iterative Solutions of Linear Systems Consistent linear systems in real life are solved in one of two ways: by direct calculation (using a matrix factorization,

More information

Chapter 17. Orthogonal Matrices and Symmetries of Space

Chapter 17. Orthogonal Matrices and Symmetries of Space Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length

More information

Orthogonal Diagonalization of Symmetric Matrices

Orthogonal Diagonalization of Symmetric Matrices MATH10212 Linear Algebra Brief lecture notes 57 Gram Schmidt Process enables us to find an orthogonal basis of a subspace. Let u 1,..., u k be a basis of a subspace V of R n. We begin the process of finding

More information

Quotient Rings and Field Extensions

Quotient Rings and Field Extensions Chapter 5 Quotient Rings and Field Extensions In this chapter we describe a method for producing field extension of a given field. If F is a field, then a field extension is a field K that contains F.

More information

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION

4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION 4: EIGENVALUES, EIGENVECTORS, DIAGONALIZATION STEVEN HEILMAN Contents 1. Review 1 2. Diagonal Matrices 1 3. Eigenvectors and Eigenvalues 2 4. Characteristic Polynomial 4 5. Diagonalizability 6 6. Appendix:

More information

DETERMINANTS TERRY A. LORING

DETERMINANTS TERRY A. LORING DETERMINANTS TERRY A. LORING 1. Determinants: a Row Operation By-Product The determinant is best understood in terms of row operations, in my opinion. Most books start by defining the determinant via formulas

More information

MATH 551 - APPLIED MATRIX THEORY

MATH 551 - APPLIED MATRIX THEORY MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points

More information

Notes on Symmetric Matrices

Notes on Symmetric Matrices CPSC 536N: Randomized Algorithms 2011-12 Term 2 Notes on Symmetric Matrices Prof. Nick Harvey University of British Columbia 1 Symmetric Matrices We review some basic results concerning symmetric matrices.

More information

( ) which must be a vector

( ) which must be a vector MATH 37 Linear Transformations from Rn to Rm Dr. Neal, WKU Let T : R n R m be a function which maps vectors from R n to R m. Then T is called a linear transformation if the following two properties are

More information

BANACH AND HILBERT SPACE REVIEW

BANACH AND HILBERT SPACE REVIEW BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but

More information

October 3rd, 2012. Linear Algebra & Properties of the Covariance Matrix

October 3rd, 2012. Linear Algebra & Properties of the Covariance Matrix Linear Algebra & Properties of the Covariance Matrix October 3rd, 2012 Estimation of r and C Let rn 1, rn, t..., rn T be the historical return rates on the n th asset. rn 1 rṇ 2 r n =. r T n n = 1, 2,...,

More information

LEARNING OBJECTIVES FOR THIS CHAPTER

LEARNING OBJECTIVES FOR THIS CHAPTER CHAPTER 2 American mathematician Paul Halmos (1916 2006), who in 1942 published the first modern linear algebra book. The title of Halmos s book was the same as the title of this chapter. Finite-Dimensional

More information

. 0 1 10 2 100 11 1000 3 20 1 2 3 4 5 6 7 8 9

. 0 1 10 2 100 11 1000 3 20 1 2 3 4 5 6 7 8 9 Introduction The purpose of this note is to find and study a method for determining and counting all the positive integer divisors of a positive integer Let N be a given positive integer We say d is a

More information

Inner products on R n, and more

Inner products on R n, and more Inner products on R n, and more Peyam Ryan Tabrizian Friday, April 12th, 2013 1 Introduction You might be wondering: Are there inner products on R n that are not the usual dot product x y = x 1 y 1 + +

More information

Linear Algebra Review. Vectors

Linear Algebra Review. Vectors Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka kosecka@cs.gmu.edu http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa Cogsci 8F Linear Algebra review UCSD Vectors The length

More information

Chapter 3. Cartesian Products and Relations. 3.1 Cartesian Products

Chapter 3. Cartesian Products and Relations. 3.1 Cartesian Products Chapter 3 Cartesian Products and Relations The material in this chapter is the first real encounter with abstraction. Relations are very general thing they are a special type of subset. After introducing

More information