# 6.042/18.062J Mathematics for Computer Science October 3, 2006 Tom Leighton and Ronitt Rubinfeld. Graph Theory III

Save this PDF as:

Size: px
Start display at page:

Download "6.042/18.062J Mathematics for Computer Science October 3, 2006 Tom Leighton and Ronitt Rubinfeld. Graph Theory III"

## Transcription

1 6.04/8.06J Mathematics for Computer Science October 3, 006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Graph Theory III Draft: please check back in a couple of days for a modified version of these notes. Trees Today we ll talk about a very special class of graphs called trees. Trees arise in all sorts of applications and you ll see them in just about every computer science class that you ll take at MIT. There are at least half a dozen ways to define a tree, but the simplest is the following. Definition. A tree is a simple, connected, acyclic graph. For example, a tree might look like this. On the other hand, this is not a tree and neither is this Recall that we only consider simple graphs in this class, that is, graphs without loops or multiple edges.

2 Graph Theory III Sometimes we ll draw trees in a leveled fashion, in which case we can identify the top node as the root, and every edge joints a parent to a child. Root Parent Child The nodes at the bottom of degree are called leaves. Definition. A leaf is a node in a tree with degree. For example, in the tree above there are 5 leaves. It turns out that no matter how we draw a tree, every tree with more than node always has some leaves. Leaf Theorem. Every tree with more than node has at least one leaf. Proof. We prove the theorem by contradiction. Suppose it is not true. Then there exists a tree T = (V, E) where every node has degree at least. Let P = v, v,..., v m be a path of maximum length in T, i.e., there is no path with m + or more nodes in T (recall that all nodes in a path are distinct by definition). Note that we are implicitly using the well-ordering principle here. Since V and T is connected, such a P exists and we have m n. Since T has minimum degree at least by assumption, v m is joined to at least nodes. In particular, there is a node x v m such that {v m, x} E. Since P has maximum length, v, v,..., v m, x is not a path, which means x = v i for some i < m. But then v i, v i+,..., v m, v m, v i is a cycle in T. But T is a tree, and so by definition contains no cycle. This is a contradiction. As it turns out, every tree has at least leaves, which you ll prove in the problem sets. There is also a close correlation between the number of nodes and number of edges in a tree. In the previous example we saw that N = 7 and E = 6. We also have the following examples. N = 4 N = 3 E = 3 E = Naturally this leads us to guess,

3 Graph Theory III 3 Theorem. For any tree T = (V, E), E = V. Proof. We prove the theorem by induction on the number of nodes N. Our inductive hypothesis P (N) is that every N-node tree has exactly N edges. For the base case, i.e., to show P (), we just note that every node graph has no edges. Now assume that P (N) holds for some N, and let s show that P (N + ) holds. Consider any (N + )-node tree T. Let v be a leaf of T. We know by the previous theorem that such a leaf v exists. Let T = (V, E ) be the tree formed by removing v and its incident edge from T. T v We first claim that T is in fact a tree. Since T is connected, so is T since we have only removed a leaf. Moreover, removing vertices or edges cannot create any new cycles, so T is also acyclic. Thus T is a tree. By our inductive hypothesis, it follows that E = V. Now, we formed E by removing one edge of E. Thus E = E. Similarly, V = V. Since E = V, this means E = V, or E = V, which shows P (N + ), and completes the proof. In fact, in the problems sets you will show the converse: Theorem 3. Any connected, N-node graph with N edges is a tree. Note that we need to assume the graph is connected, as otherwise the following graph would be a counterexample. Besides this theorem, there are many other ways to characterize a tree, though we won t cover them here. Graphs typically contain lots of trees as subgraphs. Of special interest are trees that contain every node of the graph. Such tree are called spanning trees.

4 4 Graph Theory III Definition. A tree T = (V, E) is a spanning tree for a graph G = (V, E ) if V = V and E E. The following figure shows a spanning tree T inside of a graph G. = T Spanning trees are interesting because they connect all the nodes of a graph using the smallest possible number of edges. For example, in the graph above there are 7 edges in the spanning tree, while there are 8 vertices in the graph. It is not hard to show that any connected graph contains a spanning tree, and often lots of them. Spanning trees are very useful in practice, but in the real world, not all spanning trees are equally desirable. That s because, in practice, there are often costs associated with the edges of the graph. For example, suppose the nodes of a graph represent buildings or towns and edges represent connections between buildings or towns. The cost to actually make a connection may vary a lot from one pair of buildings or towns to another. The cost might depend on distance or topography. For example, the cost to connect LA to NY might be much higher than that to connect NY to Boston. Or the cost of a pipe through Manhatten might be more than the cost of a pipe through a cornfield. In any case, we typically represent the cost to connect pairs of nodes with a weighted edge, where the weight of the edge is its cost The weight of a spanning tree is then just the sum of the weights of the edges in the tree. For example, the weight of the following spanning tree is 9.

5 Graph Theory III The goal, of course, is to find the spanning tree with minimum weight, called the minweight spanning tree (MST) for short. Definition. The min-weight spanning tree (MST) of an edge-weighted graph G is the spanning tree of G with the smallest possible sum of edge weights. Is the spanning tree above an MST of the weighted graph we presented? Actually, it is not, since the following tree is also a spanning tree of our graph, of cost only Now is this spanning tree an MST? It seems to be, but how do we prove it? In general, how do we find an MST? We could, of course, enumerate all trees, but this could take forever for very large graphs. Here are two possible algorithms: ALG:. Grow a tree one edge at a time by adding the minimum weight edge of the graph to the tree, making sure that you have a tree at each step. ALG:. Select edges one at a time, always choosing the minimum weight edge that does not create a cycle with previously selected edges. We do not impose the constraint that the graph is a tree - our selected edges may indeed form a disconnected graph.

6 6 Graph Theory III. Continue until we get N edges, i.e., a spanning tree. For example, in the weighted graph we have been considering, we might run ALG as follows. We would start by choosing one of the weight edges, since this is the smallest weight in the graph. Suppose we chose the weight edge on the bottom of the triangle of weight edges in our graph. This edge is incident to two weight edges, a weight 4 edge, a weight 7 edge, and a weight 3 edge. We would then choose the incident edge of minimum weight. In this case, one of the two weight one edges. At this point, we cannot choose the third weight edge since this would form a cycle, but we can continue by choosing a weight edge. We might end up with the following spanning tree, which has weight 7, the smallest we ve seen so far. 3 7 Now suppose we instead ran ALG on our graph. We might again choose the weight edge on the bottom of the triangle of weight edges in our graph. Now, instead of choosing one of the weight edges it touches, we might choose the weight edge on the top of the graph. Note that this edge still has minimum weight, and does not cause us to form a cycle, so ALG can choose it. We would then choose one of the remaining weight edges. Note that neither causes us to form a cycle. Continuing the algorithm, we may end up with the same spanning tree as above, though this need not always be the case. It turns out that both algorithms work, but they might end up with different MSTs. The MST is not necessarily unique - indeed, if all edges of an N-node graph have the same weight (= ), then all spanning trees have weight N. These are examples of greedy approaches to optimization. Sometimes it works and sometimes it doesn t. The good news is that it works to find the MST. In fact, both variations of ALG work. It s a little easier to prove it for ALG so we ll do that one here. Theorem. For any connected, weighted graph G, ALG produces an MST for G. Proof. The proof is a bit tricky. We need to show the algorithm terminates, i.e., if we have selected < N edges, then we can always find an edge to add that does not create a cycle. We also need to show the algorithm creates a tree of minimum weight. The key to doing all of this is to show that the algorithm never gets stuck or goes in a bad direction by adding an edge that will keep us from ultimately producing an MST. The

7 Graph Theory III 7 natural way to prove this is to show that the set of edges selected at any point is contain in some MST - i.e., we can always get to where we need to be. We ll state this as a Lemma. Lemma 4. For any m 0, let S consist of the first m edges selected by ALG. Then there exists some MST T = (V, E) for G s.t. S E, i.e., the set of edges we are growing is always contained in some MST. We ll prove this momentarily, but first let s see why it helps prove the theorem. Assume the lemma is true. Then how do we know ALG can always find an edge to add without creating a cycle? Well, as long as there are < N edges picked, there exists some edge in T \ S and so the tree has no cycle. Next, how do we know that we get an MST at the end? Well, once M = N, we know that S is a tree Okay, so the theorem is an easy corollary of the lemma. Let s prove the lemma. Any ideas how to proceed? We ll use induction on the number of edges chosen by the algorithm so far. This is very typical in proving an algorithm preserves some kind of invariant condition - induct on the number of steps taken, i.e., the number of edges added. Our inductive hypothesis is the following: P (m): For any G and any set S of m edges initially selected by ALG, there exists an MST T = (V, E) of G such that S E. For the base case, we need to show P (0). In this case S =, so S E trivially holds for any MST T = (V, E). For the inductive step, we assume P (m) holds and we show that it implies P (m + ). Let e denote the (m + )st edge selected by ALG, and let S denote the first m edges selected by ALG. Let T = (V, E ) be the MST such that S E, which exists by the inductive hypothesis. There are now two cases. In the first case, e E, in which case S {e} E, and thus P (m + ) holds. In the second case, e / E, as illustrated by the following diagram. Now we need to find a different MST that contains S and e. e S = e E* = S U { } e = (m+)st edge What happens when we add e to T? Well since T is a tree, we get a cycle. Moreover, the cycle cannot only contain edges in S, since e was chosen so that together with the edges in S, it does not form a cycle. This implies that e T contains a cycle that contains an edge e of E \ S. See the figure above.

8 8 Graph Theory III Now, we claim that the weight of e is at most that of e. Indeed, ALG picks the minimum weight edge that does not make a cycle with S. Note that e T so it cannot make a cycle with S. Okay, we re almost done. Now we ll make an MST that contains S {e}. Let T = (V, E ) where E = (E {e }) {e}, that is, we swap e and e in T. Claim. T is an MST. Proof. We first show that T is a spanning tree. We have E = E = N so T has N edges. Moreover, T is still connected since we deleted an edge of e T to form T, and that edge was on a cycle. It follows by Theorem that T is a spanning tree. Next, let s look at the weight of T. Well, since the weight of e was at most that of e, the weight of T is at most that of T, and thus T is an MST. Since S {e} E, P (m + ) holds. Thus, when ALG has N edges, it produces an MST. So now we know for sure that the MST for our example graph has weight 7 since it was produced by ALG. Directed Graphs So far we have been working with graphs with undirected edges. Graphs with directed edges are also very useful in computer science. A directed edge is an edge where the endpoints are distinguished - one is the head and one is the tail. Thus its endpoints as forming an ordered pair. tail head B A A graph with directed edges is called an directed graph, or digraph. These graphs can have directed edges in both directions: e = (B,A) B e = (A,B) A Note that we treat e and e as different edges in the graph above. With directed graphs, the notion of degree splits into indegree and outdegree. In the following digraph indegree(d) = while outdegree(d) =.

9 Graph Theory III 9 B A C Directed graphs arise in all sorts of applications. One interesting example is the digraph that represents the hyperlink structure of the World Wide Web. In this example, every page or file is represented by a node and there is a directed edge from node x to node y if the page associated with x has a link to the page associated with y. For example, in the following graph the vertices V = {x,..., x N } are web pages and x i x j if x i contains a hyperlink to x j. x3 x4 D x7 x x x5 x6 The web graph is an enormous graph with many billions and probably even trillions of nodes. At first glance, this graph wouldn t seem to be very interesting. But in 995, two students at Stanford, Larry Page and Sergey Brin realized that the structure of this graph could be very useful in building a search engine. Traditional document searching programs had been around for a long time and they worked in a fairly straighforward way. Basically, you would enter some search terms and the searching program would return all documents containing those terms. A relevance score might also be returned for each document based on the frequency or position that the search terms appeared in the document. For example, if the search term appeared in the title or appeared 00 times in a document, that document would get a higher score. (So if an author wanted a document to get a higher score for certain keywords, the would put the keywords in the title and make it appear in lots of places. You can even see this today with some bogus web sites.) This approach works fine if you only have a few documents that match a search term. But on the web, there are billions of documents and millions of matches to a typical search. For example, doing a search on Google for math computer science notes gives over 7 million hits! How do you decide which 0 or 0 to show first? (If someone pays then

10 0 Graph Theory III maybe it s OK, but what about the people who don t??) Probably you don t want to pick the ones that have these words lots of times: math math... math across the front of the document. Now in this case, the 3rd ranked hit was for the Spring 006 class notes for Google did not know I was interested in MIT - how on earth did they pick 6.04 to be third out of 7 million? Incidentally, the number was Elsevier - books for sale, and the number was the reference list for the University of Paderborn. Well back in 995, Larry and Sergey got the idea to exploit the structure of the web graph to figure out which pages are likely to be the most important and then they would show those first in response to a search request. Looking at the web graph, any idea which node/page might be the best to rank st? Assume that all the pages match the search terms for now. Well, intuitively, we should choose x since lots of other pages point to it. This leads us to their first idea. Define the page rank of x to equal indegree(x), which we denote as P R(x). Then, of the pages that match the search terms, list those with the highest page rank first. The idea is to think of web pages as voting for the most important page - the more votes, the better rank. Of course, there are some problems with this idea. Suppose you wanted to have your page get a high ranking. One thing you could do is to create lots of dummy pages with links to your page. +n There is another problem - one page might have a lot of links, thereby increasing the rank of lots of other pages This is sort of like the expression, vote early, vote often, and this is not good if you want to build a search engine with real money involved.

11 Graph Theory III So, admittedly, their original idea was not so great. It was better than nothing, but certainly not worth billions of dollars. But then Sergey and Larry thought some more and came up with a couple of improvements. To solve the vote early, vote often problem, they decided to weight each vote so that any page gets at most one total vote. This is done by dividing the vote equally among outgoing links so if a node has outdegree d, every link gets /d of the vote. So now every edge has weight /outdegree(x) if its tail is x. x /3 /3 /3 Now any page has the same impact regardless of the number of links it has. To solve the dummy page problem making your page look more important, they decided to weight the vote of a page by its PageRank! The hope is that dummy pages will have low page rank and thus won t influence the average rank of real pages. In particular, they defined the page rank of a node x by solving the following system of linear equations: find {P R(x)} such that x, P R(x) = For example, in our web graph, we have i x i x P R(x 4 ) = P R(x 7) P R(x i ) outdegree(x i ). + P R(x ). One can think of this as x 7 sending of its page rank to x and the other half to x 4. x sends all of its page rank to x 4. This provides a system of N equations in N variables where N is the number of nodes, or pages, and the variables are the page ranks. At first glance, it s not even clear that there is a solution to this system of equations other than the solution where all the pageranks are zero, which is not very interesting. Indeed, you ll consider a variation of this scheme in the problem sets, where there is no good solution. But Sergey and Larry were smart fellows and they set up their page rank algorithm so it would always have a meaningful solution (all PR values of 0, for instance, is not helpful). Furthermore, there will always be a meaningful solution that is non-negative

12 Graph Theory III and for which the sums of the page ranks is equal to, and we will consider only such solutions. In fact, it turns out that the page rank computed for a page is the probability that a surfer lands on that page after a long random walk through the web starting from a random page (and clicking on links uniformly). We ll talk more about randomness later in the course, but you can intuitively see why this might be true. The probability of being at x 4 at time T is just Pr[ at x 7 at time T ]/ + Pr[ at x at time T ]/. This matches the page rank formula. Cool, right? There is still the problem of figuring out how to solve the system of equations to compute the page ranks. To do this, it is helpful to represent the web graph by its adjacency matrix. Definition. The adjacency matrix for an N-node graph G = (V, E) is the N N matrix A = {a i,j } where a i,j = if and only if (x i, x j ) E. For example, the following graph x G = x x3 would have adjacency matrix That is, x points to x, x points to x and x 3, and x 3 has no outgoing edges. For a weighted graph, the weighted adjacency matrix is W = {w i,j }, where w i,j is the weight on edge i j if (i, j) E, and is 0 otherwise. For example, the graph x x3 / / x

13 Graph Theory III 3 would have adjacency matrix Now for Sergey and Larry s graph, the edge weights are just /outdegree(x) for nodes x. The row sums in such a weighted graph must equal 0 or since in the xth row, each non-zero entry, if any, has weight /outdegree(x). Of course some rows may have zero sum, and these correspond to pages with no hyperlinks out, i.e., nodes with outdegree 0. These nodes are called sinks in a digraph because once you are there, you can t get out. Definition. A sink is a node with outdegree 0. Of course, in the web you don t really get stuck, you hit back or you go somewhere new, and so to model this to make their page rank values work better, Sergey and Larry added a supernode to the web graph and had every sink point to it. Moreover, the supernode points to every other node in the graph. x x N+ x Now you can t get stuck at any node. (Note that we could have also added reverse edges everywhere to simulate the back button.) The weighted adjacency matrix W now is 4 4 and looks like x Now all the row sums are one. This turns out to make the page rank calculation better. Sergey and Larry also did a lot of other stuff, but we don t have time to go too deeply into it here, and also most of it is closely held secret! The nice thing about the weighted adjacency matrix is that it gives a very simple form for expressing the linear equations for page rank. If you put page ranks in vector P :

14 4 Graph Theory III P R(x ) P R(x )... P R(x N ) Then W T P = P, where W T denotes the transpose of W. Note that this follows from the fact that the equations have the form i N w i,jp R(x i ) = P R(x j ) for each j N. If you have taken a linear algebra or numerical analysis course, you realize that the vector of page ranks is just the principle eigenvector of the weighted adjacency matrix of the web graph! Once you ve had such a course, these values are easy to compute. Of course, when you are dealing with matrices of this size, the problem gets a little more interesting. Just keeping track of billions of pages is a daunting task. That s why Google is building power plants. Indeed, Larry and Sergey named their system Google after the number 0 00, called googol), to reflect the fact that the web graph is so enormous. Anyway, now you can see how 6.04 ranked third out of 7 million matches. Lots of other universities use our notes and probably have links to the 6.04 open courseware site and they are themselves legitimate, which ultimately leads 6.04 to get a high page rank in the web graph. The moral of this story is that you too can become a billionaire if you study your graph theory!

### Chapter 4. Trees. 4.1 Basics

Chapter 4 Trees 4.1 Basics A tree is a connected graph with no cycles. A forest is a collection of trees. A vertex of degree one, particularly in a tree, is called a leaf. Trees arise in a variety of applications.

### Solutions to Exercises 8

Discrete Mathematics Lent 2009 MA210 Solutions to Exercises 8 (1) Suppose that G is a graph in which every vertex has degree at least k, where k 1, and in which every cycle contains at least 4 vertices.

### Lesson 3. Algebraic graph theory. Sergio Barbarossa. Rome - February 2010

Lesson 3 Algebraic graph theory Sergio Barbarossa Basic notions Definition: A directed graph (or digraph) composed by a set of vertices and a set of edges We adopt the convention that the information flows

### GRAPH THEORY and APPLICATIONS. Trees

GRAPH THEORY and APPLICATIONS Trees Properties Tree: a connected graph with no cycle (acyclic) Forest: a graph with no cycle Paths are trees. Star: A tree consisting of one vertex adjacent to all the others.

### Chapter 4: Trees. 2. Theorem: Let T be a graph with n vertices. Then the following statements are equivalent:

9 Properties of Trees. Definitions: Chapter 4: Trees forest - a graph that contains no cycles tree - a connected forest. Theorem: Let T be a graph with n vertices. Then the following statements are equivalent:

### IE 680 Special Topics in Production Systems: Networks, Routing and Logistics*

IE 680 Special Topics in Production Systems: Networks, Routing and Logistics* Rakesh Nagi Department of Industrial Engineering University at Buffalo (SUNY) *Lecture notes from Network Flows by Ahuja, Magnanti

### COLORED GRAPHS AND THEIR PROPERTIES

COLORED GRAPHS AND THEIR PROPERTIES BEN STEVENS 1. Introduction This paper is concerned with the upper bound on the chromatic number for graphs of maximum vertex degree under three different sets of coloring

### COT5405 Analysis of Algorithms Homework 3 Solutions

COT0 Analysis of Algorithms Homework 3 Solutions. Prove or give a counter example: (a) In the textbook, we have two routines for graph traversal - DFS(G) and BFS(G,s) - where G is a graph and s is any

### Reading 7 : Program Correctness

CS/Math 240: Introduction to Discrete Mathematics Fall 2015 Instructors: Beck Hasti, Gautam Prakriya Reading 7 : Program Correctness 7.1 Program Correctness Showing that a program is correct means that

### BLOSSOMS MODULE ARE RANDOM TRIANGLES ACUTE OR OBTUSE? By Gilbert Strang Professor of Mathematics Massachusetts Institute of Technology

BLOSSOMS MODULE ARE RANDOM TRIANGLES ACUTE OR OBTUSE? By Gilbert Strang Professor of Mathematics Massachusetts Institute of Technology Hi! I m Gilbert Strang. I teach math at MIT. Mostly what I teach is

### 4 Basics of Trees. Petr Hliněný, FI MU Brno 1 FI: MA010: Trees and Forests

4 Basics of Trees Trees, actually acyclic connected simple graphs, are among the simplest graph classes. Despite their simplicity, they still have rich structure and many useful application, such as in

### Homework MA 725 Spring, 2012 C. Huneke SELECTED ANSWERS

Homework MA 725 Spring, 2012 C. Huneke SELECTED ANSWERS 1.1.25 Prove that the Petersen graph has no cycle of length 7. Solution: There are 10 vertices in the Petersen graph G. Assume there is a cycle C

### Induction. Margaret M. Fleck. 10 October These notes cover mathematical induction and recursive definition

Induction Margaret M. Fleck 10 October 011 These notes cover mathematical induction and recursive definition 1 Introduction to induction At the start of the term, we saw the following formula for computing

### CSE 20: Discrete Mathematics for Computer Science. Prof. Miles Jones. Today s Topics: Graphs. The Internet graph

Today s Topics: CSE 0: Discrete Mathematics for Computer Science Prof. Miles Jones. Graphs. Some theorems on graphs. Eulerian graphs Graphs! Model relations between pairs of objects The Internet graph!

### Theorem A graph T is a tree if, and only if, every two distinct vertices of T are joined by a unique path.

Chapter 3 Trees Section 3. Fundamental Properties of Trees Suppose your city is planning to construct a rapid rail system. They want to construct the most economical system possible that will meet the

### 6.042/18.062J Mathematics for Computer Science September 28, 2006 Tom Leighton and Ronitt Rubinfeld. Graph Theory II

6.04/8.06J Mathematics for Computer Science September 8, 006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Graph Theory II Matchings Today, we are going to talk about matching problems. Matching problems

### Markov Chains, part I

Markov Chains, part I December 8, 2010 1 Introduction A Markov Chain is a sequence of random variables X 0, X 1,, where each X i S, such that P(X i+1 = s i+1 X i = s i, X i 1 = s i 1,, X 0 = s 0 ) = P(X

### Graphs and Network Flows IE411 Lecture 1

Graphs and Network Flows IE411 Lecture 1 Dr. Ted Ralphs IE411 Lecture 1 1 References for Today s Lecture Required reading Sections 17.1, 19.1 References AMO Chapter 1 and Section 2.1 and 2.2 IE411 Lecture

### 1 Digraphs. Definition 1

1 Digraphs Definition 1 Adigraphordirected graphgisatriplecomprisedofavertex set V(G), edge set E(G), and a function assigning each edge an ordered pair of vertices (tail, head); these vertices together

### MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column

### 2.3 Scheduling jobs on identical parallel machines

2.3 Scheduling jobs on identical parallel machines There are jobs to be processed, and there are identical machines (running in parallel) to which each job may be assigned Each job = 1,,, must be processed

### Homework 15 Solutions

PROBLEM ONE (Trees) Homework 15 Solutions 1. Recall the definition of a tree: a tree is a connected, undirected graph which has no cycles. Which of the following definitions are equivalent to this definition

### S = {1, 2,..., n}. P (1, 1) P (1, 2)... P (1, n) P (2, 1) P (2, 2)... P (2, n) P = . P (n, 1) P (n, 2)... P (n, n)

last revised: 26 January 2009 1 Markov Chains A Markov chain process is a simple type of stochastic process with many social science applications. We ll start with an abstract description before moving

### Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs

CSE599s: Extremal Combinatorics November 21, 2011 Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs Lecturer: Anup Rao 1 An Arithmetic Circuit Lower Bound An arithmetic circuit is just like

### Lecture 6: Approximation via LP Rounding

Lecture 6: Approximation via LP Rounding Let G = (V, E) be an (undirected) graph. A subset C V is called a vertex cover for G if for every edge (v i, v j ) E we have v i C or v j C (or both). In other

### ORDERS OF ELEMENTS IN A GROUP

ORDERS OF ELEMENTS IN A GROUP KEITH CONRAD 1. Introduction Let G be a group and g G. We say g has finite order if g n = e for some positive integer n. For example, 1 and i have finite order in C, since

### 6.3 Conditional Probability and Independence

222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

### Graph Theory Problems and Solutions

raph Theory Problems and Solutions Tom Davis tomrdavis@earthlink.net http://www.geometer.org/mathcircles November, 005 Problems. Prove that the sum of the degrees of the vertices of any finite graph is

### CS268: Geometric Algorithms Handout #5 Design and Analysis Original Handout #15 Stanford University Tuesday, 25 February 1992

CS268: Geometric Algorithms Handout #5 Design and Analysis Original Handout #15 Stanford University Tuesday, 25 February 1992 Original Lecture #6: 28 January 1991 Topics: Triangulating Simple Polygons

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

### Discrete Mathematics & Mathematical Reasoning Chapter 10: Graphs

Discrete Mathematics & Mathematical Reasoning Chapter 10: Graphs Kousha Etessami U. of Edinburgh, UK Kousha Etessami (U. of Edinburgh, UK) Discrete Mathematics (Chapter 6) 1 / 13 Overview Graphs and Graph

### CMPSCI611: Approximating MAX-CUT Lecture 20

CMPSCI611: Approximating MAX-CUT Lecture 20 For the next two lectures we ll be seeing examples of approximation algorithms for interesting NP-hard problems. Today we consider MAX-CUT, which we proved to

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### Outline. NP-completeness. When is a problem easy? When is a problem hard? Today. Euler Circuits

Outline NP-completeness Examples of Easy vs. Hard problems Euler circuit vs. Hamiltonian circuit Shortest Path vs. Longest Path 2-pairs sum vs. general Subset Sum Reducing one problem to another Clique

### Markov chains and Markov Random Fields (MRFs)

Markov chains and Markov Random Fields (MRFs) 1 Why Markov Models We discuss Markov models now. This is the simplest statistical model in which we don t assume that all variables are independent; we assume

### 6.042/18.062J Mathematics for Computer Science. Expected Value I

6.42/8.62J Mathematics for Computer Science Srini Devadas and Eric Lehman May 3, 25 Lecture otes Expected Value I The expectation or expected value of a random variable is a single number that tells you

### Applied Algorithm Design Lecture 5

Applied Algorithm Design Lecture 5 Pietro Michiardi Eurecom Pietro Michiardi (Eurecom) Applied Algorithm Design Lecture 5 1 / 86 Approximation Algorithms Pietro Michiardi (Eurecom) Applied Algorithm Design

### SAMPLES OF HIGHER RATED WRITING: LAB 5

SAMPLES OF HIGHER RATED WRITING: LAB 5 1. Task Description Lab report 5. (April 14) Graph Coloring. Following the guidelines, and keeping in mind the assessment criteria, using where appropriate experimental

### Topology-based network security

Topology-based network security Tiit Pikma Supervised by Vitaly Skachek Research Seminar in Cryptography University of Tartu, Spring 2013 1 Introduction In both wired and wireless networks, there is the

### Notes on Matrix Multiplication and the Transitive Closure

ICS 6D Due: Wednesday, February 25, 2015 Instructor: Sandy Irani Notes on Matrix Multiplication and the Transitive Closure An n m matrix over a set S is an array of elements from S with n rows and m columns.

### 6.042/18.062J Mathematics for Computer Science December 12, 2006 Tom Leighton and Ronitt Rubinfeld. Random Walks

6.042/8.062J Mathematics for Comuter Science December 2, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Random Walks Gambler s Ruin Today we re going to talk about one-dimensional random walks. In

### Linear Programming I

Linear Programming I November 30, 2003 1 Introduction In the VCR/guns/nuclear bombs/napkins/star wars/professors/butter/mice problem, the benevolent dictator, Bigus Piguinus, of south Antarctica penguins

### THE DIMENSION OF A VECTOR SPACE

THE DIMENSION OF A VECTOR SPACE KEITH CONRAD This handout is a supplementary discussion leading up to the definition of dimension and some of its basic properties. Let V be a vector space over a field

### Social Media Mining. Graph Essentials

Graph Essentials Graph Basics Measures Graph and Essentials Metrics 2 2 Nodes and Edges A network is a graph nodes, actors, or vertices (plural of vertex) Connections, edges or ties Edge Node Measures

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 4. Stable Marriage - An Application of Proof Techniques to Algorithmic

CS 70-2 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 4 Stable Marriage - An Application of Proof Techniques to Algorithmic Analysis Consider a dating agency that must

### princeton univ. F 13 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Sanjeev Arora

princeton univ. F 13 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Sanjeev Arora Scribe: One of the running themes in this course is the notion of

### Solution to Homework 2

Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

### 1 Basic Definitions and Concepts in Graph Theory

CME 305: Discrete Mathematics and Algorithms 1 Basic Definitions and Concepts in Graph Theory A graph G(V, E) is a set V of vertices and a set E of edges. In an undirected graph, an edge is an unordered

### 136 CHAPTER 4. INDUCTION, GRAPHS AND TREES

136 TER 4. INDUCTION, GRHS ND TREES 4.3 Graphs In this chapter we introduce a fundamental structural idea of discrete mathematics, that of a graph. Many situations in the applications of discrete mathematics

### Basic Notions on Graphs. Planar Graphs and Vertex Colourings. Joe Ryan. Presented by

Basic Notions on Graphs Planar Graphs and Vertex Colourings Presented by Joe Ryan School of Electrical Engineering and Computer Science University of Newcastle, Australia Planar graphs Graphs may be drawn

### Analysis of Algorithms, I

Analysis of Algorithms, I CSOR W4231.002 Eleni Drinea Computer Science Department Columbia University Thursday, February 26, 2015 Outline 1 Recap 2 Representing graphs 3 Breadth-first search (BFS) 4 Applications

### Graph Theory. Directed and undirected graphs make useful mental models for many situations. These objects are loosely defined as follows:

Graph Theory Directed and undirected graphs make useful mental models for many situations. These objects are loosely defined as follows: Definition An undirected graph is a (finite) set of nodes, some

### Long questions answer Advanced Mathematics for Computer Application If P= , find BT. 19. If B = 1 0, find 2B and -3B.

Unit-1: Matrix Algebra Short questions answer 1. What is Matrix? 2. Define the following terms : a) Elements matrix b) Row matrix c) Column matrix d) Diagonal matrix e) Scalar matrix f) Unit matrix OR

### MATH 56A SPRING 2008 STOCHASTIC PROCESSES 31

MATH 56A SPRING 2008 STOCHASTIC PROCESSES 3.3. Invariant probability distribution. Definition.4. A probability distribution is a function π : S [0, ] from the set of states S to the closed unit interval

### Steps to Proving a Theorem

Steps to Proving a Theorem Step 1: Understand Goal What am I looking for? What should the last sentence in my proof say? What are some equivalent ways to state what I want? Are there any complicated definitions

### Practical Graph Mining with R. 5. Link Analysis

Practical Graph Mining with R 5. Link Analysis Outline Link Analysis Concepts Metrics for Analyzing Networks PageRank HITS Link Prediction 2 Link Analysis Concepts Link A relationship between two entities

### Trees and structural induction

Trees and structural induction Margaret M. Fleck 25 October 2010 These notes cover trees, tree induction, and structural induction. (Sections 10.1, 4.3 of Rosen.) 1 Why trees? Computer scientists are obsessed

### Min-cost flow problems and network simplex algorithm

Min-cost flow problems and network simplex algorithm The particular structure of some LP problems can be sometimes used for the design of solution techniques more efficient than the simplex algorithm.

### SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH

31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,

### Spectral graph theory

Spectral graph theory Uri Feige January 2010 1 Background With every graph (or digraph) one can associate several different matrices. We have already seen the vertex-edge incidence matrix, the Laplacian

### Partitioning edge-coloured complete graphs into monochromatic cycles and paths

arxiv:1205.5492v1 [math.co] 24 May 2012 Partitioning edge-coloured complete graphs into monochromatic cycles and paths Alexey Pokrovskiy Departement of Mathematics, London School of Economics and Political

### Lecture 7: Approximation via Randomized Rounding

Lecture 7: Approximation via Randomized Rounding Often LPs return a fractional solution where the solution x, which is supposed to be in {0, } n, is in [0, ] n instead. There is a generic way of obtaining

### Math 4707: Introduction to Combinatorics and Graph Theory

Math 4707: Introduction to Combinatorics and Graph Theory Lecture Addendum, November 3rd and 8th, 200 Counting Closed Walks and Spanning Trees in Graphs via Linear Algebra and Matrices Adjacency Matrices

### Approximation Algorithms

Approximation Algorithms or: How I Learned to Stop Worrying and Deal with NP-Completeness Ong Jit Sheng, Jonathan (A0073924B) March, 2012 Overview Key Results (I) General techniques: Greedy algorithms

### MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix.

MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix. Inverse matrix Definition. Let A be an n n matrix. The inverse of A is an n n matrix, denoted

### Lattice Point Geometry: Pick s Theorem and Minkowski s Theorem. Senior Exercise in Mathematics. Jennifer Garbett Kenyon College

Lattice Point Geometry: Pick s Theorem and Minkowski s Theorem Senior Exercise in Mathematics Jennifer Garbett Kenyon College November 18, 010 Contents 1 Introduction 1 Primitive Lattice Triangles 5.1

### Lecture 1: Course overview, circuits, and formulas

Lecture 1: Course overview, circuits, and formulas Topics in Complexity Theory and Pseudorandomness (Spring 2013) Rutgers University Swastik Kopparty Scribes: John Kim, Ben Lund 1 Course Information Swastik

### (Refer Slide Time 1.50)

Discrete Mathematical Structures Dr. Kamala Krithivasan Department of Computer Science and Engineering Indian Institute of Technology, Madras Module -2 Lecture #11 Induction Today we shall consider proof

### Forests and Trees: A forest is a graph with no cycles, a tree is a connected forest.

2 Trees What is a tree? Forests and Trees: A forest is a graph with no cycles, a tree is a connected forest. Theorem 2.1 If G is a forest, then comp(g) = V (G) E(G). Proof: We proceed by induction on E(G).

### Lecture 3: Summations and Analyzing Programs with Loops

high school algebra If c is a constant (does not depend on the summation index i) then ca i = c a i and (a i + b i )= a i + b i There are some particularly important summations, which you should probably

### CMSC 451: Graph Properties, DFS, BFS, etc.

CMSC 451: Graph Properties, DFS, BFS, etc. Slides By: Carl Kingsford Department of Computer Science University of Maryland, College Park Based on Chapter 3 of Algorithm Design by Kleinberg & Tardos. Graphs

### Social Media Mining. Network Measures

Klout Measures and Metrics 22 Why Do We Need Measures? Who are the central figures (influential individuals) in the network? What interaction patterns are common in friends? Who are the like-minded users

### Math 313 Lecture #10 2.2: The Inverse of a Matrix

Math 1 Lecture #10 2.2: The Inverse of a Matrix Matrix algebra provides tools for creating many useful formulas just like real number algebra does. For example, a real number a is invertible if there is

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

### 10.1 Integer Programming and LP relaxation

CS787: Advanced Algorithms Lecture 10: LP Relaxation and Rounding In this lecture we will design approximation algorithms using linear programming. The key insight behind this approach is that the closely

### A CHARACTERIZATION OF TREE TYPE

A CHARACTERIZATION OF TREE TYPE LON H MITCHELL Abstract Let L(G) be the Laplacian matrix of a simple graph G The characteristic valuation associated with the algebraic connectivity a(g) is used in classifying

### Mining Social-Network Graphs

342 Chapter 10 Mining Social-Network Graphs There is much information to be gained by analyzing the large-scale data that is derived from social networks. The best-known example of a social network is

### Lecture 3: Linear Programming Relaxations and Rounding

Lecture 3: Linear Programming Relaxations and Rounding 1 Approximation Algorithms and Linear Relaxations For the time being, suppose we have a minimization problem. Many times, the problem at hand can

### Introduction to Flocking {Stochastic Matrices}

Supelec EECI Graduate School in Control Introduction to Flocking {Stochastic Matrices} A. S. Morse Yale University Gif sur - Yvette May 21, 2012 CRAIG REYNOLDS - 1987 BOIDS The Lion King CRAIG REYNOLDS

### Handout #Ch7 San Skulrattanakulchai Gustavus Adolphus College Dec 6, 2010. Chapter 7: Digraphs

MCS-236: Graph Theory Handout #Ch7 San Skulrattanakulchai Gustavus Adolphus College Dec 6, 2010 Chapter 7: Digraphs Strong Digraphs Definitions. A digraph is an ordered pair (V, E), where V is the set

### Principle of (Weak) Mathematical Induction. P(1) ( n 1)(P(n) P(n + 1)) ( n 1)(P(n))

Outline We will cover (over the next few weeks) Mathematical Induction (or Weak Induction) Strong (Mathematical) Induction Constructive Induction Structural Induction Principle of (Weak) Mathematical Induction

### Similarity and Diagonalization. Similar Matrices

MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

### ON THE FIBONACCI NUMBERS

ON THE FIBONACCI NUMBERS Prepared by Kei Nakamura The Fibonacci numbers are terms of the sequence defined in a quite simple recursive fashion. However, despite its simplicity, they have some curious properties

### The origins of graph theory are humble, even frivolous. Biggs, E. K. Lloyd, and R. J. Wilson)

Chapter 11 Graph Theory The origins of graph theory are humble, even frivolous. Biggs, E. K. Lloyd, and R. J. Wilson) (N. Let us start with a formal definition of what is a graph. Definition 72. A graph

### 1. R In this and the next section we are going to study the properties of sequences of real numbers.

+a 1. R In this and the next section we are going to study the properties of sequences of real numbers. Definition 1.1. (Sequence) A sequence is a function with domain N. Example 1.2. A sequence of real

### 10. Graph Matrices Incidence Matrix

10 Graph Matrices Since a graph is completely determined by specifying either its adjacency structure or its incidence structure, these specifications provide far more efficient ways of representing a

### Network Flow I. Lecture 16. 16.1 Overview. 16.2 The Network Flow Problem

Lecture 6 Network Flow I 6. Overview In these next two lectures we are going to talk about an important algorithmic problem called the Network Flow Problem. Network flow is important because it can be

### 1 Gaussian Elimination

Contents 1 Gaussian Elimination 1.1 Elementary Row Operations 1.2 Some matrices whose associated system of equations are easy to solve 1.3 Gaussian Elimination 1.4 Gauss-Jordan reduction and the Reduced

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 1 9/3/2008 PROBABILISTIC MODELS AND PROBABILITY MEASURES

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 1 9/3/2008 PROBABILISTIC MODELS AND PROBABILITY MEASURES Contents 1. Probabilistic experiments 2. Sample space 3. Discrete probability

### Basics Inversion and related concepts Random vectors Matrix calculus. Matrix algebra. Patrick Breheny. January 20

Matrix algebra January 20 Introduction Basics The mathematics of multiple regression revolves around ordering and keeping track of large arrays of numbers and solving systems of equations The mathematical

### The Determinant: a Means to Calculate Volume

The Determinant: a Means to Calculate Volume Bo Peng August 20, 2007 Abstract This paper gives a definition of the determinant and lists many of its well-known properties Volumes of parallelepipeds are

### Math 443/543 Graph Theory Notes 4: Connector Problems

Math 443/543 Graph Theory Notes 4: Connector Problems David Glickenstein September 19, 2012 1 Trees and the Minimal Connector Problem Here is the problem: Suppose we have a collection of cities which we

### Definition A square matrix M is invertible (or nonsingular) if there exists a matrix M 1 such that

0. Inverse Matrix Definition A square matrix M is invertible (or nonsingular) if there exists a matrix M such that M M = I = M M. Inverse of a 2 2 Matrix Let M and N be the matrices: a b d b M =, N = c

### Sample Problems in Discrete Mathematics

Sample Problems in Discrete Mathematics This handout lists some sample problems that you should be able to solve as a pre-requisite to Computer Algorithms Try to solve all of them You should also read

### Lecture 9. 1 Introduction. 2 Random Walks in Graphs. 1.1 How To Explore a Graph? CS-621 Theory Gems October 17, 2012

CS-62 Theory Gems October 7, 202 Lecture 9 Lecturer: Aleksander Mądry Scribes: Dorina Thanou, Xiaowen Dong Introduction Over the next couple of lectures, our focus will be on graphs. Graphs are one of

### Lecture Notes on Spanning Trees

Lecture Notes on Spanning Trees 15-122: Principles of Imperative Computation Frank Pfenning Lecture 26 April 26, 2011 1 Introduction In this lecture we introduce graphs. Graphs provide a uniform model

### TREES IN SET THEORY SPENCER UNGER

TREES IN SET THEORY SPENCER UNGER 1. Introduction Although I was unaware of it while writing the first two talks, my talks in the graduate student seminar have formed a coherent series. This talk can be

### max cx s.t. Ax c where the matrix A, cost vector c and right hand side b are given and x is a vector of variables. For this example we have x

Linear Programming Linear programming refers to problems stated as maximization or minimization of a linear function subject to constraints that are linear equalities and inequalities. Although the study