# Approximation Algorithms

Size: px
Start display at page:

## Transcription

1 Approximation Algorithms or: How I Learned to Stop Worrying and Deal with NP-Completeness Ong Jit Sheng, Jonathan (A B) March, 2012

2 Overview Key Results (I) General techniques: Greedy algorithms Pricing method (primal-dual) Linear programming and rounding Dynamic programming on rounded inputs

3 Overview Key Results (II) Approximation results: 3 2-approx of Load Balancing 2-approx of Center Selection H(d )-approx of Set Cover 2-approx of Vertex Cover (2cm 1/(c+1) + 1)-approx of Disjoint Paths 2-approx of Vertex Cover (with LP) 2-approx of Generalized Load Balancing (1 + ɛ)-approx of Knapsack Problem

4 Load Balancing Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

5 Load Balancing Problem Formulation Load Balancing: Problem Formulation Problem m machines M 1,..., M m n jobs; each job j has processing time t j Goal Assign each job to a machine Balance loads across all machines

6 Load Balancing Problem Formulation Load Balancing: Problem Formulation Concrete formulation Let A(i) = set of jobs assigned to M i Total load on M i : T i = j A(i) t j Want to minimize the makespan (the max load on any machine), T = max i T i

7 Load Balancing Algorithm Load Balancing: Algorithm 1st Algo: procedure Greedy-Balance 1 pass through jobs in any order. Assign job j to to machine with current smallest load. end procedure However, this may not produce an optimal solution.

8 Load Balancing Analysis of Algorithm Load Balancing: Analysis of Algorithm We want to show that resulting makespan T is not much larger than optimum T. Theorem (11.1) Optimal makespan is at least T 1 m j t j. Proof. One of the m machines must do at least 1 m of total work. Theorem (11.2) Optimal makespan is at least T max j t j

9 Load Balancing Analysis of Algorithm Load Balancing: Analysis of Algorithm Theorem (11.3) Greedy-Balance produces an assignment with makespan T 2T. Proof. Let T i be the total load of machine M i. When we assigned job j to M i, M i had the smallest load of all machines, with load T i t j before adding the last job. = Every machine had load at least T i t j k T k = k T k m(t i t j ) = T i t j 1 m T i t j T From (11.2), t j T so T i = (T i t j ) + t j 2T T = T i 2T

10 Load Balancing Improved Approx Algo Load Balancing: An Improved Approx Algo procedure Sorted-Balance Sort jobs in descending order of processing time (so t 1 t 2 t n ) for j = 1,..., n do Let M i = machine that achieves min k T k Assign job j to machine M i Set A(i) A(i) {j} Set T i T i + t j end for end procedure

11 Load Balancing Analysis of Improved Algo Load Balancing: Analysis of Improved Algo Theorem (11.4) If there are more than m jobs, then T 2t m+1 Proof. Consider the first m + 1 jobs in the sorted order. Each takes at least t m+1 time. There are m + 1 jobs but m machines. there must be a machine that is assigned two of these jobs. The machine will have processing time at least 2t m+1.

12 Load Balancing Analysis of Improved Algo Load Balancing: Analysis of Improved Algo Theorem (11.5) Sorted-Balance produces an assignment with makespan T 3 2 T Proof. Consider machine M i with the maximum load. If M i only holds a single job, we are done. Otherwise, assume M i has at least two jobs, and let t i = last job assigned to M i. Note that j m + 1, since first m jobs go to m distinct machines. Thus, t j t m T (from 11.4). Similar to (11.3), but now: T i t j T and t j 1 2 T, so T i = (T i t j ) + t j 3 2 T.

13 Center Selection Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

14 Center Selection Problem Formulation Center Selection: Problem Formulation Problem Given a set S of n sites Want to select k centers such that they are central Formally: We are given an integer k, a set S of n sites and a distance function. Any point in the plane is an option for placing a center. Distance function must satisfy: dist(s, s) = 0 s S symmetry: dist(s, z) = dist(z, s) s, z S triangle inequality: dist(s, z) + dist(z, h) dist(s, h)

15 Center Selection Problem Formulation Center Selection: Problem Formulation Let C be a set of centers. Assume people in a given town will shop at the closest mall. Define distance of site s from the centers as dist(s, C) = min c C {dist(s, c)} Then C forms an r-cover if each site is within distance at most r from one of the centers, i.e. dist(s, C) r s S. The minimum r for which C is an r-cover is called the covering radius of C, denoted r(c). Goal Select a set C of k centers that minimizes r(c).

16 Center Selection Algorithm Center Selection: Algorithm Simplest greedy solution: 1 Find best location for a single center 2 Keep adding centers so as to reduce by as much as possible. However, this leads to some bad solutions.

17 Center Selection Algorithm Center Selection: Algorithm Suppose we know the optimum radius r. Then we can find a set of k centers C such that r(c) is at most 2r. Consider any site s S. There must be a center c C that covers s with distance at most r from s. Now take s as a center instead. By expanding the radius from r to 2r, s covers all the sites c covers. (i.e. dist(s, t) dist(s, c ) + dist(c, t) = 2r)

18 Center Selection Algorithm Center Selection: Algorithm Assuming we know r: procedure Center-Select-1 // S = sites still needing to be covered Init S = S, C = while S do Select any s S and add s to C Delete all t S where dist(t, s) 2r end while if C k then Return C as the selected set of sites else Claim there is no set of k centers with covering radius at most r end if end procedure Theorem (11.6) Any set of centers C returned by the algo has covering radius r(c) 2r.

19 Center Selection Analysis Center Selection: Analysis of Algorithm Theorem (11.7) Suppose the algo picks more than k centers. Then, for any set C of size at most k, the covering radius is r(c ) > r. Proof. Assume there is a set C of at most k centers with r(c ) r. Each center c C selected by the algo is a site in S, so there must be a center c C at most distance r from c. (Call such a c close to c.) Claim: no c C can be close to two different centers in C. Each pair of centers c, c C is separated by a distance of more than 2r, so if c were within distance r from each, this would violate the triangle inequality. = each center c C has a close optimal center c C, and each of these close optimal centers is distinct = C C, and since C > k, this is a contradiction.

20 Center Selection Actual Algorithm Center Selection: Actual algorithm Eliminating the assumption of knowing the optimal radius We simply select the site s that is furthest from all previously selected sites. procedure Center-Select Assume k S (else define C = S) Select any site s and let C = {s} while C < k do Select a site s S that maximizes dist(s, C) Add s to C end while Return C as the selected set of sites end procedure

21 Center Selection Actual Algorithm Center Selection: Analysis of Actual Algorithm Theorem (11.8) This algo returns a set C of k points such that r(c) 2r(C ). Proof. Let r = r(c ) denote the minimum radius of a set of k centers. Assume we obtain a set C of k centers with r(c) > 2r for contradiction. Let s be a site more than 2r from every center in C. Consider an intermediate iteration (selected a set C and adding c in this iteration). We have dist(c, C ) dist(s, C ) dist(s, C) > 2r. Thus, Center-Select is a correct implementation of the first k iterations of the while loop of Center-Select-1. But Center-Select-1 would have S after selecting k centers, as it would have s S, and so it would select more than k centers and conclude that k centers cannot have covering radius at most r. This contradicts our choice of r, so we must have r(c) 2r.

22 Set Cover: A General Greedy Heuristic Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

23 Set Cover: A General Greedy Heuristic Problem Formulation Set Cover: Problem Formulation Problem Given a set U of n elements and a list S 1,..., S m of subsets of U, a set cover is a collection of these sets whose union is equal to U. Each set S i has weight w i 0. Goal Find a set cover C minimizing the total weight S i C w i.

24 Set Cover: A General Greedy Heuristic Algorithm Set Cover: Algorithm Designing the algo (greedy) Build set cover one at a time Choose next set by looking at wi S i, cost per element covered. Since we are only concerned with elements still left uncovered, we maintain the set R of remaining uncovered elements and choose S i that minimizes w i S i R.

25 Set Cover: A General Greedy Heuristic Algorithm Set Cover: Algorithm procedure Greedy-Set-Cover Start with R = U and no sets selected while R do w i S i R Select set S i that minimizes Delete set S i from R end while Return the selected sets end procedure Note: Greedy-Set-Cover can miss optimal solution.

26 Set Cover: A General Greedy Heuristic Analysis Set Cover: Analysis To analyze the algo, we add the following line after selecting S i : Define c s = wi S s S i R i R i.e. record the cost paid for each newly covered element Theorem (11.9) If C is the set cover obtained by Greedy-Set-Cover, then S i C w i = s U c s We will use the harmonic function H(n) = n i=1 1 i, bounded above by 1 + ln n and below by ln(n + 1), so H(n) = Θ(ln n).

27 Set Cover: A General Greedy Heuristic Analysis Set Cover: Analysis Theorem (11.10) For every set S k, s S k c s is at most H( S k )w k. Proof. For simplicity, assume S k contains the first d = S k elements of U, i.e. S k = {s 1,..., s d }. Also assume these elements are labelled in the order in which they are assigned a cost c sj by the algo. Consider the iteration when s j is covered by the algo, for some j d At the start of this iteration, s j, s j+1,..., s d R by our labelling. So S k R d j + 1, and so the average cost of S k is at most w k S k R w k d j+1 In this iteration, the algo selected a set S i of min average cost, so S i has average cost at most that of S k. So c sj = wi S w k i R S k R w k d j+1, giving us s S k c s = d j=1 c s j d j=1 w k d j+1 = w k d + w k d w k 1 = H(d)w k

28 Set Cover: A General Greedy Heuristic Analysis Set Cover: Analysis Let d = max i S i denote the max size of any set. Then Theorem (11.11) The set cover C selected by Greedy-Set-Cover has weight at most H(d ) times the optimal weight w. Proof. Let C be the optimum set cover, so w = S w i C i. For each of the sets in C, (11.10) implies w i 1 H(d ) s S i c s. Since these sets form a set cover, S i C s S i c s s U c s. Combining these with (11.9), we get w = S w i C i [ 1 S i C 1 H(d ) w i. H(d ) s S i c s ] 1 H(d ) s U c s =

29 Set Cover: A General Greedy Heuristic Analysis Set Cover: Analysis The greedy algo finds a solution within O(log d ) of optimal. Since d can be a constant fraction of n, this is a worst-case upper bound of O(log n). More complicated means show that no polynomial-time approximation algo can achieve an approximation bound better than H(n) times optimal, unless P=NP.

30 Vertex Cover: Pricing Method Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

31 Vertex Cover: Pricing Method Problem Formulation Vertex Cover: Problem Formulation Problem A vertex cover in a graph G = (V, E) is a set S V such that each edge has at least one end in S. We give each vertex i V weight w i 0, and weight of a set S of vertices w(s) = i S w i. Goal Find a vertex cover S that minimizes w(s).

32 Vertex Cover: Pricing Method Approximations via Reduction Vertex Cover: Approximations via Reduction Note that Vertex Cover p Set Cover Theorem (11.12) One can use the Set Cover approximation algo to give an H(d)-approximation algo for weighted Vertex Cover, where d is the maximum degree of the graph. However, not all reductions work similarly.

33 Vertex Cover: Pricing Method Pricing Method (aka Primal-Dual Method) Vertex Cover: Pricing Method Pricing Method (aka primal-dual method) Think of weights on nodes as costs Each edge pays for its share of cost of vertex cover Determine prices p e 0 for each edge e E such that if each e pays p e, this will approximately cover the cost of S Fairness: selecting a vertex i covers all edges incident to i, so it is unfair to charge incident edges in total more than the cost of i Prices p e fair if e=(i,j) p e w i (don t pay more than the cost of i)

34 Vertex Cover: Pricing Method Pricing Method (aka Primal-Dual Method) Vertex Cover: Algorithm Theorem (11.13) For any vertex cover S, and any non-negative and fair prices p e, we have e E p e w(s ). Proof. Consider vertex cover S. By definition of fairness, e=(i,j) p e w i i S. p e w i = w(s ) i S i S e=(i,j) Since S is a vertex cover, each edge e contributes to at least one term p e to the LHS. Prices are non-negative, so LHS is at least as large as the sum of all prices, i.e. e E p e i S e=(i,j) p e w(s ).

35 Vertex Cover: Pricing Method Algorithm Vertex Cover: Algorithm We say a node i is tight (or paid for ) if e=(i,j) p e = w i. procedure Vertex-Cover-Approx(G, w) Set p e = 0 for all e E while edge e = (i, j) such that neither i nor j is tight do Select e Increase p e without violating fairness end while Let S = set of all tight nodes Return S. end procedure

36 Vertex Cover: Pricing Method Analysis Vertex Cover: Analysis Theorem (11.14) The set S and prices p returned by Vertex-Cover-Approx satisfy w(s) 2 e E p e. Proof. All nodes in S are tight, so e=(i,j) p e = w i i S. Adding over all nodes: w(s) = i S w i = i S e=(i,j) p e. An edge e = (i, j) can be included in the sum in the RHS at most twice, so w(s) = p e 2 p e i S e=(i,j) e E

37 Vertex Cover: Pricing Method Analysis Vertex Cover: Analysis Theorem (11.15) The set S returned by Vertex-Cover-Approx is a vertex cover, and its cost is at most twice the min cost of any vertex cover. Proof. Claim 1: S is a vertex cover. Suppose it does not cover edge e = (i, j). Then neither i nor j is tight, contradicting the fact that the while loop terminated. Claim 2: Approximate bound. Let p = prices set by the algo, and S be an optimum vertex cover. By (11.14), 2 e E p e w(s), and by (11.13) e E p e w(s ), so w(s) 2 e E p e 2w(S )

38 (Maximum) Disjoint Paths: Maximization via Pricing Method Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

39 (Maximum) Disjoint Paths: Maximization via Pricing Method Problem Formulation Disjoint Paths: Problem Formulation Problem Given: a directed graph G k pairs of nodes (s 1, t 1), (s 2, t 2),..., (s k, t k ) an integer capacity C Each pair (s i, t i ) is a routing request for a path from s i to t i Each edge is used by at most c paths A solution consists of a subset of the requests to satisfy, I {1,..., k}, together with paths that satisfy them while not overloading any one edge. Goal Find a solution with I as large as possible.

40 (Maximum) Disjoint Paths: Maximization via Pricing Method First Algorithm Disjoint Paths: First Algorithm A Greedy Approach (when c = 1) procedure Greedy-Disjoint-Paths Set I = until no new path can be found Let P i be the shortest path (if one exists) that is edge-disjoint from previously selected paths, and connects some unconnected (s i, t i ) pair Add i to I and select path P i to connect s i to t i end until end procedure

41 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of First Algorithm Disjoint Paths: Analysis of First Algo Theorem (11.16) Greedy-Disjoint-Paths is a (2 m + 1)-approximation algo for Max Disjoint Paths (where m = E = number of edges). Proof. Let I = set of pairs connected in an optimal solution, and Pi for i I be the selected paths. Let I = the set of pairs selected by the algo, and P i for i I be the corresponding paths. Call a path long if it has at least m edges, and short otherwise. Let Is be indices in I with short Pi, and similarly define I s for I. G has m edges, and long paths use at least m edges, so there can be at most m long paths in I. Now consider short paths I. In order for I to be much larger than I, there must be many connected pairs that are in I but not in I.

42 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of First Algorithm Proof. Consider pairs connected by the optimum by a short path, but not connected by our algo. Since Pi connecting s i and t i in I is short, the greedy algo would have picked it before picking long paths if it was available. Since the algo did not pick it, one of the edges e along Pi must occur in a path P j selected earlier by the algo. We say edge e blocks path Pi. Lengths of paths selected by the algo are monotone increasing. P j was selected before Pi, and so must be shorter: P j Pi m, so P j is short. Paths are edge-disjoint, so each edge in a path P j can block at most one path Pi. So each short path P j blocks at most m paths in the optimal solution, and so Is I P j I s m (*) j I s

43 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of First Algorithm Proof. I consists of three kinds of paths: long paths, of which there are at most m; paths that are also in I; and short paths that are not in I, fewer than I s m by (*). Note that I 1 whenever at least one pair can be connected. So I m + I + I s I m + I + m I s m I + I + m I = (2 m + 1) I.

44 (Maximum) Disjoint Paths: Maximization via Pricing Method Second Algorithm Disjoint Paths: Second Algorithm Pricing Method (for c > 1) Consider a pricing scheme where edges are viewed as more expensive if they have been used. This encourages spreading out paths. Define cost of an edge e as its length l e, and length of a path to be l(p) = e P l e. Use a multiplicative parameter β to increase the length of an edge each time it is used.

45 (Maximum) Disjoint Paths: Maximization via Pricing Method Second Algorithm Disjoint Paths: Second Algorithm procedure Greedy-Paths-With-Capacity Set I = Set edge length l e = 1 for all e E until no new path can be found Let P i be the shortest path (if one exists) such that adding P i to the selected set of paths does not use any edge more than c times, and P i connects some unconnected (s i, t i ) pair Add i to I and select P i to connect s i to t i Multiply the length of all edges along P i by β end until end procedure

46 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of Second Algo Disjoint Paths: Analysis of Second Algo For simplicity, focus on case c = 2. Set β = m 1 3. Consider a path P i selected by the algo to be short if its length is less than β 2. Let I s denote the set of short paths selected by the algo. Let I be an optimal solution, and Pi the paths it uses. Let l be the length function at the first point at which there are no short paths left to choose. Consider a path Pi in I short if l(p i ) < β2, and long otherwise. Let Is denote the set of short paths in I.

47 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of Second Algo Disjoint Paths: Analysis of Second Algo Theorem (11.17) Consider a source-sink pair i I that is not connected by the approx algo; i.e. i I. Then l(p i ) β2. Proof. As long as short paths are being selected, any edge e considered for selection by a third path would already have length l e = β 2 and hence be long. Consider the state of the algo with length l. We can imagine the algo running up to this point without caring about the limit of c. Since s i, t i of Pi are not connected by the algo, and since there are no short paths left when the length function reaches l, it must be that path Pi has length of at least β 2 as measured by l.

48 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of Second Algo Disjoint Paths: Analysis of Second Algo Finding the total length in the graph e l e e l e starts out at m (length 1 for each edge). Adding a short path to the solution I s can increase the length by at most β 3, as the selected path has length at most β 2 (for c = 2), and the lengths of the edges are increased by a factor of β along the path. Thus, Theorem (11.18) The set I s of short paths selected by the approx algo, and the lengths l, satisfy the relation e l e β 3 I s + m.

49 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of Second Algo Disjoint Paths: Analysis of Second Algo Theorem (11.19) Greedy-Paths-With-Capacity, using β = m 1 3, is a (4m )-approx algo for capacity c = 2. Proof. By (11.17), we have l(p i ) β2 i I I. Summing over all paths in I I, i I I l(p i ) β2 I I. On the other hand, each edge is used by at most two paths in I, so i I I l(p i ) e E 2 l e. Combining these with (11.18): β 2 I β 2 I I + β 2 I i I I l(p i ) + β2 I e E 2 l e + β 2 I 2(β 2 I + m) + β 2 I. Dividing throughout by β 2, using I 1 and setting β = m 1 3, I (4m ) I.

50 (Maximum) Disjoint Paths: Maximization via Pricing Method Analysis of Second Algo Disjoint Paths: Analysis of Second Algo The same algo works for any capacity c > 0. To extend the analysis, choose β = m 1 c+1 and consider paths to be short if their length is at most β c. Theorem (11.20) Greedy-Paths-With-Capacity, using β = m 1 c+1, is a (2cm 1 c+1 + 1)-approx algo when the edge capacities are c.

51 Vertex Cover (LP) Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

52 Vertex Cover (LP) Problem Formulation Vertex Cover: Problem Formulation Linear programming (LP) Given an m n matrix A, and vectors b R m and c R n, find a vector x R n to solve the following optimization problem: min(c t x s.t. x 0; Ax b) The most widely-used algo is the simplex method.

53 Vertex Cover (LP) Problem Formulation Vertex Cover: Integer Programming Vertex Cover as an Integer Program Consider a graph G = (V, E) with weight w i 0 for each node i V. Have { a decision variable x i for each node i: 0 if i not in vertex cover x i = 1 otherwise Create a single n-dimensional vector x where the i-th coordinate corresponds to x i. Use linear inequalities to encode the requirement that selected nodes form a vertex cover, and an objective function to encode the goal of minimizing weight. (VC.IP) Min i V w ix i s.t. x i + x j 1 (i, j) E x i {0, 1} i V

54 Vertex Cover (LP) Problem Formulation Theorem (11.21) S is a vertex cover in G iff vector x satisfies the constraints in (VC.IP). Further, w(s) = w t x. In matrix form, define matrix A whose columns correspond to nodes in V and whose { rows correspond to edges in E: 1 if node i is an end of edge e A[e, i] = 0 otherwise Then we can write Ax 1, 1 x 0. So our problem is: min(w t x subject to 1 x 0, Ax 1, x has integer coords) ( ) Theorem (11.22) Vertex Cover p Integer Programming

55 Vertex Cover (LP) Algorithm Vertex Cover: Linear Programming Using Linear Programming for Vertex Cover Drop the requirement that x i {0, 1} and let x i [0, 1] to get an instance of LP, (VC.LP), which we can solve in polynomial time. Call such a vector x and let w LP = w t x be the value of the objective function. Theorem (11.23) Let S denote a vertex cover of minimum weight. Then w LP w(s ). Proof. Vertex covers of G correspond to integer solutions of (VC.IP), so the minimum of ( ) over all integer x vectors is exactly the minimum-weight vertex cover. In (VC.LP), we minimize over more choices of x, so the minimum of (VC.LP) is no larger than that of (VC.IP).

56 Vertex Cover (LP) Algorithm Vertex Cover: Linear Programming Rounding Given a fractional solution {x i }, define S = {i V : x i 1 2 }. Theorem (11.24) The set S defined this way is a vertex cover, and w(s) 2w LP. Proof. Claim 1: S is a vertex cover. Consider an edge e = (i, j). Claim: at least one of i or j is in S. Recall that one inequality is x i + x j 1. So any solution x satisfies this: either x i 1 2 or x j 1 2. at least one of them will be rounded up, and i or j will be in S.

57 Vertex Cover (LP) Algorithm Vertex Cover: Linear Programming Proof. Claim 2: w(s) 2w LP. Consider w(s). S only has vertices with x i 1 2. Thus, the linear program paid at least 1 2 w i for node i, and we only pay w i at most twice as much, i.e. w LP = w t x = i w ix i i S w ix i 1 2 i S w i = 1 2 w(s). Theorem (11.25) The algo produces a vertex cover S of at most twice the minimum possible weight: w(s) (11.24) 2w LP (11.23) 2w(S )

58 Generalized Load Balancing Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

59 Generalized Load Balancing Problem Formulation Generalized Load Balancing: Problem Formulation Problem Generalization of the Load Balancing Problem. Given a set J of n jobs, and a set M of m machines. Additional requirement: for each job, there is just a subset of machines to which it can be assigned, i.e. each job j has a fixed given size t j 0 and a set of machines M j M that it may be assigned to. An assignment of jobs is feasible if each job j is assigned to a machine i M j. Goal Minimize load on any machine: Using J i J as the jobs assigned to a machine i M in a feasible assignment, and L i = j J i t j to denote the resulting load, we seek to minimize max i L i.

60 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Designing and Analyzing the Algorithm (GL.IP) Min L i x ij = t j j J j x ij L i M x ij {0, t j } j J, i M j x ij = 0 j J, i M j Theorem (11.26) An assignment of jobs to machines has load at most L iff the vector x, defined by setting x ij = t j whenever job j is assigned to machine i, and x ij = 0 otherwise, satisfies the constraints in (GL.IP), with L set to the maximum load of the assignment.

61 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Consider the corresponding linear program (GL.LP) obtained by replacing the requirement that each x ij {0, t j } by x ij 0 j J and i M j. Theorem (11.27) If the optimum value of (GL.LP) is L, then the optimal load is at least L L. We can use LP to obtain such a solution (x, L) in polynomial time. Theorem (11.28) The optimal load is at least L max j t j. (see 11.2)

62 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Rounding the solution when there are no cycles Problem: the LP solution may assign small fractions of job j to each of the m machines. Analysis: Some jobs may be spread over many machines, but this cannot happen to too many jobs. Consider the bipartite graph G(x) = (V (x), E(x)): nodes are V (x) = M J, and there is an edge (i, j) E(x) iff x ij > 0.

63 Generalized Load Balancing Algorithm Theorem (11.29) Given a solution (x, L) of (GL.LP) s.t. G(x) has no cycles, we can use this solution x to obtain a feasible assignment with load at most L + L in O(mn) time. Proof. G(x) has no cycles = each connected component is a tree. Pick one component (it is a tree with jobs and machines as nodes). 1. Root the tree at an arbitrary node. 2. Consider a job j. If its node is a leaf of the tree, let machine node i be its parent. 2a. Since j has degree 1 (leaf node), machine i is the only machine that has been assigned any part of job j. x ij = t j. So this will assign such a job j to its only neighbour i. 2b. For a job j whose node is not a leaf, we assign j to an arbitrary child of its node in the rooted tree. This method can be implemented in O(mn) time. It is feasible, as (GL.LP) required x ij = 0 whenever i M j.

64 Generalized Load Balancing Algorithm Proof. Claim: load is at most L + L. Let i be any machine, and J i be its set of jobs. The jobs assigned to i form a subset of the neighbours of i in G(x): J i contains those children of node i that are leaves, plus possibly the parent p(i) of node i. Consider each p(i) separately. For all other jobs j p(i) assigned to i, we have x ij = t j. j J i,j p(i) t j j J x ij L For the parent j = p(i), we use t j L (11.28). Adding the inequalities, we get j J i x ij L + L. By (11.27), L L, so L + L 2L (twice of optimum), so we get: Theorem (11.30) Restatement of (11.29), but with load at most twice the optimum.

65 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Eliminating cycles from the LP solution We need to convert an arbitrary solution of (GL.LP) into a solution x with no cycles in G(x). Given a fixed load value L, we use a flow computation to decide if (GL.LP) has a solution with value at most L. Consider the directed flow graph G = (V, E), with V = M J {v}, where v is a new node.

66 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Theorem (11.31) The solutions of this flow problem with capacity L are in one-to-one correspondence with solutions of (GL.LP) with value L, where x ij is the flow value along edge (i, j), and the flow value on edge (i, v) is the load j x ij on machine i. Thus, we can solve (GL.LP) using flow computations and a binary search for optimal L. From the flow graph, G(x) is an undirected graph obtained by ignoring directions, deleting v and all adjacent edges, and deleting all edges from J to M that do not carry flow.

67 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Theorem (11.32) Let (x, L) be any solution to (GL.LP) and C be a cycle in G(x). In time linear in the length of the cycle, we can modify x to eliminate at least one edge from G(x) without increasing the load or introducing any new edges. Proof. Consider the cycle C in G(x). G(x) corresponds to the set of edges that carry flow in the solution x. We augment the flow along cycle C. This will keep the balance between incoming and outgoing flow at any node, and will eliminate one backward edge from G(x).

68 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Proof. Assume the nodes along the cycle are i 1, j 1, i 2, j 2,..., i k, j k, where i l is a machine node and j l is a job node. We decrease the flow along all edges (j l, i l ) and increase the flow on the edges (j l, i l+1 ) for all l = 1,..., k (where k + 1 is used to denote 1), by the same amount δ. This does not affect flow conservation constraints. By setting δ = min k l=1 x il j l, we ensure that the flow remains feasible and the edge obtaining the minimum is deleted from G(x).

69 Generalized Load Balancing Algorithm Generalized Load Balancing: Algorithm Theorem (11.33) Given an instance of the Generalized Load Balancing Problem, we can find, in polynomial time, a feasible assignment with load at most twice the minimum possible.

70 Knapsack Problem: Arbitrarily Good Approximations Outline 1 Load Balancing 2 Center Selection 3 Set Cover: A General Greedy Heuristic 4 Vertex Cover: Pricing Method 5 (Maximum) Disjoint Paths: Maximization via Pricing Method 6 Vertex Cover (LP) 7 Generalized Load Balancing 8 Knapsack Problem: Arbitrarily Good Approximations

71 Knapsack Problem: Arbitrarily Good Approximations Problem Formulation Knapsack Problem: Problem Formulation Problem n items to pack in a knapsack with capacity W. Each item i = 1,..., n has two integer parameters: weight w i and value v i. Goal Find a subset S of items of maximum value s.t. total weight W, i.e. maximize i S v i subject to the condition i S w i W. In addition, we take a parameter ɛ, the desired precision. Our algo will find a subset S satisfying the conditions above, and with i S v i at most a (1 + ɛ) factor below the maximum possible. The algo will run in polynomial time for any fixed choice of ɛ > 0. We call this a polynomial-time approximation scheme.

72 Knapsack Problem: Arbitrarily Good Approximations Algorithm Knapsack Problem: Algorithm Designing the Algorithm We use a DP algo (given later) with running time O(n 2 v ) (pseudopolynomial) where v = max i v i. If values are large, we use a rounding parameter b and consider the values rounded to an integer multiple of b. For each item i, let its rounded value be v i = vi b b. The rounded and original values are close to each other. Theorem (11.34) For each item i, v i v i v i + b.

73 Knapsack Problem: Arbitrarily Good Approximations Algorithm Knapsack Problem: Algorithm Instead of solving with the rounded values, we can divide all values by b and get an equivalent problem. Let ˆv i = vi b = vi b b for i = 1,..., n. Theorem (11.35) The Knapsack Problem with values v i and the scaled problem with values ˆv i have the same set of optimum solutions, the optimum values differ exactly by a factor of b, and the scaled values are integral.

74 Knapsack Problem: Arbitrarily Good Approximations Algorithm Knapsack Problem: Algorithm Assume all items have weight at most W. Also assume for simplicity that ɛ 1 is an integer. procedure Knapsack-Approx(ɛ) Set b = ɛ 2n max i v i Solve Knapsack Problem with values ˆv i (equivalently v i ) Return the set S of items found end procedure Theorem (11.36) The set of items S returned by Knapsack-Approx has total weight i S w i W.

75 Knapsack Problem: Arbitrarily Good Approximations Analysis Knapsack Problem: Analysis Theorem (11.37) Knapsack-Approx runs in polynomial time for any fixed ɛ > 0. Proof. Setting b and rounding item values can be done in polynomial time. The DP algo we use has running time O(n 2 v ) (v = max i v i ) for integer values. In this instance, each item i has weight w i and value ˆv i. The item j with max value v j = max i v i also has maximum value in the rounded problem, so max i ˆv i = ˆv j = vj b = 2nɛ 1. Hence, the overall running time is O(n 3 ɛ 1 ). Note: This is polynomial for any fixed ɛ > 0, but dependence on ɛ is not polynomial.

76 Knapsack Problem: Arbitrarily Good Approximations Analysis Theorem (11.38) If S is the solution found by Knapsack-Approx, and S is any other solution, then (1 + ɛ) i S v i i S v i. Proof. Let S be any set satisfying i S w i W. Our algo finds the optimal solution with values v i, so we have v i i S v i. Thus, i S i S v i (11.34) i S v i i S (11.34) v i (v i + b) nb + i S i S v i ( ) Let j be the item with the largest value; by our choice of b, v j = 2ɛ 1 nb and v j = v j. By our assumption w i W i, we have i S v i v j = 2ɛ 1 nb. From ( ), i S v i i S v i nb, and thus i S v i (2ɛ 1 1)nb. Hence nb ɛ i S v i for ɛ 1, so i S v i i S v i + nb (1 + ɛ) i S v i.

77 Knapsack Problem: Arbitrarily Good Approximations The Dynamic Programming Algo Knapsack Problem: DP Algo The Dynamic Programming Algo Our subproblems are defined by i and a target value V, and OPT(i, V ) is the smallest knapsack weight W so that one can obtain a solution using a subset of items {1,..., i} with value at least V. We will have a subproblem for all i = 0,..., n and values V = 0,..., i j=1 v j. If v denotes max i v i, then the largest V can get is n j=1 v j nv. Thus, assuming values are integral, there are at most O(n 2 v ) subproblems. We are looking for the largest value V s.t. OPT(n, V ) W.

78 Knapsack Problem: Arbitrarily Good Approximations The Dynamic Programming Algo Knapsack Problem: DP Algo Recurrence relation: Consider whether last item n is included in the optimal solution O. If n O, then OPT(n, V ) = OPT(n 1, V ). If n O, then OPT(n, V ) = w n + OPT(n 1, max(0, V v n )). Theorem (11.39) If V > n 1 i=1 v i, then OPT(n, V ) = w n + OPT(n 1, V v n ). Otherwise, OPT(n, V ) = min(opt(n 1, V ), w n + OPT(n 1, max(0, V v n ))). Theorem (11.40) Knapsack(n) takes O(n 2 v ) time and correctly computes the optimal values of the subproblems.

79 Knapsack Problem: Arbitrarily Good Approximations The Dynamic Programming Algo Knapsack Problem: DP Algo procedure Knapsack(n) Array M[0... n, 0... V ] for i = 0,..., n do M[i, 0] = 0 end for for i = 1, 2,..., n do for V = 1,..., i j=1 v j do if V > i 1 j=1 v j then M[i, V ] = w i + M[i 1, V ] else M[i, V ] = min(m[i 1, V ], w i + M[i 1, max(0, V v i )]) end if end for end for Return the maximum value V s.t. M[n, V ] W end procedure

80 Conclusion Conclusion Many important problems are NP-complete. Even if we may not be able to find an efficient algorithm to solve these problems, we would still like to be able to approximate solutions efficiently. We have looked at some techniques for proving bounds on the results of some simple algorithms, and techniques for devising algorithms to obtain approximate solutions. LP rounding algorithms for Generalized Load Balancing and Weighted Vertex Cover illustrate a widely used method for designing approximation algorithms: Set up an integer programming formulation for the problem Transform it to a related linear programming problem Round the solution

81 Conclusion Conclusion One topic not covered is inapproximability. Just as one can prove that a given NP-hard problem can be approximated to within a certain factor in polynomial time, one can sometimes establish lower bounds, showing that if the problem can be approximated better than some factor c in polynomial time, then it could be solved optimally, thereby proving P=NP.

82 Conclusion The End The End

### Applied Algorithm Design Lecture 5

Applied Algorithm Design Lecture 5 Pietro Michiardi Eurecom Pietro Michiardi (Eurecom) Applied Algorithm Design Lecture 5 1 / 86 Approximation Algorithms Pietro Michiardi (Eurecom) Applied Algorithm Design

Approximation Algorithms Chapter Approximation Algorithms Q. Suppose I need to solve an NP-hard problem. What should I do? A. Theory says you're unlikely to find a poly-time algorithm. Must sacrifice one

### ! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. !-approximation algorithm.

Approximation Algorithms Chapter Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of

### ! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. #-approximation algorithm.

Approximation Algorithms 11 Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of three

### 11. APPROXIMATION ALGORITHMS

11. APPROXIMATION ALGORITHMS load balancing center selection pricing method: vertex cover LP rounding: vertex cover generalized load balancing knapsack problem Lecture slides by Kevin Wayne Copyright 2005

### Algorithm Design and Analysis

Algorithm Design and Analysis LECTURE 27 Approximation Algorithms Load Balancing Weighted Vertex Cover Reminder: Fill out SRTEs online Don t forget to click submit Sofya Raskhodnikova 12/6/2011 S. Raskhodnikova;

### 2.3 Scheduling jobs on identical parallel machines

2.3 Scheduling jobs on identical parallel machines There are jobs to be processed, and there are identical machines (running in parallel) to which each job may be assigned Each job = 1,,, must be processed

### 5.1 Bipartite Matching

CS787: Advanced Algorithms Lecture 5: Applications of Network Flow In the last lecture, we looked at the problem of finding the maximum flow in a graph, and how it can be efficiently solved using the Ford-Fulkerson

### 5 INTEGER LINEAR PROGRAMMING (ILP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1

5 INTEGER LINEAR PROGRAMMING (ILP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 General Integer Linear Program: (ILP) min c T x Ax b x 0 integer Assumption: A, b integer The integrality condition

### Fairness in Routing and Load Balancing

Fairness in Routing and Load Balancing Jon Kleinberg Yuval Rabani Éva Tardos Abstract We consider the issue of network routing subject to explicit fairness conditions. The optimization of fairness criteria

### Lecture 7: Approximation via Randomized Rounding

Lecture 7: Approximation via Randomized Rounding Often LPs return a fractional solution where the solution x, which is supposed to be in {0, } n, is in [0, ] n instead. There is a generic way of obtaining

### Approximation Algorithms: LP Relaxation, Rounding, and Randomized Rounding Techniques. My T. Thai

Approximation Algorithms: LP Relaxation, Rounding, and Randomized Rounding Techniques My T. Thai 1 Overview An overview of LP relaxation and rounding method is as follows: 1. Formulate an optimization

### Lecture 3: Linear Programming Relaxations and Rounding

Lecture 3: Linear Programming Relaxations and Rounding 1 Approximation Algorithms and Linear Relaxations For the time being, suppose we have a minimization problem. Many times, the problem at hand can

### CSC2420 Fall 2012: Algorithm Design, Analysis and Theory

CSC2420 Fall 2012: Algorithm Design, Analysis and Theory Allan Borodin November 15, 2012; Lecture 10 1 / 27 Randomized online bipartite matching and the adwords problem. We briefly return to online algorithms

### Approximation Algorithms. Scheduling. Approximation algorithms. Scheduling jobs on a single machine

Approximation algorithms Approximation Algorithms Fast. Cheap. Reliable. Choose two. NP-hard problems: choose 2 of optimal polynomial time all instances Approximation algorithms. Trade-off between time

### Near Optimal Solutions

Near Optimal Solutions Many important optimization problems are lacking efficient solutions. NP-Complete problems unlikely to have polynomial time solutions. Good heuristics important for such problems.

### CSC2420 Spring 2015: Lecture 3

CSC2420 Spring 2015: Lecture 3 Allan Borodin January 22, 2015 1 / 1 Announcements and todays agenda Assignment 1 due next Thursday. I may add one or two additional questions today or tomorrow. Todays agenda

### Linear Programming. March 14, 2014

Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1

### Warshall s Algorithm: Transitive Closure

CS 0 Theory of Algorithms / CS 68 Algorithms in Bioinformaticsi Dynamic Programming Part II. Warshall s Algorithm: Transitive Closure Computes the transitive closure of a relation (Alternatively: all paths

### princeton univ. F 13 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Sanjeev Arora

princeton univ. F 13 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Sanjeev Arora Scribe: One of the running themes in this course is the notion of

### Analysis of Algorithms, I

Analysis of Algorithms, I CSOR W4231.002 Eleni Drinea Computer Science Department Columbia University Thursday, February 26, 2015 Outline 1 Recap 2 Representing graphs 3 Breadth-first search (BFS) 4 Applications

### Complexity Theory. IE 661: Scheduling Theory Fall 2003 Satyaki Ghosh Dastidar

Complexity Theory IE 661: Scheduling Theory Fall 2003 Satyaki Ghosh Dastidar Outline Goals Computation of Problems Concepts and Definitions Complexity Classes and Problems Polynomial Time Reductions Examples

### Answers to some of the exercises.

Answers to some of the exercises. Chapter 2. Ex.2.1 (a) There are several ways to do this. Here is one possibility. The idea is to apply the k-center algorithm first to D and then for each center in D

### Minimum Makespan Scheduling

Minimum Makespan Scheduling Minimum makespan scheduling: Definition and variants Factor 2 algorithm for identical machines PTAS for identical machines Factor 2 algorithm for unrelated machines Martin Zachariasen,

### Week 5 Integral Polyhedra

Week 5 Integral Polyhedra We have seen some examples 1 of linear programming formulation that are integral, meaning that every basic feasible solution is an integral vector. This week we develop a theory

### CMPSCI611: Approximating MAX-CUT Lecture 20

CMPSCI611: Approximating MAX-CUT Lecture 20 For the next two lectures we ll be seeing examples of approximation algorithms for interesting NP-hard problems. Today we consider MAX-CUT, which we proved to

### Why? A central concept in Computer Science. Algorithms are ubiquitous.

Analysis of Algorithms: A Brief Introduction Why? A central concept in Computer Science. Algorithms are ubiquitous. Using the Internet (sending email, transferring files, use of search engines, online

### Scheduling Shop Scheduling. Tim Nieberg

Scheduling Shop Scheduling Tim Nieberg Shop models: General Introduction Remark: Consider non preemptive problems with regular objectives Notation Shop Problems: m machines, n jobs 1,..., n operations

### The Goldberg Rao Algorithm for the Maximum Flow Problem

The Goldberg Rao Algorithm for the Maximum Flow Problem COS 528 class notes October 18, 2006 Scribe: Dávid Papp Main idea: use of the blocking flow paradigm to achieve essentially O(min{m 2/3, n 1/2 }

### Permutation Betting Markets: Singleton Betting with Extra Information

Permutation Betting Markets: Singleton Betting with Extra Information Mohammad Ghodsi Sharif University of Technology ghodsi@sharif.edu Hamid Mahini Sharif University of Technology mahini@ce.sharif.edu

### Offline sorting buffers on Line

Offline sorting buffers on Line Rohit Khandekar 1 and Vinayaka Pandit 2 1 University of Waterloo, ON, Canada. email: rkhandekar@gmail.com 2 IBM India Research Lab, New Delhi. email: pvinayak@in.ibm.com

### Solutions to Homework 6

Solutions to Homework 6 Debasish Das EECS Department, Northwestern University ddas@northwestern.edu 1 Problem 5.24 We want to find light spanning trees with certain special properties. Given is one example

### 1 Approximating Set Cover

CS 05: Algorithms (Grad) Feb 2-24, 2005 Approximating Set Cover. Definition An Instance (X, F ) of the set-covering problem consists of a finite set X and a family F of subset of X, such that every elemennt

### Distributed Computing over Communication Networks: Maximal Independent Set

Distributed Computing over Communication Networks: Maximal Independent Set What is a MIS? MIS An independent set (IS) of an undirected graph is a subset U of nodes such that no two nodes in U are adjacent.

### Definition 11.1. Given a graph G on n vertices, we define the following quantities:

Lecture 11 The Lovász ϑ Function 11.1 Perfect graphs We begin with some background on perfect graphs. graphs. First, we define some quantities on Definition 11.1. Given a graph G on n vertices, we define

### IE 680 Special Topics in Production Systems: Networks, Routing and Logistics*

IE 680 Special Topics in Production Systems: Networks, Routing and Logistics* Rakesh Nagi Department of Industrial Engineering University at Buffalo (SUNY) *Lecture notes from Network Flows by Ahuja, Magnanti

### JUST-IN-TIME SCHEDULING WITH PERIODIC TIME SLOTS. Received December May 12, 2003; revised February 5, 2004

Scientiae Mathematicae Japonicae Online, Vol. 10, (2004), 431 437 431 JUST-IN-TIME SCHEDULING WITH PERIODIC TIME SLOTS Ondřej Čepeka and Shao Chin Sung b Received December May 12, 2003; revised February

### Transportation Polytopes: a Twenty year Update

Transportation Polytopes: a Twenty year Update Jesús Antonio De Loera University of California, Davis Based on various papers joint with R. Hemmecke, E.Kim, F. Liu, U. Rothblum, F. Santos, S. Onn, R. Yoshida,

### 4.6 Linear Programming duality

4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP. Different spaces and objective functions but in general same optimal

### Topic: Greedy Approximations: Set Cover and Min Makespan Date: 1/30/06

CS880: Approximations Algorithms Scribe: Matt Elder Lecturer: Shuchi Chawla Topic: Greedy Approximations: Set Cover and Min Makespan Date: 1/30/06 3.1 Set Cover The Set Cover problem is: Given a set of

### Computer Algorithms. NP-Complete Problems. CISC 4080 Yanjun Li

Computer Algorithms NP-Complete Problems NP-completeness The quest for efficient algorithms is about finding clever ways to bypass the process of exhaustive search, using clues from the input in order

### Max Flow, Min Cut, and Matchings (Solution)

Max Flow, Min Cut, and Matchings (Solution) 1. The figure below shows a flow network on which an s-t flow is shown. The capacity of each edge appears as a label next to the edge, and the numbers in boxes

### 3. Linear Programming and Polyhedral Combinatorics

Massachusetts Institute of Technology Handout 6 18.433: Combinatorial Optimization February 20th, 2009 Michel X. Goemans 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the

### Network (Tree) Topology Inference Based on Prüfer Sequence

Network (Tree) Topology Inference Based on Prüfer Sequence C. Vanniarajan and Kamala Krithivasan Department of Computer Science and Engineering Indian Institute of Technology Madras Chennai 600036 vanniarajanc@hcl.in,

### 24. The Branch and Bound Method

24. The Branch and Bound Method It has serious practical consequences if it is known that a combinatorial problem is NP-complete. Then one can conclude according to the present state of science that no

### Guessing Game: NP-Complete?

Guessing Game: NP-Complete? 1. LONGEST-PATH: Given a graph G = (V, E), does there exists a simple path of length at least k edges? YES 2. SHORTEST-PATH: Given a graph G = (V, E), does there exists a simple

### Discrete Mathematics & Mathematical Reasoning Chapter 10: Graphs

Discrete Mathematics & Mathematical Reasoning Chapter 10: Graphs Kousha Etessami U. of Edinburgh, UK Kousha Etessami (U. of Edinburgh, UK) Discrete Mathematics (Chapter 6) 1 / 13 Overview Graphs and Graph

### 2.3 Convex Constrained Optimization Problems

42 CHAPTER 2. FUNDAMENTAL CONCEPTS IN CONVEX OPTIMIZATION Theorem 15 Let f : R n R and h : R R. Consider g(x) = h(f(x)) for all x R n. The function g is convex if either of the following two conditions

### Permutation Betting Markets: Singleton Betting with Extra Information

Permutation Betting Markets: Singleton Betting with Extra Information Mohammad Ghodsi Sharif University of Technology ghodsi@sharif.edu Hamid Mahini Sharif University of Technology mahini@ce.sharif.edu

### Bicolored Shortest Paths in Graphs with Applications to Network Overlay Design

Bicolored Shortest Paths in Graphs with Applications to Network Overlay Design Hongsik Choi and Hyeong-Ah Choi Department of Electrical Engineering and Computer Science George Washington University Washington,

### Approximated Distributed Minimum Vertex Cover Algorithms for Bounded Degree Graphs

Approximated Distributed Minimum Vertex Cover Algorithms for Bounded Degree Graphs Yong Zhang 1.2, Francis Y.L. Chin 2, and Hing-Fung Ting 2 1 College of Mathematics and Computer Science, Hebei University,

### Discuss the size of the instance for the minimum spanning tree problem.

3.1 Algorithm complexity The algorithms A, B are given. The former has complexity O(n 2 ), the latter O(2 n ), where n is the size of the instance. Let n A 0 be the size of the largest instance that can

### Network File Storage with Graceful Performance Degradation

Network File Storage with Graceful Performance Degradation ANXIAO (ANDREW) JIANG California Institute of Technology and JEHOSHUA BRUCK California Institute of Technology A file storage scheme is proposed

### Diversity Coloring for Distributed Data Storage in Networks 1

Diversity Coloring for Distributed Data Storage in Networks 1 Anxiao (Andrew) Jiang and Jehoshua Bruck California Institute of Technology Pasadena, CA 9115, U.S.A. {jax, bruck}@paradise.caltech.edu Abstract

### Minimize subject to. x S R

Chapter 12 Lagrangian Relaxation This chapter is mostly inspired by Chapter 16 of [1]. In the previous chapters, we have succeeded to find efficient algorithms to solve several important problems such

### Graphical degree sequences and realizations

swap Graphical and realizations Péter L. Erdös Alfréd Rényi Institute of Mathematics Hungarian Academy of Sciences MAPCON 12 MPIPKS - Dresden, May 15, 2012 swap Graphical and realizations Péter L. Erdös

### OPRE 6201 : 2. Simplex Method

OPRE 6201 : 2. Simplex Method 1 The Graphical Method: An Example Consider the following linear program: Max 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2

### Linear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.

Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.

### Classification - Examples

Lecture 2 Scheduling 1 Classification - Examples 1 r j C max given: n jobs with processing times p 1,...,p n and release dates r 1,...,r n jobs have to be scheduled without preemption on one machine taking

### Introduction to Algorithms Review information for Prelim 1 CS 4820, Spring 2010 Distributed Wednesday, February 24

Introduction to Algorithms Review information for Prelim 1 CS 4820, Spring 2010 Distributed Wednesday, February 24 The final exam will cover seven topics. 1. greedy algorithms 2. divide-and-conquer algorithms

### Linear Programming. April 12, 2005

Linear Programming April 1, 005 Parts of this were adapted from Chapter 9 of i Introduction to Algorithms (Second Edition) /i by Cormen, Leiserson, Rivest and Stein. 1 What is linear programming? The first

### Optimal Index Codes for a Class of Multicast Networks with Receiver Side Information

Optimal Index Codes for a Class of Multicast Networks with Receiver Side Information Lawrence Ong School of Electrical Engineering and Computer Science, The University of Newcastle, Australia Email: lawrence.ong@cantab.net

### Small Maximal Independent Sets and Faster Exact Graph Coloring

Small Maximal Independent Sets and Faster Exact Graph Coloring David Eppstein Univ. of California, Irvine Dept. of Information and Computer Science The Exact Graph Coloring Problem: Given an undirected

### 8.1 Makespan Scheduling

600.469 / 600.669 Approximation Algorithms Lecturer: Michael Dinitz Topic: Dynamic Programing: Min-Makespan and Bin Packing Date: 2/19/15 Scribe: Gabriel Kaptchuk 8.1 Makespan Scheduling Consider an instance

### 136 CHAPTER 4. INDUCTION, GRAPHS AND TREES

136 TER 4. INDUCTION, GRHS ND TREES 4.3 Graphs In this chapter we introduce a fundamental structural idea of discrete mathematics, that of a graph. Many situations in the applications of discrete mathematics

### Outline. NP-completeness. When is a problem easy? When is a problem hard? Today. Euler Circuits

Outline NP-completeness Examples of Easy vs. Hard problems Euler circuit vs. Hamiltonian circuit Shortest Path vs. Longest Path 2-pairs sum vs. general Subset Sum Reducing one problem to another Clique

### The Union-Find Problem Kruskal s algorithm for finding an MST presented us with a problem in data-structure design. As we looked at each edge,

The Union-Find Problem Kruskal s algorithm for finding an MST presented us with a problem in data-structure design. As we looked at each edge, cheapest first, we had to determine whether its two endpoints

### ON THE COMPLEXITY OF THE GAME OF SET. {kamalika,pbg,dratajcz,hoeteck}@cs.berkeley.edu

ON THE COMPLEXITY OF THE GAME OF SET KAMALIKA CHAUDHURI, BRIGHTEN GODFREY, DAVID RATAJCZAK, AND HOETECK WEE {kamalika,pbg,dratajcz,hoeteck}@cs.berkeley.edu ABSTRACT. Set R is a card game played with a

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### Lecture 6 Online and streaming algorithms for clustering

CSE 291: Unsupervised learning Spring 2008 Lecture 6 Online and streaming algorithms for clustering 6.1 On-line k-clustering To the extent that clustering takes place in the brain, it happens in an on-line

### Dynamic programming. Doctoral course Optimization on graphs - Lecture 4.1. Giovanni Righini. January 17 th, 2013

Dynamic programming Doctoral course Optimization on graphs - Lecture.1 Giovanni Righini January 1 th, 201 Implicit enumeration Combinatorial optimization problems are in general NP-hard and we usually

### THE PROBLEM WORMS (1) WORMS (2) THE PROBLEM OF WORM PROPAGATION/PREVENTION THE MINIMUM VERTEX COVER PROBLEM

1 THE PROBLEM OF WORM PROPAGATION/PREVENTION I.E. THE MINIMUM VERTEX COVER PROBLEM Prof. Tiziana Calamoneri Network Algorithms A.y. 2014/15 2 THE PROBLEM WORMS (1)! A computer worm is a standalone malware

### SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH

31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,

### 1. Sorting (assuming sorting into ascending order) a) BUBBLE SORT

DECISION 1 Revision Notes 1. Sorting (assuming sorting into ascending order) a) BUBBLE SORT Make sure you show comparisons clearly and label each pass First Pass 8 4 3 6 1 4 8 3 6 1 4 3 8 6 1 4 3 6 8 1

### Private Approximation of Clustering and Vertex Cover

Private Approximation of Clustering and Vertex Cover Amos Beimel, Renen Hallak, and Kobbi Nissim Department of Computer Science, Ben-Gurion University of the Negev Abstract. Private approximation of search

### 10. Graph Matrices Incidence Matrix

10 Graph Matrices Since a graph is completely determined by specifying either its adjacency structure or its incidence structure, these specifications provide far more efficient ways of representing a

### Resource Allocation with Time Intervals

Resource Allocation with Time Intervals Andreas Darmann Ulrich Pferschy Joachim Schauer Abstract We study a resource allocation problem where jobs have the following characteristics: Each job consumes

### Dynamic Programming. Applies when the following Principle of Optimality

Dynamic Programming Applies when the following Principle of Optimality holds: In an optimal sequence of decisions or choices, each subsequence must be optimal. Translation: There s a recursive solution.

### Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs

CSE599s: Extremal Combinatorics November 21, 2011 Lecture 15 An Arithmetic Circuit Lowerbound and Flows in Graphs Lecturer: Anup Rao 1 An Arithmetic Circuit Lower Bound An arithmetic circuit is just like

### The Conference Call Search Problem in Wireless Networks

The Conference Call Search Problem in Wireless Networks Leah Epstein 1, and Asaf Levin 2 1 Department of Mathematics, University of Haifa, 31905 Haifa, Israel. lea@math.haifa.ac.il 2 Department of Statistics,

### Lecture 4 Online and streaming algorithms for clustering

CSE 291: Geometric algorithms Spring 2013 Lecture 4 Online and streaming algorithms for clustering 4.1 On-line k-clustering To the extent that clustering takes place in the brain, it happens in an on-line

### Chapter 13: Binary and Mixed-Integer Programming

Chapter 3: Binary and Mixed-Integer Programming The general branch and bound approach described in the previous chapter can be customized for special situations. This chapter addresses two special situations:

### 3 Does the Simplex Algorithm Work?

Does the Simplex Algorithm Work? In this section we carefully examine the simplex algorithm introduced in the previous chapter. Our goal is to either prove that it works, or to determine those circumstances

### GENERATING LOW-DEGREE 2-SPANNERS

SIAM J. COMPUT. c 1998 Society for Industrial and Applied Mathematics Vol. 27, No. 5, pp. 1438 1456, October 1998 013 GENERATING LOW-DEGREE 2-SPANNERS GUY KORTSARZ AND DAVID PELEG Abstract. A k-spanner

### On the independence number of graphs with maximum degree 3

On the independence number of graphs with maximum degree 3 Iyad A. Kanj Fenghui Zhang Abstract Let G be an undirected graph with maximum degree at most 3 such that G does not contain any of the three graphs

CS787: Advanced Algorithms Topic: Online Learning Presenters: David He, Chris Hopman 17.3.1 Follow the Perturbed Leader 17.3.1.1 Prediction Problem Recall the prediction problem that we discussed in class.

### Minimum cost maximum flow, Minimum cost circulation, Cost/Capacity scaling

6.854 Advanced Algorithms Lecture 16: 10/11/2006 Lecturer: David Karger Scribe: Kermin Fleming and Chris Crutchfield, based on notes by Wendy Chu and Tudor Leu Minimum cost maximum flow, Minimum cost circulation,

### Analysis of Approximation Algorithms for k-set Cover using Factor-Revealing Linear Programs

Analysis of Approximation Algorithms for k-set Cover using Factor-Revealing Linear Programs Stavros Athanassopoulos, Ioannis Caragiannis, and Christos Kaklamanis Research Academic Computer Technology Institute

### Classification - Examples -1- 1 r j C max given: n jobs with processing times p 1,..., p n and release dates

Lecture 2 Scheduling 1 Classification - Examples -1-1 r j C max given: n jobs with processing times p 1,..., p n and release dates r 1,..., r n jobs have to be scheduled without preemption on one machine

### Single machine parallel batch scheduling with unbounded capacity

Workshop on Combinatorics and Graph Theory 21th, April, 2006 Nankai University Single machine parallel batch scheduling with unbounded capacity Yuan Jinjiang Department of mathematics, Zhengzhou University

### Scheduling. Open shop, job shop, flow shop scheduling. Related problems. Open shop, job shop, flow shop scheduling

Scheduling Basic scheduling problems: open shop, job shop, flow job The disjunctive graph representation Algorithms for solving the job shop problem Computational complexity of the job shop problem Open

### NP-Hardness Results Related to PPAD

NP-Hardness Results Related to PPAD Chuangyin Dang Dept. of Manufacturing Engineering & Engineering Management City University of Hong Kong Kowloon, Hong Kong SAR, China E-Mail: mecdang@cityu.edu.hk Yinyu

### 1 Introduction. Linear Programming. Questions. A general optimization problem is of the form: choose x to. max f(x) subject to x S. where.

Introduction Linear Programming Neil Laws TT 00 A general optimization problem is of the form: choose x to maximise f(x) subject to x S where x = (x,..., x n ) T, f : R n R is the objective function, S

### Algorithm Design for Performance Aware VM Consolidation

Algorithm Design for Performance Aware VM Consolidation Alan Roytman University of California, Los Angeles Sriram Govindan Microsoft Corporation Jie Liu Microsoft Research Aman Kansal Microsoft Research

### Partitioning edge-coloured complete graphs into monochromatic cycles and paths

arxiv:1205.5492v1 [math.co] 24 May 2012 Partitioning edge-coloured complete graphs into monochromatic cycles and paths Alexey Pokrovskiy Departement of Mathematics, London School of Economics and Political

### A network flow algorithm for reconstructing. binary images from discrete X-rays

A network flow algorithm for reconstructing binary images from discrete X-rays Kees Joost Batenburg Leiden University and CWI, The Netherlands kbatenbu@math.leidenuniv.nl Abstract We present a new algorithm

### CSE 326, Data Structures. Sample Final Exam. Problem Max Points Score 1 14 (2x7) 2 18 (3x6) 3 4 4 7 5 9 6 16 7 8 8 4 9 8 10 4 Total 92.

Name: Email ID: CSE 326, Data Structures Section: Sample Final Exam Instructions: The exam is closed book, closed notes. Unless otherwise stated, N denotes the number of elements in the data structure

### Cost Model: Work, Span and Parallelism. 1 The RAM model for sequential computation:

CSE341T 08/31/2015 Lecture 3 Cost Model: Work, Span and Parallelism In this lecture, we will look at how one analyze a parallel program written using Cilk Plus. When we analyze the cost of an algorithm