# Example 5.5. The heuristics are demonstrated with this example of n=5 vertices and distances in the following matrix:

Save this PDF as:

Size: px
Start display at page:

Download "Example 5.5. The heuristics are demonstrated with this example of n=5 vertices and distances in the following matrix:"

## Transcription

1 HEURISTICS FOR THE TSP Notation: f = length of the tour given by the algortihm a f = length of the optimal tour min Most of the following heuristics are designed to solve symmetric instances of TSP, although they can be modified for asymmetric cases. Let us assume, that the distances are nonnegative and symmetric satisfy the triangle inequality. Without these assumptions, the bound given for the objective function value may not be valid. Many of these methods, e.g. the construction heuristics, start with an arbitrary vertex. To increase reliability, the procedure can be repeated from several (or all) vertices in turn. Then the computation time multiplies correspondingly. The heuristics are demonstrated with this example of n=5 vertices and distances in the following matrix: c ij CONSTRUCTION METHODS In construction methods, the tour is built up by adding new vertices to a partial tour or path. A. NEAREST NEIGHBOR METHOD 1. Choose an arbitrary starting node for the tour. This is the initial path of one node. 2. Find an unconnected node that is closest to the last node of the path. Join this node to the last node. 3. Repeat step 2 until all nodes are joined to the path. Then, join the last node to the first one. Evaluation of the solution: f a / f min # ½jlog(n)k + ½ Worst case complexity: T(n) = O(n 2 ) (jxk = smallest integer that is \$x) Experimental testing on the TSPLIB problems gives an average f a / f min Starting with node 1, the solution is , f = 31 Different solutions result from different starting points.

2 40 B. METHOD OF CLARKE AND WRIGHT = THE SAVINGS ALGORITHM 1. Choose an arbitrary node k (as a center node) for the tour. The starting closed walk visits each other node one by one and returns to node k after each of them. 2. For all pairs of nodes i,j = 1,...,n, such that i k, j k, i j, calculate the savings for replacing cycles k-i-k and k-j-k by a combined cycle k-i-j-k: s = c + c - c. ij ki kj ij 3. Sort the savings in decreasing order. 4. In the order of the savings s, modify the current walk by replacing two edges incident to the ij center, i-k and k-j, by edge i-j. The replacement is not made if i and j already belong to the same subtour. Repeat until a Hamiltonian cycle is formed. Evaluation of the solution: f a / f min = O(log n) 2 Worst case complexity: T(n) = O(n log n) Savings matrix, with center k=3: s ij Symmetry: s ij = s ji (only upper half of the matrix needed) Decreasing order: s 45, s 24, s 12, s 25, s 15, s14 1) 2) 3) 4) Solution: , f = 29 C. INSERTION METHODS In insertion methods, the tour is consrtructed by inserting new nodes to subtours, i.e. partial tours.

3 Notation: T = subtour, partial tour Îf = c ik + c kj - c ij = increase in tour length, when node k is inserted between nodes i and j. Define the distance from node k to subtour T as d(k,t) = c kj 41 METHOD OF NEAREST INSERTION 1. Choose an arbitrary node i as a starting node. 2. Find a node j closest to i. Form a subtour T = i-j-i. 3. Find a node k not in the subtour that is closest to any of the subtour nodes (that is, for which the distance to the subtour is smallest), d(k,t) = d(i,t) 4. Find an edge [i,j] of the subtour to insert k, such that the increase of length Îf = c + c - c ik kj ij is minimized. Modify the subtour by inserting k between i and j. 5. Go to 3 until a Hamiltonian cycle is formed. Evaluation of the solution: f a / f min # 2 Worst case complexity: T(n) = O(n 2 ) Starting node: i=1. Closest node: j=3: T= Closest node to the subtour: k=4: T = k=5: T = k=2: insertion to 1-3: Îf = c + c - c = = insertion to 3-4: Îf = c + c - c = = 8 ² smallest T = , f = 30 T = T = Solution: T = , f =30

4 42 METHOD OF CHEAPEST INSERTION 1. Choose an arbitrary node i as a starting node. 2. Find a node j closest to i. Form a subtour T = i-j-i. 3. Find an edge [i,j] of the subtour and a node k not in the subtour, such that the increase of length Îf = c ik + c kj - c ij is minimized. Modify the subtour by inserting k between i and j. 4. Go to 3 until a Hamiltonian cycle is formed. Evaluation of the solution: f a / f min # 2 2 Worst case complexity: T(n) = O(n log n) Starting node i=1. Closest node j=3: T= Edge 1-3, insert node 2: Îf = c + c - c = = 10 ² smallest : Îf = c + c - c = = : Îf = c + c - c = = k=2: T = , insert node 4: Îf = c + c - c = = , insert node 5: Îf = c + c - c = = , insert node 4: Îf = c + c - c = = 6 ² smallest , insert node 5: Îf = c + c - c = = , insert node 4: Îf = c + c - c = = , insert node 5: Îf = c + c - c = = k=4: T = Last node 5: optimal insertion to 4-3. k=5: T = , f = 29 T = T = Solution T = , f = 29

5 43 METHOD OF FARTHEST INSERTION 1. Choose an arbitrary node i as a starting node. 2. Find the farthest node from i, i.e. the node j for which distance c ij is longest. Form a subtour T = i-j-i. 3. Find a node k not in the subtour that is farthest from any of the subtour nodes (that is, for which the distance to the subtour is longest), d(k,t) = d(i,t) 4. Find an edge [i,j] of the subtour to which the insertion of k gives the smallest increase of length, i.e. for which Îf = c ik + c kj - c ij is smallest. Modify the subtour by inserting k between i and j. 5. Go to 3 until a Hamiltonian cycle is formed. Evaluation of the solution: f a / f min # jlog(n)k + 1 Worst case complexity: T(n) = O(n 2 ) According to experimental results, the Farthest Insertion Method usually gives a better average function value than nearest and cheapest insertion, although it is unknown whether the f-ratio has a constant upper bound. Starting node i=1. Farthest node j=4: T= Smallest distance to T from node 2: c = 7 ² largest 24 3: c = : c = 4 54 k=2: T = Smallest distance to T from node 3: c = : c = 4 54 k=3: T = , because Îf smallest when 3 inserted to 4-1. Last node 5: optimal insertion to 4-3. k=5: T = , f=29 T = T =

6 44 T = Solution: T = , f = 29 OTHER INSERTION METHODS: Quick insertion or Nearest addition, Arbitrary insertion, Convex hull insertion, Greatest angle insertion D. MINIMUM SPANNING TREE METHOD In this algorithm an Eulerian cycle is formed in a multigraph where the edges of a minimum spanning tree are doubled. 1. Construct the minimum spannng tree for the weighted graph G. 2. Choose a leaf node i (i.e. node of degree 1). Set i:=i. 0 o 3. If an untraversed edge [i,j] incident to i exists, go from i to j (edge [i,j] is added to the path). Set i:=j and repeat step 3. If all edges from i are traversed, return to the first predecessor of i, be it node k. If k=i (the o starting node), an Eulerian cycle is formed: go to 4. Else, set i:=k and repeat step Form a Hamiltonian cycle using shortcuts: traverse the Eulerian cycle by skipping every node already visited. Evaluation of the solution: f a / f min # 2 Worst case complexity: T(n) = O(n 2 ) Minimum spanning tree: Eulerian cycle: Construction of the Eulerian cycle: Choose i o = , i=3 3-2, i=2 Return to k=3 using 2-3, i=3 3-4, i=4 4-5, i=5 Return to k=4 using 5-4, i=4 Return to k=3 using 4-3, i=3 Return to k=1 using 3-1, i=1=i o. Eulerian cycle: Hamiltonian cycle with shortcuts: , f = 30

7 45 E. METHOD OF CHRISTOFIDES 1. Construct the minimum spannng tree T for the weighted graph G. 2. Identify the nodes with odd degree. Construct a minimum weight perfect matching for these nodes. Append the edges of the matching to the minimum spanning tree. Every node has an even degree. Generate an Eulerian cycle in this graph. 3. Form a Hamiltonian cyle using shortcuts as in the previous method. Evaluation of the solution: f a / f min # 1.5 This is the best worst case bound among nonexact methods! Worst case complexity: T(n) = O(n 3 ) Experimental testing on the TSPLIB problems gives an average f a / f min A minimum weight perfect matching in a complete graph of n vertices can be found in time 3 O(n ). Some edges may double when appending the matching edges to the tree. Start with the minimum spanning tree given in the previous example. Nodes with odd degree: 1,2,3,5 Perfect matchings in the set {1,2,3,5}:: 1-2, 3-5, weight 14 ² smallest 1-3, 2-5, weight 14 ² smallest 1-5, 2-3, weight 15 Add edges 1-2, 3-5 of the minimum weight matching to the spanning tree. Eulerian cycle: Hamiltonian cycle using shortcuts: Minimum spanning tree + matching edges Solution: , f = 32 F. MERGING METHODS METHOD OF NEAREST MERGER Start with n one-node subtours. Find two cycles with minimum distance and merge them into one cycle in an optimal way. Continue until you get one cycle.

8 46 Evaluation of the solution: f a / f min # 2 Worst case complexity: T(n) = O(n 2 ) ASSIGNMENT-BASED MERGING starts with a solution of the assignment relaxation. If separate subtours exist, two largest subtours are merged like in the previous method. This method is suitable mainly for asymmetric TSP IMPROVEMENT METHODS Improvement methods start with a complete tour and try to improve it gradually. Many improvement methods use local search or neighborhood search. LOCAL SEARCH = NEIGHBORHOOD SEARCH, a generic algorithm 1. Generate a feasible solution x. 2. Generate an unexamined neighbor y of x: y 0 N(x) 1 S. 3. If f(y) < f(x), set x:=y. 4. Stop, if all neighbors of x are examined without improvement: x is a locally optimal solution. Else, go to 2. S = set of feasible solutions N(x) = neighborhood of x, a set of neighboring solutions of x. The definition of a neighborhood depends on the problem and it has often a strong effect on the quality of the solution. Definition 5.1. a) Operation k-change means deleting k edges from a tour and replacing them with k edges such that the result is a Hamiltonian cycle. b) A k-neighborhood of a TSP-solution (Hamiltonian cycle) x is the set of Hamiltonian cycles that result from x with a k-change. c) TSP tour (Hamiltonian cycle) is k-optimal, if it cannot be improved with any k-change. We can say that any k-optimal solution is a locally optimal solution of the TSP with respect to the k-neighborhood. Example of a 2-change: The edges marked with broken line to be changed: Notice that in the directed Hamiltonian cycle, some of the old edges change direction after the k-change.

9 47 ALGORITHM k-opt: 1. Construct a Hamiltonian cycle x. 2. Execute a k-change, resulting in cycle y. 3. If f(y) < f(x), set x:=y. 4. Go to 2 until a local optimum is obtained. This is a typical local search for TSP. In step 1, a construction method or random choice can be applied. Alogirthm 2-Opt Starting cycle: T = , f = 32 Possibilities for a 2-change: Edges to be changed Result a) 1-2, f=30 b) 1-2, f=39 c) 2-3, f=35 d) 2-3, f=31 e) 3-4, f=33 a) b) c) d) e)

10 48 The first change improves the solution: T = Changing edges 3-2 and 5-1 result in optimum: T = , f = 29 Typically small values of parameter k are used: k=2 or k=3. Then the change is relatively easy to perform and the neighborhood is small. Prosedure 3-Opt takes about n times as long as the 2- Opt prosedure. Also this algorithm can be repeated from different randomly generated starting solutions to improve the solution. When k is icreased, the number of iterations increases but the solution improves. It has been shown experimentally that values of k>3 don't give further advantage to the quality of the solution. Best results are gained with methods where the value of k is dynamically changed. COMPOSITE k-opt HEURISTIC 1. Construct a Hamiltonian cycle x. 2. Apply 2-Opt algorithm to x, resulting solution y. 3. Apply 3-Opt algorithm to y. Modifications: Repeat the composite procedure with varying construction methods. Random generation is recommended because it tends to cover the solution space more evenly. Repeat the construction step 1 from several starting vertex. Apply steps 2-3 to the best initial solution. LIN-KERNIGHAN HEURISTIC This is a very powerful method, based on k-opt. Different versions of the Lin-Kernighanmethods exist, and they have given good, "near-optimal" results on empirical tests. The method is more complicated to code than the simple k-opt. ( Several other heuristics are available for the TSP. Some special methods are introduced in the last chapter: - Genetic Algorithms - Simulated Annealing - Tabu Search

### 2.3 Scheduling jobs on identical parallel machines

2.3 Scheduling jobs on identical parallel machines There are jobs to be processed, and there are identical machines (running in parallel) to which each job may be assigned Each job = 1,,, must be processed

### Answers to some of the exercises.

Answers to some of the exercises. Chapter 2. Ex.2.1 (a) There are several ways to do this. Here is one possibility. The idea is to apply the k-center algorithm first to D and then for each center in D

### 1. Sorting (assuming sorting into ascending order) a) BUBBLE SORT

DECISION 1 Revision Notes 1. Sorting (assuming sorting into ascending order) a) BUBBLE SORT Make sure you show comparisons clearly and label each pass First Pass 8 4 3 6 1 4 8 3 6 1 4 3 8 6 1 4 3 6 8 1

### Social Media Mining. Graph Essentials

Graph Essentials Graph Basics Measures Graph and Essentials Metrics 2 2 Nodes and Edges A network is a graph nodes, actors, or vertices (plural of vertex) Connections, edges or ties Edge Node Measures

Approximation Algorithms Chapter Approximation Algorithms Q. Suppose I need to solve an NP-hard problem. What should I do? A. Theory says you're unlikely to find a poly-time algorithm. Must sacrifice one

### Approximation Algorithms

Approximation Algorithms or: How I Learned to Stop Worrying and Deal with NP-Completeness Ong Jit Sheng, Jonathan (A0073924B) March, 2012 Overview Key Results (I) General techniques: Greedy algorithms

### ! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. #-approximation algorithm.

Approximation Algorithms 11 Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of three

### Ant Colony Optimization (ACO)

Ant Colony Optimization (ACO) Exploits foraging behavior of ants Path optimization Problems mapping onto foraging are ACO-like TSP, ATSP QAP Travelling Salesman Problem (TSP) Why? Hard, shortest path problem

### ! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. !-approximation algorithm.

Approximation Algorithms Chapter Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of

### Outline. NP-completeness. When is a problem easy? When is a problem hard? Today. Euler Circuits

Outline NP-completeness Examples of Easy vs. Hard problems Euler circuit vs. Hamiltonian circuit Shortest Path vs. Longest Path 2-pairs sum vs. general Subset Sum Reducing one problem to another Clique

### Computer Algorithms. NP-Complete Problems. CISC 4080 Yanjun Li

Computer Algorithms NP-Complete Problems NP-completeness The quest for efficient algorithms is about finding clever ways to bypass the process of exhaustive search, using clues from the input in order

### CMPSCI611: Approximating MAX-CUT Lecture 20

CMPSCI611: Approximating MAX-CUT Lecture 20 For the next two lectures we ll be seeing examples of approximation algorithms for interesting NP-hard problems. Today we consider MAX-CUT, which we proved to

### Vehicle Routing and Scheduling. Martin Savelsbergh The Logistics Institute Georgia Institute of Technology

Vehicle Routing and Scheduling Martin Savelsbergh The Logistics Institute Georgia Institute of Technology Vehicle Routing and Scheduling Part I: Basic Models and Algorithms Introduction Freight routing

### Consider a problem in which we are given a speed function

Fast marching methods for the continuous traveling salesman problem June Andrews and J. A. Sethian* Department of Mathematics, University of California, Berkeley, CA 94720 Communicated by Alexandre J.

### Research Paper Business Analytics. Applications for the Vehicle Routing Problem. Jelmer Blok

Research Paper Business Analytics Applications for the Vehicle Routing Problem Jelmer Blok Applications for the Vehicle Routing Problem Jelmer Blok Research Paper Vrije Universiteit Amsterdam Faculteit

### Scheduling Shop Scheduling. Tim Nieberg

Scheduling Shop Scheduling Tim Nieberg Shop models: General Introduction Remark: Consider non preemptive problems with regular objectives Notation Shop Problems: m machines, n jobs 1,..., n operations

### Applied Algorithm Design Lecture 5

Applied Algorithm Design Lecture 5 Pietro Michiardi Eurecom Pietro Michiardi (Eurecom) Applied Algorithm Design Lecture 5 1 / 86 Approximation Algorithms Pietro Michiardi (Eurecom) Applied Algorithm Design

### Home Page. Data Structures. Title Page. Page 1 of 24. Go Back. Full Screen. Close. Quit

Data Structures Page 1 of 24 A.1. Arrays (Vectors) n-element vector start address + ielementsize 0 +1 +2 +3 +4... +n-1 start address continuous memory block static, if size is known at compile time dynamic,

### Artificial Intelligence Methods (G52AIM)

Artificial Intelligence Methods (G52AIM) Dr Rong Qu rxq@cs.nott.ac.uk Constructive Heuristic Methods Constructive Heuristics method Start from an empty solution Repeatedly, extend the current solution

### A binary search tree is a binary tree with a special property called the BST-property, which is given as follows:

Chapter 12: Binary Search Trees A binary search tree is a binary tree with a special property called the BST-property, which is given as follows: For all nodes x and y, if y belongs to the left subtree

### Divide-and-Conquer. Three main steps : 1. divide; 2. conquer; 3. merge.

Divide-and-Conquer Three main steps : 1. divide; 2. conquer; 3. merge. 1 Let I denote the (sub)problem instance and S be its solution. The divide-and-conquer strategy can be described as follows. Procedure

### Transportation Logistics

Transportation Logistics Lecture held by Gilbert Laporte Winter Term 2004 (University of Vienna) Summarized by Guenther Fuellerer Contents 1 Travelling Sales Person Problem (TSP) 5 1.1 Applications of

### Constraint Satisfaction Problems. Constraint Satisfaction Problems. Greedy Local Search. Example. 1 Greedy algorithm. 2 Stochastic Greedy Local Search

Constraint Satisfaction Problems June 19, 2007 Greedy Local Search Constraint Satisfaction Problems Greedy Local Search Bernhard Nebel, Julien Hué, and Stefan Wölfl Albert-Ludwigs-Universität Freiburg

### VEHICLE ROUTING PROBLEM

VEHICLE ROUTING PROBLEM Readings: E&M 0 Topics: versus TSP Solution methods Decision support systems for Relationship between TSP and Vehicle routing problem () is similar to the Traveling salesman problem

### 11. APPROXIMATION ALGORITHMS

11. APPROXIMATION ALGORITHMS load balancing center selection pricing method: vertex cover LP rounding: vertex cover generalized load balancing knapsack problem Lecture slides by Kevin Wayne Copyright 2005

### Fleet Management Optimisation

Fleet Management Optimisation Sindre Soltun Master of Science in Communication Technology Submission date: January 2007 Supervisor: Steinar Andresen, ITEM Co-supervisor: Per Stein, Nordisk Mobiltelefon

### Dynamic programming. Doctoral course Optimization on graphs - Lecture 4.1. Giovanni Righini. January 17 th, 2013

Dynamic programming Doctoral course Optimization on graphs - Lecture.1 Giovanni Righini January 1 th, 201 Implicit enumeration Combinatorial optimization problems are in general NP-hard and we usually

### Lecture 3: Linear Programming Relaxations and Rounding

Lecture 3: Linear Programming Relaxations and Rounding 1 Approximation Algorithms and Linear Relaxations For the time being, suppose we have a minimization problem. Many times, the problem at hand can

### Network (Tree) Topology Inference Based on Prüfer Sequence

Network (Tree) Topology Inference Based on Prüfer Sequence C. Vanniarajan and Kamala Krithivasan Department of Computer Science and Engineering Indian Institute of Technology Madras Chennai 600036 vanniarajanc@hcl.in,

### 6.852: Distributed Algorithms Fall, 2009. Class 2

.8: Distributed Algorithms Fall, 009 Class Today s plan Leader election in a synchronous ring: Lower bound for comparison-based algorithms. Basic computation in general synchronous networks: Leader election

### ONLINE DEGREE-BOUNDED STEINER NETWORK DESIGN. Sina Dehghani Saeed Seddighin Ali Shafahi Fall 2015

ONLINE DEGREE-BOUNDED STEINER NETWORK DESIGN Sina Dehghani Saeed Seddighin Ali Shafahi Fall 2015 ONLINE STEINER FOREST PROBLEM An initially given graph G. s 1 s 2 A sequence of demands (s i, t i ) arriving

### Approximating Average Distortion of Embeddings into Line

Approximating Average Distortion of Embeddings into Line Kedar Dhamdhere Carnegie Mellon University Joint work with Anupam Gupta, R. Ravi Finite metric spaces (V, d) is a finite metric space if V is a

### 5.4 Closest Pair of Points

5.4 Closest Pair of Points Closest Pair of Points Closest pair. Given n points in the plane, find a pair with smallest Euclidean distance between them. Fundamental geometric primitive. Graphics, computer

### MATHEMATICAL ENGINEERING TECHNICAL REPORTS. An Improved Approximation Algorithm for the Traveling Tournament Problem

MATHEMATICAL ENGINEERING TECHNICAL REPORTS An Improved Approximation Algorithm for the Traveling Tournament Problem Daisuke YAMAGUCHI, Shinji IMAHORI, Ryuhei MIYASHIRO, Tomomi MATSUI METR 2009 42 September

### IE 680 Special Topics in Production Systems: Networks, Routing and Logistics*

IE 680 Special Topics in Production Systems: Networks, Routing and Logistics* Rakesh Nagi Department of Industrial Engineering University at Buffalo (SUNY) *Lecture notes from Network Flows by Ahuja, Magnanti

### The number of marks is given in brackets [ ] at the end of each question or part question. The total number of marks for this paper is 72.

ADVANCED SUBSIDIARY GCE UNIT 4736/01 MATHEMATICS Decision Mathematics 1 THURSDAY 14 JUNE 2007 Afternoon Additional Materials: Answer Booklet (8 pages) List of Formulae (MF1) Time: 1 hour 30 minutes INSTRUCTIONS

### Warshall s Algorithm: Transitive Closure

CS 0 Theory of Algorithms / CS 68 Algorithms in Bioinformaticsi Dynamic Programming Part II. Warshall s Algorithm: Transitive Closure Computes the transitive closure of a relation (Alternatively: all paths

### Discuss the size of the instance for the minimum spanning tree problem.

3.1 Algorithm complexity The algorithms A, B are given. The former has complexity O(n 2 ), the latter O(2 n ), where n is the size of the instance. Let n A 0 be the size of the largest instance that can

### Guessing Game: NP-Complete?

Guessing Game: NP-Complete? 1. LONGEST-PATH: Given a graph G = (V, E), does there exists a simple path of length at least k edges? YES 2. SHORTEST-PATH: Given a graph G = (V, E), does there exists a simple

### Lecture 3. Linear Programming. 3B1B Optimization Michaelmas 2015 A. Zisserman. Extreme solutions. Simplex method. Interior point method

Lecture 3 3B1B Optimization Michaelmas 2015 A. Zisserman Linear Programming Extreme solutions Simplex method Interior point method Integer programming and relaxation The Optimization Tree Linear Programming

### 2. (a) Explain the strassen s matrix multiplication. (b) Write deletion algorithm, of Binary search tree. [8+8]

Code No: R05220502 Set No. 1 1. (a) Describe the performance analysis in detail. (b) Show that f 1 (n)+f 2 (n) = 0(max(g 1 (n), g 2 (n)) where f 1 (n) = 0(g 1 (n)) and f 2 (n) = 0(g 2 (n)). [8+8] 2. (a)

### Asking Hard Graph Questions. Paul Burkhardt. February 3, 2014

Beyond Watson: Predictive Analytics and Big Data U.S. National Security Agency Research Directorate - R6 Technical Report February 3, 2014 300 years before Watson there was Euler! The first (Jeopardy!)

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### Algorithms and Data Structures (INF1) Lecture 14/15 Hua Lu

Algorithms and Data Structures (INF1) Lecture 14/15 Hua Lu Department of Computer Science Aalborg University Fall 2007 This Lecture Shortest paths Problem preliminary Shortest paths in DAG Bellman-Moore

### CHAPTER 9. Integer Programming

CHAPTER 9 Integer Programming An integer linear program (ILP) is, by definition, a linear program with the additional constraint that all variables take integer values: (9.1) max c T x s t Ax b and x integral

### Flow and Activity Analysis

Facility Location, Layout, and Flow and Activity Analysis Primary activity relationships Organizational relationships» Span of control and reporting hierarchy Flow relationships» Flow of materials, people,

### CSE 326, Data Structures. Sample Final Exam. Problem Max Points Score 1 14 (2x7) 2 18 (3x6) 3 4 4 7 5 9 6 16 7 8 8 4 9 8 10 4 Total 92.

Name: Email ID: CSE 326, Data Structures Section: Sample Final Exam Instructions: The exam is closed book, closed notes. Unless otherwise stated, N denotes the number of elements in the data structure

### The Union-Find Problem Kruskal s algorithm for finding an MST presented us with a problem in data-structure design. As we looked at each edge,

The Union-Find Problem Kruskal s algorithm for finding an MST presented us with a problem in data-structure design. As we looked at each edge, cheapest first, we had to determine whether its two endpoints

### 5.1 Bipartite Matching

CS787: Advanced Algorithms Lecture 5: Applications of Network Flow In the last lecture, we looked at the problem of finding the maximum flow in a graph, and how it can be efficiently solved using the Ford-Fulkerson

### Solutions to Homework 6

Solutions to Homework 6 Debasish Das EECS Department, Northwestern University ddas@northwestern.edu 1 Problem 5.24 We want to find light spanning trees with certain special properties. Given is one example

### Chapter 6: Graph Theory

Chapter 6: Graph Theory Graph theory deals with routing and network problems and if it is possible to find a best route, whether that means the least expensive, least amount of time or the least distance.

### THE TRAVELING SALESMAN PROBLEM AND ITS VARIATIONS

THE TRAVELING SALESMAN PROBLEM AND ITS VARIATIONS Edited by GREGORY GUTIN Royal Holloway, University of London, UK ABRAHAM PUNNEN University of New Brunswick, St. John, Canada Kluwer Academic Publishers

### An Approximation Algorithm for the Unconstrained Traveling Tournament Problem

An Approximation Algorithm for the Unconstrained Traveling Tournament Problem Shinji Imahori 1, Tomomi Matsui 2, and Ryuhei Miyashiro 3 1 Graduate School of Engineering, Nagoya University, Furo-cho, Chikusa-ku,

### Binary Heaps. CSE 373 Data Structures

Binary Heaps CSE Data Structures Readings Chapter Section. Binary Heaps BST implementation of a Priority Queue Worst case (degenerate tree) FindMin, DeleteMin and Insert (k) are all O(n) Best case (completely

### SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH

31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,

### Analysis of Algorithms I: Binary Search Trees

Analysis of Algorithms I: Binary Search Trees Xi Chen Columbia University Hash table: A data structure that maintains a subset of keys from a universe set U = {0, 1,..., p 1} and supports all three dictionary

### Branch and Cut for TSP

Branch and Cut for TSP jla,jc@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark 1 Branch-and-Cut for TSP Branch-and-Cut is a general technique applicable e.g. to solve symmetric

### Facility Location: Discrete Models and Local Search Methods

Facility Location: Discrete Models and Local Search Methods Yury KOCHETOV Sobolev Institute of Mathematics, Novosibirsk, Russia Abstract. Discrete location theory is one of the most dynamic areas of operations

### Handout #Ch7 San Skulrattanakulchai Gustavus Adolphus College Dec 6, 2010. Chapter 7: Digraphs

MCS-236: Graph Theory Handout #Ch7 San Skulrattanakulchai Gustavus Adolphus College Dec 6, 2010 Chapter 7: Digraphs Strong Digraphs Definitions. A digraph is an ordered pair (V, E), where V is the set

### Data Structures and Algorithms Written Examination

Data Structures and Algorithms Written Examination 22 February 2013 FIRST NAME STUDENT NUMBER LAST NAME SIGNATURE Instructions for students: Write First Name, Last Name, Student Number and Signature where

Load Balancing Backtracking, branch & bound and alpha-beta pruning: how to assign work to idle processes without much communication? Additionally for alpha-beta pruning: implementing the young-brothers-wait

### Modeling and Solving the Capacitated Vehicle Routing Problem on Trees

in The Vehicle Routing Problem: Latest Advances and New Challenges Modeling and Solving the Capacitated Vehicle Routing Problem on Trees Bala Chandran 1 and S. Raghavan 2 1 Department of Industrial Engineering

### Technology, Kolkata, INDIA, pal.sanjaykumar@gmail.com. sssarma2001@yahoo.com

Sanjay Kumar Pal 1 and Samar Sen Sarma 2 1 Department of Computer Science & Applications, NSHM College of Management & Technology, Kolkata, INDIA, pal.sanjaykumar@gmail.com 2 Department of Computer Science

### Near Optimal Solutions

Near Optimal Solutions Many important optimization problems are lacking efficient solutions. NP-Complete problems unlikely to have polynomial time solutions. Good heuristics important for such problems.

### Graph Theory and Complex Networks: An Introduction. Chapter 06: Network analysis

Graph Theory and Complex Networks: An Introduction Maarten van Steen VU Amsterdam, Dept. Computer Science Room R4.0, steen@cs.vu.nl Chapter 06: Network analysis Version: April 8, 04 / 3 Contents Chapter

### Homework Exam 1, Geometric Algorithms, 2016

Homework Exam 1, Geometric Algorithms, 2016 1. (3 points) Let P be a convex polyhedron in 3-dimensional space. The boundary of P is represented as a DCEL, storing the incidence relationships between the

### LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING. ----Changsheng Liu 10-30-2014

LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING ----Changsheng Liu 10-30-2014 Agenda Semi Supervised Learning Topics in Semi Supervised Learning Label Propagation Local and global consistency Graph

### Balanced Binary Search Tree

AVL Trees / Slide 1 Balanced Binary Search Tree Worst case height of binary search tree: N-1 Insertion, deletion can be O(N) in the worst case We want a tree with small height Height of a binary tree with

### Network File Storage with Graceful Performance Degradation

Network File Storage with Graceful Performance Degradation ANXIAO (ANDREW) JIANG California Institute of Technology and JEHOSHUA BRUCK California Institute of Technology A file storage scheme is proposed

### Design of LDPC codes

Design of LDPC codes Codes from finite geometries Random codes: Determine the connections of the bipartite Tanner graph by using a (pseudo)random algorithm observing the degree distribution of the code

### A Library of Local Search Heuristics for the Vehicle Routing Problem

A Library of Local Search Heuristics for the Vehicle Routing Problem Chris Groër 1 Oak Ridge National Laboratory, 1 Bethel Valley Rd, Oak Ridge, TN 37831 cgroer@gmail.com Bruce Golden R.H. Smith School

### Labeling outerplanar graphs with maximum degree three

Labeling outerplanar graphs with maximum degree three Xiangwen Li 1 and Sanming Zhou 2 1 Department of Mathematics Huazhong Normal University, Wuhan 430079, China 2 Department of Mathematics and Statistics

### MATHEMATICS Unit Decision 1

General Certificate of Education January 2007 Advanced Subsidiary Examination MATHEMATICS Unit Decision 1 MD01 Tuesday 16 January 2007 9.00 am to 10.30 am For this paper you must have: an 8-page answer

### TU e. Advanced Algorithms: experimentation project. The problem: load balancing with bounded look-ahead. Input: integer m 2: number of machines

The problem: load balancing with bounded look-ahead Input: integer m 2: number of machines integer k 0: the look-ahead numbers t 1,..., t n : the job sizes Problem: assign jobs to machines machine to which

### Improving Emergency Medical Dispatching with Emphasis on Mass-Casualty Incidents

Improving Emergency Medical Dispatching with Emphasis on Mass-Casualty Incidents, Harald Burgsteiner, Martin Bernroider, Günter Kiechle, Maria Obermayer Dispatcher s Challenges Dispatching ambulances is

### Reductions & NP-completeness as part of Foundations of Computer Science undergraduate course

Reductions & NP-completeness as part of Foundations of Computer Science undergraduate course Alex Angelopoulos, NTUA January 22, 2015 Outline Alex Angelopoulos (NTUA) FoCS: Reductions & NP-completeness-

### Approximation Algorithms. Scheduling. Approximation algorithms. Scheduling jobs on a single machine

Approximation algorithms Approximation Algorithms Fast. Cheap. Reliable. Choose two. NP-hard problems: choose 2 of optimal polynomial time all instances Approximation algorithms. Trade-off between time

### Introduction to Algorithms. Part 3: P, NP Hard Problems

Introduction to Algorithms Part 3: P, NP Hard Problems 1) Polynomial Time: P and NP 2) NP-Completeness 3) Dealing with Hard Problems 4) Lower Bounds 5) Books c Wayne Goddard, Clemson University, 2004 Chapter

### A Study of Local Optima in the Biobjective Travelling Salesman Problem

A Study of Local Optima in the Biobjective Travelling Salesman Problem Luis Paquete, Marco Chiarandini and Thomas Stützle FG Intellektik, Technische Universität Darmstadt, Alexanderstr. 10, Darmstadt,

### Modeling and Performance Evaluation of Computer Systems Security Operation 1

Modeling and Performance Evaluation of Computer Systems Security Operation 1 D. Guster 2 St.Cloud State University 3 N.K. Krivulin 4 St.Petersburg State University 5 Abstract A model of computer system

### Scheduling. Open shop, job shop, flow shop scheduling. Related problems. Open shop, job shop, flow shop scheduling

Scheduling Basic scheduling problems: open shop, job shop, flow job The disjunctive graph representation Algorithms for solving the job shop problem Computational complexity of the job shop problem Open

### Discrete Optimization

Discrete Optimization [Chen, Batson, Dang: Applied integer Programming] Chapter 3 and 4.1-4.3 by Johan Högdahl and Victoria Svedberg Seminar 2, 2015-03-31 Todays presentation Chapter 3 Transforms using

### Exam study sheet for CS2711. List of topics

Exam study sheet for CS2711 Here is the list of topics you need to know for the final exam. For each data structure listed below, make sure you can do the following: 1. Give an example of this data structure

### Computational Geometry. Lecture 1: Introduction and Convex Hulls

Lecture 1: Introduction and convex hulls 1 Geometry: points, lines,... Plane (two-dimensional), R 2 Space (three-dimensional), R 3 Space (higher-dimensional), R d A point in the plane, 3-dimensional space,

### Why? A central concept in Computer Science. Algorithms are ubiquitous.

Analysis of Algorithms: A Brief Introduction Why? A central concept in Computer Science. Algorithms are ubiquitous. Using the Internet (sending email, transferring files, use of search engines, online

### The mean field traveling salesman and related problems

Acta Math., 04 (00), 9 50 DOI: 0.007/s5-00-0046-7 c 00 by Institut Mittag-Leffler. All rights reserved The mean field traveling salesman and related problems by Johan Wästlund Chalmers University of Technology

### Efficiency of algorithms. Algorithms. Efficiency of algorithms. Binary search and linear search. Best, worst and average case.

Algorithms Efficiency of algorithms Computational resources: time and space Best, worst and average case performance How to compare algorithms: machine-independent measure of efficiency Growth rate Complexity

V. Adamchik 1 Graph Theory Victor Adamchik Fall of 2005 Plan 1. Basic Vocabulary 2. Regular graph 3. Connectivity 4. Representing Graphs Introduction A.Aho and J.Ulman acknowledge that Fundamentally, computer

### Informatique Fondamentale IMA S8

Informatique Fondamentale IMA S8 Cours 4 : graphs, problems and algorithms on graphs, (notions of) NP completeness Laure Gonnord http://laure.gonnord.org/pro/teaching/ Laure.Gonnord@polytech-lille.fr Université

### Binary Search. Search for x in a sorted array A.

Divide and Conquer A general paradigm for algorithm design; inspired by emperors and colonizers. Three-step process: 1. Divide the problem into smaller problems. 2. Conquer by solving these problems. 3.

### 8.1 Min Degree Spanning Tree

CS880: Approximations Algorithms Scribe: Siddharth Barman Lecturer: Shuchi Chawla Topic: Min Degree Spanning Tree Date: 02/15/07 In this lecture we give a local search based algorithm for the Min Degree

### Mining Social Network Graphs

Mining Social Network Graphs Debapriyo Majumdar Data Mining Fall 2014 Indian Statistical Institute Kolkata November 13, 17, 2014 Social Network No introduc+on required Really? We s7ll need to understand

### 2.3 Convex Constrained Optimization Problems

42 CHAPTER 2. FUNDAMENTAL CONCEPTS IN CONVEX OPTIMIZATION Theorem 15 Let f : R n R and h : R R. Consider g(x) = h(f(x)) for all x R n. The function g is convex if either of the following two conditions

### Load balancing in a heterogeneous computer system by self-organizing Kohonen network

Bull. Nov. Comp. Center, Comp. Science, 25 (2006), 69 74 c 2006 NCC Publisher Load balancing in a heterogeneous computer system by self-organizing Kohonen network Mikhail S. Tarkov, Yakov S. Bezrukov Abstract.

### A Scatter Search Algorithm for the Split Delivery Vehicle Routing Problem

A Scatter Search Algorithm for the Split Delivery Vehicle Routing Problem Campos,V., Corberán, A., Mota, E. Dep. Estadística i Investigació Operativa. Universitat de València. Spain Corresponding author:

### MATHEMATICS Unit Decision 1

General Certificate of Education January 2008 Advanced Subsidiary Examination MATHEMATICS Unit Decision 1 MD01 Tuesday 15 January 2008 9.00 am to 10.30 am For this paper you must have: an 8-page answer

### An Improved ACO Algorithm for Multicast Routing

An Improved ACO Algorithm for Multicast Routing Ziqiang Wang and Dexian Zhang School of Information Science and Engineering, Henan University of Technology, Zheng Zhou 450052,China wzqagent@xinhuanet.com