IE418 Integer Programming
|
|
- Asher Miller
- 7 years ago
- Views:
Transcription
1 IE418: Integer Programming Department of Industrial and Systems Engineering Lehigh University 24th January 2005 Name two reasons why anyone would want to program with integers? What is the knapsack problem? (MIP): max{c T x + h T y Ax + Gy b, x Z n +, y R p + } What is Mixed 0-1 Programming? What is Pure Integer Programming What is Binary Programming? What is 0-1 Programming? What is Q n +? What is my son s name?
2 Outline Set {Packing, Covering, Partitioning} TSP Models of Choice Pick one! Piecewise Linear Functions Algorithimic Modeling A couple examples Set {Pack,Cover,Partition}ing Traveling Salesman Selecting from a Set We can use constraints of the form j T x j 1 to represent that at least one item should be chosen from a set T. Similarly, we can also model that at most one or exactly one item should be chosen. Example: Set covering problem If A in a 0-1 matrix, then a set covering problem is any problem of the form Set Packing: Ax e min c T x s.t. Ax e 1 x j {0, 1} Set Partitioning: Ax = e 1 It is common to denote the vector of 1 s as e j
3 Set {Pack,Cover,Partition}ing Traveling Salesman COP Set{Cover, Pack, Partition}ing A combinatorial optimization problem CP = (N, F) consists of A finite ground set N, A set F 2 N of feasible solutions, and A cost function c Each row of A represents an item from N Each column A j represents a subset N j F of the items. Each variable x j represents selecting subset N j. The constraints (for covering and partitioning) say that {j xj =1}N j = N. In other words, each item must appear in at least, (or exactly one selected subset. Set {Pack,Cover,Partition}ing Traveling Salesman Vehicle Routing x 1 x 2 x 3... Customer 1 : Customer 2 : Customer 3 : Customer 4 : Customer 5 : = 1. = 1. = 1. = 1. = 1 This is a very flexible modeling trick You can list all feasible routes, allowing you to handle weird constraints like time windows, strange precedence rules, nonlinear cost functions, etc.
4 Set {Pack,Cover,Partition}ing Traveling Salesman The Farmer s Daughter This is The Most Famous Problem in Combinatorial Optimization! A traveling salesman must visit all his cities at minimum cost. Given directed (complete) graph with node set N. (G = (N, N N)) Given costs c ij of traveling from city i to city j Find a minimum cost Hamiltonian Cycle in G Variables: x ij = 1 if and only if salesman goes from city i to city j Set {Pack,Cover,Partition}ing Traveling Salesman TSP (cont.) min c ij x ij i N j N x ij = 1 j N Enter Each City i N x ij = 1 i N Leave Each City j N x ij {0, 1} i N, j N Subtour elimination constraint: x ij 1 S N, 2 S N 2 i S j S Alternatively: x ij S 1 S N, 2 S N 2 i S j S ( No Beaming ) ( No Beaming )
5 Set {Pack,Cover,Partition}ing Traveling Salesman TSP Trivia Time! What is This Number? Is this... a) The number of times an undergraduate student asked me where room 355 was this week? b) The number of subatomic particles in the universe? c) The number of subtour elimination constraints when N = 299. d) All of the above? e) None of the above? Set {Pack,Cover,Partition}ing Traveling Salesman Answer Time The answer is (e). (a) (c) are all too small (as far as I know) :-). (It is (c), for N = 300). Exponential is really big. Yet people have solved TSP s with N > 16, 000! You will learn how to solve these problems too! The trick is to only add the subset of constraints that are necessary to prove optimality. This is a trick known as branch-and-cut, and you will learn lots about branch-and-cut in this course.
6 SOS1 SOS2 Modeling a Restricted Set of Values We may want variable x to only take on values in the set {a 1,..., a m }. We introduce m binary variables y j, j = 1,..., m and the constraints x = m a j y j, j=1 m y j = 1, j=1 y j {0, 1} The set of variables {y 1, y 2,... y m } is called a special ordered set (SOS) of variables. SOS1 SOS2 Example Building a warehouse Suppose we are modeling a facility location problem in which we must decide on the size of a warehouse to build. The choices of sizes and their associated cost are shown below: Size Cost Warehouse sizes and costs
7 SOS1 SOS2 Warehouse Modeling Using binary decision variables x 1, x 2,..., x 5, we can model the cost of building the warehouse as COST 100x x x x x 5. The warehouse will have size SIZE 10x x x x x 5, and we have the SOS constraint x 1 + x 2 + x 3 + x 4 + x 5 = 1. SOS1 SOS2 Piecewise Linear Cost Functions We can use binary variables to model arbitrary piecewise linear functions. The function is specified by ordered pairs (a i, f(a i )) We have a binary variable y i, which indicates whether a i x a i+1. f(a 6 ) f(a 5 ) f(a 5 ) f(x) f(a 3 ) f(a 2 ) f(a 1 ) a 1 a 2 a 3 a 4 x a 5 a 6
8 SOS1 SOS2 Minimizing Piecewise Linear Cost Functions To evaluate the function, we will take linear combinations k i=1 λ if(a i ) of the given functions values. This only works if the only two nonzero λ is are the ones corresponding to the endpoints of the interval in which x lies. The Key Idea! If y j = 1, then λ i = 0, i j, j+1. kx min λ i f(a i ) i=1 kx s.t. λ i = 1, i=1 λ 1 y 1, λ i y i 1 + y i, i = 2,..., k 1, λ k y k 1, Xk 1 y i = 1, i=1 λ i 0, y i {0, 1}. SOS1 SOS2 SOS2 A better formulation involves the use of special ordered sets of type 2 SOS2 A set of variables of which at most two can be positive. If two are positive, they must be adjacent in the set. k min λ i f(a i ) i=1 k s.t. λ i = 1 i=1 λ i 0 {λ 1, λ 2,..., λ k } SOS2 The adjacency conditions of SOS2 are enforced by the solution algorithm (All) commercial solvers allow you to specify SOS2
9 Modeling Disjunctive Constraints We are given two constraints a T x b and c T x d with nonnegative coefficients. Instead of insisting both constraints be satisfied, we want at least one of the two constraints to be satisfied. To model this, we define a binary variable y and impose a T x yb, c T x (1 y)d, y {0, 1}. More generally, we can impose that at least k out of m constraints be satisfied with (a i )T x b i y i, i {1, 2,... m} m i=1 y i k, y i {0, 1} There are lots of things you can model with binary variables: Indicator variables (Positivity of variables) Limiting the Number of Positive Variables Fixed Charge problems Minimum production level Indicator variables (Validity of constraints) Either-or If-then k out of n
10 Nonconvex regions Economies of Scale Discrete Capacity Extensions Maximax or Minimin The problem is that sometimes to see the modeling trick is difficult. For example... Use a 0-1 variable δ to indicate whether or not the constraint 2x 1 + 3x 2 1 is satisfied. x 1, x 2 are nonnegative continuous variables that are 1 δ = 1 2x 1 + 3x 2 1 The Slide of Tricks. Indicator Variables... δ = 1 j N a jx j b j N a jx j + Mδ M + b j N a jx j b δ = 1 j N a jx j (m ɛ)δ b + ɛ δ = 1 j N a jx j b j N a jx j + mδ m + b j N a jx j b δ = 1 j N a jx j (M + ɛ)δ b ɛ Definitions δ: Indicator variable (δ {0, 1}). M: Upper bound on j N a jx j b m: Lower bound on j N a jx j b ɛ: Small tolerance beyond which we regard the constraint as haven been broken. If a j Z, x j Z, then we can take ɛ = 1.
11 Modeling Trick #1 Indicating Constraint (Non)violation Suppose we wish to indicate whether or not an inequality j N a jx j b holds by means of an indicator variable δ. Implication We Wish to Model δ = 1 j N a j x j b This can be represented by the constraint j N a jx j + Mδ M + b Trick #1... The Logic δ = 1 j N a jx j b j N a jx j + Mδ M + b (Thinking)... δ = 1 j N a jx j b 0 1 δ = 0 j N a jx j b 0 j N a jx j b M(1 δ) Does it work? δ = 0 j N a jx j b M (true by definition of M) δ = 1 j N a jx j b 0
12 Modeling Trick #2 j N a jx j b δ = 1 δ = 0 j N a jx j b δ = 0 j N a jx j > b δ = 0 j N a jx j b + ɛ If a j, x j are integer, we can choose ɛ = 1 Model as j N a jx j (m ɛ)δ b + ɛ m is a lower bound for the expression j N a jx j b Some Last Modeling Tricks δ = 1 j N a jx j b Model as j N a jx j + mδ m + b j N a jx j b δ = 1 Model as j N a jx j (M + ɛ)δ b ɛ You can obtain these by just transforming the constraints to form and using the first two tricks.
13 Back To Our Example... Use a 0-1 variable δ to indicate whether or not the constraint 2x 1 + 3x 2 1 is satisfied. x 1, x 2 are nonnegative continuous variables that cannot exceed 1. δ = 1 2x 1 + 3x 2 1 M : Upper Bound on 2x 1 + 3x works m : Lower Bound on 2x 1 + 3x works. ɛ : 0.1 Example, Cont. ( ) Recall the trick. δ = 1 j N a jx j b j N a jx j + Mδ M + b 2x 1 + 3x 2 + 4δ 5 ( ). Recall the trick. j N a jx j b δ = 1 j N a jx j (m ɛ)δ b + ɛ 2x 1 + 3x δ 1.1 2x 1 + 3x 2 + 4δ 5 2x 1 + 3x δ 1.1
14 A More Realistic Example PPP Production Planning Problem. (A simple linear program). An engineering plant can produce five types of products: p 1, p 2,... p 5 by using two production processes: grinding and drilling. Each product requires the following number of hours of each process, and contributes the following amount (in hundreds of dollars) to the net total profit. p 1 p 2 p 3 p 4 p 5 Grinding Drilling Profit PPP More Info Each unit of each product take 20 manhours for final assembly. The factory has three grinding machines and two drilling machines. The factory works a six day week with two shifts of 8 hours/day. Eight workers are employed in assembly, each working one shift per day.
15 PPP maximize 55x x x x x 5 (Profit/week) subject to 12x x 2 + 0x x x (Grinding) 10x 1 + 8x x 3 + 0x 4 + 0x (Drilling) 20x x x x x Final Assembly x i 0 i = 1, 2,... 5 Another PPP Modeling Example Let s model the following situation. If we manufacture P 1 or P 2 (or both), then at least one of P 3, P 4, P 5 must also be manufactured. We first need an indicator variable z j that indicate when each of the x j > 0. How do we model x j > 0 z j = 1?. Hint: This is equivalent to z j = 0 x j = 0
16 Modeling the Logic Answer: x j Mz j Given that we have included the constraints x j Mz j, we d like to model the following implication: z 1 + z 2 1 z 3 + z 4 + z 5 1 Can you just see the answer? I can t. So let s try our formulaic approach. Think of it in two steps z 1 + z 2 1 δ = 1 δ = 1 z 3 + z 4 + z 5 1. Look up the Tricks First we model the following: z 1 + z 2 1 δ = 1 The formula from the bag o tricks j N a jx j b δ = 1 j N a jx j (M + ɛ)δ b ɛ M : Upper Bound on j N a jz j b M = 1 in this case. (z 1 1, z 2 1, b = 1). ɛ : Tolerance Level indicating the minimum about by which the constraint can be violated. ɛ = 1 in this case! If the constraint is going to be violated, then it will be violated by at least one.
17 Modeling z 1 + z 2 1 δ = 1, Cont. Just plug in the formula j N a jx j (M + ɛ)δ b ɛ z 1 + z 2 2δ 0 Does this do what we want? z 1 z 2 δ /2( = 1) 1 0 1/2( = 1) Second Part Want to model the following: δ = 1 z 3 + z 4 + z 5 1. The formula from the bag o tricks δ = 1 j N a jx j b j N a jx j + mδ m + b m : lower bound on j N a jx j b. m = 1. (z 1 0, z 2 0, b = 1). Plug in the formula: z 3 + z 4 + z 5 δ 0 It works! (Check for δ = 0, δ = 1).
18 PPP, Make 1 or 2 make 3, 4, or 5 maximize 55x x x x x 5 (Profit/week) subject to 12x x 2 + 0x x x x 1 + 8x x 3 + 0x 4 + 0x x x x x x x i M i z i i = 1, 2,... 5 z 1 + z 2 2δ 0 z 3 + z 4 + z 5 δ 0 x i 0 i = 1, 2,... 5 z i {0, 1} i = 1, 2,... 5 δ {0, 1} Cool Things You Can Now Do Either constraint 1 or constraint 2 must hold Create indicators δ 1, δ 2, then δ 1 + δ 2 1 At least one constraint of all the constraints in M should hold i M δ i 1 At least k of the constraints in M must hold i M δ i k If x, then y δ y δ x
19 That s All Folks! That s it for modeling. You should have read N&W I.1.1 by now. Those of you who want to get a jump start on the homeworks can consider doing problems??????
Lecture 3. Linear Programming. 3B1B Optimization Michaelmas 2015 A. Zisserman. Extreme solutions. Simplex method. Interior point method
Lecture 3 3B1B Optimization Michaelmas 2015 A. Zisserman Linear Programming Extreme solutions Simplex method Interior point method Integer programming and relaxation The Optimization Tree Linear Programming
More informationLinear Programming. March 14, 2014
Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1
More informationINTEGER PROGRAMMING. Integer Programming. Prototype example. BIP model. BIP models
Integer Programming INTEGER PROGRAMMING In many problems the decision variables must have integer values. Example: assign people, machines, and vehicles to activities in integer quantities. If this is
More informationDiscuss the size of the instance for the minimum spanning tree problem.
3.1 Algorithm complexity The algorithms A, B are given. The former has complexity O(n 2 ), the latter O(2 n ), where n is the size of the instance. Let n A 0 be the size of the largest instance that can
More informationDiscrete Optimization
Discrete Optimization [Chen, Batson, Dang: Applied integer Programming] Chapter 3 and 4.1-4.3 by Johan Högdahl and Victoria Svedberg Seminar 2, 2015-03-31 Todays presentation Chapter 3 Transforms using
More informationBasic Components of an LP:
1 Linear Programming Optimization is an important and fascinating area of management science and operations research. It helps to do less work, but gain more. Linear programming (LP) is a central topic
More information5 INTEGER LINEAR PROGRAMMING (ILP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1
5 INTEGER LINEAR PROGRAMMING (ILP) E. Amaldi Fondamenti di R.O. Politecnico di Milano 1 General Integer Linear Program: (ILP) min c T x Ax b x 0 integer Assumption: A, b integer The integrality condition
More informationOptimization Modeling for Mining Engineers
Optimization Modeling for Mining Engineers Alexandra M. Newman Division of Economics and Business Slide 1 Colorado School of Mines Seminar Outline Linear Programming Integer Linear Programming Slide 2
More informationMathematical finance and linear programming (optimization)
Mathematical finance and linear programming (optimization) Geir Dahl September 15, 2009 1 Introduction The purpose of this short note is to explain how linear programming (LP) (=linear optimization) may
More informationLinear Programming. April 12, 2005
Linear Programming April 1, 005 Parts of this were adapted from Chapter 9 of i Introduction to Algorithms (Second Edition) /i by Cormen, Leiserson, Rivest and Stein. 1 What is linear programming? The first
More informationApproximation Algorithms
Approximation Algorithms or: How I Learned to Stop Worrying and Deal with NP-Completeness Ong Jit Sheng, Jonathan (A0073924B) March, 2012 Overview Key Results (I) General techniques: Greedy algorithms
More information24. The Branch and Bound Method
24. The Branch and Bound Method It has serious practical consequences if it is known that a combinatorial problem is NP-complete. Then one can conclude according to the present state of science that no
More informationOutline. NP-completeness. When is a problem easy? When is a problem hard? Today. Euler Circuits
Outline NP-completeness Examples of Easy vs. Hard problems Euler circuit vs. Hamiltonian circuit Shortest Path vs. Longest Path 2-pairs sum vs. general Subset Sum Reducing one problem to another Clique
More informationCHAPTER 9. Integer Programming
CHAPTER 9 Integer Programming An integer linear program (ILP) is, by definition, a linear program with the additional constraint that all variables take integer values: (9.1) max c T x s t Ax b and x integral
More informationInteger Programming Formulation
Integer Programming Formulation 1 Integer Programming Introduction When we introduced linear programs in Chapter 1, we mentioned divisibility as one of the LP assumptions. Divisibility allowed us to consider
More informationLinear Programming for Optimization. Mark A. Schulze, Ph.D. Perceptive Scientific Instruments, Inc.
1. Introduction Linear Programming for Optimization Mark A. Schulze, Ph.D. Perceptive Scientific Instruments, Inc. 1.1 Definition Linear programming is the name of a branch of applied mathematics that
More informationOptimal Scheduling for Dependent Details Processing Using MS Excel Solver
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 8, No 2 Sofia 2008 Optimal Scheduling for Dependent Details Processing Using MS Excel Solver Daniela Borissova Institute of
More informationLinear Programming Notes V Problem Transformations
Linear Programming Notes V Problem Transformations 1 Introduction Any linear programming problem can be rewritten in either of two standard forms. In the first form, the objective is to maximize, the material
More information1 Solving LPs: The Simplex Algorithm of George Dantzig
Solving LPs: The Simplex Algorithm of George Dantzig. Simplex Pivoting: Dictionary Format We illustrate a general solution procedure, called the simplex algorithm, by implementing it on a very simple example.
More information5.1 Bipartite Matching
CS787: Advanced Algorithms Lecture 5: Applications of Network Flow In the last lecture, we looked at the problem of finding the maximum flow in a graph, and how it can be efficiently solved using the Ford-Fulkerson
More informationAn Introduction to Linear Programming
An Introduction to Linear Programming Steven J. Miller March 31, 2007 Mathematics Department Brown University 151 Thayer Street Providence, RI 02912 Abstract We describe Linear Programming, an important
More informationPractical Guide to the Simplex Method of Linear Programming
Practical Guide to the Simplex Method of Linear Programming Marcel Oliver Revised: April, 0 The basic steps of the simplex algorithm Step : Write the linear programming problem in standard form Linear
More informationScheduling Home Health Care with Separating Benders Cuts in Decision Diagrams
Scheduling Home Health Care with Separating Benders Cuts in Decision Diagrams André Ciré University of Toronto John Hooker Carnegie Mellon University INFORMS 2014 Home Health Care Home health care delivery
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More informationMath 120 Final Exam Practice Problems, Form: A
Math 120 Final Exam Practice Problems, Form: A Name: While every attempt was made to be complete in the types of problems given below, we make no guarantees about the completeness of the problems. Specifically,
More informationWorkforce scheduling with logical constraints: theory and applications in call centers
Workforce scheduling with logical constraints: theory and applications in call centers Gábor Danó This thesis was supervised by Sandjai Bhulai and Ger Koole Department of Mathematics Vrije Universiteit
More informationIEOR 4404 Homework #2 Intro OR: Deterministic Models February 14, 2011 Prof. Jay Sethuraman Page 1 of 5. Homework #2
IEOR 4404 Homework # Intro OR: Deterministic Models February 14, 011 Prof. Jay Sethuraman Page 1 of 5 Homework #.1 (a) What is the optimal solution of this problem? Let us consider that x 1, x and x 3
More informationZeros of Polynomial Functions
Zeros of Polynomial Functions The Rational Zero Theorem If f (x) = a n x n + a n-1 x n-1 + + a 1 x + a 0 has integer coefficients and p/q (where p/q is reduced) is a rational zero, then p is a factor of
More informationSeveral Views of Support Vector Machines
Several Views of Support Vector Machines Ryan M. Rifkin Honda Research Institute USA, Inc. Human Intention Understanding Group 2007 Tikhonov Regularization We are considering algorithms of the form min
More informationChapter 6. Linear Programming: The Simplex Method. Introduction to the Big M Method. Section 4 Maximization and Minimization with Problem Constraints
Chapter 6 Linear Programming: The Simplex Method Introduction to the Big M Method In this section, we will present a generalized version of the simplex method that t will solve both maximization i and
More informationEXCEL SOLVER TUTORIAL
ENGR62/MS&E111 Autumn 2003 2004 Prof. Ben Van Roy October 1, 2003 EXCEL SOLVER TUTORIAL This tutorial will introduce you to some essential features of Excel and its plug-in, Solver, that we will be using
More information! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. !-approximation algorithm.
Approximation Algorithms Chapter Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of
More informationChapter 3. Distribution Problems. 3.1 The idea of a distribution. 3.1.1 The twenty-fold way
Chapter 3 Distribution Problems 3.1 The idea of a distribution Many of the problems we solved in Chapter 1 may be thought of as problems of distributing objects (such as pieces of fruit or ping-pong balls)
More informationChapter 13: Binary and Mixed-Integer Programming
Chapter 3: Binary and Mixed-Integer Programming The general branch and bound approach described in the previous chapter can be customized for special situations. This chapter addresses two special situations:
More informationA Branch and Bound Algorithm for Solving the Binary Bi-level Linear Programming Problem
A Branch and Bound Algorithm for Solving the Binary Bi-level Linear Programming Problem John Karlof and Peter Hocking Mathematics and Statistics Department University of North Carolina Wilmington Wilmington,
More informationCreating, Solving, and Graphing Systems of Linear Equations and Linear Inequalities
Algebra 1, Quarter 2, Unit 2.1 Creating, Solving, and Graphing Systems of Linear Equations and Linear Inequalities Overview Number of instructional days: 15 (1 day = 45 60 minutes) Content to be learned
More informationPractice with Proofs
Practice with Proofs October 6, 2014 Recall the following Definition 0.1. A function f is increasing if for every x, y in the domain of f, x < y = f(x) < f(y) 1. Prove that h(x) = x 3 is increasing, using
More informationLinear Programming. Solving LP Models Using MS Excel, 18
SUPPLEMENT TO CHAPTER SIX Linear Programming SUPPLEMENT OUTLINE Introduction, 2 Linear Programming Models, 2 Model Formulation, 4 Graphical Linear Programming, 5 Outline of Graphical Procedure, 5 Plotting
More information1 Introduction. Linear Programming. Questions. A general optimization problem is of the form: choose x to. max f(x) subject to x S. where.
Introduction Linear Programming Neil Laws TT 00 A general optimization problem is of the form: choose x to maximise f(x) subject to x S where x = (x,..., x n ) T, f : R n R is the objective function, S
More informationCan linear programs solve NP-hard problems?
Can linear programs solve NP-hard problems? p. 1/9 Can linear programs solve NP-hard problems? Ronald de Wolf Linear programs Can linear programs solve NP-hard problems? p. 2/9 Can linear programs solve
More informationSOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties
SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 3 Fall 2008 III. Spaces with special properties III.1 : Compact spaces I Problems from Munkres, 26, pp. 170 172 3. Show that a finite union of compact subspaces
More informationChapter 3 INTEGER PROGRAMMING 3.1 INTRODUCTION. Robert Bosch. Michael Trick
Chapter 3 INTEGER PROGRAMMING Robert Bosch Oberlin College Oberlin OH, USA Michael Trick Carnegie Mellon University Pittsburgh PA, USA 3.1 INTRODUCTION Over the last 20 years, the combination of faster
More informationTransportation Polytopes: a Twenty year Update
Transportation Polytopes: a Twenty year Update Jesús Antonio De Loera University of California, Davis Based on various papers joint with R. Hemmecke, E.Kim, F. Liu, U. Rothblum, F. Santos, S. Onn, R. Yoshida,
More informationWhat is Linear Programming?
Chapter 1 What is Linear Programming? An optimization problem usually has three essential ingredients: a variable vector x consisting of a set of unknowns to be determined, an objective function of x to
More informationNoncommercial Software for Mixed-Integer Linear Programming
Noncommercial Software for Mixed-Integer Linear Programming J. T. Linderoth T. K. Ralphs December, 2004. Revised: January, 2005. Abstract We present an overview of noncommercial software tools for the
More informationDERIVATIVES AS MATRICES; CHAIN RULE
DERIVATIVES AS MATRICES; CHAIN RULE 1. Derivatives of Real-valued Functions Let s first consider functions f : R 2 R. Recall that if the partial derivatives of f exist at the point (x 0, y 0 ), then we
More information! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. #-approximation algorithm.
Approximation Algorithms 11 Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of three
More information1 Review of Least Squares Solutions to Overdetermined Systems
cs4: introduction to numerical analysis /9/0 Lecture 7: Rectangular Systems and Numerical Integration Instructor: Professor Amos Ron Scribes: Mark Cowlishaw, Nathanael Fillmore Review of Least Squares
More informationSpecial Session on Integrating Constraint Programming and Operations Research ISAIM 2016
Titles Special Session on Integrating Constraint Programming and Operations Research ISAIM 2016 1. Grammar-Based Integer Programming Models and Methods for Employee Scheduling Problems 2. Detecting and
More informationLinear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.
Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.
More informationLinear Programming Problems
Linear Programming Problems Linear programming problems come up in many applications. In a linear programming problem, we have a function, called the objective function, which depends linearly on a number
More informationA Note on the Bertsimas & Sim Algorithm for Robust Combinatorial Optimization Problems
myjournal manuscript No. (will be inserted by the editor) A Note on the Bertsimas & Sim Algorithm for Robust Combinatorial Optimization Problems Eduardo Álvarez-Miranda Ivana Ljubić Paolo Toth Received:
More informationVieta s Formulas and the Identity Theorem
Vieta s Formulas and the Identity Theorem This worksheet will work through the material from our class on 3/21/2013 with some examples that should help you with the homework The topic of our discussion
More informationUndergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics
Undergraduate Notes in Mathematics Arkansas Tech University Department of Mathematics An Introductory Single Variable Real Analysis: A Learning Approach through Problem Solving Marcel B. Finan c All Rights
More informationx a x 2 (1 + x 2 ) n.
Limits and continuity Suppose that we have a function f : R R. Let a R. We say that f(x) tends to the limit l as x tends to a; lim f(x) = l ; x a if, given any real number ɛ > 0, there exists a real number
More informationOPRE 6201 : 2. Simplex Method
OPRE 6201 : 2. Simplex Method 1 The Graphical Method: An Example Consider the following linear program: Max 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2
More informationInteger Programming. subject to: (i = 1, 2,..., m),
Integer Programming 9 The linear-programming models that have been discussed thus far all have been continuous, in the sense that decision variables are allowed to be fractional. Often this is a realistic
More informationLecture 3: Finding integer solutions to systems of linear equations
Lecture 3: Finding integer solutions to systems of linear equations Algorithmic Number Theory (Fall 2014) Rutgers University Swastik Kopparty Scribe: Abhishek Bhrushundi 1 Overview The goal of this lecture
More informationInner Product Spaces
Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and
More informationVENDOR MANAGED INVENTORY
VENDOR MANAGED INVENTORY Martin Savelsbergh School of Industrial and Systems Engineering Georgia Institute of Technology Joint work with Ann Campbell, Anton Kleywegt, and Vijay Nori Distribution Systems:
More informationStandard Form of a Linear Programming Problem
494 CHAPTER 9 LINEAR PROGRAMMING 9. THE SIMPLEX METHOD: MAXIMIZATION For linear programming problems involving two variables, the graphical solution method introduced in Section 9. is convenient. However,
More informationChapter 11. 11.1 Load Balancing. Approximation Algorithms. Load Balancing. Load Balancing on 2 Machines. Load Balancing: Greedy Scheduling
Approximation Algorithms Chapter Approximation Algorithms Q. Suppose I need to solve an NP-hard problem. What should I do? A. Theory says you're unlikely to find a poly-time algorithm. Must sacrifice one
More informationSpecial Situations in the Simplex Algorithm
Special Situations in the Simplex Algorithm Degeneracy Consider the linear program: Maximize 2x 1 +x 2 Subject to: 4x 1 +3x 2 12 (1) 4x 1 +x 2 8 (2) 4x 1 +2x 2 8 (3) x 1, x 2 0. We will first apply the
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More informationChapter 5. Linear Inequalities and Linear Programming. Linear Programming in Two Dimensions: A Geometric Approach
Chapter 5 Linear Programming in Two Dimensions: A Geometric Approach Linear Inequalities and Linear Programming Section 3 Linear Programming gin Two Dimensions: A Geometric Approach In this section, we
More informationBranch and Cut for TSP
Branch and Cut for TSP jla,jc@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark 1 Branch-and-Cut for TSP Branch-and-Cut is a general technique applicable e.g. to solve symmetric
More information2.3 Convex Constrained Optimization Problems
42 CHAPTER 2. FUNDAMENTAL CONCEPTS IN CONVEX OPTIMIZATION Theorem 15 Let f : R n R and h : R R. Consider g(x) = h(f(x)) for all x R n. The function g is convex if either of the following two conditions
More informationIntroduction to Linear Programming (LP) Mathematical Programming (MP) Concept
Introduction to Linear Programming (LP) Mathematical Programming Concept LP Concept Standard Form Assumptions Consequences of Assumptions Solution Approach Solution Methods Typical Formulations Massachusetts
More informationLECTURE 5: DUALITY AND SENSITIVITY ANALYSIS. 1. Dual linear program 2. Duality theory 3. Sensitivity analysis 4. Dual simplex method
LECTURE 5: DUALITY AND SENSITIVITY ANALYSIS 1. Dual linear program 2. Duality theory 3. Sensitivity analysis 4. Dual simplex method Introduction to dual linear program Given a constraint matrix A, right
More informationA Simple Introduction to Support Vector Machines
A Simple Introduction to Support Vector Machines Martin Law Lecture for CSE 802 Department of Computer Science and Engineering Michigan State University Outline A brief history of SVM Large-margin linear
More informationAlgebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.
Chapter 1 Vocabulary identity - A statement that equates two equivalent expressions. verbal model- A word equation that represents a real-life problem. algebraic expression - An expression with variables.
More informationDefinition 11.1. Given a graph G on n vertices, we define the following quantities:
Lecture 11 The Lovász ϑ Function 11.1 Perfect graphs We begin with some background on perfect graphs. graphs. First, we define some quantities on Definition 11.1. Given a graph G on n vertices, we define
More informationOnline Adwords Allocation
Online Adwords Allocation Shoshana Neuburger May 6, 2009 1 Overview Many search engines auction the advertising space alongside search results. When Google interviewed Amin Saberi in 2004, their advertisement
More information4.6 Linear Programming duality
4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP. Different spaces and objective functions but in general same optimal
More informationA Labeling Algorithm for the Maximum-Flow Network Problem
A Labeling Algorithm for the Maximum-Flow Network Problem Appendix C Network-flow problems can be solved by several methods. In Chapter 8 we introduced this topic by exploring the special structure of
More informationBinary Adders: Half Adders and Full Adders
Binary Adders: Half Adders and Full Adders In this set of slides, we present the two basic types of adders: 1. Half adders, and 2. Full adders. Each type of adder functions to add two binary bits. In order
More informationMath 4310 Handout - Quotient Vector Spaces
Math 4310 Handout - Quotient Vector Spaces Dan Collins The textbook defines a subspace of a vector space in Chapter 4, but it avoids ever discussing the notion of a quotient space. This is understandable
More informationProximal mapping via network optimization
L. Vandenberghe EE236C (Spring 23-4) Proximal mapping via network optimization minimum cut and maximum flow problems parametric minimum cut problem application to proximal mapping Introduction this lecture:
More informationIn this paper we present a branch-and-cut algorithm for
SOLVING A TRUCK DISPATCHING SCHEDULING PROBLEM USING BRANCH-AND-CUT ROBERT E. BIXBY Rice University, Houston, Texas EVA K. LEE Georgia Institute of Technology, Atlanta, Georgia (Received September 1994;
More informationVector and Matrix Norms
Chapter 1 Vector and Matrix Norms 11 Vector Spaces Let F be a field (such as the real numbers, R, or complex numbers, C) with elements called scalars A Vector Space, V, over the field F is a non-empty
More informationNear Optimal Solutions
Near Optimal Solutions Many important optimization problems are lacking efficient solutions. NP-Complete problems unlikely to have polynomial time solutions. Good heuristics important for such problems.
More informationStudy Guide 2 Solutions MATH 111
Study Guide 2 Solutions MATH 111 Having read through the sample test, I wanted to warn everyone, that I might consider asking questions involving inequalities, the absolute value function (as in the suggested
More informationNetwork coding for security and robustness
Network coding for security and robustness 1 Outline Network coding for detecting attacks Network management requirements for robustness Centralized versus distributed network management 2 Byzantine security
More information2.2 Derivative as a Function
2.2 Derivative as a Function Recall that we defined the derivative as f (a) = lim h 0 f(a + h) f(a) h But since a is really just an arbitrary number that represents an x-value, why don t we just use x
More informationThe Graphical Method: An Example
The Graphical Method: An Example Consider the following linear program: Maximize 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2 0, where, for ease of reference,
More informationTo give it a definition, an implicit function of x and y is simply any relationship that takes the form:
2 Implicit function theorems and applications 21 Implicit functions The implicit function theorem is one of the most useful single tools you ll meet this year After a while, it will be second nature to
More informationDegeneracy in Linear Programming
Degeneracy in Linear Programming I heard that today s tutorial is all about Ellen DeGeneres Sorry, Stan. But the topic is just as interesting. It s about degeneracy in Linear Programming. Degeneracy? Students
More information1(a). How many ways are there to rearrange the letters in the word COMPUTER?
CS 280 Solution Guide Homework 5 by Tze Kiat Tan 1(a). How many ways are there to rearrange the letters in the word COMPUTER? There are 8 distinct letters in the word COMPUTER. Therefore, the number of
More informationSUPPLY CHAIN OPTIMIZATION MODELS IN THE AREA OF OPERATION
SUPPLY CHAIN OPTIMIZATION MODELS IN THE AREA OF OPERATION Tomáš DVOŘÁK, Martin VLKOVSKÝ Abstract: Main idea of this paper is to choose both suitable and applicable operations research methods for military
More informationFactoring Polynomials
Factoring Polynomials Sue Geller June 19, 2006 Factoring polynomials over the rational numbers, real numbers, and complex numbers has long been a standard topic of high school algebra. With the advent
More informationApplied Algorithm Design Lecture 5
Applied Algorithm Design Lecture 5 Pietro Michiardi Eurecom Pietro Michiardi (Eurecom) Applied Algorithm Design Lecture 5 1 / 86 Approximation Algorithms Pietro Michiardi (Eurecom) Applied Algorithm Design
More information8 Square matrices continued: Determinants
8 Square matrices continued: Determinants 8. Introduction Determinants give us important information about square matrices, and, as we ll soon see, are essential for the computation of eigenvalues. You
More informationDiscrete Optimization Introduction & applications
Discrete Optimization 2013 1/21 Discrete Optimization Introduction & applications Bertrand Cornélusse ULg - Institut Montefiore 2013 Discrete Optimization 2013 2/21 Outline Introduction Some applications
More informationApplication. Outline. 3-1 Polynomial Functions 3-2 Finding Rational Zeros of. Polynomial. 3-3 Approximating Real Zeros of.
Polynomial and Rational Functions Outline 3-1 Polynomial Functions 3-2 Finding Rational Zeros of Polynomials 3-3 Approximating Real Zeros of Polynomials 3-4 Rational Functions Chapter 3 Group Activity:
More informationSudoku puzzles and how to solve them
Sudoku puzzles and how to solve them Andries E. Brouwer 2006-05-31 1 Sudoku Figure 1: Two puzzles the second one is difficult A Sudoku puzzle (of classical type ) consists of a 9-by-9 matrix partitioned
More informationHow To Solve A Minimum Set Covering Problem (Mcp)
Measuring Rationality with the Minimum Cost of Revealed Preference Violations Mark Dean and Daniel Martin Online Appendices - Not for Publication 1 1 Algorithm for Solving the MASP In this online appendix
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology Handout 6 18.433: Combinatorial Optimization February 20th, 2009 Michel X. Goemans 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the
More informationOne last point: we started off this book by introducing another famously hard search problem:
S. Dasgupta, C.H. Papadimitriou, and U.V. Vazirani 261 Factoring One last point: we started off this book by introducing another famously hard search problem: FACTORING, the task of finding all prime factors
More informationQuestion 2: How will changes in the objective function s coefficients change the optimal solution?
Question 2: How will changes in the objective function s coefficients change the optimal solution? In the previous question, we examined how changing the constants in the constraints changed the optimal
More informationA Reference Point Method to Triple-Objective Assignment of Supporting Services in a Healthcare Institution. Bartosz Sawik
Decision Making in Manufacturing and Services Vol. 4 2010 No. 1 2 pp. 37 46 A Reference Point Method to Triple-Objective Assignment of Supporting Services in a Healthcare Institution Bartosz Sawik Abstract.
More information