# Linear Programming I

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Linear Programming I November 30, Introduction In the VCR/guns/nuclear bombs/napkins/star wars/professors/butter/mice problem, the benevolent dictator, Bigus Piguinus, of south Antarctica penguins (having 24 million penguins under its control) has to decide how to allocate his empire resources to the maximal benefits of his penguins. In particular, she has to decide how to allocate the money for the next year budget. For example, buying a nuclear bomb has a tremendous positive effect on security (the ability to destruct yourself completely together with your enemy is considered to induce a peaceful security feeling in most people). Guns on the other hand has lesser effect. Piguina (the state) has to supply a certain level of security. Thus, the allocation should be such that: x gun x nuclear bomb 1000 where x guns is the number of guns constructed, and x nuclear bomb is the number of NB constructed. On the other hand, 1000 x gun x nuclear bomb x security where x security is the total Piguina is willing to spend on security, and 1000 is the price of producing a single gun, and is the price of manufacturing one nuclear bomb. There are a lot of other constrains of this type, and Bigus Piguinus would like to solve them, while minimizing the total money allocated for such spending (the less spent on budget, the larger the tax cut). More formally, we have a large number of variables: x 1,..., x n and a large system of linear inequalities: a 11 x a 1n x n b 1 a 21 x a 2n x n b 2... a m1 x a mn x n b m 1

2 we would like to decide if there is an assignment of values to x 1,..., x n where those inequalities are satisfied. Since there might be infinite number of such solutions, we decide that we want the solution that maximizes the quantity: c 1 x c n x n. This quantity is known as the objective function of the linear program. Question: How do we compute such a solution? This is known as linear programming. 1.1 History Linear programming can be traced back to the early 19th century. It really started in 1939 when L.V. Kantorovich noticed the importance of certain type of Linear Programming problems. Unfortunately, for several years, Kantorovich work was unknown in the west and unnoticed in the east. Dantzig, in 1947, invented the simplex method for solving LP problems for the US Air force planning problems. T.C. Koopmans, in 1947, showed that LP provide the right model for the analysis of classical economic theories. In 1975, both Koopmans and Kantorovich got the Nobel prize of economics. Dantzig probably did not get it because his work was too mathematical. 2 On the geometry of the simplex algorithm Let us assume, that we have an LP, and we have a set of n variables and m constraints. Furthermore, we know a vertex of the feasible region, and we have the direction of the objective function. For example, if we are on p in the following drawing, we can improve the situation by moving to... p q...to q. In general, a vertex of a polytope is defined by n constraints (since we are in n dimensions). Every two vertices u and v that have d 1 common constraints, are adjacent in the sense that there is an edge on the boundary of the polytope that connects them. To see that, let l be the intersection of the boundaries of those d 1 constraints. Clearly, l is a line, and its intersection with the feasible region is a segment, where u and v are its 2

3 endpoints. As such, if we are at u but the vertex v has a better value for the objective function, we move our current solution there, updating the current set of constraints to reflect this. So essentially, we have a graph G which is the set of all vertices in the polytope, where two vertices are connected if they have d 1 common constraints, and we walk on this graph, all the time moving from the current vertex to one of the neighbors with a better value. In the end we will get to the global minimum. 3 The simplex algorithm 3.1 LP - All variables being positive We are given an LP: subject to Maximize c j x j j=1 a ij x j b i for i = 1, 2,..., m j=1 here any variable can have any real value. We would like to rewrite it such that every variable is non-negative. This is easy to do, by replacing a variable x i by x i x i. Namely, x i = x i x i where x i 0 and x i 0. Thus, the (trivial) LP 2x + y 5 would be replaced by Thus, we have 2x 2x + y y 5 x 0 y 0 x 0 y 0 Lemma 3.1 Given an instance I of LP, one can rewrite it into an equivalent LP, such that all the variables must be non-negative. 3

4 3.2 Standard form Maximize c j x j j=1 subject to a ij x j b i for i = 1, 2,..., m j=1 Setting c = and x = Then: c 1. c n x 1 x 2. x n 1 x n, A =. x j 0 for j = 1,..., n. a 11 a a 1(n 1) a 1n a 21 a a 2(n 1) a 2n a (m 1)1 a (m 1)2... a (m 1)(n 1) a (m 1)n a m1 a m2... a m(n 1) a mn subject to Maximize Ax b x 0 c T x In the following, we are going to do a long long sequence of rewritings. Slack Form One can rewrite an LP instance, so that every inequality becomes equality, and all variables must be positive: subject to Maximize Ax = b x 0 c T x To do that, we introduce new variables (slack variables) rewriting an inequality: a i x i b i=1 4

5 by x n+1 = b x n+1 0 a i x i i=1 In fact, now we have a special variable for each equality inequality in the LP program. This variables are special, and would be called basic variables. The variable on the right side are nonbasic variables (original isn t it?). This form, is called SLACK FORM. It is defined by the following parameters: B - Set of indices of basic variables N - Set of indices of nonbasic variables n = N - number of original variables b, c - two vectors of constants m = B - number of basic variables (i.e., number of inequalities) A - The matrix of coefficients N B = {1,..., n + m} And the slack form itself is: A tuple (N,B,A,b,c,v) Where the objective function is to maximize: z = v + c j x j j N And the constraints are: x i = b i a ij x j j N for i B, of course, all variables x i must be non-negative (i.e., x i 0). Exercise 3.2 Show that any linear program can be transformed into equivalent slack form. Example 3.3 In the slack form, we have z = 28 x 3 6 x 5 6 2x 6 3 x 1 = 8 + x x 5 6 x 6 3 x 2 = 4 8x 3 3 2x x 6 3 5

6 Here we have: x 4 = 18 x x 5 2 b = A = b 1 b 2 b 4 B = {1, 2, 4}, N = {3, 5, 6} a 13 a 15 a 16 a 23 a 25 a 26 a 43 a 45 a 46 = = c = 1/6 1/6 1/3 8/3 2/3 1/3 1/2 1/2 0 c 3 c 5 c 6 = 1/6 1/6 2/3 v = 28. Note that indices depend on N and B. Note also that A entires are negation of what they appear in the slack form. 3.3 Geometric interpretation of linear programming Each inequality defines a half space. The feasible region is the intersection of those halfspaces. This region is known as a convex polytope or just polytope. 3.4 A concrete example maximize 5x 1 + 4x 2 + 3x 3 subject to 2x 1 + 3x 2 + x 3 5 4x 1 + x 2 + 2x x 1 + 4x 2 + 2x 3 8 x 1, x 2, x 3 0 Next, we introduce slack variables, for example, rewriting 2x 1 + 3x 2 + x 3 5 as the constraints: w 1 0 and w 1 = 5 2x 1 3x 2 x 3. maximize z = 5x 1 + 4x 2 + 3x 3 subject to w 1 = 5 2x 1 3x 2 x 3 w 2 = 11 4x 1 x 2 2x 3 w 3 = 8 3x 1 4x 2 2x 3 x 1, x 2, x 3, w 1, w 2, w 3 0 where w 1, w 2, w 3 are the slack variables. Note also that they are currently also the basic variables. We start from the slack representation trivial solution: x 1 = x 2 = x 3 = 0 then w 1 = 5, w 2 = 11 and w 3 = 8. This is a feasible solution, and z = 0. 6

7 How to improve this solution? max z = 5x 1 + 4x 2 + 3x 3 subject to w 1 = 5 2x 1 3x 2 x 3 w 2 = 11 4x 1 x 2 2x 3 w 3 = 8 3x 1 4x 2 2x 3 x 1, x 2, x 3, w 1, w 2, w 3 0 For x 1 = x 2 = x 3 = 0 then w 1 = 5, w 2 = 11 and w 3 = 8 and z = 0. How to improve the value of the objective function? Let increase the value of x 1! Good things: objective function increases. Bad things: the solution might stop being feasible. Solution: Let us increase x 1 as much as possible... So: x 2 = x 3 = 0 and w 1 = 5 2x 1 3x 2 x 3 = 5 2x 1 w 2 = 11 4x 1 x 2 2x 3 = 11 4x 1 w 3 = 8 3x 1 4x 2 2x 3 = 8 3x 1 We want to increase x 1 as much as possible, as long as w 1, w 2, w 3 are non-negative. Formally, w 1 = 5 2x 1 0, w 2 = 11 4x 1 0 and w 3 = 8 3x 1 0. This implies that: x x 1 11/4 = 2.75 and x 1 8/3 = So, by how much can we increase the value of x 1? We must take the strictest condition. Namely, x 1 = 2.5. Putting it into the system, we now have, that the current solution is: x 1 = 2.5, x 2 = 0, x 3 = 0 and w 1 = 0, w 2 = 1, w 3 = 0.5 and the objective function is z = 5x 1 + 4x 2 + 3x 3 = Namely, we did find a better solution. What happens? One zero nonbasic variable (i.e., x 1 ) became non-zero, and one basic variable became zero (i.e., w 1 ): maximize z = 5x 1 + 4x 2 + 3x 3 subject to w 1 = 5 2x 1 3x 2 x 3 w 2 = 11 4x 1 x 2 2x 3 w 3 = 8 3x 1 4x 2 2x 3 x 1, x 2, x 3, w 1, w 2, w 3 0 7

8 Simplex( LP : linear system of inequalities ) Transform LP into slack form. Let L be the resulting slack form. Compute L F easible(l) (as described above) x StartSolution(L ) x SimplexInner(L, x) (*) if objective function value of x is > 0 then return No solution x SimplexInner(L, x ) return x Figure 1: The simplex algorithm Let us rewrite the first rule for w 1 so that x 1 is on the left side: x 1 = w 1 1.5x 2 0.5x 3 The problem is that x 1 still appears in the right size of the equations for w 2 and w 3. How to solve this? We substitute x 1 into We get: z = w x x 3 x 1 = w 1 1.5x 2 0.5x 3 w 2 = 1 + 2w 1 + 5x 2 w 3 = w x 2 0.5x 3 Note that we get the solution, by putting w 1 = x 2 = x 3 = 0. We repeat the above procedure for x 3. Why x 3? Because the coefficient of x 3 in the objective function is positive.). Checking carefully, it follows that the maximum we can increase x 3 is to 1 (why?). We rewrite the last equality for x 3 and we get: x 3 = 1 + 3w 1 + x 2 2w 3 Substituting this into the LP, we get: z = 13 w 1 3x 2 w 3 x 1 = 2 2w 1 2x 2 + w 3 w 2 = 1 + 2w 1 + 5x 2 x 3 = 1 + 3w 1 + x 2 2w 3 What should we do next? Nothing. We had reached the optimal solution. Indeed, all the coefficients in the objective function are negative (or zero). As such, the trivial solution (all non-basic variables get zero) is maximal, as they must all be non-negative, and increasing their value decreases the value of the objective function. So we better stop. 8

9 3.5 Starting somewhere OK. We had transformed a linear programming problem into slack form. Intuitively, what the Simplex algorithm is going to do, is to start from a feasible solution and start walking around in the feasible region till it reaches the best possible point as far as the objective function is concerned. But maybe the linear program L is not feasible at all (i.e., no solution exists.). Let L be (in slack form): z = v + j N c j x j x i = b i j N a ij x j for i B, where all variables x i must be non-negative (i.e., x i 0). Clearly, if we set all x i = 0 if i N then this determines the values of the basic variables. If they are all positive, we are done, as we found a feasible solution. The problem is that they might be negative. We generate a new LP problem L = F easible(l): Minimize x 0 x i = x 0 + b i j N a ij x j for i B, where all variables x i must be non-negative (i.e., x i 0). Clearly, if we pick x j = 0 for all j N (all the nonbasic variables), and a value large enough for x 0 then all the basic variables would be non-negatives, and as such, we have found a feasible solution for L. Let StartSolution(L ) denote this easily computable feasible solution. We can now use the SimplexInner algorithm to find this optimal solution to L (because we have a feasible solution to start from!). Lemma 3.4 L is feasible if and only if the optimal objective value of L is zero. Proof: A feasible solution to L is immediately an optimal solution to L with x 0 = 0, and vice versa. Namely, given a solution to L with x 0 = 0 we can transform it to a feasible solution to L by removing x 0. The simplex algorithm is presented in Figure 1. Thus, in the following, we have to describe SimplexInner - a procedure to solve an LP in slack form, when we start from a feasible solution. One technicality that is ignored above, is that the starting solution we have for L, generated by StartSolution(L) is not legal as far as the slack form is concerned, because the non-basic variable x 0 is assigned a non-zero value. However, this can be easily resolve by immediately pivot on x 0 when we execute (*) in Figure 1. Namely, we first try to decrease 9

10 x 0 as much as possible. Details are delayed till the next lecture, when we describe in more detail the SimplexInner algorithm. 10

### Definition of a Linear Program

Definition of a Linear Program Definition: A function f(x 1, x,..., x n ) of x 1, x,..., x n is a linear function if and only if for some set of constants c 1, c,..., c n, f(x 1, x,..., x n ) = c 1 x 1

### Chapter 15 Introduction to Linear Programming

Chapter 15 Introduction to Linear Programming An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Brief History of Linear Programming The goal of linear programming is to determine the values of

### Theory of Linear Programming

Theory of Linear Programming Debasis Mishra April 6, 2011 1 Introduction Optimization of a function f over a set S involves finding the maximum (minimum) value of f (objective function) in the set S (feasible

### The Simplex Method. yyye

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #05 1 The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/

### Linear Programming Notes V Problem Transformations

Linear Programming Notes V Problem Transformations 1 Introduction Any linear programming problem can be rewritten in either of two standard forms. In the first form, the objective is to maximize, the material

### Chap 4 The Simplex Method

The Essence of the Simplex Method Recall the Wyndor problem Max Z = 3x 1 + 5x 2 S.T. x 1 4 2x 2 12 3x 1 + 2x 2 18 x 1, x 2 0 Chap 4 The Simplex Method 8 corner point solutions. 5 out of them are CPF solutions.

### IEOR 4404 Homework #2 Intro OR: Deterministic Models February 14, 2011 Prof. Jay Sethuraman Page 1 of 5. Homework #2

IEOR 4404 Homework # Intro OR: Deterministic Models February 14, 011 Prof. Jay Sethuraman Page 1 of 5 Homework #.1 (a) What is the optimal solution of this problem? Let us consider that x 1, x and x 3

### Section Notes 3. The Simplex Algorithm. Applied Math 121. Week of February 14, 2011

Section Notes 3 The Simplex Algorithm Applied Math 121 Week of February 14, 2011 Goals for the week understand how to get from an LP to a simplex tableau. be familiar with reduced costs, optimal solutions,

### Linear Programming. March 14, 2014

Linear Programming March 1, 01 Parts of this introduction to linear programming were adapted from Chapter 9 of Introduction to Algorithms, Second Edition, by Cormen, Leiserson, Rivest and Stein [1]. 1

### Math 407A: Linear Optimization

Math 407A: Linear Optimization Lecture 4: LP Standard Form 1 1 Author: James Burke, University of Washington LPs in Standard Form Minimization maximization Linear equations to linear inequalities Lower

### Quiz 1 Sample Questions IE406 Introduction to Mathematical Programming Dr. Ralphs

Quiz 1 Sample Questions IE406 Introduction to Mathematical Programming Dr. Ralphs These questions are from previous years and should you give you some idea of what to expect on Quiz 1. 1. Consider the

### 1 Solving LPs: The Simplex Algorithm of George Dantzig

Solving LPs: The Simplex Algorithm of George Dantzig. Simplex Pivoting: Dictionary Format We illustrate a general solution procedure, called the simplex algorithm, by implementing it on a very simple example.

### Can linear programs solve NP-hard problems?

Can linear programs solve NP-hard problems? p. 1/9 Can linear programs solve NP-hard problems? Ronald de Wolf Linear programs Can linear programs solve NP-hard problems? p. 2/9 Can linear programs solve

### Lecture 4 Linear Programming Models: Standard Form. August 31, 2009

Linear Programming Models: Standard Form August 31, 2009 Outline: Lecture 4 Standard form LP Transforming the LP problem to standard form Basic solutions of standard LP problem Operations Research Methods

### Linear Programming for Optimization. Mark A. Schulze, Ph.D. Perceptive Scientific Instruments, Inc.

1. Introduction Linear Programming for Optimization Mark A. Schulze, Ph.D. Perceptive Scientific Instruments, Inc. 1.1 Definition Linear programming is the name of a branch of applied mathematics that

### 1 Introduction. Linear Programming. Questions. A general optimization problem is of the form: choose x to. max f(x) subject to x S. where.

Introduction Linear Programming Neil Laws TT 00 A general optimization problem is of the form: choose x to maximise f(x) subject to x S where x = (x,..., x n ) T, f : R n R is the objective function, S

### Geometry of Linear Programming

Chapter 2 Geometry of Linear Programming The intent of this chapter is to provide a geometric interpretation of linear programming problems. To conceive fundamental concepts and validity of different algorithms

### Linear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.

Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.

### 3. Evaluate the objective function at each vertex. Put the vertices into a table: Vertex P=3x+2y (0, 0) 0 min (0, 5) 10 (15, 0) 45 (12, 2) 40 Max

SOLUTION OF LINEAR PROGRAMMING PROBLEMS THEOREM 1 If a linear programming problem has a solution, then it must occur at a vertex, or corner point, of the feasible set, S, associated with the problem. Furthermore,

### Practical Guide to the Simplex Method of Linear Programming

Practical Guide to the Simplex Method of Linear Programming Marcel Oliver Revised: April, 0 The basic steps of the simplex algorithm Step : Write the linear programming problem in standard form Linear

### What is Linear Programming?

Chapter 1 What is Linear Programming? An optimization problem usually has three essential ingredients: a variable vector x consisting of a set of unknowns to be determined, an objective function of x to

### The Graphical Simplex Method: An Example

The Graphical Simplex Method: An Example Consider the following linear program: Max 4x 1 +3x Subject to: x 1 +3x 6 (1) 3x 1 +x 3 () x 5 (3) x 1 +x 4 (4) x 1, x 0. Goal: produce a pair of x 1 and x that

### THEORY OF SIMPLEX METHOD

Chapter THEORY OF SIMPLEX METHOD Mathematical Programming Problems A mathematical programming problem is an optimization problem of finding the values of the unknown variables x, x,, x n that maximize

### Chapter 6. Linear Programming: The Simplex Method. Introduction to the Big M Method. Section 4 Maximization and Minimization with Problem Constraints

Chapter 6 Linear Programming: The Simplex Method Introduction to the Big M Method In this section, we will present a generalized version of the simplex method that t will solve both maximization i and

### Lecture 2: August 29. Linear Programming (part I)

10-725: Convex Optimization Fall 2013 Lecture 2: August 29 Lecturer: Barnabás Póczos Scribes: Samrachana Adhikari, Mattia Ciollaro, Fabrizio Lecci Note: LaTeX template courtesy of UC Berkeley EECS dept.

### Using the Simplex Method in Mixed Integer Linear Programming

Integer Using the Simplex Method in Mixed Integer UTFSM Nancy, 17 december 2015 Using the Simplex Method in Mixed Integer Outline Mathematical Programming Integer 1 Mathematical Programming Optimisation

### I. Solving Linear Programs by the Simplex Method

Optimization Methods Draft of August 26, 2005 I. Solving Linear Programs by the Simplex Method Robert Fourer Department of Industrial Engineering and Management Sciences Northwestern University Evanston,

### Linear Programming. April 12, 2005

Linear Programming April 1, 005 Parts of this were adapted from Chapter 9 of i Introduction to Algorithms (Second Edition) /i by Cormen, Leiserson, Rivest and Stein. 1 What is linear programming? The first

### By W.E. Diewert. July, Linear programming problems are important for a number of reasons:

APPLIED ECONOMICS By W.E. Diewert. July, 3. Chapter : Linear Programming. Introduction The theory of linear programming provides a good introduction to the study of constrained maximization (and minimization)

### Linear Inequalities and Linear Programming. Systems of Linear Inequalities in Two Variables

Linear Inequalities and Linear Programming 5.1 Systems of Linear Inequalities 5.2 Linear Programming Geometric Approach 5.3 Geometric Introduction to Simplex Method 5.4 Maximization with constraints 5.5

### Outline. Linear Programming (LP): Simplex Search. Simplex: An Extreme-Point Search Algorithm. Basic Solutions

Outline Linear Programming (LP): Simplex Search Benoît Chachuat McMaster University Department of Chemical Engineering ChE 4G03: Optimization in Chemical Engineering 1 Basic Solutions

### 3. Linear Programming and Polyhedral Combinatorics

Massachusetts Institute of Technology Handout 6 18.433: Combinatorial Optimization February 20th, 2009 Michel X. Goemans 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the

### LINEAR PROGRAMMING P V Ram B. Sc., ACA, ACMA Hyderabad

LINEAR PROGRAMMING P V Ram B. Sc., ACA, ACMA 98481 85073 Hyderabad Page 1 of 19 Question: Explain LPP. Answer: Linear programming is a mathematical technique for determining the optimal allocation of resources

### 3y 1 + 5y 2. y 1 + y 2 20 y 1 0, y 2 0.

1 Linear Programming A linear programming problem is the problem of maximizing (or minimizing) a linear function subject to linear constraints. The constraints may be equalities or inequalities. 1.1 Example

### OPRE 6201 : 2. Simplex Method

OPRE 6201 : 2. Simplex Method 1 The Graphical Method: An Example Consider the following linear program: Max 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2

### Algebraic Simplex Method - Introduction Previous

Algebraic Simplex Method - Introduction To demonstrate the simplex method, consider the following linear programming model: This is the model for Leo Coco's problem presented in the demo, Graphical Method.

### LECTURE 5: DUALITY AND SENSITIVITY ANALYSIS. 1. Dual linear program 2. Duality theory 3. Sensitivity analysis 4. Dual simplex method

LECTURE 5: DUALITY AND SENSITIVITY ANALYSIS 1. Dual linear program 2. Duality theory 3. Sensitivity analysis 4. Dual simplex method Introduction to dual linear program Given a constraint matrix A, right

### Section Notes 4. Duality, Sensitivity, Dual Simplex, Complementary Slackness. Applied Math 121. Week of February 28, 2011

Section Notes 4 Duality, Sensitivity, Dual Simplex, Complementary Slackness Applied Math 121 Week of February 28, 2011 Goals for the week understand the relationship between primal and dual programs. know

### Standard Form of a Linear Programming Problem

494 CHAPTER 9 LINEAR PROGRAMMING 9. THE SIMPLEX METHOD: MAXIMIZATION For linear programming problems involving two variables, the graphical solution method introduced in Section 9. is convenient. However,

### 7.4 Linear Programming: The Simplex Method

7.4 Linear Programming: The Simplex Method For linear programming problems with more than two variables, the graphical method is usually impossible, so the simplex method is used. Because the simplex method

### Chapter 1 Linear Programming. Paragraph 2 Developing Ideas for an Algorithm solving Linear Optimization

Chapter 1 Linear Programming Paragraph 2 Developing Ideas for an Algorithm solving Linear Optimization What we did so far How to model an optimization problem Data, Variables, Constraints, Objective We

### Special Situations in the Simplex Algorithm

Special Situations in the Simplex Algorithm Degeneracy Consider the linear program: Maximize 2x 1 +x 2 Subject to: 4x 1 +3x 2 12 (1) 4x 1 +x 2 8 (2) 4x 1 +2x 2 8 (3) x 1, x 2 0. We will first apply the

### MATHEMATICAL BACKGROUND

Chapter 1 MATHEMATICAL BACKGROUND This chapter discusses the mathematics that is necessary for the development of the theory of linear programming. We are particularly interested in the solutions of a

### Lecture 3. Linear Programming. 3B1B Optimization Michaelmas 2015 A. Zisserman. Extreme solutions. Simplex method. Interior point method

Lecture 3 3B1B Optimization Michaelmas 2015 A. Zisserman Linear Programming Extreme solutions Simplex method Interior point method Integer programming and relaxation The Optimization Tree Linear Programming

### Linear Programming Problems

Linear Programming Problems Linear programming problems come up in many applications. In a linear programming problem, we have a function, called the objective function, which depends linearly on a number

### 3.1 Solving Systems Using Tables and Graphs

Algebra 2 Chapter 3 3.1 Solve Systems Using Tables & Graphs 3.1 Solving Systems Using Tables and Graphs A solution to a system of linear equations is an that makes all of the equations. To solve a system

### Chapter 3 LINEAR PROGRAMMING GRAPHICAL SOLUTION 3.1 SOLUTION METHODS 3.2 TERMINOLOGY

Chapter 3 LINEAR PROGRAMMING GRAPHICAL SOLUTION 3.1 SOLUTION METHODS Once the problem is formulated by setting appropriate objective function and constraints, the next step is to solve it. Solving LPP

### SOLVING LINEAR SYSTEM OF INEQUALITIES WITH APPLICATION TO LINEAR PROGRAMS

SOLVING LINEAR SYSTEM OF INEQUALITIES WITH APPLICATION TO LINEAR PROGRAMS Hossein Arsham, University of Baltimore, (410) 837-5268, harsham@ubalt.edu Veena Adlakha, University of Baltimore, (410) 837-4969,

### The Simplex Method. What happens when we need more decision variables and more problem constraints?

The Simplex Method The geometric method of solving linear programming problems presented before. The graphical method is useful only for problems involving two decision variables and relatively few problem

### max cx s.t. Ax c where the matrix A, cost vector c and right hand side b are given and x is a vector of variables. For this example we have x

Linear Programming Linear programming refers to problems stated as maximization or minimization of a linear function subject to constraints that are linear equalities and inequalities. Although the study

### The Simplex Solution Method

Module A The Simplex Solution Method A-1 A-2 Module A The Simplex Solution Method The simplex method is a general mathematical solution technique for solving linear programming problems. In the simplex

### 4.6 Linear Programming duality

4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP. Different spaces and objective functions but in general same optimal

### 1 Polyhedra and Linear Programming

CS 598CSC: Combinatorial Optimization Lecture date: January 21, 2009 Instructor: Chandra Chekuri Scribe: Sungjin Im 1 Polyhedra and Linear Programming In this lecture, we will cover some basic material

### 3 Does the Simplex Algorithm Work?

Does the Simplex Algorithm Work? In this section we carefully examine the simplex algorithm introduced in the previous chapter. Our goal is to either prove that it works, or to determine those circumstances

### Graphical method. plane. (for max) and down (for min) until it touches the set of feasible solutions. Graphical method

The graphical method of solving linear programming problems can be applied to models with two decision variables. This method consists of two steps (see also the first lecture): 1 Draw the set of feasible

### Advanced Topics in Machine Learning (Part II)

Advanced Topics in Machine Learning (Part II) 3. Convexity and Optimisation February 6, 2009 Andreas Argyriou 1 Today s Plan Convex sets and functions Types of convex programs Algorithms Convex learning

### Chapter 5.1 Systems of linear inequalities in two variables.

Chapter 5. Systems of linear inequalities in two variables. In this section, we will learn how to graph linear inequalities in two variables and then apply this procedure to practical application problems.

### Good luck, veel succes!

Final exam Advanced Linear Programming, May 7, 13.00-16.00 Switch off your mobile phone, PDA and any other mobile device and put it far away. No books or other reading materials are allowed. This exam

### Lecture notes 1: Introduction to linear and (mixed) integer programs

Lecture notes 1: Introduction to linear and (mixed) integer programs Vincent Conitzer 1 An example We will start with a simple example. Suppose we are in the business of selling reproductions of two different

### Chapter 6: Sensitivity Analysis

Chapter 6: Sensitivity Analysis Suppose that you have just completed a linear programming solution which will have a major impact on your company, such as determining how much to increase the overall production

### Linear Programming, Lagrange Multipliers, and Duality Geoff Gordon

lp.nb 1 Linear Programming, Lagrange Multipliers, and Duality Geoff Gordon lp.nb 2 Overview This is a tutorial about some interesting math and geometry connected with constrained optimization. It is not

### Linear Programming. Solving LP Models Using MS Excel, 18

SUPPLEMENT TO CHAPTER SIX Linear Programming SUPPLEMENT OUTLINE Introduction, 2 Linear Programming Models, 2 Model Formulation, 4 Graphical Linear Programming, 5 Outline of Graphical Procedure, 5 Plotting

### 10.1 Integer Programming and LP relaxation

CS787: Advanced Algorithms Lecture 10: LP Relaxation and Rounding In this lecture we will design approximation algorithms using linear programming. The key insight behind this approach is that the closely

### Transportation Polytopes: a Twenty year Update

Transportation Polytopes: a Twenty year Update Jesús Antonio De Loera University of California, Davis Based on various papers joint with R. Hemmecke, E.Kim, F. Liu, U. Rothblum, F. Santos, S. Onn, R. Yoshida,

### Introduction to Linear Programming.

Chapter 1 Introduction to Linear Programming. This chapter introduces notations, terminologies and formulations of linear programming. Examples will be given to show how real-life problems can be modeled

### Lecture 3: Linear Programming Relaxations and Rounding

Lecture 3: Linear Programming Relaxations and Rounding 1 Approximation Algorithms and Linear Relaxations For the time being, suppose we have a minimization problem. Many times, the problem at hand can

### Fundamentals of Operations Research Prof.G. Srinivasan Department of Management Studies Lecture No. # 03 Indian Institute of Technology, Madras

Fundamentals of Operations Research Prof.G. Srinivasan Department of Management Studies Lecture No. # 03 Indian Institute of Technology, Madras Linear Programming solutions - Graphical and Algebraic Methods

### DATA ANALYSIS II. Matrix Algorithms

DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where

### Stanford University CS261: Optimization Handout 6 Luca Trevisan January 20, In which we introduce the theory of duality in linear programming.

Stanford University CS261: Optimization Handout 6 Luca Trevisan January 20, 2011 Lecture 6 In which we introduce the theory of duality in linear programming 1 The Dual of Linear Program Suppose that we

### 26 Linear Programming

The greatest flood has the soonest ebb; the sorest tempest the most sudden calm; the hottest love the coldest end; and from the deepest desire oftentimes ensues the deadliest hate. Th extremes of glory

### This exposition of linear programming

Linear Programming and the Simplex Method David Gale This exposition of linear programming and the simplex method is intended as a companion piece to the article in this issue on the life and work of George

### 1111: Linear Algebra I

1111: Linear Algebra I Dr. Vladimir Dotsenko (Vlad) Lecture 3 Dr. Vladimir Dotsenko (Vlad) 1111: Linear Algebra I Lecture 3 1 / 12 Vector product and volumes Theorem. For three 3D vectors u, v, and w,

### 3.4. Solving Simultaneous Linear Equations. Introduction. Prerequisites. Learning Outcomes

Solving Simultaneous Linear Equations 3.4 Introduction Equations often arise in which there is more than one unknown quantity. When this is the case there will usually be more than one equation involved.

### The Canonical and Dictionary Forms of Linear Programs

The Canonical and Dictionary Forms of Linear Programs Recall the general optimization problem: Minimize f(x) subect to x D (1) The real valued function f is called the obective function, and D the constraint

### CHAPTER 17. Linear Programming: Simplex Method

CHAPTER 17 Linear Programming: Simplex Method CONTENTS 17.1 AN ALGEBRAIC OVERVIEW OF THE SIMPLEX METHOD Algebraic Properties of the Simplex Method Determining a Basic Solution Basic Feasible Solution 17.2

### Chapter 5. Linear Inequalities and Linear Programming. Linear Programming in Two Dimensions: A Geometric Approach

Chapter 5 Linear Programming in Two Dimensions: A Geometric Approach Linear Inequalities and Linear Programming Section 3 Linear Programming gin Two Dimensions: A Geometric Approach In this section, we

### is redundant. If you satisfy the other four constraints, then you automatically satisfy x 1 0. (In fact, if the first two constraints hold, then x 1 m

Linear Programming Notes II: Graphical Solutions 1 Graphing Linear Inequalities in the Plane You can solve linear programming problems involving just two variables by drawing a picture. The method works

### Linear Programming. Lecture 2: Introduction to Linear Programming 1. 1 Author: James Burke, University of Washington

Linear Programming Lecture 2: Introduction to Linear Programming 1 1 Author: James Burke, University of Washington Math 407: Introduction What is linear programming? Applications of Linear Programing Example:

### Lecture 7 - Linear Programming

COMPSCI 530: Design and Analysis of Algorithms DATE: 09/17/2013 Lecturer: Debmalya Panigrahi Lecture 7 - Linear Programming Scribe: Hieu Bui 1 Overview In this lecture, we cover basics of linear programming,

### Using the Simplex Method to Solve Linear Programming Maximization Problems J. Reeb and S. Leavengood

PERFORMANCE EXCELLENCE IN THE WOOD PRODUCTS INDUSTRY EM 8720-E October 1998 \$3.00 Using the Simplex Method to Solve Linear Programming Maximization Problems J. Reeb and S. Leavengood A key problem faced

### 2.3 Convex Constrained Optimization Problems

42 CHAPTER 2. FUNDAMENTAL CONCEPTS IN CONVEX OPTIMIZATION Theorem 15 Let f : R n R and h : R R. Consider g(x) = h(f(x)) for all x R n. The function g is convex if either of the following two conditions

### Min-cost flow problems and network simplex algorithm

Min-cost flow problems and network simplex algorithm The particular structure of some LP problems can be sometimes used for the design of solution techniques more efficient than the simplex algorithm.

### Basic solutions in standard form polyhedra

Recap, and outline of Lecture Previously min s.t. c x Ax = b x Converting any LP into standard form () Interpretation and visualization () Full row rank assumption on A () Basic solutions and bases in

### Converting a Linear Program to Standard Form

Converting a Linear Program to Standard Form Hi, welcome to a tutorial on converting an LP to Standard Form. We hope that you enjoy it and find it useful. Amit, an MIT Beaver Mita, an MIT Beaver 2 Linear

### Simplex Method. Introduction:

Introduction: In the previous chapter, we discussed about the graphical method for solving linear programming problems. Although the graphical method is an invaluable aid to understand the properties of

### Sensitivity Analysis 3.1 AN EXAMPLE FOR ANALYSIS

Sensitivity Analysis 3 We have already been introduced to sensitivity analysis in Chapter via the geometry of a simple example. We saw that the values of the decision variables and those of the slack and

### value is determined is called constraints. It can be either a linear equation or inequality.

Contents 1. Index 2. Introduction 3. Syntax 4. Explanation of Simplex Algorithm Index Objective function the function to be maximized or minimized is called objective function. E.g. max z = 2x + 3y Constraints

### Mathematics Notes for Class 12 chapter 12. Linear Programming

1 P a g e Mathematics Notes for Class 12 chapter 12. Linear Programming Linear Programming It is an important optimization (maximization or minimization) technique used in decision making is business and

### Module1. x 1000. y 800.

Module1 1 Welcome to the first module of the course. It is indeed an exciting event to share with you the subject that has lot to offer both from theoretical side and practical aspects. To begin with,

### Lecture 1: Linear Programming Models. Readings: Chapter 1; Chapter 2, Sections 1&2

Lecture 1: Linear Programming Models Readings: Chapter 1; Chapter 2, Sections 1&2 1 Optimization Problems Managers, planners, scientists, etc., are repeatedly faced with complex and dynamic systems which

### Linear Programming with Post-Optimality Analyses

Linear Programming with Post-Optimality Analyses Wilson Problem: Wilson Manufacturing produces both baseballs and softballs, which it wholesales to vendors around the country. Its facilities permit the

### Linear Programming: Introduction

Linear Programming: Introduction Frédéric Giroire F. Giroire LP - Introduction 1/28 Course Schedule Session 1: Introduction to optimization. Modelling and Solving simple problems. Modelling combinatorial

### Reduced echelon form: Add the following conditions to conditions 1, 2, and 3 above:

Section 1.2: Row Reduction and Echelon Forms Echelon form (or row echelon form): 1. All nonzero rows are above any rows of all zeros. 2. Each leading entry (i.e. left most nonzero entry) of a row is in

### 3.5 Reduction to Standard Form

3.5 Reduction to Standard Form 77 Exercise 3-4-4. Read the following statements carefully to see whether it is true or false. Justify your answer by constructing a simple illustrative example (for false),

### Mathematical finance and linear programming (optimization)

Mathematical finance and linear programming (optimization) Geir Dahl September 15, 2009 1 Introduction The purpose of this short note is to explain how linear programming (LP) (=linear optimization) may

### SUPPLEMENT TO CHAPTER

SUPPLEMENT TO CHAPTER 6 Linear Programming SUPPLEMENT OUTLINE Introduction and Linear Programming Model, 2 Graphical Solution Method, 5 Computer Solutions, 14 Sensitivity Analysis, 17 Key Terms, 22 Solved

### Approximation Algorithms: LP Relaxation, Rounding, and Randomized Rounding Techniques. My T. Thai

Approximation Algorithms: LP Relaxation, Rounding, and Randomized Rounding Techniques My T. Thai 1 Overview An overview of LP relaxation and rounding method is as follows: 1. Formulate an optimization