An asynchronous Oneshot method with Load Balancing
|
|
- Aron Christian Chandler
- 8 years ago
- Views:
Transcription
1 An asynchronous Oneshot method with Load Balancing Torsten Bosse Argonne National Laboratory, IL
2 . 2 of 24 Design Optimization Problem min f(u,y) subject to c(u,y) = 0, (u,y) R m+n for sufficiently smooth functions f : R m n R and c : R m n R n Assumption a slowly convergent fixed-point solver G : R m n R n for c: y k+1 = G(u,y k ) [c(u,y) = 0 y = G(u,y)] with a global contraction rate G y (u,y) ρ < 1, e.g. ρ Lagrange function with adjoint variable ȳ R n L(u,y,ȳ) f(u,y) + ȳ [G(u,y) y] Find (u,y,ȳ ) satisfying first order necessary / KKT conditions 0 = Lȳ (u,y,ȳ ) G(u,y ) y (primal) 0 = L y (u,y,ȳ ) f y (u,y ) + [G y (u,y) I] ȳ (adjoint) 0 = L u (u,y,ȳ ) f u (u,y ) + G u (u,y )ȳ (design)
3 . 3 of 24 Fixed-Point Solver for the State Equation Assume Optimal control u and y is known. Goal Find state y satisfying c(u,y ) = 0. Solution Use slowly convergent state fixed-point solver G : U Y Y, i.e., start with an initial approximation y 0 Y and iterate Notation y k+1 = G(u,y k ) for k = 0,1,2,... such that y = lim k y k solves y = G(u,y ) c(u,y ) = 0 due to global contraction rate G y (u,y) ρ < 1 and Banach FPT. (state) (state) (state)... Interpretation Fixed-point iteration is some solver for a PDE/numerical model that describes a physical process represented by the equality c(u, y) = 0
4 . 4 of 24 Fixed-Point Solver for the State + Adjoint Equation Assume Optimal control u is known. Goal Find state y satisfying c(u,y ) = 0 and adjoint solution ȳ with 0 = f y (u,y ) + [G y (u,y ) I] ȳ BUT only allowed to use Jacobi-vector, vector-jacobi products - evaluation/inversion/factorization of G y might be to costly! Idea For an initial approximation ȳ 0 and given y the adjoint iteration ȳ k+1 = f y (u,y) + G y (u,y)ȳ k is also a fixed point iteration due to G y (u,y) ρ < 1. Updating scheme according to Christianson (state) (state) (adjoint) (adjoint)... (B.C.)
5 . 5 of 24 Fixed-Point Solver for the State + Adjoint Equation (Griewank) Problem The B.C. updating is sequential, i.e., converge primal iteration y k+1 = G(u,y k ) for k = 0,1,2,... to a solution y = G(u,y ) (or an approximation) before iterating ȳ k+1 = f y (u,y ) + G y (u,y )ȳ k for k = 0,1,2,... from initial ȳ 0 until ȳ = lim k ȳ k with L y (u,y,ȳ ) = 0. Alternative approach (Griewank): Update (y k,ȳ k ) in parallel, i.e., y k+1 = G(u },y k ) ȳ k+1 = f y (u,y k ) + G y (u,y k )ȳ k for k = 0,1,2,... or, in short, use the Piggyback method (state,adjoint) (state,adjoint)... (A.G.)
6 ??? 6 of 24 Observations Observation I Changes of y k+1 = G(u,y k ) in primal update cause a lag-effect of the adjoint iteration ȳ k+1 = f y (u,y k ) + G y (u,y k )ȳ k, i.e., L y (u,y k,ȳ k ) might grow while y k is not sufficiently converged. Observation II Multiple primal for/before an adjoint update reduce the lag effect Observation III Primal precision/number of forward iterations unkown for B.C. Question What are the consequences and can we do better? B.C. Residual Pure Pure/B.C. A.G.??? Adjoint (B.C.) Adjoint (A.G.) Time Motivation primal and adjoint updates have usually different execution times
7 7 of 24 Blurred Piggyback - Best of both worlds Idea I Run primal and adjoints in an asynchronous parallel fashion, i.e., (state) (state) (state) (state) (state)... (adjoint) (adjoint) (adjoint) (adjoint) (adjoint)... Idea II Always use the latest available information y for the adjoint update. Quasi-Code 1: Input: u = u, y = t y, ȳ = tȳ ; t y shared 2: while (y, ȳ) not converged do 3: Process 0: 4: Compute state t y = G(t u,y) 5: Update state y = t y 6: Process 1: 7: Compute adjoint tȳ = f y (t u,t y ) + ȳ G y (t u,t y ) 8: Update adjoint ȳ = tȳ 9: end while 10: Output: y, ȳ Convergence Based on G y (u,y) ρ < 1 and smoothness of f, G
8 . 8 of 24 Numerical results for Laplace problem Objective Tracking type functional f(u,y) = 1 2 y y d 2 + µ 2 u 2, y d triangle Constraint Laplace y = u, y Ω = 0 over Ω = [0,1] Slow Contraction Jacobi-iteration y k+1 = D 1 (u Ry k ) for A = D + R, D diagonal Measurements of the runtime seem to be inconsistent with the convergence history Residual e-05 1e-06 1e-07 1e-08 1e-09 B.C. A.G. B.P. PURE Residual Pure Adjoint (B.C.) Adjoint (B.P.) Adjoint (A.G.) Iteration Time PURE A.G. B.C. B.P e e e e-02
9 . 8 of 24 Numerical results for Laplace problem Objective Tracking type functional f(u,y) = 1 2 y y d 2 + µ 2 u 2, y d triangle Constraint Laplace y = u, y Ω = 0 over Ω = [0,1] Slow Contraction Jacobi-iteration y k+1 = D 1 (u Ry k ) for A = D + R, D diagonal Measurements of the runtime seem to be inconsistent with the convergence history Residual e-05 1e-06 1e-07 1e-08 1e-09 B.C. A.G. B.P. PURE Residual Pure Adjoint (B.C.) Adjoint (B.P.) Adjoint (A.G.) Iteration Time PURE A.G. B.C. B.P e e e e-02 G G, f y + Gy ȳ, sync G or f y + Gy ȳ λ 1 [G] and λ 2 [f y + Gy ȳ]
10 Load Balancing Assumption I The functions f, G and their derivatives can be implemented as parallel programs and only scale up to a certain degree Assumption II Finite amount of computational resources available λ R + Idea Use load balancing λ = λ 1 + λ 2 and find a speed up of overall process by optimal distribution (λ 1,λ 2 ) of the primal/adjoint updates on available resources Goal Minimize computational time T (λ 1,λ 2 ) required to find (y,ȳ ) Example of a static load balancing for three different tuple (λ 1,λ 2 ) Adjoint (B.P.) Residual Pure Residual Pure Residual Pure Adjoint (B.P.) Adjoint (B.P.) Time Time Time. 9 of 24
11 . 10 of 24 Dynamic Load Balancing Automatic setup based on information about f, G and their derivatives, residual, scalability, extra cost for data transfer, communication, experience,... develop self adjusting method that efficiently distributes the computational resources during the course of optimization Example Consider the following dynamic load balancing Phase I: Mainly reduce primal error (B.C. style) Phase II: Reduce primal error and adjoint error (A.G./B.P. style) Phase III: Mainly reduce adjoint error (B.C. style) Adjoint (B.P.) Adjoint (B.P.) Adjoint (B.P.) Residual Pure Residual Pure Residual Pure Phase I Phase II Phase III
12 11 of 24 (Summary I) State and Adjoint equation can be solved by three different fixed-point approaches: Christianson (state) (state) (adjoint) (adjoint)... (B.C.) Griewank (state,adjoint) (state,adjoint)... (A.G.) Blurred (state) (state) (state) (state) (state)... (adjoint) (adjoint) (adjoint) (adjoint)... (B.P.) (New) Blurred Piggyback method (asynchronous + blurred state information for the adjoint) seems to be favorable (at least for this example, this setting,...) A.G. and B.C. can be recovered as a special case of B.P. by load balancing. (Dynamic) load balancing to reduce execution time - that s the important thing!!!
13 12 of 24 Oneshot methods Goal Solve optimization problem min (u,y) R m+n f(u,y) s.t. y = G(u,y). Updates u + = u αb 1 L u (u,y,ȳ), y + = G(u,y),and ȳ + = ȳ + L y (u,y,ȳ) Sequencing Combine the three update steps into an optimization method. Choose order of state, adjoint and design updates, their multiplicity s, parameters B and α to ensure (optimal) contraction of the combined method towards stationary points. Scenarios (design,state,adjoint) (design,state,adjoint)... (Jacobi) (design) (state) (adjoint) (design)... (Seidel) (design) (state,adjoint) (design)... (Mixed) (design) (state) s (adjoint) s (design)... (Multi-Step)
14 . 13 of 24 Most wanted Oneshot methods Jacobi method by Griewank/Gauger/Slawig/Kaland... (design,state,adjoint) (design,state,adjoint)... with doubly augmented Lagrangian preconditioner B L uu + αg u G u + βl uy L yu Seidel (multi-step) by B/Lehmann/Griewank (design) (state) s (adjoint) s (design)... with projected Lagrangian preconditioner (or modifications) B [ ][ ] I Z ][ L uu L uy I,Z = (I G y ) 1 G u. L yu L yy Z Generalization Both/(almost) a all considered one-shot methods are a special case of the following general one-shot method and can be derived by a suitable load balancing schemes a to the best of my knowledge one can even skip almost
15 . 13 of 24 Algorithm 1 General Oneshot Method 1: Input: u, y, ȳ, α, B 2: while (u, y, ȳ) not converged do 3: Process 0: 4: Monitor processes, determine allocation of resources 5: Process 1: 6: Update α and B 7: Compute design t u = u αb 1 L u (u,y,ȳ) 8: Process 2: 9: Compute state t y = G(u,y) 10: Process 3: 11: Compute adjoint tȳ = L y (u,y,ȳ) + ȳ 12: Process 4: 13: Update design u = t u 14: Process 5: 15: Update state y = t y 16: Process 6: 17: Update adjoint ȳ = tȳ 18: end while 19: Output: u, y, ȳ, α, B
16 14 of 24 Load balancing Resources need to be distributed for processes. Jacobi method and corresponding load balancing (design,state,adjoint) (design,state,adjoint)... STATE ADJOINT DESIGN WORK RUN-TIME RUN-TIME M.Seidel method and corresponding load balancing (design) (state) s (adjoint) s (design)... STATE ADJOINT DESIGN WORK RUN-TIME RUN-TIME Problem Both methods (Jacobi, Multi-Seidel) are not optimal: idle vs. cross-communication
17 Blurred Oneshot method Idea Run all three processes (design,state,adjoint) in parallel but in an asynchronous fashion and allow blurred updates analogous to the blurred piggyback approach. STATE ADJOINT DESIGN WORK RUN-TIME RUN-TIME WARNING We have a coupling: u depends on y,ȳ and vice versa. Solution Use dynamic load balancing to enforce convergence Load balancing should be mostly stable for efficiency reasons but may still vary. Intuition In the worst case, one can slow down the control updates by reducing the computational resources for this process and crawl along/to the manifold primal and adjoint feasible Manifold M.. 15 of 24
18 16 of 24 Blurred Oneshot Algorithm 1: Input: u = t u, y = t y, ȳ = tȳ, α, B, (t u,t y,tȳ shared ) 2: while (u, y, ȳ) not converged do 3: Process 0: 4: Monitor processes, determine allocation of resources 5: Process 1: 6: Update α and B 7: Compute design t u = u αb 1 L u (u,t y,tȳ ) 8: Update design u = t u 9: Process 2: 10: Compute state t y = G(t u,y) 11: Update state y = t y 12: Process 3: 13: Compute adjoint tȳ = f y (t u,t y ) + ȳ G y (t u,t y ) 14: Update adjoint ȳ = tȳ 15: end while 16: Output: u, y, ȳ, α, B
19 Numerical results for Laplace design optimization problem Setup Blurred Oneshot with L-BFGS approximation of projected Hessian, no load balancing (not yet), α by quasi-backtrack Residuals of an typical optimization evaluation 1 Control State Adjoint Residual 1e-05 1e-10 1e Iteration. 17 of 24
20 . 18 of 24 Time dependent problems - Gauger/Günther/Wang/(Griewank) Problem 1 T min f(u, y(τ))dτ such that u,y T 0 y(τ) + c(y(τ),u) = 0 τ [0,T ], y(0) = y τ 0 State y : [0,T ] Y is a function that varies over a time interval [0,T ] R Time discr. 0 = τ 0 < τ 1 < < τ N = T and approx. y y i = y(τ i ) R n Assume I time integration of the constraint is a one-step method a and state y i at time t i is implicitly given by state y i 1 at previous time t i 1, i.e., R(u,y i,y i 1 ) = 0, i = 1,...,N Assume II that there exists a contractive fixed-point solver y k+1 i = G(u,yi k,y i 1 ) : U Y Y to compute solutions lim k yi k of the previous integration scheme R with contraction rate G yi (u,y i,y i 1 ) ρ G < 1. a e.g. implicit Euler - although higher order methods are also possible
21 . 19 of 24 Extended Fixed-Point iteration Extended Mapping G : U Y Y with Y = Y N = Y Y defined by G 1 (u,y) G(u,y 1,y 0 ) G 2 (u,y) G(u,y G(u,y) =. = 2,G(u,y 1,y 0 )). G N (u,y) G(u,y N,G(u,y N 1,G( G(u,y 1,y 0 )) ))) Contraction is inherited by the extended mapping G, i.e. Extended Problem can be formulated G y (u,y) ρ G = ρ G < 1. min f(u,y) such that y = G(u,y) with y 0 = y(0) u,y where the objective objective functional is approximated by N f(u,y) = i f N (u,y i ) i=1 t 1 T T 0 f(u,y(t))
22 Comments Interpretation Extended fixed-point mapping can be understood as parallel update on the discrete state approximation for each time-step STATE TIME Lag-Effect and different execution times of G PROCESS RUN-TIME Blurred updates with Load Balancing for different time-steps strongly recommended!. 20 of 24
23 . 21 of 24 Blurred Oneshot Method for time-dependent Problems 1: Input: u = t u, y = (t y1,...,t yn ), ȳ i = tȳi, α, B 2: while (u,y 1,...,y N,ȳ 1,...,ȳ N ) not converged do 3: Process 0: Monitor processes, determine allocation of resources 4: Process 1: 5: Update α and B 6: Compute design t u = u αb 1 L u (u,t y1,...,t yn,tȳ1,...,tȳn ) 7: Update design u = t u 8: Process 2: 9: Compute state t y1 = G(t u,y 1,y 0 ) 10: Update state y 1 = t y1 11: Process 3: 12: Compute state t y2 = G(t u,y 2,t y1 ) 13: Update state y 2 = t y2 14:... 15: Process N+1: 16: Compute state t yn = G(t u,y N,t yn 1 ) 17: Update state y N = t yn 18: 19: Process N+2: 20: Compute adjoint tȳ1 = f y (t u,t y1 ) + G y (t u,t y1,...,t yn ) ȳ 1 21: Update adjoint ȳ 1 = tȳ1 22:... 23: Process 2N+1: 24: Compute adjoint tȳn = f y (t u,t yn ) + G y (t u,t y1,...,t yn ) ȳ N 25: Update adjoint ȳ N = tȳn 26: end while
24 Observation Load balance I for the extended primal iteration, e.g. Dynamic Allocation of Computational Resources Allocated Resource Process Load balance II similar for extended adjoint iteration Load balance III between primal and adjoint updates still possible Load balance IV between (primal,adjoint) and design also possible GOAL Allocating the resources to all 2N+2 processes needs to be harmonized like an orchestra to achieve maximal efficiency.. 22 of 24
25 . 23 of 24 Summary Blurred Piggyback/Oneshot using asynchronous and inconsistent updates General Piggyback/Oneshot method for design optimization Extension to Time dependent problems can be improved by (Optimal) Load Balancing for use in HPC, convergence, efficiency Outlook - TODO It s still a loooooong way to go... Thank you for your attention!
26 24 of 24 Challenge Shared memory in MPI 3.0 could be a great challenge for AD in the future. Any suggestions? (Except of saying: Don t use it!)
Iterative Solvers for Linear Systems
9th SimLab Course on Parallel Numerical Simulation, 4.10 8.10.2010 Iterative Solvers for Linear Systems Bernhard Gatzhammer Chair of Scientific Computing in Computer Science Technische Universität München
More informationNonlinear Optimization: Algorithms 3: Interior-point methods
Nonlinear Optimization: Algorithms 3: Interior-point methods INSEAD, Spring 2006 Jean-Philippe Vert Ecole des Mines de Paris Jean-Philippe.Vert@mines.org Nonlinear optimization c 2006 Jean-Philippe Vert,
More informationGeneral Framework for an Iterative Solution of Ax b. Jacobi s Method
2.6 Iterative Solutions of Linear Systems 143 2.6 Iterative Solutions of Linear Systems Consistent linear systems in real life are solved in one of two ways: by direct calculation (using a matrix factorization,
More informationNonlinear Algebraic Equations. Lectures INF2320 p. 1/88
Nonlinear Algebraic Equations Lectures INF2320 p. 1/88 Lectures INF2320 p. 2/88 Nonlinear algebraic equations When solving the system u (t) = g(u), u(0) = u 0, (1) with an implicit Euler scheme we have
More informationBilevel Models of Transmission Line and Generating Unit Maintenance Scheduling
Bilevel Models of Transmission Line and Generating Unit Maintenance Scheduling Hrvoje Pandžić July 3, 2012 Contents 1. Introduction 2. Transmission Line Maintenance Scheduling 3. Generating Unit Maintenance
More information10. Proximal point method
L. Vandenberghe EE236C Spring 2013-14) 10. Proximal point method proximal point method augmented Lagrangian method Moreau-Yosida smoothing 10-1 Proximal point method a conceptual algorithm for minimizing
More information(Quasi-)Newton methods
(Quasi-)Newton methods 1 Introduction 1.1 Newton method Newton method is a method to find the zeros of a differentiable non-linear function g, x such that g(x) = 0, where g : R n R n. Given a starting
More informationMathematical finance and linear programming (optimization)
Mathematical finance and linear programming (optimization) Geir Dahl September 15, 2009 1 Introduction The purpose of this short note is to explain how linear programming (LP) (=linear optimization) may
More informationReal Time Scheduling Basic Concepts. Radek Pelánek
Real Time Scheduling Basic Concepts Radek Pelánek Basic Elements Model of RT System abstraction focus only on timing constraints idealization (e.g., zero switching time) Basic Elements Basic Notions task
More informationOptimization of Supply Chain Networks
Optimization of Supply Chain Networks M. Herty TU Kaiserslautern September 2006 (2006) 1 / 41 Contents 1 Supply Chain Modeling 2 Networks 3 Optimization Continuous optimal control problem Discrete optimal
More informationLecture 2. Marginal Functions, Average Functions, Elasticity, the Marginal Principle, and Constrained Optimization
Lecture 2. Marginal Functions, Average Functions, Elasticity, the Marginal Principle, and Constrained Optimization 2.1. Introduction Suppose that an economic relationship can be described by a real-valued
More informationEfficient and Robust Allocation Algorithms in Clouds under Memory Constraints
Efficient and Robust Allocation Algorithms in Clouds under Memory Constraints Olivier Beaumont,, Paul Renaud-Goud Inria & University of Bordeaux Bordeaux, France 9th Scheduling for Large Scale Systems
More informationDiscrete mechanics, optimal control and formation flying spacecraft
Discrete mechanics, optimal control and formation flying spacecraft Oliver Junge Center for Mathematics Munich University of Technology joint work with Jerrold E. Marsden and Sina Ober-Blöbaum partially
More informationSolutions of Equations in One Variable. Fixed-Point Iteration II
Solutions of Equations in One Variable Fixed-Point Iteration II Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011
More informationDie Multipol Randelementmethode in industriellen Anwendungen
Fast Boundary Element Methods in Industrial Applications Söllerhaus, 15. 18. Oktober 2003 Die Multipol Randelementmethode in industriellen Anwendungen G. Of, O. Steinbach, W. L. Wendland Institut für Angewandte
More informationDesign and Optimization of OpenFOAM-based CFD Applications for Hybrid and Heterogeneous HPC Platforms
Design and Optimization of OpenFOAM-based CFD Applications for Hybrid and Heterogeneous HPC Platforms Amani AlOnazi, David E. Keyes, Alexey Lastovetsky, Vladimir Rychkov Extreme Computing Research Center,
More informationDuality in General Programs. Ryan Tibshirani Convex Optimization 10-725/36-725
Duality in General Programs Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: duality in linear programs Given c R n, A R m n, b R m, G R r n, h R r : min x R n c T x max u R m, v R r b T
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Martin Lauer AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg martin.lauer@kit.edu
More informationNumerical Analysis An Introduction
Walter Gautschi Numerical Analysis An Introduction 1997 Birkhauser Boston Basel Berlin CONTENTS PREFACE xi CHAPTER 0. PROLOGUE 1 0.1. Overview 1 0.2. Numerical analysis software 3 0.3. Textbooks and monographs
More informationFinite Difference Approach to Option Pricing
Finite Difference Approach to Option Pricing February 998 CS5 Lab Note. Ordinary differential equation An ordinary differential equation, or ODE, is an equation of the form du = fut ( (), t) (.) dt where
More informationNumerical Verification of Optimality Conditions in Optimal Control Problems
Numerical Verification of Optimality Conditions in Optimal Control Problems Dissertation zur Erlangung des naturwissenschaftlichen Doktorgrades der Julius-Maximilians-Universität Würzburg vorgelegt von
More informationCHAPTER 3 SECURITY CONSTRAINED OPTIMAL SHORT-TERM HYDROTHERMAL SCHEDULING
60 CHAPTER 3 SECURITY CONSTRAINED OPTIMAL SHORT-TERM HYDROTHERMAL SCHEDULING 3.1 INTRODUCTION Optimal short-term hydrothermal scheduling of power systems aims at determining optimal hydro and thermal generations
More informationLecture 11. 3.3.2 Cost functional
Lecture 11 3.3.2 Cost functional Consider functions L(t, x, u) and K(t, x). Here L : R R n R m R, K : R R n R sufficiently regular. (To be consistent with calculus of variations we would have to take L(t,
More informationParallel Computing for Option Pricing Based on the Backward Stochastic Differential Equation
Parallel Computing for Option Pricing Based on the Backward Stochastic Differential Equation Ying Peng, Bin Gong, Hui Liu, and Yanxin Zhang School of Computer Science and Technology, Shandong University,
More informationNumerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems
Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001,
More informationLecture 10. Finite difference and finite element methods. Option pricing Sensitivity analysis Numerical examples
Finite difference and finite element methods Lecture 10 Sensitivities and Greeks Key task in financial engineering: fast and accurate calculation of sensitivities of market models with respect to model
More informationYousef Saad University of Minnesota Computer Science and Engineering. CRM Montreal - April 30, 2008
A tutorial on: Iterative methods for Sparse Matrix Problems Yousef Saad University of Minnesota Computer Science and Engineering CRM Montreal - April 30, 2008 Outline Part 1 Sparse matrices and sparsity
More informationIntroduction to Algebraic Geometry. Bézout s Theorem and Inflection Points
Introduction to Algebraic Geometry Bézout s Theorem and Inflection Points 1. The resultant. Let K be a field. Then the polynomial ring K[x] is a unique factorisation domain (UFD). Another example of a
More informationSIXTY STUDY QUESTIONS TO THE COURSE NUMERISK BEHANDLING AV DIFFERENTIALEKVATIONER I
Lennart Edsberg, Nada, KTH Autumn 2008 SIXTY STUDY QUESTIONS TO THE COURSE NUMERISK BEHANDLING AV DIFFERENTIALEKVATIONER I Parameter values and functions occurring in the questions belowwill be exchanged
More informationModel order reduction via Proper Orthogonal Decomposition
Model order reduction via Proper Orthogonal Decomposition Reduced Basis Summer School 2015 Martin Gubisch University of Konstanz September 17, 2015 Martin Gubisch (University of Konstanz) Model order reduction
More informationAN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS
AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS Revised Edition James Epperson Mathematical Reviews BICENTENNIAL 0, 1 8 0 7 z ewiley wu 2007 r71 BICENTENNIAL WILEY-INTERSCIENCE A John Wiley & Sons, Inc.,
More informationSix Strategies for Building High Performance SOA Applications
Six Strategies for Building High Performance SOA Applications Uwe Breitenbücher, Oliver Kopp, Frank Leymann, Michael Reiter, Dieter Roller, and Tobias Unger University of Stuttgart, Institute of Architecture
More informationIMPROVED NETWORK PARAMETER ERROR IDENTIFICATION USING MULTIPLE MEASUREMENT SCANS
IMPROVED NETWORK PARAMETER ERROR IDENTIFICATION USING MULTIPLE MEASUREMENT SCANS Liuxi Zhang and Ali Abur Department of Electrical and Computer Engineering Northeastern University Boston, MA, USA lzhang@ece.neu.edu
More informationIRS: Implicit Radiation Solver Version 1.0 Benchmark Runs
IRS: Implicit Radiation Solver Version 1.0 Benchmark Runs This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.
More informationBranch-and-Price Approach to the Vehicle Routing Problem with Time Windows
TECHNISCHE UNIVERSITEIT EINDHOVEN Branch-and-Price Approach to the Vehicle Routing Problem with Time Windows Lloyd A. Fasting May 2014 Supervisors: dr. M. Firat dr.ir. M.A.A. Boon J. van Twist MSc. Contents
More informationDuality of linear conic problems
Duality of linear conic problems Alexander Shapiro and Arkadi Nemirovski Abstract It is well known that the optimal values of a linear programming problem and its dual are equal to each other if at least
More informationDistributed Machine Learning and Big Data
Distributed Machine Learning and Big Data Sourangshu Bhattacharya Dept. of Computer Science and Engineering, IIT Kharagpur. http://cse.iitkgp.ac.in/~sourangshu/ August 21, 2015 Sourangshu Bhattacharya
More informationParameter Estimation for Bingham Models
Dr. Volker Schulz, Dmitriy Logashenko Parameter Estimation for Bingham Models supported by BMBF Parameter Estimation for Bingham Models Industrial application of ceramic pastes Material laws for Bingham
More informationA HYBRID GENETIC ALGORITHM FOR THE MAXIMUM LIKELIHOOD ESTIMATION OF MODELS WITH MULTIPLE EQUILIBRIA: A FIRST REPORT
New Mathematics and Natural Computation Vol. 1, No. 2 (2005) 295 303 c World Scientific Publishing Company A HYBRID GENETIC ALGORITHM FOR THE MAXIMUM LIKELIHOOD ESTIMATION OF MODELS WITH MULTIPLE EQUILIBRIA:
More informationDesigning Efficient Software for Solving Delay Differential Equations. C.A.H. Paul. Numerical Analysis Report No. 368. Oct 2000
ISSN 1360-1725 UMIST Designing Efficient Software for Solving Delay Differential Equations C.A.H. Paul Numerical Analysis Report No. 368 Oct 2000 Manchester Centre for Computational Mathematics Numerical
More informationCooling and Euler's Method
Lesson 2: Cooling and Euler's Method 2.1 Applied Problem. Heat transfer in a mass is very important for a number of objects such as cooling of electronic parts or the fabrication of large beams. Although
More informationCHAPTER 7 APPLICATIONS TO MARKETING. Chapter 7 p. 1/54
CHAPTER 7 APPLICATIONS TO MARKETING Chapter 7 p. 1/54 APPLICATIONS TO MARKETING State Equation: Rate of sales expressed in terms of advertising, which is a control variable Objective: Profit maximization
More informationCITY AND REGIONAL PLANNING 7230. Consumer Behavior. Philip A. Viton. March 4, 2015. 1 Introduction 2
CITY AND REGIONAL PLANNING 7230 Consumer Behavior Philip A. Viton March 4, 2015 Contents 1 Introduction 2 2 Foundations 2 2.1 Consumption bundles........................ 2 2.2 Preference relations.........................
More informationFeedback guided load balancing in a distributed memory environment
Feedback guided load balancing in a distributed memory environment Constantinos Christofi August 18, 2011 MSc in High Performance Computing The University of Edinburgh Year of Presentation: 2011 Abstract
More informationHPC Deployment of OpenFOAM in an Industrial Setting
HPC Deployment of OpenFOAM in an Industrial Setting Hrvoje Jasak h.jasak@wikki.co.uk Wikki Ltd, United Kingdom PRACE Seminar: Industrial Usage of HPC Stockholm, Sweden, 28-29 March 2011 HPC Deployment
More information10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method
578 CHAPTER 1 NUMERICAL METHODS 1. ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS As a numerical technique, Gaussian elimination is rather unusual because it is direct. That is, a solution is obtained after
More informationOpenFOAM Optimization Tools
OpenFOAM Optimization Tools Henrik Rusche and Aleks Jemcov h.rusche@wikki-gmbh.de and a.jemcov@wikki.co.uk Wikki, Germany and United Kingdom OpenFOAM Optimization Tools p. 1 Agenda Objective Review optimisation
More informationSolving NP Hard problems in practice lessons from Computer Vision and Computational Biology
Solving NP Hard problems in practice lessons from Computer Vision and Computational Biology Yair Weiss School of Computer Science and Engineering The Hebrew University of Jerusalem www.cs.huji.ac.il/ yweiss
More informationHPC enabling of OpenFOAM R for CFD applications
HPC enabling of OpenFOAM R for CFD applications Towards the exascale: OpenFOAM perspective Ivan Spisso 25-27 March 2015, Casalecchio di Reno, BOLOGNA. SuperComputing Applications and Innovation Department,
More informationThe QOOL Algorithm for fast Online Optimization of Multiple Degree of Freedom Robot Locomotion
The QOOL Algorithm for fast Online Optimization of Multiple Degree of Freedom Robot Locomotion Daniel Marbach January 31th, 2005 Swiss Federal Institute of Technology at Lausanne Daniel.Marbach@epfl.ch
More informationLecture 16 - Free Surface Flows. Applied Computational Fluid Dynamics
Lecture 16 - Free Surface Flows Applied Computational Fluid Dynamics Instructor: André Bakker http://www.bakker.org André Bakker (2002-2006) Fluent Inc. (2002) 1 Example: spinning bowl Example: flow in
More information8. Linear least-squares
8. Linear least-squares EE13 (Fall 211-12) definition examples and applications solution of a least-squares problem, normal equations 8-1 Definition overdetermined linear equations if b range(a), cannot
More informationOptimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani. EPEW 2014, Florence
Optimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani EPEW 2014, Florence Scenario How many cloud instances should be hired? Requests Host hiring servers The number of active servers is controlled
More informationR u t c o r Research R e p o r t. A Method to Schedule Both Transportation and Production at the Same Time in a Special FMS.
R u t c o r Research R e p o r t A Method to Schedule Both Transportation and Production at the Same Time in a Special FMS Navid Hashemian a Béla Vizvári b RRR 3-2011, February 21, 2011 RUTCOR Rutgers
More informationNumerical Methods For Image Restoration
Numerical Methods For Image Restoration CIRAM Alessandro Lanza University of Bologna, Italy Faculty of Engineering CIRAM Outline 1. Image Restoration as an inverse problem 2. Image degradation models:
More informationEconometrics Simple Linear Regression
Econometrics Simple Linear Regression Burcu Eke UC3M Linear equations with one variable Recall what a linear equation is: y = b 0 + b 1 x is a linear equation with one variable, or equivalently, a straight
More informationNumerical methods for American options
Lecture 9 Numerical methods for American options Lecture Notes by Andrzej Palczewski Computational Finance p. 1 American options The holder of an American option has the right to exercise it at any moment
More informationLinear Programming. Widget Factory Example. Linear Programming: Standard Form. Widget Factory Example: Continued.
Linear Programming Widget Factory Example Learning Goals. Introduce Linear Programming Problems. Widget Example, Graphical Solution. Basic Theory:, Vertices, Existence of Solutions. Equivalent formulations.
More informationAn Overview Of Software For Convex Optimization. Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.
An Overview Of Software For Convex Optimization Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.edu In fact, the great watershed in optimization isn t between linearity
More informationSimulation of Fluid-Structure Interactions in Aeronautical Applications
Simulation of Fluid-Structure Interactions in Aeronautical Applications Martin Kuntz Jorge Carregal Ferreira ANSYS Germany D-83624 Otterfing Martin.Kuntz@ansys.com December 2003 3 rd FENET Annual Industry
More informationSolving ODEs in Matlab. BP205 M.Tremont 1.30.2009
Solving ODEs in Matlab BP205 M.Tremont 1.30.2009 - Outline - I. Defining an ODE function in an M-file II. III. IV. Solving first-order ODEs Solving systems of first-order ODEs Solving higher order ODEs
More informationEnvelope Theorem. Kevin Wainwright. Mar 22, 2004
Envelope Theorem Kevin Wainwright Mar 22, 2004 1 Maximum Value Functions A maximum (or minimum) value function is an objective function where the choice variables have been assigned their optimal values.
More informationSavvyDox Publishing Augmenting SharePoint and Office 365 Document Content Management Systems
SavvyDox Publishing Augmenting SharePoint and Office 365 Document Content Management Systems Executive Summary This white paper examines the challenges of obtaining timely review feedback and managing
More informationIntegrating Benders decomposition within Constraint Programming
Integrating Benders decomposition within Constraint Programming Hadrien Cambazard, Narendra Jussien email: {hcambaza,jussien}@emn.fr École des Mines de Nantes, LINA CNRS FRE 2729 4 rue Alfred Kastler BP
More informationSpatial Decomposition/Coordination Methods for Stochastic Optimal Control Problems. Practical aspects and theoretical questions
Spatial Decomposition/Coordination Methods for Stochastic Optimal Control Problems Practical aspects and theoretical questions P. Carpentier, J-Ph. Chancelier, M. De Lara, V. Leclère École des Ponts ParisTech
More informationA Simultaneous Solution for General Linear Equations on a Ring or Hierarchical Cluster
Acta Technica Jaurinensis Vol. 3. No. 1. 010 A Simultaneous Solution for General Linear Equations on a Ring or Hierarchical Cluster G. Molnárka, N. Varjasi Széchenyi István University Győr, Hungary, H-906
More informationComputational Optical Imaging - Optique Numerique. -- Deconvolution --
Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method
More informationDecentralized control of stochastic multi-agent service system. J. George Shanthikumar Purdue University
Decentralized control of stochastic multi-agent service system J. George Shanthikumar Purdue University Joint work with Huaning Cai, Peng Li and Andrew Lim 1 Many problems can be thought of as stochastic
More informationAirport Planning and Design. Excel Solver
Airport Planning and Design Excel Solver Dr. Antonio A. Trani Professor of Civil and Environmental Engineering Virginia Polytechnic Institute and State University Blacksburg, Virginia Spring 2012 1 of
More informationGenOpt (R) Generic Optimization Program User Manual Version 3.0.0β1
(R) User Manual Environmental Energy Technologies Division Berkeley, CA 94720 http://simulationresearch.lbl.gov Michael Wetter MWetter@lbl.gov February 20, 2009 Notice: This work was supported by the U.S.
More informationA Multi-layered Domain-specific Language for Stencil Computations
A Multi-layered Domain-specific Language for Stencil Computations Christian Schmitt, Frank Hannig, Jürgen Teich Hardware/Software Co-Design, University of Erlangen-Nuremberg Workshop ExaStencils 2014,
More informationFlexible Distributed Capacity Allocation and Load Redirect Algorithms for Cloud Systems
Flexible Distributed Capacity Allocation and Load Redirect Algorithms for Cloud Systems Danilo Ardagna 1, Sara Casolari 2, Barbara Panicucci 1 1 Politecnico di Milano,, Italy 2 Universita` di Modena e
More informationParallel Programming at the Exascale Era: A Case Study on Parallelizing Matrix Assembly For Unstructured Meshes
Parallel Programming at the Exascale Era: A Case Study on Parallelizing Matrix Assembly For Unstructured Meshes Eric Petit, Loïc Thebault, Quang V. Dinh May 2014 EXA2CT Consortium 2 WPs Organization Proto-Applications
More informationP013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE
1 P013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE JEAN-MARC GRATIEN, JEAN-FRANÇOIS MAGRAS, PHILIPPE QUANDALLE, OLIVIER RICOIS 1&4, av. Bois-Préau. 92852 Rueil Malmaison Cedex. France
More informationA Review of Customized Dynamic Load Balancing for a Network of Workstations
A Review of Customized Dynamic Load Balancing for a Network of Workstations Taken from work done by: Mohammed Javeed Zaki, Wei Li, Srinivasan Parthasarathy Computer Science Department, University of Rochester
More informationBig Data - Lecture 1 Optimization reminders
Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Big Data - Lecture 1 Optimization reminders S. Gadat Toulouse, Octobre 2014 Schedule Introduction Major issues Examples Mathematics
More informationFurther Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1
Further Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1 J. Zhang Institute of Applied Mathematics, Chongqing University of Posts and Telecommunications, Chongqing
More informationMetric Spaces. Chapter 7. 7.1. Metrics
Chapter 7 Metric Spaces A metric space is a set X that has a notion of the distance d(x, y) between every pair of points x, y X. The purpose of this chapter is to introduce metric spaces and give some
More information24. The Branch and Bound Method
24. The Branch and Bound Method It has serious practical consequences if it is known that a combinatorial problem is NP-complete. Then one can conclude according to the present state of science that no
More informationEffective Page Refresh Policies For Web Crawlers
Effective Page Refresh Policies For Web Crawlers JUNGHOO CHO University of California, Los Angeles and HECTOR GARCIA-MOLINA Stanford University In this paper we study how we can maintain local copies of
More informationIntroduction to Markov Chain Monte Carlo
Introduction to Markov Chain Monte Carlo Monte Carlo: sample from a distribution to estimate the distribution to compute max, mean Markov Chain Monte Carlo: sampling using local information Generic problem
More informationSINGLE-STAGE MULTI-PRODUCT PRODUCTION AND INVENTORY SYSTEMS: AN ITERATIVE ALGORITHM BASED ON DYNAMIC SCHEDULING AND FIXED PITCH PRODUCTION
SIGLE-STAGE MULTI-PRODUCT PRODUCTIO AD IVETORY SYSTEMS: A ITERATIVE ALGORITHM BASED O DYAMIC SCHEDULIG AD FIXED PITCH PRODUCTIO Euclydes da Cunha eto ational Institute of Technology Rio de Janeiro, RJ
More informationOptimal Pricing and Service Provisioning Strategies in Cloud Systems: A Stackelberg Game Approach
Optimal Pricing and Service Provisioning Strategies in Cloud Systems: A Stackelberg Game Approach Valerio Di Valerio Valeria Cardellini Francesco Lo Presti Dipartimento di Ingegneria Civile e Ingegneria
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Joschka Bödecker AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg jboedeck@informatik.uni-freiburg.de
More informationInterior-Point Algorithms for Quadratic Programming
Interior-Point Algorithms for Quadratic Programming Thomas Reslow Krüth Kongens Lyngby 2008 IMM-M.Sc-2008-19 Technical University of Denmark Informatics and Mathematical Modelling Building 321, DK-2800
More informationA Load Balancing Tool for Structured Multi-Block Grid CFD Applications
A Load Balancing Tool for Structured Multi-Block Grid CFD Applications K. P. Apponsah and D. W. Zingg University of Toronto Institute for Aerospace Studies (UTIAS), Toronto, ON, M3H 5T6, Canada Email:
More informationScheduling Real-time Tasks: Algorithms and Complexity
Scheduling Real-time Tasks: Algorithms and Complexity Sanjoy Baruah The University of North Carolina at Chapel Hill Email: baruah@cs.unc.edu Joël Goossens Université Libre de Bruxelles Email: joel.goossens@ulb.ac.be
More information! Solve problem to optimality. ! Solve problem in poly-time. ! Solve arbitrary instances of the problem. !-approximation algorithm.
Approximation Algorithms Chapter Approximation Algorithms Q Suppose I need to solve an NP-hard problem What should I do? A Theory says you're unlikely to find a poly-time algorithm Must sacrifice one of
More informationC3.8 CRM wing/body Case
C3.8 CRM wing/body Case 1. Code description XFlow is a high-order discontinuous Galerkin (DG) finite element solver written in ANSI C, intended to be run on Linux-type platforms. Relevant supported equation
More informationDifferentiating a Time-dependent CFD Solver
Differentiating a Time-dependent CFD Solver Presented to The AD Workshop, Nice, April 2005 Mohamed Tadjouddine & Shaun Forth Engineering Systems Department Cranfield University (Shrivenham Campus) Swindon
More informationEquilibrium computation: Part 1
Equilibrium computation: Part 1 Nicola Gatti 1 Troels Bjerre Sorensen 2 1 Politecnico di Milano, Italy 2 Duke University, USA Nicola Gatti and Troels Bjerre Sørensen ( Politecnico di Milano, Italy, Equilibrium
More informationTESLA Report 2003-03
TESLA Report 23-3 A multigrid based 3D space-charge routine in the tracking code GPT Gisela Pöplau, Ursula van Rienen, Marieke de Loos and Bas van der Geer Institute of General Electrical Engineering,
More informationRecovery of primal solutions from dual subgradient methods for mixed binary linear programming; a branch-and-bound approach
MASTER S THESIS Recovery of primal solutions from dual subgradient methods for mixed binary linear programming; a branch-and-bound approach PAULINE ALDENVIK MIRJAM SCHIERSCHER Department of Mathematical
More informationAdaptive Numerical Solution of State Constrained Optimal Control Problems
Technische Universität München Lehrstuhl für Mathematische Optimierung Adaptive Numerical Solution of State Constrained Optimal Control Problems Olaf Benedix Vollständiger Abdruck der von der Fakultät
More informationarxiv:1412.5558v1 [q-fin.tr] 17 Dec 2014
Backtest of Trading Systems on Candle Charts Stanislaus Maier-Paape Institut für Mathematik, RWTH Aachen, Templergraben 55, D-52052 Aachen, Germany maier@instmath.rwth-aachen.de Andreas Platen Institut
More information4.6 Linear Programming duality
4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP. Different spaces and objective functions but in general same optimal
More informationA New Unstructured Variable-Resolution Finite Element Ice Sheet Stress-Velocity Solver within the MPAS/Trilinos FELIX Dycore of PISCEES
A New Unstructured Variable-Resolution Finite Element Ice Sheet Stress-Velocity Solver within the MPAS/Trilinos FELIX Dycore of PISCEES Irina Kalashnikova, Andy G. Salinger, Ray S. Tuminaro Numerical Analysis
More informationA MULTI-PERIOD INVESTMENT SELECTION MODEL FOR STRATEGIC RAILWAY CAPACITY PLANNING
A MULTI-PERIOD INVESTMENT SELECTION MODEL FOR STRATEGIC RAILWAY Yung-Cheng (Rex) Lai, Assistant Professor, Department of Civil Engineering, National Taiwan University, Rm 313, Civil Engineering Building,
More informationPassive Discovery Algorithms
t t Technische Universität Berlin Telecommunication Networks Group arxiv:1506.05255v1 [cs.ni] 17 Jun 2015 Optimized Asynchronous Passive Multi-Channel Discovery of Beacon-Enabled Networks Niels Karowski,
More informationClustering and scheduling maintenance tasks over time
Clustering and scheduling maintenance tasks over time Per Kreuger 2008-04-29 SICS Technical Report T2008:09 Abstract We report results on a maintenance scheduling problem. The problem consists of allocating
More information