Stochastic Model Predictive Control
|
|
- Maud Allen
- 7 years ago
- Views:
Transcription
1 Stochastic Model Predictive Control stochastic finite horizon control stochastic dynamic programming certainty equivalent model predictive control Prof. S. Boyd, EE364b, Stanford University
2 Causal state-feedback control linear dynamical system, over finite time horizon: x t+1 = Ax t + Bu t + w t, t = 0,..., T 1 x t R n is state, u t R m is the input at time t w t is the process noise (or exogeneous input) at time t X t = (x 0,..., x t ) is the state history up to time t causal state-feedback control: u t = φ t (X t ) = ψ t (x 0, w 0,..., w t 1 ), t = 0,..., T 1 φ t : R (t+1)n R m called the control policy at time t Prof. S. Boyd, EE364b, Stanford University 1
3 Stochastic finite horizon control (x 0, w 0,..., w T 1 ) is a random variable objective: J = E ( T ) 1 t=0 l t(x t, u t ) + l T (x T ) convex stage cost functions l t : R n R m R, t = 0,..., T 1 convex terminal cost function l T : R n R J depends on control policies φ 0,..., φ T 1 constraints: u t U t, t = 0,..., T 1 convex input constraint sets U 0,..., U T 1 stochastic control problem: choose control policies φ 0,..., φ T 1 to minimize J, subject to constraints Prof. S. Boyd, EE364b, Stanford University 2
4 Stochastic finite horizon control an infinite dimensional problem: variables are functions φ 0,..., φ T 1 can restrict policies to finite dimensional subspace, e.g., φ t all affine key idea: we have recourse (a.k.a. feedback, closed-loop control) we can change u t based on the observed state history x 0,..., x t cf standard ( open loop ) optimal control problem, where we commit to u 0,..., u T 1 ahead of time in general case, need to evaluate J (for given control policies) via Monte Carlo simulation Prof. S. Boyd, EE364b, Stanford University 3
5 Solution via dynamic programming let V t (X t ) be optimal value of objective, from t on, starting from initial state history X t V T (X T ) = l T (x T ); J = EV 0 (x 0 ) V t can be found by backward recursion: for t = T 1,...,0 V t (X t ) = inf v U {l t(x t, v) + E(V t+1 ((X t, Ax t + Bv + w t )) X t )} V t, t = 0,..., T are convex functions optimal policy is causal state feedback φ t(x t ) = argmin{l t (x t, v) + E(V t+1 ((X t, Ax t + Bv + w t )) X t )} v U Prof. S. Boyd, EE364b, Stanford University 4
6 Independent process noise assume x 0, w 0,..., w T 1 are independent V t depends only on the current state x t (and not the state history X t ) Bellman equations: V T (x T ) = l T (x T ); for t = T 1,...,0, V t (x t ) = inf v U {l t(x t, v) + EV t+1 (Ax t + Bv + w t )} optimal policy is a function of current state x t φ (x t ) = argmin{l t (x t, v) + EV t+1 (Ax t + Bv + w t )} v U Prof. S. Boyd, EE364b, Stanford University 5
7 Linear quadratic stochastic control special case of linear stochastic control U t = R m x 0, w 0,..., w T 1 are independent, with E x 0 = 0, E w t = 0, Ex 0 x T 0 = Σ, Ew t w T t = W t l t (x t, u t ) = x T t Q t x t + u T t R t u t, with Q t 0, R t 0 l T (x T ) = x T T Q Tx T, with Q T 0 Prof. S. Boyd, EE364b, Stanford University 6
8 can show value functions are quadratic, i.e., V t (x t ) = x T t P t x t + q t, t = 0,..., T Bellman recursion: P T = Q T, q T = 0; for t = T 1,...,0, V t (z) = inf v {zt Q t z + v T R t v +E((Az + Bv + w t ) T P t+1 (Az + Bv + w t ) + q t+1 )} works out to P t = A T P t+1 A A T P t+1 B(B T P t+1 B + R t ) 1 B T P t+1 A + Q t q t = q t+1 + Tr(W t P t+1 ) Prof. S. Boyd, EE364b, Stanford University 7
9 optimal policy is linear state feedback: φ t(x t ) = K t x t, K t = (B T P t+1 B + R t ) 1 B T P t+1 A (which, strangely, does not depend on Σ, W 0,..., W T 1 ) optimal cost J = EV 0 (x 0 ) = Tr(ΣP 0 ) + q 0 = Tr(ΣP 0 ) + T 1 t=0 Tr(W t P t+1 ) Prof. S. Boyd, EE364b, Stanford University 8
10 Certainty equivalent model predictive control at every time t we solve the certainty equivalent problem T 1 minimize τ=t l t(x τ, u τ ) + l T (x T ) subject to u τ U τ, τ = t,..., T 1 x τ+1 = Ax τ + Bu τ + ŵ τ t, τ = t,..., T 1 with variables x t+1,..., x T, u t,..., u T 1 and data x t, ŵ t t,...,ŵ T 1 t ŵ t t,...,ŵ T 1 t are predicted values of w t,..., w T 1 based on X t (e.g., conditional expectations) call solution x t+1,..., x T, ũ t,...,ũ T 1 we take φ mpc (X t ) = ũ t φ mpc is a function of X t since ŵ t t,...,ŵ T 1 t are functions of X t Prof. S. Boyd, EE364b, Stanford University 9
11 Certainty equivalent model predictive control widely used, e.g., in revenue management based on (bad) approximations: future values of disturbance are exactly as predicted; there is no future uncertainty in future, no recourse is available yet, often works very well Prof. S. Boyd, EE364b, Stanford University 10
12 Example system with n = 3 states, m = 2 inputs; horizon T = 50 A, B chosen randomly quadratic stage cost: l t (x, u) = x u 2 2 quadratic final cost: l T (x) = x 2 2 constraint set: U = {u u 0.5} x 0, w 0,..., w T 1 iid N(0,0.25I) Prof. S. Boyd, EE364b, Stanford University 11
13 sample trace of x 1 and u 1 Stochastic MPC: Sample trajectory 2 x1(t) u1(t) t Prof. S. Boyd, EE364b, Stanford University 12
14 Cost histogram J relax J sat J relax J mpc Prof. S. Boyd, EE364b, Stanford University 13
15 Simple lower bound for quadratic stochastic control x 0, w 0,..., w T 1 independent quadratic stage and final cost relaxation: ignore U t ; yields linear quadratic stochastic control problem solve relaxed problem exactly; optimal cost is J relax J J relax for our numerical example, J mpc = (via Monte Carlo) J sat = (linear quadratic stochastic control with saturation) J relax = Prof. S. Boyd, EE364b, Stanford University 14
Optimization of warehousing and transportation costs, in a multiproduct multi-level supply chain system, under a stochastic demand
Int. J. Simul. Multidisci. Des. Optim. 4, 1-5 (2010) c ASMDO 2010 DOI: 10.1051/ijsmdo / 2010001 Available online at: http://www.ijsmdo.org Optimization of warehousing and transportation costs, in a multiproduct
More informationNeuro-Dynamic Programming An Overview
1 Neuro-Dynamic Programming An Overview Dimitri Bertsekas Dept. of Electrical Engineering and Computer Science M.I.T. September 2006 2 BELLMAN AND THE DUAL CURSES Dynamic Programming (DP) is very broadly
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Martin Lauer AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg martin.lauer@kit.edu
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Joschka Bödecker AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg jboedeck@informatik.uni-freiburg.de
More informationOptimization under uncertainty: modeling and solution methods
Optimization under uncertainty: modeling and solution methods Paolo Brandimarte Dipartimento di Scienze Matematiche Politecnico di Torino e-mail: paolo.brandimarte@polito.it URL: http://staff.polito.it/paolo.brandimarte
More informationReal-Time Embedded Convex Optimization
Real-Time Embedded Convex Optimization Stephen Boyd joint work with Michael Grant, Jacob Mattingley, Yang Wang Electrical Engineering Department, Stanford University Spencer Schantz Lecture, Lehigh University,
More informationC21 Model Predictive Control
C21 Model Predictive Control Mark Cannon 4 lectures Hilary Term 216-1 Lecture 1 Introduction 1-2 Organisation 4 lectures: week 3 week 4 { Monday 1-11 am LR5 Thursday 1-11 am LR5 { Monday 1-11 am LR5 Thursday
More informationTexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA
2015 School of Information Technology and Electrical Engineering at the University of Queensland TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA Schedule Week Date
More informationCurrent Accounts in Open Economies Obstfeld and Rogoff, Chapter 2
Current Accounts in Open Economies Obstfeld and Rogoff, Chapter 2 1 Consumption with many periods 1.1 Finite horizon of T Optimization problem maximize U t = u (c t ) + β (c t+1 ) + β 2 u (c t+2 ) +...
More informationSpatial Decomposition/Coordination Methods for Stochastic Optimal Control Problems. Practical aspects and theoretical questions
Spatial Decomposition/Coordination Methods for Stochastic Optimal Control Problems Practical aspects and theoretical questions P. Carpentier, J-Ph. Chancelier, M. De Lara, V. Leclère École des Ponts ParisTech
More informationProbability and Random Variables. Generation of random variables (r.v.)
Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly
More informationDuality in General Programs. Ryan Tibshirani Convex Optimization 10-725/36-725
Duality in General Programs Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: duality in linear programs Given c R n, A R m n, b R m, G R r n, h R r : min x R n c T x max u R m, v R r b T
More information3. Reaction Diffusion Equations Consider the following ODE model for population growth
3. Reaction Diffusion Equations Consider the following ODE model for population growth u t a u t u t, u 0 u 0 where u t denotes the population size at time t, and a u plays the role of the population dependent
More informationLecture 13 Linear quadratic Lyapunov theory
EE363 Winter 28-9 Lecture 13 Linear quadratic Lyapunov theory the Lyapunov equation Lyapunov stability conditions the Lyapunov operator and integral evaluating quadratic integrals analysis of ARE discrete-time
More informationStochastic control of HVAC systems: a learning-based approach. Damiano Varagnolo
Stochastic control of HVAC systems: a learning-based approach Damiano Varagnolo Something about me 2 Something about me Post-Doc at KTH Post-Doc at U. Padova Visiting Scholar at UC Berkeley Ph.D. Student
More informationLecture 3. Linear Programming. 3B1B Optimization Michaelmas 2015 A. Zisserman. Extreme solutions. Simplex method. Interior point method
Lecture 3 3B1B Optimization Michaelmas 2015 A. Zisserman Linear Programming Extreme solutions Simplex method Interior point method Integer programming and relaxation The Optimization Tree Linear Programming
More informationThe Effects of Start Prices on the Performance of the Certainty Equivalent Pricing Policy
BMI Paper The Effects of Start Prices on the Performance of the Certainty Equivalent Pricing Policy Faculty of Sciences VU University Amsterdam De Boelelaan 1081 1081 HV Amsterdam Netherlands Author: R.D.R.
More informationRobust and Data-Driven Optimization: Modern Decision-Making Under Uncertainty
Robust and Data-Driven Optimization: Modern Decision-Making Under Uncertainty Dimtris Bertsimas Aurélie Thiele March 2006 Abstract Traditional models of decision-making under uncertainty assume perfect
More informationRobust output feedbackstabilization via risk-sensitive control
Automatica 38 22) 945 955 www.elsevier.com/locate/automatica Robust output feedbackstabilization via risk-sensitive control Valery A. Ugrinovskii, Ian R. Petersen School of Electrical Engineering, Australian
More informationDynamic Modeling, Predictive Control and Performance Monitoring
Biao Huang, Ramesh Kadali Dynamic Modeling, Predictive Control and Performance Monitoring A Data-driven Subspace Approach 4y Spri nnger g< Contents Notation XIX 1 Introduction 1 1.1 An Overview of This
More informationStochastic Gradient Method: Applications
Stochastic Gradient Method: Applications February 03, 2015 P. Carpentier Master MMMEF Cours MNOS 2014-2015 114 / 267 Lecture Outline 1 Two Elementary Exercices on the Stochastic Gradient Two-Stage Recourse
More informationChapter 3 Nonlinear Model Predictive Control
Chapter 3 Nonlinear Model Predictive Control In this chapter, we introduce the nonlinear model predictive control algorithm in a rigorous way. We start by defining a basic NMPC algorithm for constant reference
More informationA joint control framework for supply chain planning
17 th European Symposium on Computer Aided Process Engineering ESCAPE17 V. Plesu and P.S. Agachi (Editors) 2007 Elsevier B.V. All rights reserved. 1 A joint control framework for supply chain planning
More informationNonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms
Nonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms Al-Duwaish H. and Naeem, Wasif Electrical Engineering Department/King Fahd University of Petroleum and Minerals
More informationModelling Incomplete Markets for Long Term Asset Liability Management
INI DQF Workshop on Modelling Philosophy 22 April 2005 Modelling Incomplete Markets for Long Term Asset Liability Management M A H Dempster Centre for Financial Research Judge Institute of Management University
More informationIntroduction to the Finite Element Method (FEM)
Introduction to the Finite Element Method (FEM) ecture First and Second Order One Dimensional Shape Functions Dr. J. Dean Discretisation Consider the temperature distribution along the one-dimensional
More informationCustomers with positive demand lead times place orders in advance of their needs. A
Replenishment Strategies for Distribution Systems Under Advance Demand Information Özalp Özer Department of Management Science and Engineering, Stanford University, Stanford, California 94305 ozalp@stanford.edu
More information1 Short Introduction to Time Series
ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The
More informationMatching Investment Strategies in General Insurance Is it Worth It? Aim of Presentation. Background 34TH ANNUAL GIRO CONVENTION
Matching Investment Strategies in General Insurance Is it Worth It? 34TH ANNUAL GIRO CONVENTION CELTIC MANOR RESORT, NEWPORT, WALES Aim of Presentation To answer a key question: What are the benefit of
More informationBinomial lattice model for stock prices
Copyright c 2007 by Karl Sigman Binomial lattice model for stock prices Here we model the price of a stock in discrete time by a Markov chain of the recursive form S n+ S n Y n+, n 0, where the {Y i }
More informationUsing MATLAB in a Graduate Electrical Engineering Optimal Control Course
Using MATLAB in a Graduate Electrical Engineering Optimal Control Course Asad Azemi Department of Electrical Engineering Penn State University Great Valley Campus Malvern, PA 19355-1443 Abstract - Control
More informationFleet Management. Warren B. Powell and Huseyin Topaloglu. June, 2002
Fleet Management Warren B. Powell and Huseyin Topaloglu June, 2002 Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08544 1 1. Introduction The fleet management
More informationLecture 13: Risk Aversion and Expected Utility
Lecture 13: Risk Aversion and Expected Utility Uncertainty over monetary outcomes Let x denote a monetary outcome. C is a subset of the real line, i.e. [a, b]. A lottery L is a cumulative distribution
More informationSection 1.4. Lines, Planes, and Hyperplanes. The Calculus of Functions of Several Variables
The Calculus of Functions of Several Variables Section 1.4 Lines, Planes, Hyperplanes In this section we will add to our basic geometric understing of R n by studying lines planes. If we do this carefully,
More informationLecture 7: Finding Lyapunov Functions 1
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.243j (Fall 2003): DYNAMICS OF NONLINEAR SYSTEMS by A. Megretski Lecture 7: Finding Lyapunov Functions 1
More informationAn Improved Dynamic Programming Decomposition Approach for Network Revenue Management
An Improved Dynamic Programming Decomposition Approach for Network Revenue Management Dan Zhang Leeds School of Business University of Colorado at Boulder May 21, 2012 Outline Background Network revenue
More informationTowards Dual MPC. Tor Aksel N. Heirung B. Erik Ydstie Bjarne Foss
4th IFAC Nonlinear Model Predictive Control Conference International Federation of Automatic Control Towards Dual MPC Tor Aksel N. Heirung B. Erik Ydstie Bjarne Foss Department of Engineering Cybernetics,
More informationApplied Computational Economics and Finance
Applied Computational Economics and Finance Mario J. Miranda and Paul L. Fackler The MIT Press Cambridge, Massachusetts London, England Preface xv 1 Introduction 1 1.1 Some Apparently Simple Questions
More informationPredictive Control Algorithms: Stability despite Shortened Optimization Horizons
Predictive Control Algorithms: Stability despite Shortened Optimization Horizons Philipp Braun Jürgen Pannek Karl Worthmann University of Bayreuth, 9544 Bayreuth, Germany University of the Federal Armed
More informationA Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems
A Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems Alp Muharremoğlu John N. sitsiklis July 200 Revised March 2003 Former version titled: Echelon Base Stock Policies in Uncapacitated
More informationOPTIMAl PREMIUM CONTROl IN A NON-liFE INSURANCE BUSINESS
ONDERZOEKSRAPPORT NR 8904 OPTIMAl PREMIUM CONTROl IN A NON-liFE INSURANCE BUSINESS BY M. VANDEBROEK & J. DHAENE D/1989/2376/5 1 IN A OPTIMAl PREMIUM CONTROl NON-liFE INSURANCE BUSINESS By Martina Vandebroek
More informationHerd Management Science
Herd Management Science Preliminary edition Compiled for the Advanced Herd Management course KVL, August 28th - November 3rd, 2006 Anders Ringgaard Kristensen Erik Jørgensen Nils Toft The Royal Veterinary
More informationPartial Fractions. (x 1)(x 2 + 1)
Partial Fractions Adding rational functions involves finding a common denominator, rewriting each fraction so that it has that denominator, then adding. For example, 3x x 1 3x(x 1) (x + 1)(x 1) + 1(x +
More informationDistributed Control in Transportation and Supply Networks
Distributed Control in Transportation and Supply Networks Marco Laumanns, Institute for Operations Research, ETH Zurich Joint work with Harold Tiemessen, Stefan Wörner (IBM Research Zurich) Apostolos Fertis,
More informationTwo-Stage Stochastic Linear Programs
Two-Stage Stochastic Linear Programs Operations Research Anthony Papavasiliou 1 / 27 Two-Stage Stochastic Linear Programs 1 Short Reviews Probability Spaces and Random Variables Convex Analysis 2 Deterministic
More informationCOMPLETE MARKETS DO NOT ALLOW FREE CASH FLOW STREAMS
COMPLETE MARKETS DO NOT ALLOW FREE CASH FLOW STREAMS NICOLE BÄUERLE AND STEFANIE GRETHER Abstract. In this short note we prove a conjecture posed in Cui et al. 2012): Dynamic mean-variance problems in
More informationEnergy and Buildings
Energy and Buildings 45 (2012) 15 27 Contents lists available at SciVerse ScienceDirect Energy and Buildings j ourna l ho me p age: www.elsevier.com/locate/enbuild Use of model predictive control and weather
More information10. Proximal point method
L. Vandenberghe EE236C Spring 2013-14) 10. Proximal point method proximal point method augmented Lagrangian method Moreau-Yosida smoothing 10-1 Proximal point method a conceptual algorithm for minimizing
More informationFleet Management. Warren B. Powell and Huseyin Topaloglu. June, 2002
Fleet Management Warren B. Powell and Huseyin Topaloglu June, 2002 Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08544 Abstract Fleet management addresses
More informationTime Series Analysis
Time Series Analysis Forecasting with ARIMA models Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and García-Martos (UC3M-UPM)
More informationOptimal feedback strength for noise suppression in. auto-regulatory gene networks
Optimal feedback strength for noise suppression in auto-regulatory gene networks Abhyudai Singh 1 Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA Joao P.
More informationGovernment Debt Management: the Long and the Short of it
Government Debt Management: the Long and the Short of it E. Faraglia (U. of Cambridge and CEPR) A. Marcet (IAE, UAB, ICREA, BGSE, MOVE and CEPR), R. Oikonomou (U.C. Louvain) A. Scott (LBS and CEPR) ()
More informationFormulations of Model Predictive Control. Dipartimento di Elettronica e Informazione
Formulations of Model Predictive Control Riccardo Scattolini Riccardo Scattolini Dipartimento di Elettronica e Informazione Impulse and step response models 2 At the beginning of the 80, the early formulations
More informationOnline Learning of Optimal Strategies in Unknown Environments
1 Online Learning of Optimal Strategies in Unknown Environments Santiago Paternain and Alejandro Ribeiro Abstract Define an environment as a set of convex constraint functions that vary arbitrarily over
More information19 LINEAR QUADRATIC REGULATOR
19 LINEAR QUADRATIC REGULATOR 19.1 Introduction The simple form of loopshaping in scalar systems does not extend directly to multivariable (MIMO) plants, which are characterized by transfer matrices instead
More informationDynamic Asset Allocation Using Stochastic Programming and Stochastic Dynamic Programming Techniques
Dynamic Asset Allocation Using Stochastic Programming and Stochastic Dynamic Programming Techniques Gerd Infanger Stanford University Winter 2011/2012 MS&E348/Infanger 1 Outline Motivation Background and
More informationMonte Carlo-based statistical methods (MASM11/FMS091)
Monte Carlo-based statistical methods (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 7, 2014 M. Wiktorsson
More informationSeminar. Path planning using Voronoi diagrams and B-Splines. Stefano Martina stefano.martina@stud.unifi.it
Seminar Path planning using Voronoi diagrams and B-Splines Stefano Martina stefano.martina@stud.unifi.it 23 may 2016 This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International
More informationState-Space Feedback Control for Elastic Distributed Storage in a Cloud Environment
State-Space Feedback Control for Elastic Distributed Storage in a Cloud Environment M. Amir Moulavi Ahmad Al-Shishtawy Vladimir Vlassov KTH Royal Institute of Technology, Stockholm, Sweden ICAS 2012, March
More informationNonlinear Programming Methods.S2 Quadratic Programming
Nonlinear Programming Methods.S2 Quadratic Programming Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard A linearly constrained optimization problem with a quadratic objective
More informationSTOCHASTIC MODELING OF INSURANCE BUSINESS WITH DYNAMICAL CONTROL OF INVESTMENTS 1
Theory of Stochastic Processes Vol.9 (25), no.1-2, 2003, pp.184-205 DMITRII SILVESTROV, ANATOLIY MALYARENKO AND EVELINA SILVESTROVA STOCHASTIC MODELING OF INSURANCE BUSINESS WITH DYNAMICAL CONTROL OF INVESTMENTS
More informationHow To Understand And Understand Finance
Ill. i,t.,. QUANTITATIVE FINANCIAL ECONOMICS STOCKS, BONDS AND FOREIGN EXCHANGE Second Edition KEITH CUTHBERTSON AND DIRK NITZSCHE HOCHSCHULE John Wiley 8k Sons, Ltd CONTENTS Preface Acknowledgements 2.1
More informationUncertainty modeling revisited: What if you don t know the probability distribution?
: What if you don t know the probability distribution? Hans Schjær-Jacobsen Technical University of Denmark 15 Lautrupvang, 2750 Ballerup, Denmark hschj@dtu.dk Uncertain input variables Uncertain system
More informationSales forecasting # 2
Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univ-rennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
More informationTetris: A Study of Randomized Constraint Sampling
Tetris: A Study of Randomized Constraint Sampling Vivek F. Farias and Benjamin Van Roy Stanford University 1 Introduction Randomized constraint sampling has recently been proposed as an approach for approximating
More informationCONTROLLABILITY. Chapter 2. 2.1 Reachable Set and Controllability. Suppose we have a linear system described by the state equation
Chapter 2 CONTROLLABILITY 2 Reachable Set and Controllability Suppose we have a linear system described by the state equation ẋ Ax + Bu (2) x() x Consider the following problem For a given vector x in
More informationCHAPTER 9. Integer Programming
CHAPTER 9 Integer Programming An integer linear program (ILP) is, by definition, a linear program with the additional constraint that all variables take integer values: (9.1) max c T x s t Ax b and x integral
More informationBuilding and Using Spreadsheet Decision Models
Chapter 9 Building and Using Spreadsheet Decision Models Models A model is an abstraction or representation of a real system, idea, or object. Models could be pictures, spreadsheets, or mathematical relationships
More informationLecture 13: Martingales
Lecture 13: Martingales 1. Definition of a Martingale 1.1 Filtrations 1.2 Definition of a martingale and its basic properties 1.3 Sums of independent random variables and related models 1.4 Products of
More informationA Simultaneous Deterministic Perturbation Actor-Critic Algorithm with an Application to Optimal Mortgage Refinancing
Proceedings of the 45th IEEE Conference on Decision & Control Manchester Grand Hyatt Hotel San Diego, CA, USA, December 13-15, 2006 A Simultaneous Deterministic Perturbation Actor-Critic Algorithm with
More informationOptimization of Supply Chain Networks
Optimization of Supply Chain Networks M. Herty TU Kaiserslautern September 2006 (2006) 1 / 41 Contents 1 Supply Chain Modeling 2 Networks 3 Optimization Continuous optimal control problem Discrete optimal
More informationDuality of linear conic problems
Duality of linear conic problems Alexander Shapiro and Arkadi Nemirovski Abstract It is well known that the optimal values of a linear programming problem and its dual are equal to each other if at least
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More information5.1 Dynamic programming and the HJB equation
Lecture 20 Cold war era: Pontryagin vs. Bellman. 5.1 Dynamic programming and the HJB equation In place of determining the optimal sequence of decisions from the fixed state of the system, we wish to determine
More informationLending in Last Resort to Governments
Olivier Jeanne, Johns Hopkins University Indiana University, March 2015 Introduction Fiscal fundamentals in 2009: an international comparison Net debt/gdp (%) 40 50 60 70 80 90 100 110 120 US JAP UK EUR
More informationitesla Project Innovative Tools for Electrical System Security within Large Areas
itesla Project Innovative Tools for Electrical System Security within Large Areas Samir ISSAD RTE France samir.issad@rte-france.com PSCC 2014 Panel Session 22/08/2014 Advanced data-driven modeling techniques
More informationOnline Model Predictive Control of a Robotic System by Combining Simulation and Optimization
Mohammad Rokonuzzaman Pappu Online Model Predictive Control of a Robotic System by Combining Simulation and Optimization School of Electrical Engineering Department of Electrical Engineering and Automation
More informationProposal 1: Model-Based Control Method for Discrete-Parts machining processes
Proposal 1: Model-Based Control Method for Discrete-Parts machining processes Proposed Objective: The proposed objective is to apply and extend the techniques from continuousprocessing industries to create
More informationHow To Solve A Sequential Mca Problem
Monte Carlo-based statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 3, 2012 Changes in HA1 Problem
More informationAn Incomplete Market Approach to Employee Stock Option Valuation
An Incomplete Market Approach to Employee Stock Option Valuation Kamil Kladívko Department of Statistics, University of Economics, Prague Department of Finance, Norwegian School of Economics, Bergen Mihail
More informationNonlinear Model Predictive Control: From Theory to Application
J. Chin. Inst. Chem. Engrs., Vol. 35, No. 3, 299-315, 2004 Nonlinear Model Predictive Control: From Theory to Application Frank Allgöwer [1], Rolf Findeisen, and Zoltan K. Nagy Institute for Systems Theory
More informationApproaches to Capacity Planning
CHAPTER 3 Approaches to Capacity Planning 3.1 Introduction Having identified the scope of uncertainties in the previous chapter, we now consider how to model it. The modelling approach appeals favourably
More informationDynamics of Small Open Economies
Dynamics of Small Open Economies Lecture 2, ECON 4330 Tord Krogh January 22, 2013 Tord Krogh () ECON 4330 January 22, 2013 1 / 68 Last lecture The models we have looked at so far are characterized by:
More informationPYKC Jan-7-10. Lecture 1 Slide 1
Aims and Objectives E 2.5 Signals & Linear Systems Peter Cheung Department of Electrical & Electronic Engineering Imperial College London! By the end of the course, you would have understood: Basic signal
More informationDiscrete Optimization
Discrete Optimization [Chen, Batson, Dang: Applied integer Programming] Chapter 3 and 4.1-4.3 by Johan Högdahl and Victoria Svedberg Seminar 2, 2015-03-31 Todays presentation Chapter 3 Transforms using
More informationRobust Path Planning and Feedback Design under Stochastic Uncertainty
Robust Path Planning and Feedback Design under Stochastic Uncertainty Lars Blackmore Autonomous vehicles require optimal path planning algorithms to achieve mission goals while avoiding obstacles and being
More informationAppendix to: When Can Life-cycle Investors Benefit from Time-varying Bond Risk Premia?
Theo Nijman Bas Werker Ralph Koijen Appendix to: When Can Life-cycle Investors Benefit from Time-varying Bond Risk Premia? Discussion Paper 2006-017 May 2007 (replacing version of January, 2006) Appendix
More informationReal Business Cycle Models
Real Business Cycle Models Lecture 2 Nicola Viegi April 2015 Basic RBC Model Claim: Stochastic General Equlibrium Model Is Enough to Explain The Business cycle Behaviour of the Economy Money is of little
More informationA Comparison of the Optimal Costs of Two Canonical Inventory Systems
A Comparison of the Optimal Costs of Two Canonical Inventory Systems Ganesh Janakiraman 1, Sridhar Seshadri 2, J. George Shanthikumar 3 First Version: December 2005 First Revision: July 2006 Subject Classification:
More informationBayesian Statistics: Indian Buffet Process
Bayesian Statistics: Indian Buffet Process Ilker Yildirim Department of Brain and Cognitive Sciences University of Rochester Rochester, NY 14627 August 2012 Reference: Most of the material in this note
More informationMonte Carlo-based statistical methods (MASM11/FMS091)
Monte Carlo-based statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February 5, 2013 J. Olsson Monte Carlo-based
More informationSampled-Data Model Predictive Control for Constrained Continuous Time Systems
Sampled-Data Model Predictive Control for Constrained Continuous Time Systems Rolf Findeisen, Tobias Raff, and Frank Allgöwer Institute for Systems Theory and Automatic Control, University of Stuttgart,
More informationLecture notes: single-agent dynamics 1
Lecture notes: single-agent dynamics 1 Single-agent dynamic optimization models In these lecture notes we consider specification and estimation of dynamic optimization models. Focus on single-agent models.
More informationSYSTEMS OF REGRESSION EQUATIONS
SYSTEMS OF REGRESSION EQUATIONS 1. MULTIPLE EQUATIONS y nt = x nt n + u nt, n = 1,...,N, t = 1,...,T, x nt is 1 k, and n is k 1. This is a version of the standard regression model where the observations
More informationAdaptive Business Intelligence
Adaptive Business Intelligence Zbigniew Michalewicz 1 Business Intelligence What is Business Intelligence? Business Intelligence is a collection of tools, methods, technologies, and processes needed to
More informationStatistical Tests for Multiple Forecast Comparison
Statistical Tests for Multiple Forecast Comparison Roberto S. Mariano (Singapore Management University & University of Pennsylvania) Daniel Preve (Uppsala University) June 6-7, 2008 T.W. Anderson Conference,
More informationParallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data
Parallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data Jun Wang Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Shatin, New Territories,
More informationIntroduction to Kalman Filtering
Introduction to Kalman Filtering A set of two lectures Maria Isabel Ribeiro Associate Professor Instituto Superior écnico / Instituto de Sistemas e Robótica June All rights reserved INRODUCION O KALMAN
More informationCoordinated Pricing and Inventory in A System with Minimum and Maximum Production Constraints
The 7th International Symposium on Operations Research and Its Applications (ISORA 08) Lijiang, China, October 31 Novemver 3, 2008 Copyright 2008 ORSC & APORC, pp. 160 165 Coordinated Pricing and Inventory
More information