Irreversible investment with regime shifts



Similar documents
ECON20310 LECTURE SYNOPSIS REAL BUSINESS CYCLE

A Simple Model of Price Dispersion *

Optimal replenishment for a periodic review inventory system with two supply modes

Effects of electricity price volatility and covariance on the firm s investment decisions and long-run demand for electricity

Universidad de Montevideo Macroeconomia II. The Ramsey-Cass-Koopmans Model

The Behavior of Bonds and Interest Rates. An Impossible Bond Pricing Model. 780 w Interest Rate Models

Online Appendix. Supplemental Material for Insider Trading, Stochastic Liquidity and. Equilibrium Prices. by Pierre Collin-Dufresne and Vyacheslav Fos

CS 522 Computational Tools and Methods in Finance Robert Jarrow Lecture 1: Equity Options

Financial Development and Macroeconomic Stability

Stock Price Dynamics, Dividends and Option Prices with Volatility Feedback

Increasing for all. Convex for all. ( ) Increasing for all (remember that the log function is only defined for ). ( ) Concave for all.

Macroeconomics Lecture 1: The Solow Growth Model

2. Real Business Cycle Theory (June 25, 2013)

ECG590I Asset Pricing. Lecture 2: Present Value 1

REPLACEMENT INVESTMENT: OPTIMAL ECONOMIC LIFE UNDER UNCERTAINTY

The Real Business Cycle Model

Current Accounts in Open Economies Obstfeld and Rogoff, Chapter 2

Stephane Crepey. Financial Modeling. A Backward Stochastic Differential Equations Perspective. 4y Springer

LECTURE 15: AMERICAN OPTIONS

Asset liquidity, capital structure, and secured debt $

Lecture. S t = S t δ[s t ].

1 The Black-Scholes Formula

Lecture 12: The Black-Scholes Model Steven Skiena. skiena

ARBITRAGE-FREE OPTION PRICING MODELS. Denis Bell. University of North Florida

VI. Real Business Cycles Models

Mathematical Finance

The Black-Scholes Formula

Stocks paying discrete dividends: modelling and option pricing

Moral Hazard. Itay Goldstein. Wharton School, University of Pennsylvania

OPTIMAL CONTROL OF FLEXIBLE SERVERS IN TWO TANDEM QUEUES WITH OPERATING COSTS

Effective control policies for stochastic inventory systems with a minimum order quantity and linear costs $

Lecture 2. Marginal Functions, Average Functions, Elasticity, the Marginal Principle, and Constrained Optimization

Lecture 3: Growth with Overlapping Generations (Acemoglu 2009, Chapter 9, adapted from Zilibotti)

American Capped Call Options on Dividend-Paying Assets

Moreover, under the risk neutral measure, it must be the case that (5) r t = µ t.

SECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA

Inflation. Chapter Money Supply and Demand

Graduate Macro Theory II: Notes on Investment

Computational Finance Options

Private Equity Fund Valuation and Systematic Risk

Hydrodynamic Limits of Randomized Load Balancing Networks

Multi-variable Calculus and Optimization

Lecture Notes on Elasticity of Substitution

QUANTIZED INTEREST RATE AT THE MONEY FOR AMERICAN OPTIONS

Lecture notes: single-agent dynamics 1

第 9 讲 : 股 票 期 权 定 价 : B-S 模 型 Valuing Stock Options: The Black-Scholes Model

Brownian Motion and Stochastic Flow Systems. J.M Harrison

Chapter 13 Real Business Cycle Theory

The Basics of Interest Theory

Optimal order placement in a limit order book. Adrien de Larrard and Xin Guo. Laboratoire de Probabilités, Univ Paris VI & UC Berkeley

Nonparametric adaptive age replacement with a one-cycle criterion

Stochastic Inventory Control

Pricing American Options without Expiry Date

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

MASTER OF SCIENCE FINANCIAL ECONOMICS ABAC SCHOOL OF MANAGEMENT ASSUMPTION UNIVERSITY OF THAILAND

1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let

Second degree price discrimination

The Optimal Growth Problem

6. Debt Valuation and the Cost of Capital

Optimal Paternalism: Sin Taxes and Health Subsidies

Four Derivations of the Black Scholes PDE by Fabrice Douglas Rouah

Analysis of a Production/Inventory System with Multiple Retailers

Monte Carlo Methods in Finance

15 Kuhn -Tucker conditions

Maximum likelihood estimation of mean reverting processes

Revenue Management for Transportation Problems

Continued Fractions and the Euclidean Algorithm

Markups and Firm-Level Export Status: Appendix

Normalization and Mixed Degrees of Integration in Cointegrated Time Series Systems

Black-Scholes Equation for Option Pricing

Exchange rate intervention with options

Chapter 2: Binomial Methods and the Black-Scholes Formula

Preparation course MSc Business&Econonomics: Economic Growth

5 Numerical Differentiation

Corporate Policies with Temporary and Permanent Shocks

Two-State Option Pricing

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Constrained optimization.

Prices versus Exams as Strategic Instruments for Competing Universities

Introduction to Algebraic Geometry. Bézout s Theorem and Inflection Points

The Agency Effects on Investment, Risk Management and Capital Structure

How To Price A Call Option

Section A. Index. Section A. Planning, Budgeting and Forecasting Section A.2 Forecasting techniques Page 1 of 11. EduPristine CMA - Part I

A Regime-Switching Model for Electricity Spot Prices. Gero Schindlmayr EnBW Trading GmbH

A Detailed Price Discrimination Example

Real Estate Investments with Stochastic Cash Flows

WACC and a Generalized Tax Code

Does Black-Scholes framework for Option Pricing use Constant Volatilities and Interest Rates? New Solution for a New Problem

CHAPTER 7 APPLICATIONS TO MARKETING. Chapter 7 p. 1/54

Economic Development and Gains from Trade

Transcription:

Journal of Economic Theory 22 (2005) 37 59 Irreversible investment with regime shifts Xin Guo, a Jianjun Miao, b and Erwan Morellec c,d,e, a Department of Operations Research and Industrial Engineering, Cornell University, 24 Rhodes Hall, Ithaca, NY 4853, USA b Department of Economics, Boston University, 270 Bay State Road, Boston, MA 0225, USA c Ecole des HEC, University of Lausanne, Lausanne CH 007, Switzerland d International Center FAME, 40bd. du Pont d Arve, Geneva CH 2, Switzerland e William E. Simon Graduate School of Business Administration, University of Rochester, Rochester NY 4627, USA Received 5 March 2002; final version received 20 April 2004 Available online 7 July 2004 Abstract Under the real options approach to investment under uncertainty, agents formulate optimal policies under the assumption that firms growth prospects do not vary over time. This paper proposes and solves a model of investment decisions in which the growth rate and volatility of the decision variable shift between different states at random times. A value-maximizing investment policy is derived such that in each regime the firm s investment policy is optimal and recognizes the possibility of a regime shift. Under this policy, investment is intermittent and increases with marginal q: Moreover, investment typically is very small but, in some states, the capital stock jumps. Implications for marginal q and the user cost of capital are also examined. r 2004 Elsevier Inc. All rights reserved. JEL classification: D92; E22; E32 Keywords: Investment; Capacity choice; Regime shifts Corresponding author. William E. Simon Graduate School of Business Administration, University of Rochester, Rochester NY 4627, USA. E-mail addresses: xinguo@orie.cornell.edu (X. Guo), miaoj@bu.edu (J. Miao), morellec@simon. rochester.edu (E. Morellec). 0022-053/$ - see front matter r 2004 Elsevier Inc. All rights reserved. doi:0.06/j.jet.2004.04.005

38 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59. Introduction The notion that regime shifts are important in explaining the cyclical features of real macroeconomic variables as proposed by Hamilton [5] is nowwidely accepted. Motivated by anecdotal evidence, a pervasive manifestation of this viewis that regime shifts, by changing firms growth prospects, affect capital accumulation and investment decisions. On economic grounds, there are indeed reasons to believe that regime shifts contain the possibility of significant impact on firms policy choices. For example, business cycle expansion and contraction regimes potentially have sizable effects on the profitability or riskiness of investment and, hence, on firms willingness to invest in physical or human capital. Yet, despite these potential effects, we still know very little about the relation between regime shifts and investment decisions. The idea that shifts in a firm s environment can have first-order effects on its investment policy can be related to the burgeoning literature on investment decisions under uncertainty (see the survey by Dixit and Pindyck [9]). In this literature, investment opportunities are analyzed as options written on real assets and the optimal investment policy is derived by maximizing the value of the option to invest. Because option values depend on the riskiness of the underlying asset, volatility is an important determinant of the optimal investment policy. Despite this observation, models of investment decisions typically presume that this very parameter is fixed. It is not difficult to imagine however that as volatility changes over the business cycle, so does the value-maximizing investment policy. This paper develops a framework to study the behavior of investment when the dynamics of the decision variable are subject to discrete regime shifts at random times. Following Hamilton, we define shifts in regime for a process as episodes across which the behavior of the series is markedly different. To emphasize the impact of regime shifts on investment decisions and capital accumulation, we construct a simple model of capacity choice that builds on earlier work by Pindyck [26] and Abel and Eberly [3]. Specifically, we consider an infinitely lived firm that produces output with its capital stock and variable factors of production. The price of the firm s output fluctuates randomly, yielding a stochastic continuous stream of cash flows. At any time t; the firm can (irreversibly) increase capacity by purchasing capital. Investment arises when the marginal valuation of capital equals the purchase price of capital. Models of investment decisions under uncertainty generally presume that the firm s operating profits are subject to a multiplicative shock that evolves according to a geometric Brownian motion. Implicit in this modeling is the assumption that the Statistical tests of the option theory of irreversible investment typically are specified under this assumption (see for example [8]). In fact, Harchaoui and Lasserre note that the empirical experiment in which agents respond to changes in a [the drift rate] or s [volatility] cannot be experimented within their econometric model because the theoretical model does not yield any analytical solution for this underlying process. In this paper, we provide such a solution. In his survey paper, Chirinko [8, pp. 905 906] also points out the importance of the time-varying volatility for the econometric specification of investment equations.

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 39 firm s growth prospects do not vary over time. This paper solves for the valuemaximizing investment policy when the growth rate and volatility of the marginal revenue product of capital are subject to discrete regime shifts. The analysis demonstrates that, in contrast with standard models of investment, the optimal decision rule is not described by a simple threshold for the marginal revenue product of capital. Instead, the optimal investment policy is characterized by a different threshold for each regime. Moreover, because of the possibility of a regime shift, the value-maximizing threshold in each regime reflects the possibility for the firm to invest in the other regimes. That is, a value-maximizing policy is derived such that in each regime the firm s investment policy is optimal, conditional on the optimal investment policy in the other regimes. An important question is whether regime shifts actually affect growth and capital accumulation. To answer this question, we examine the implications of the model for the optimal rate of investment. These implications are generally consistent with recent evidence on firms investment behavior (see [] or [7]). In particular, the model predicts that investment is intermittent and increasing with marginal q: Moreover, the state space of the dynamic investment problem can be partitioned into various domains including an inaction region where no investment occurs. Outside of this region, the optimal rate of investment can be in one of two regimes: infinitesimal or lumpy. Investment is infinitesimal at the investment threshold. Investment is lumpy in the transient region and at the initial date if the state of the system is in the action region. Also, while it is always optimal to invest in the action region, the optimality of investment is regime dependent in the transient region. That is, regime shifts generate some time-series variation in the present value of future cash flows to current cash flows that may induce the firm to invest following a regime shift. The analysis in the present paper relates to two different strands of literature. First, from an economic point of view, it relates to the investment literature that combines real options features irreversibility and a continuous stochastic process with neoclassical features no indivisibilities. In these models, investment is intermittent and, in the absence of fixed adjustment costs, involves marginal adjustments in the stock of capital (see [26,2,6,3]). When fixed adjustment costs are introduced, investment is intermittent and lumpy, and the optimal policy involves impulse control techniques (see [4] or [7]). In the present paper, there are no fixed adjustment costs. Yet, the optimal investment policy involves both marginal adjustments and jumps in the stock of capital. From a technical viewpoint, the present paper relates to a series of recent papers on option pricing with regime shifts (see [5,6,0]). One of our main contributions is the extension of techniques in these papers to the case of stochastic control problems where control policies change the underlying diffusion process. In particular, we use the solution to the optimal stopping problem derived by Guo [5] to analyze the recurrent investment decision of a firm with divisible capital. Because the firm s problem is homogeneous, the recurrent model displays a structure that is similar to the stopping problem except that the firm obtains a newinvestment option whenever it stops.

40 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 The paper that is most closely related to the present analysis is Driffill and Sola []. These authors also analyze investment decisions when the dynamics of the state variable can shift between several regimes. One essential difference between the two papers is that we examine capacity choice and the valuation of interrelated options whereas they focus on the valuation of a single investment opportunity (in the spirit of McDonald and Siegel [24]). Another important point of departure is that we solve our model analytically whereas they solve their model numerically. Finally, we derive implications for capital accumulation, marginal q; and the user cost of capital, which are not examined in their paper. The remainder of the paper is organized as follows. Section 2 presents the basic model of investment decisions with regime shifts. Section 3 derives the firm s objective function and optimality conditions. Section 4 determines the valuemaximizing investment policy. Section 5 presents simulation results. Section 6 investigates the implications of the optimal investment policy for capital accumulation and growth. Section 7 analyses marginal q and the user cost of capital. Section 8 concludes. 2. The model This paper provides an analysis of investment decisions under uncertainty when the dynamics of the state variable shift between different states at random times. Throughout the paper, agents are risk neutral and discount cash flows at a constant rate r: Time is continuous and uncertainty is modeled by a complete probability space ðo; F; PÞ: For any process ðy t Þ tx0 defined on ðo; F; PÞ; F y ¼ðF y t Þ tx0 denotes the P-augmentation of the filtration ðsðy s ; sptþþ tx0 generated by y: Technology: Consider an infinitely-lived firm that produces output with its capital stock and variable factors of production. Assume for simplicity that the good produced by the firm is not storable so that output equals demand. In addition, suppose that the firm s capital stock depreciates at a constant exponential rate dx0 and that its operating profit is given by a linearly homogenous function p : R þþ R þþ -R þþ satisfying: pðx t ; k t Þ¼ a xa t k a t ; aað0; Þ; ðþ where ðk t Þ tx0 is a nonnegative process representing the firm s capital stock, and ðx t Þ tx0 is a demand shock with law of motion specified below. As shown by Abel and Eberly [3] and Morellec [25], Eq. () is consistent with a price taking firm whose technology exhibits decreasing returns to scale or with a monopolist facing a constant returns to scale technology and a constant elasticity demand curve. At any time t; the firm can increase capacity by purchasing capital at the price p: The capital input is homogenous and perfectly divisible and the firm is a price-taker in the market for capital goods. The optimality of the decision to invest depends on the incremental profits associated with an increase in the capital stock and the price of capital. It also depends on other dimensions of the firm s environment such as

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 4 ongoing uncertainty in profits or the firm s ability to reverse its decisions. Following Pindyck [26], Abel and Eberly [3], and Grenadier [4], we consider that investment is irreversible. 2 In contrast to these studies, we do not assume that ðx t Þ tx0 is governed by a Markov process with constant drift and volatility but instead characterize capital accumulation and investment decisions when the dynamics of the demand shock shift between different states at random times. As shown below, this specification introduces some interesting, yet tractable, variations in the firm s growth prospects. Dynamics of the demand shock: Throughout the paper, the dynamics of the demand shock ðx t Þ tx0 are governed by a Markov regime switching model. Within the current setting, such a model may reflect the impact of the business cycle on the cash flows generated by the firm s assets. Depending on the state of the economy, the dynamics of the demand shift parameter for the good produced by the firm shift from one state to another, in turn changing the dynamics growth rate and volatility of the firm cash flows. Specifically, we presume that the dynamics of ðx t Þ tx0 can shift between two states and are governed by the process: 3 dx t ¼ m eðtþ x t dt þ s eðtþ x t dw t ; x t 40; ð2þ where ðw t Þ tx0 is standard Brownian motion defined on ðo; F; PÞ and ðe t Þ tx0 is a Markov process independent of ðw t Þ tx0 : The pair ðm eðtþ ; s eðtþ Þ takes different values when the process ðe t Þ is in different states. For each state i; there is a known drift parameter m i and a known volatility parameter s i 40: Moreover, while ðx t Þ tx0 is not a Markov process, ðz t Þ tx0 ðx t ; e t Þ tx0 is jointly Markovian if at any time t the state of e t is known. Regime shifts: Assume that ðe t Þ tx0 is observable and that the transition probability of ðe t Þ tx0 follows a Poisson law, such that ðe t Þ tx0 is a two-state Markov chain alternating between states and 2: Let l i 40 denote the rate of leaving state i and t i the time to leave state i: Within our model, the exponential lawholds Pðt i 4tÞ ¼e lit ; i ¼ ; 2 ð3þ and the process eðtþ has the transition matrix between time t and t þ Dt: l Dt l Dt : l 2 Dt l 2 Dt 2 A natural way to introduce irreversibility within the present model is to consider that capital has no resale value. Because the marginal revenue product of capital is bounded from belowby zero, it is never optimal for the firm to sell assets. The model can be extended to consider costly reversibility, abandonment, and the interaction between financing and investment policies. To focus more clearly on the regime shift aspect, we keep these complications out of this paper. 3 This process has been introduced by Guo [5,6] in a model that addresses the pricing of perpetual lookback options. Our paper extends her analysis to the valuation of multiple interrelated options. Obtaining the exact solution (which is of the viscosity type) to the Hamilton Jacobi Bellman equation in our case is analytically more challenging. The nature of the optimal policy is of singular control type, which is similar in spirit to the threshold type stopping rules in [5].

42 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 The above set of assumptions captures the idea that both the drift and volatility parameters of the demand shift may change over time at random dates. That is, unlike traditional models of investment, the present model allows for stochastic regime shifts in the parameters of the underlying state variable. In particular, during an infinitesimal time interval Dt; there is a probability l Dt that these parameters shift from ðm ; s Þ to ðm 2 ; s 2 Þ and a probability l 2 Dt that they shift from ðm 2 ; s 2 Þ to ðm ; s Þ: 4 Statement of the problem: The firm s objective is to determine the investment policy that maximizes the present value of future profits net of investment costs. Given the properties of the profit function (), this investment policy takes the form of a trigger policy that can be described, for every ka½k; þnþ and in each regime i; by a first passage time of ðx t Þ tx0 to a constant threshold xðkþ: While the trigger policy is common to previous models of investment decisions under uncertainty, two major differences arise within the present model. First, because the dynamics of the demand shock depend on the current regime, so does the value-maximizing investment policy. In other words, there exists a different trigger threshold x i ðkþ for each regime i: Second, because of the possibility of a regime shift, the optimal trigger threshold in each regime reflects the possibility for the firm to invest in the other regime. That is, the firm has to determine an investment policy in each regime, while taking into the optimal investment policy in the other regime. 3. Capacity choice with regime shifts This section derives optimality conditions for investment when the firm s profit function satisfies Eq. () and changes in the demand shock are governed by (2). We start by specifying the firm s objective function. Firm s objective function: The firm s objective is to determine the investment policy that maximizes the expected present value of profits net of investment costs. Following Bertola and Caballero [6], we denote by ðg t Þ tx0 the right continuous, nonnegative process that represents cumulative gross investment at time t: Assume that ðg t Þ tx0 is progressively measurable with respect to ðf ðx;eþ t Þ tx0 : Within the present model, the net change of capital stock at time t satisfies dk t ¼ dg t dk t dt and firm value can be written in each regime i as Vðx t ; k t ; iþ max E fdg tþu X0g Z þn 0 e ru ½pðx tþu ; k tþu Þdu pdg tþu ŠjF ðx;eþ t : ð4þ In this equation, Eð:jF ðx;eþ t Þ is the expectation operator associated with the measure P conditional on the information available at time t: Moreover, since G t is not differentiable, the last term in Eq. (4) has to be interpreted as a Stieltjes integral. Because the demand shift ðx t Þ tx0 is governed by the Markov regime switching process (2), the relevant state space is fðx; eþ : xar þþ ; e ¼ ; 2g: This implies that the 4 The assumption of 2-state regime shifts is made here for tractability. Hamilton [7], Bansal and Zhou [5] and Guo [5] also model the regime shift process as a finite state Markov process.

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 43 optimization problem (4) is more difficult to solve than traditional models of investment (see [26]) since there can be a discontinuous jump over the investment boundary when the process ðe t Þ tx0 shifts from one state to another. This also implies that the model can generate richer investment strategies than one-regime models. In particular, we show below that the firm may increase capacity either following an increase of the demand shock in a given regime or following a regime shift. Solution technique: Let x i ðkþ be the value of the demand shock that triggers investment in regime i: Depending on parameter values, the two thresholds may be ordered differently. For expositional purpose, we analyze the case where x 2 ðkþ4x ðkþ for ka½k; þnþ: However, we present a complete characterization of the solution in Theorem. Using standard techniques, it is possible to showthat the Hamilton Jacobi Bellman equation associated with the optimization problem (4) is rvðx t ; k t ; e t Þ¼pðx t ; k t Þ dkv k ðx t ; k t ; e t Þþm et xv x ðx t ; k t ; e t Þ þ 2 s2 e t x 2 V xx ðx t ; k t ; e t Þþl et ½Vðx t ; k t ; 3 e t Þ Vðx t ; k t ; e t ÞŠ; ð5þ where the Kuhn Tucker conditions for the maximization are V k ðx t ; k t ; e t Þpp; dg t X0and½V k ðx t ; k t ; e t Þ pšdg t ¼ 0; 8tX0: The left-hand side of (5) reflects the required rate of return for investing in the firm. The right-hand side is the expected change in firm value in the region for the state variable where the firm does not invest. This equation is similar to that obtained in one-regime investment models where the state variable is governed by a diffusion process. 5 However, it contains an additional term l et ½Vðx t ; k t ; 3 e t Þ Vðx t ; k t ; e t ÞŠ; that reflects the impact of the possibility of a regime shift on the value function. This term corresponds to the probability weighted change in firm value due to a regime shift. Eq. (5) holds identically in k: Thus, the partial derivative of the left-hand side with respect to k equals the partial derivative of the right-hand side with respect to k: Performing this partial differentiation yields: rv k ðx t ; k t ; e t Þ¼p k ðx t ; k t Þ d½v k ðx t ; k t ; e t ÞþkV kk ðx t ; k t ; e t ÞŠ þ m et xv xk ðx t ; k t ; e t Þþ s2 e t 2 x2 V xxk ðx t ; k t ; e t Þ þ l et ½V k ðx t ; k t ; 3 e t Þ V k ðx t ; k t ; e t ÞŠ: ð6þ 5 In the diffusion case, the demand shift parameter is governed by the geometric Brownian motion dx t ¼ mx t dt þ sx t dw t : By an application of Itoˆ s lemma, the expected change in firm value per unit of time is then given by dt E½dVðx; kþš ¼ dkv kðx; kþþmxv x ðx; kþþ 2 s2 x 2 Vxx 2 ðx; kþ; where subscripts denote partial derivatives. The equilibrium expected return on firm value is r: Combining this condition with the above equation gives the differential equation: rvðx; kþ ¼pðx; kþ dkv k ðx; kþþmxv x ðx; kþþ 2 s2 x x2 V xx ðx; kþ; which is solved subject to appropriate boundary conditions.

44 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 To solve Eq. (6), we will use the fact that the value function V is homogenous of degree one in x and k: This property of the value function implies that the marginal valuation of capital V k is homogenous of degree zero in x t and k t and, hence, can be written simply as a function of y t ; the ratio of x t to k t : Define y i ¼ x i ðkþ=k: Then x 2 ðkþ4x ðkþ implies y 2 4y : Define the marginal valuation of capital in regime i by: q i ðyþ ¼V k ðx; k; iþ: ð7þ Differentiating this equation and using the definition of y yields expressions for the partial derivatives of the value-function. Substituting the definition of qðyþ and its partial derivatives in Eq. (6) yields the following system of second-order ordinary differential equations for the marginal valuation of capital q i ðyþ: * On the region ypy ; ðr þ dþq ðyþ ¼y a þðm þ dþyq 0 ðyþþ 2 s2 y2 q 00 ðyþþl ½q 2 ðyþ q ðyþš; ð8þ ðr þ dþq 2 ðyþ ¼y a þðm 2 þ dþyq 0 2 ðyþþ 2 s2 2 y2 q 00 2 ðyþþl 2½q ðyþ q 2 ðyþš: ð9þ * On the region y pypy 2 ; ðr þ dþq 2 ðyþ ¼y a þðm 2 þ dþyq 0 2 ðyþþ 2 s2 2 y2 q 00 2 ðyþþl 2½p q 2 ðyþš: ð0þ The sets ð0; y Š and ½y 2 ; NÞ are the inaction region and the action region, respectively. We followguo [4] and call the set ½y ; y 2Š the transient region. Fig. illustrates these regions. By definition of the barrier policy (see [9]), the firm makes a discrete adjustment in its capital stock, from k to k; at the time of a shift from regime 2 to regime on the region y % pypy 2 with:6 k ¼ supfka½k; þnþ : V k ðx; k; ÞXpg: % 6 Heuristically, one can derive the optimality of this policy following the arguments of Dixit and Pindyck [9] for impulse control of Brownian motion. Consider a small time interval dt: Since decisions are made continuously, we will be interested in the limit as dt-0: Suppose that the firm does not adjust capacity over the time interval dt and then increases capacity to % k at the end of this interval. The resulting value is pðx t ; k t ; e t Þdt þ e rdt E xt;et ½Vðx tþdt ; k; e tþdt Þ pð k k t ÞŠ: % % Because the profit function pð:þ is concave in k; so is the value function Vð:Þ: This concavity property ensures that the solution to the firm s optimization problem can be found using the familiar Kuhn Tucker conditions. The derivative of the above expression with respect to k is % e rdt E½V k ðx tþdt ; k; e tþdt Þ pš: % As dt-0; this expression tends to V k ðx t ; k; e t Þ p: Note that irreversibility requires kxk: Suppose that at % % the time of a regime shift we have V k ðx t ; k; e t Þ4p: Since the value function is concave in k; this in turn implies that the optimal policy is to set k at the level defined by the first-order condition V k ðx t ; k; e t Þ¼p by instantaneously installing the amount of % capital k k: % % ðþ

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 45 x Action Region x * 3 i (k) Transient Region x * i (k) Inaction Region (a) k x x * 3 i (k) Impulse control x * i (k) V k (x,k,i) = p Barrier control V k (x,k,i) < p (b) k Fig.. Regime shifts and investment policy. (a) Represents the value-maximizing investment policy as a function of k: This investment policy requires the firm to invest in regime i if x t exceeds x i : There exists a region for the state variable x for which a shift from regime 3 i to regime i triggers investment. This region is called the transient region. (b) Represents the optimal investment policy in regime i: This investment policy is a mixture of impulse control in the transient region and barrier or diffusion control at x i ðkþ: That is, when y ¼ x=ka½y ; y 2Š; it is optimal for the firm to have a lumpy adjustment in capacity following a regime shift by moving the point ðx; kþ horizontally to the curve x ðkþ: Using the equality Vðx; k; Þþpð % k kþ ¼Vðx; % k; Þ; ko % k; ð2þ which reflects the fact that the value function is just the known value function at the terminal point of the jump minus the cost of investment, it is immediate to see that V k ðx; k; Þ ¼p; or q ðyþ ¼p on the region ½y ; y 2Š: Sections 5 and 6 will provide a more detailed analysis of the nature of the optimal investment policy. The optimization problem (4) can be solved using the set of ODEs (8) (0) and appropriate boundary conditions. One boundary condition is given by requiring that, as the demand shift decreases, the marginal valuation of capital remains finite.

46 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 This condition can be written as lim q i ðyþon; i ¼ ; 2: ð3þ yk0 Now, suppose that the firm exercises its expansion option when the state variable y reaches a trigger value y i x i =k: At that time, k increases by the infinitesimal increment dk and the firm pays pdk: Thus, the following condition is satisfied: Vðx i ; k; iþ ¼Vðx i ; k þ dk; iþ pdk; i ¼ ; 2: Dividing by the increment dk; these conditions can be written in derivative form as q i ðy i Þ¼p; i ¼ ; 2: ð4þ As shown by (4), the marginal valuation of capital equals the purchase price of capital when the firm is undertaking investment. To ensure that investment occurs along the optimal path, we also require a continuity of the slopes at the endogenous investment thresholds: V x ðx i ; k; iþ ¼V xðx i ; k þ dk; iþ; i ¼ ; 2: These high-contact conditions can be written in derivative form as (see [2]): q 0 i ðy i Þ¼0; i ¼ ; 2: ð5þ Finally, because the marginal revenue product of capital p k ð:þ is a (piecewise) continuous, borel-bounded function, the marginal value-functions q i ð:þ are piecewise C 2 (see [22, Theorem 4.9, p. 27]). Therefore, the marginal valuation of capital is C 0 and C and satisfies the following conditions: lim q 2 ðyþ ¼lim q yky ymy 2 ðyþ; ð6þ lim q 0 yky 2ðyÞ ¼lim q 0 ymy 2 ðyþ; ð7þ which ensure the smoothness of the marginal value function q 2 ð:þ at the boundary between the inaction region and the transient region. 4. Value-maximizing investment policy Using the set of ODEs (8) (0) and the boundary conditions (4) (7), it is possible to characterize the value-maximizing investment policy. Before presenting the solution to the firm s optimization problem, we introduce the following notations. Let g and g 2 be the two positive real roots of the quartic equation H ðgþh 2 ðgþ ¼l l 2 ð8þ and let b and b 2 be the two real roots of the quadratic equation H 2 ðbþ ¼0 ð9þ and b and b 2 be the two real roots of the quadratic equation H ðbþ ¼0;

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 47 where H i ðgþ r þ d þ l i gðm i þ dþ 2 s2 i gðg Þ: ð20þ Define l i ; b l i ; and F i ; i ¼ ; 2; by l i r þ d þ l g l i ðm þ dþ 2 g iðg i Þs 2 ; ð2þ b li r þ d þ l 2 g l i ðm 2 þ dþ 2 2 g iðg i Þs 2 2 ; ð22þ F i r þ d þ l þ l 2 aðm 3 i þ dþ 2 s2 3 iaða Þ : ð23þ H ðaþh 2 ðaþ l l 2 The following results. Theorem. Assume that H i ðaþ40; F i 40: If there exists a solution RAð0; Þ to the nonlinear equation b 2 R b b R b 2 b 2 b ða b ÞR b 2 ða b 2 ÞR b ðb 2 b ÞH 2 ðaþ ¼ b 2 ða b ÞR b 2 b ða b 2 ÞR b ðb 2 b ÞH 2 ðaþ rþd rþdþl 2 þ l 2 rþdþl 2 þ l 2g l g 2 g 2 g þ½f 2 þ l ða g 2 Þ l 2 ða g Þ g 2 g F H 2 ðaþ ŠRa b b 2 ðr b R b 2 Þ rþd b 2 b rþdþl 2 þ g g 2 ðl 2 l Þ g 2 g h ; ð24þ þ af 2 þ g l ða g 2 Þ g 2 l 2 ða g Þ g 2 g F a H 2 ðaþ ir a then the investment policy that maximizes firm value is characterized by the investment thresholds y and y 2 satisfying y ¼ Ry 2 ð25þ and ðy 2 Þa ¼ p b 2 R b b R b 2 b 2 b ða b ÞR b 2 ða b 2 ÞR b ðb 2 b ÞH 2 ðaþ rþd rþdþl 2 þ l 2 rþdþl 2 þ l 2g l g 2 g 2 g h : ð26þ þ F 2 þ l ða g 2 Þ l 2 ða g Þ g 2 g F H 2 ðaþ ir a Otherwise, there exists a solution RAð0; Þ to the nonlinear equation: b b2 R b b b b R b b 2 b b2 b b ða b b ÞR b b 2 ða b b2 ÞR b b ðb b2 b b ÞH ðaþ ¼ rþd rþdþl þ l rþdþl þ b l 2 g b l g 2 g 2 g þ F þ b l ða g 2 Þ b l2 ða g Þ g 2 g F 2 H ðaþ b b b b b b2 ðr R 2 Þ rþd b rþdþl b2 b b þ g g 2 ðb l2 b l Þ g 2 g b b2 ða b b b ÞR 2 b b ða b b b2 ÞR þ af þ g b ; ð27þ l ða g 2 Þ g 2 b l2 ða g Þ g ðb b2 b b ÞH ðaþ 2 g F 2 a H ðaþ R a R a

48 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 and the optimal investment policy is characterized by the thresholds y and y 2 defined by y 2 ¼ Ry ð28þ and b b b2 R b b b R 2 rþd b rþdþl b2 b þ l rþdþl þ b l 2 g b l g 2 g b 2 g ðy Þa ¼ p ða b b ÞR b b 2 ða b b2 ÞR b b ðb b2 b b ÞH ðaþ þ F þ b : l ða g 2 Þ b l2 ða g Þ g 2 g F 2 H ðaþ R a Proof. See Appendix A. & Remark. Eq. (8) must have two positive real roots. To see this, define hðgþ ¼H ðgþh 2 ðgþ l l 2 : ð29þ Then, h is continuous and satisfies hð0þ40; hð NÞ40; hðnþ40; and hðb i Þ¼ l l 2 o0; i ¼ ; 2: Since b b 2 ¼ 2ðr þ d þ l 2 Þ=s 2 2o0; it follows that the equation hðgþ ¼0 has two positive roots by the intermediate value theorem. 5. Discussion and simulations Theorem characterizes the investment policy that maximizes firm value when the dynamics of the demand shift are governed by (2). This investment policy takes the form of a trigger policy and there exists one trigger threshold for each regime. Since the two regimes are related to one another (through the persistence parameters l i ), the trigger function in each regime has to reflect the possibility for the firm to adjust capacity in the other regime. In other words, the firm has to determine an exercise strategy for its options to adjust capacity in each regime, while taking into account the optimal investment strategy in the other regime. Theorem demonstrates that when determining the timing of investment, the firm balances the marginal increase in expected cash flows with purchase price of assets. This trade-off shows up for example in Eq. (26) which can be written as (remembering by () that p k ¼ y a ): F 2 p k ðx 2 ; k tþ¼py ð30þ in which x 2 y 2 =k; F 2 is defined in Eq. (23), and Y is a positive constant. The lefthand side of Eq. (30) accounts for the change in the expected present value of the firm cash flows associated with a marginal increase of capacity in regime 2 when x ¼ x 2 : That is, using the Feynman Kac theorem, it is possible to showthat the following equality holds: Z þn F i p k ðx t ; k t Þ¼E x t;i e ðrþdþu p k ðx tþu ; k tþu Þdu ; ð3þ 0

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 49 where E x;i ð:þ is the expectation operator associated with the measure P conditional on x t ¼ x and e t ¼ i: The right-hand side of (30) is the cost associated with an increase in capacity. As usual for investment decisions under uncertainty, this cost has two components: The purchase price of capital p and the value of waiting to invest represented by Y: Thus, for a given productivity of assets, the investment threshold should decrease with those very parameters that increase Y: At the same time, the decision to invest should be hastened by smaller costs of exercising the option. This second effect is directly illustrated by Theorem that shows that the thresholds y i ; i ¼ ; 2; are linearly increasing in the purchase price of capital p: An analogy with option pricing theory tells us that input parameters such as the drift, volatility, and the persistence in each regime should enter the decision to invest. Consider first the impact of the persistence in regimes on the optimal investment strategy. Because the persistence in regimes reflects the opportunity cost of investing in one regime vs. the other, the ratio of the two investment thresholds is affected by its changes. Specifically, a lower persistence of regime i (i.e. a higher l i ) reduces the opportunity cost of investing in regime i; and hence narrows the gap between the investment thresholds in the two regimes. Consider next the impact of the drift and volatility parameters. Traditional investment models show that the option of waiting to invest has more value when uncertainty is greater (see [24] or [26]). This implies that in each regime i the investment threshold y i increases with s i : This also implies that the ratio y 2 =y (resp. y =y 2 ) increases with the volatility of regime 2 (resp. regime ) and decreases with the volatility of regime (resp. regime 2). Additionally, the ratio y 2 =y decreases with the drift of the gain process in regime and increases with the drift of the gain process in regime 2. (This effect essentially arises because of the impact of the drift parameter on F i :) Finally, two additional results are worth being mentioned. First, the impact of the drift and volatility parameters on the value-maximizing investment thresholds is not as important as in traditional real options model because of the possibility of a regime shift. Second, whenever l i a0; changes in the dynamics of the demand shock in regime i affect not only the investment threshold in that regime ðy i Þ but also the investment threshold in the other regime ðy 3 i Þ: Table provides a number of simulation results relating the ratio R ¼ y =y 2 of the two trigger thresholds to input parameter values. The base case environment is as follows: The risk-free interest rate r ¼ 6%; the depreciation rate d ¼ 0; the drift and volatility parameters in the first regime m ¼ 0:04 and s ¼ 0:2; the drift and volatility parameters in the second regime m 2 ¼ 0:0 and s 2 ¼ 0:3; the persistence of the gain process l ¼ 0:5 and l 2 ¼ 0:; and the productivity of assets in place a ¼ 0:47: 7 Results in Table are consistent with the above discussion. They also 7 The profit function described by Eq. () can be approximated as follows. Let the firm production be Cobb Douglas and homogeneous of degree one with respect to capital and labor, with capital share f: Let the demand faced by the firm be isoelastic, with price elasticity =ðy Þ: It follows from this specification that the share of profits going to capital depends on f and y through the following relation: a ¼ð yþf=ð yfþ: Labor s share of national income in U.S. postwar data has been relatively constant over time at f ¼ 0:64 despite the increase in real wages (see [23]). If y ¼ 0:5; we have ad0:47:

50 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 Table Simulation results r 4% 5% 6% 7% 8% 9% R 0.762 0.7704 0.7784 0.7856 0.7920 0.7978 m 0.02 0.03 0.04 0.05 0.06 0.07 R 0.8064 0.797 0.7784 0.7664 0.7557 0.7462 m 2 0.04 0.08 0.2 0.6 0.2 0.24 R 0.8236 0.8830 0.9373 0.9834.077.0434 s 0. 0.2 0.3 0.4 0.5 0.6 R 0.6596 0.7784 0.9427.675.4557.853 s 2 0. 0.2 0.3 0.4 0.5 0.6 R.545 0.9447 0.7784 0.6397 0.5249 0.4307 l 0.05 0. 0.5 0.2 0.25 0.3 R 0.7309 0.758 0.7784 0.7944 0.8073 0.88 l 2 0.05 0. 0.5 0.2 0.25 0.3 R 0.7658 0.7784 0.7890 0.7982 0.8062 0.832 The Table provides comparative statics regarding the ratio of the investment thresholds R ¼ y =y 2 : Input parameter values are set as follows: The risk-free interest rate r ¼ 6% the depreciation rate d ¼ 0; the drift and volatility parameters in regime : m ¼ 0:04 and s ¼ 0:2; the drift and volatility parameters in regime 2: m 2 ¼ 0:0 and s 2 ¼ 0:3; the persistence of the demand shock l ¼ 0:5 and l 2 ¼ 0:; and the productivity of assets in place a ¼ 0:53: The effects of changing these parameters are also examined. reveal that depending on parameter values, the two investment thresholds may switch orders. Some of the effects discussed above are also depicted in Fig. 2 which plots the ratio R ¼ y 2 =y as a function of the volatility and persistence of the gain process in the base case environment (where input parameters are such that y 2 4y ). Consistent with the above arguments, Fig. 2 reveals that for a given degree of persistence in regimes, a higher volatility of the demand shift parameter in regime 2 increases the gap between the investment thresholds in the two regimes. For a given volatility of the demand shift parameter, a decrease in the degree of persistence in regimes (i.e. an increase in l i ) narrows the gap between the two thresholds. 6. Implications for capital accumulation Theorem characterizes the investment policy that maximizes firm value when the dynamics of the demand shock shift between two states at random times. While this investment policy takes the form of a trigger policy as in traditional one-regime

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 5.4.38 R.36.34.32 (a) 0.32 0.34 0.36 0.38 0.4 σ 2 R.95.9.85.8.75.7.65 (b) 0.5 0.2 0.25 0.3 Fig. 2. Ratio of the investment thresholds. The figure plots the ratio R ¼ y =y 2 relating the investment thresholds in the two regimes as a function of the volatility and persistence of the marginal revenue product of capital. Input parameter values for the base case environment are set as follows: The risk-free interest rate r ¼ 6%; the depreciation rate d ¼ 0; the drift and volatility parameters in regime : m ¼ 0:04 and s ¼ 0:2; the drift and volatility parameters in regime 2: m 2 ¼ 0:0 and s 2 ¼ 0:3; the persistence of the demand shock l ¼ 0:5 and l 2 ¼ 0:; and the productivity of assets in place a ¼ 0:53: In this environment we have y 2 4y and R 4: (a) Investment threshold ratio R as a function of s 2 ; (b) investment threshold ratio R as a function of l 2 : λ 2 models, two major differences arise within the present model. First, this optimal investment policy is characterized by a different trigger threshold x i ðkþ for each regime i: This implies that, while there exists a region of the state space, the action region, where it is optimal to invest independently of the current regime ða ¼ fðx; eþar þþ f; 2g : V k ðx; k; eþxpg), there exists another region, the transient region, where it is only optimal to invest if e is in state ðr ¼ fðx; eþar þþ f; 2g : V k ðx; k; Þ ¼p; V k ðx; k; 2ÞopgÞ: Second, because of the possibility of a regime shift, the optimal trigger threshold in each regime reflects the possibility for the firm to invest in the other regime. In particular, the transient region R is non empty whenever l i a0; i ¼ ; 2: An important question is whether regime shifts actually affect growth and capital accumulation. To answer this question, it is necessary to examine the implications of the value-maximizing investment policy for the rate of investment. One important prediction of the present model is that discrete adjustments in the firm s capital stock can occur several times throughout the lifetime of the firm, even though there are no fixed adjustment costs in the model. This is in contrast with traditional models of capacity adjustment in which investment is infinitesimal in the absence of fixed costs and such a discrete adjustment may occur only at the initial

52 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 instant if the state of the system is above the optimal investment curve x i ðkþ:8 For instance, Dixit and Pindyck [9, p. 362] note: At the initial instant the point [of the system] may be above the [investment] curve either because nonoptimal policies were followed in the past or because some unexpected shock just moved the curve. The analysis in Sections 3 and 4 shows that when the demand shock follows the Markov regime switching model (2), such unexpected shocks may arise at random times in the future, inducing lumpy adjustments in capacity. In other words, the optimal investment behavior of the firm can be potentially characterized by three regimes. When the demand shock is belowthe investment curve x i ðkþ in regime i; the optimal rate of investment is zero. When the demand shock reaches this curve from below, it is optimal to adjust marginally the capital stock. When the demand shock reaches the lowest of the two investment curves from above, the adjustment of capacity follows a regime shift and is discrete. This investment policy is consistent with the evidence reported by Abel and Eberly []. Using panel data to estimate a model of optimal investment, they find that there is a temporal concentration of investment investment is intermittent and that the rate of investment typically is very small but occasionally exhibits some spurts of growth. Interestingly, there is an asymmetry between the highest investment curve and the lowest one. In fact, because we presume that investment is irreversible, a shift in capital only occurs if the situation brightens up (a shift from the regime with the highest curve to the regime with the lowest curve). In addition, the size of the jump in capacity following a regime shift is not constant but depends on the value of the demand shock at the time of the regime shift as well as current firm size. This property of the optimal investment policy provides an important step towards the realistic and empirically important feature that units do not always wait for the same stock disequilibrium to adjust, and that adjustments are not always the same size across firms and for the same firm over time [...] [7]. To see this, assume that parameter values are such that H i ðaþ40; F i 40; and x 2 4x : In addition, suppose that the state is currently in regime 2, eðtþ ¼2; and belongs to the transient region, x t A½x ðkþ; x 2ðkÞŠ: Then, a shift in regimes induces a discrete adjustment in firm size from k to k; in which k satisfies: % % k ¼fkA½k; NÞ : x % ðkþ ¼x tg: ð32þ Eq. (32) shows that the jump in capacity following a regime shift in the transient region is given by k k; where k is the capital stock on the curve x % % ðkþ such that the point ðx t ; kþ moves horizontally to this curve. This feature of the optimal investment policy can be better understood by reformulating the optimal policy in terms of marginal revenue product of capital (see Section 7). Optimality requires the firm to adjust its capital stock as needed to maintain the marginal revenue product of capital 8 Models that include fixed costs of adjustments also have jumps in the capital stock. See for example [4] or [7]. The former paper generalizes the results in Hayashi [20] to the stochastic case and characterizes the optimal investment policy in the presence of adjustment costs. The latter develops an ðs; sþ model of investment in which adjustment costs are time-varying and capacity adjustments are lumpy and differ in size.

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 53 y a ¼ðx t =kþ a equal to ðy Þa given in Theorem. Using (32), we see that optimality then implies an increase in capacity from k to % k defined by or x t k ¼ x ð kþ % ¼ y k % % 2 k ¼ x t4 % R ða b ÞR b 2 ða b 2 ÞR b H 2 ðaþ ðb 2 b ÞH 2 ðaþ þ F 2 þ l ða g 2 Þ l 2 ða g Þ g 2 g F p b 2R b b R b 2 rþd b 2 b rþdþl 2 þ l 2 rþdþl 2 þ l 2g l g 2 g 2 g R a 3 a 5 : ð33þ Thus, an additional implication of the model is that the size of the jump following a regime shift is increasing with the contemporaneous value of the demand shock x: Since marginal q also increases with x; this in turn implies that the size of the jump increases with marginal q: 7. Marginal Q and the user cost of capital The analysis so far has focused on the characterization of the dynamic behavior of investment when changes in the demand shift parameter are governed by (2). Another question of interest relates to the determinants of marginal q and the user cost of capital in such an environment. Marginal q: Section 4 characterizes the investment policy that maximizes firm value. This investment policy relies on the boundary conditions (4) and (5) that ensure the smoothness of the marginal value functions at the selected trigger levels. In addition to providing a solution to the firm s problem, the system of ODEs (4) and (5) allows for a determination of the marginal valuation of capital, i.e. scaled marginal q: In particular, we have the following result. Theorem 2. Assume that H i ðaþ40; F i 40; and y 2 4y where the trigger levels y and y 2 are defined in Theorem. Then, the marginal valuation of capital in regime i is given by V k ðx; k; iþ ¼q i ðyþ; i ¼ ; 2; ð34þ where q ðyþ ¼ A y g þ A2 y g 2 þ F y a ; ypy ; p; yxy ; ð35þ and 8 l A y g þ l2 A 2 y g 2 þ F2 y a ; ypy >< ; q 2 ðyþ ¼ C y b þ C2 y b y a 2 þ H 2 ðaþ þ l 2 p ; y r þ d þ l pypy 2 ; ð36þ >: 2 p; yxy 2 :

54 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 In Eqs. (35) and (36) the factors H i ; g i ; b i and l i are determined by Eqs. (8) (20). In addition, the factors A ; A 2 ; C and C 2 are defined by A ¼ ðg 2 g Þðy ½g Þg 2p þða g 2 ÞF ðy Þa Š; ð37þ and A 2 ¼ ðg g 2 Þðy Þg 2 ½g p þða g ÞF ðy Þa Š ða b C ¼ 2 Þðy 2 Þa ðb 2 b Þðy 2 Þb H 2 ðaþ ða b C 2 ¼ Þðy 2 Þa ðb b 2 Þðy 2 Þb 2 H 2 ðaþ þ b 2ðr þ dþp r þ d þ l 2 þ b ðr þ dþp r þ d þ l 2 ð38þ ; ð39þ : ð40þ Discussion: Theorem 2 provides a characterization of the marginal valuation of capital when the dynamics of the gain process are governed by the Markov regime switching model (2) and the firm follows the investment policy derived in Theorem. These expressions generalize those that characterize marginal q in the diffusion case to incorporate possible regime shifts in the dynamics of operating profits. Indeed, it is immediate to see that when l ¼ l 2 ¼ 0; Eqs. (35) and (36) simplify to (see for example the value of marginal q in the transient region): qðyþ ¼A y b y a y þ r þ d aðm þ dþ ð4þ 2 s2 aða Þ in which A ¼ a a b po0 and y is the value-maximizing investment threshold defined by ðy Þ a ¼ b b a r þ d aðm þ dþ 2 s2 aða Þ p; ð42þ where b is the positive root of the quadratic equation r þ d ðm þ dþb 2 s2 bðb Þ ¼0: ð43þ Eq. (4) shows that in traditional models of capacity choice, 9 the marginal valuation of capital has two components: The contribution of this marginal unit to the profit flow(second term on the right-hand side) and the marginal option value to adjust capacity (first term on the right-hand side). Note that this second component is negative since when the firm invests in a marginal unit of capital it gives up the valuable option of waiting to invest in this unit. 9 See for example [26,3,6].

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 55 Theorem 2 reveals that the expression for marginal q is more complex when changes in demand shift parameter are governed by Eq. (2). In the inaction region for example, marginal q has three components. First, it incorporates the expected present value of the profits generated by the marginal unit of capital. Second, it reflects the change in marginal q due to a potential regime shift. Third, it captures the change in marginal q arising if and when the decision variable reaches the investment boundary y i : In the transient region ½y ; y 2Š; the marginal valuation of capital has four components and can be written as q 2 ðyþ ¼C y b þ C ffl{zfflffl} 2 y b 2 þ y a =H fflffl{zfflffl} 2 ðaþ þ l fflfflfflfflffl{zfflfflfflfflffl} 2 p=ðr þ d þ l 2 Þ : fflfflfflfflfflfflfflfflfflfflfflfflffl{zfflfflfflfflfflfflfflfflfflfflfflfflffl} ðþ ð2þ ð3þ ð4þ The first term on the right-hand side of this equation accounts for the change in value arising if and when the demand shift parameter reaches the investment boundary y 2 : The second term represents the change in value arising if and when the demand shift parameter reaches the lower boundary of the transient region. The third term is the expected present value of the profits generated by the marginal unit of capital. The fourth term reflects the probability weighted change in value arising from a regime shift. Finally, it is interesting to note that when the state variable reaches the lower boundary of the transient region, there is a single exogenous change in the marginal valuation of capital. This change in value arises from the fact that a switch in the process eðtþ does not trigger the investment in the inaction region whereas it triggers investment in the transient region. When the value of the state variable reaches the action region, this exogenous change is accompanied by an endogenous change. In that case, the firm exercises its option to adjust capacity marginally and the valuemaximizing policy is determined in Theorem. User cost of capital: In standard neoclassical models, the capital stock is adjusted continuously so as to maintain the marginal revenue product of capital equal to the user cost of capital. With irreversibility and uncertainty, there exists a user cost of capital c for purchasing capital and the optimal policy is to purchase capital as needed to prevent the marginal revenue product of capital from rising above c : Within the present model, the user cost of capital is defined by c i ðr þ dþq i ðyþ dt Ey;i ðdq i ðyþþ; i ¼ ; 2: ð44þ As noted by Abel and Eberly [3], with uncertainty and irreversibility it is not the purchase price of capital which is relevant for the user cost of capital but rather its shadowprice, qðyþ: Moreover, as shown by Eq. (4), these two prices differ unless the firm is actually purchasing capital 0. Applying Itoˆ s lemma to q i ðyþ yields: c i ¼ðr þ dþq i ðyþ ðm i þ dþyq 0 i ðyþ 2 s2 i y2 t q00 i ðyþ l i½q 3 i ðyþ q i ðyþš: ð45þ 0 In the analysis of Jorgenson [2], investment is costlessly reversible and marginal q is always equal to the purchase/sale price of capital.

56 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 Plugging this expression for the user cost of capital in the system of ODEs yield c i ¼ y a ; i ¼ ; 2: ð46þ Eq. (46) demonstrates that, for a given value of the demand shift parameter in the inaction region, the user cost of capital does not depend on the current regime. By contrast, the potential range of values for the user cost of capital is regime dependent. In particular, the user cost of capital relevant for purchasing capital is c ¼ðy Þa in regime whereas it is c 2 ¼ðy 2 Þa 4c in regime 2. This feature of the model in turn implies that the marginal revenue product of capital belongs to ð0; c i Š in regime i: In other words, the set of values for the marginal revenue product of capital in regime is strictly included in the set of values for the marginal revenue product of capital in regime 2. In addition, for ya½y ; y 2Š the ratio of the marginal revenue product of capital in regime 2 to the marginal revenue product of capital in regime deviates from and increases with y until the point y ¼ y 2 where it reaches a maximum of R a with R y =y 2 : Because the ratio of the two investment thresholds depend on the drift and volatility parameters of the two regimes and the persistence in regimes, so does the ratio of the two marginal revenue product of capital in the transient region. This result again emphasizes the regime-dependent nature of the optimal policy. 8. Conclusion This paper has analyzed investment decisions under uncertainty when the dynamics of the decision variable growth rate and diffusion coefficient shift between different states at random times. The main analytical result of the paper is that the value-maximizing investment policy is such that in each regime the firm s investment policy is optimal, conditional on the optimal investment policy in the other regimes. This optimal investment policy is characterized by a different investment curve for each regime. Moreover, because of the possibility of a regime shift, the investment curve in each regime reflects the possibility for the firm to invest in the other regime. To determine the implications of the model for investment decisions and capital accumulation, we showed that the state space of the dynamic investment problem can be partitioned into various domains including an inaction region where no investment occurs. Outside of this region, the optimal rate of investment can be in one of two regimes: infinitesimal or lumpy. Investment is infinitesimal following an increase of the firm cash flows in a given regime. Investment is lumpy following a shift from the regime with the highest investment curve to the regime with the lowest one. That is, the model predicts that with irreversibility and regime shifts investment is intermittent and increases with marginal q: Moreover, the optimal rate of investment typically is very small but occasionally exhibits some spurts of capacity expansion. These predictions are generally consistent with the available empirical evidence on firms investment behavior (see [7] or []). The paper also provided an

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 57 analysis of the determinants of marginal q and the user cost of capital in such an environment. Acknowledgments We thank Darrell Duffie, Steve Grenadier, Chris Hennessy, Iulian Obreja, Jacob Sagi, the associate editor, two anonymous referees, and seminar participants at HEC Montreal, McGill University, Stanford GSB and U.C. Berkeley for helpful comments. Erwan Morellec acknowledges financial support from NCCR FINRISK. The usual caveat applies. AppendixA. Proof of Theorem We present the case where y 2 4y : The other case follows from a symmetric argument. The general solutions to Eqs. (8) and (9) are q i ðyþ ¼ X4 j¼ A i;j y g j þ F i y a ; i ¼ ; 2: ða:þ We set g j 40 for j ¼ ; 2 and g j o0 for j ¼ 3; 4 by convention. The no-bubbles condition (3) implies that A i;j ¼ 0 for j ¼ 3; 4 which in turn implies that Eq. (A.) reduces to q i ðyþ ¼A i; y g þ A i;2 y g 2 þ F i y a ; i ¼ ; 2: Substituting this solution into (8) and (9) and matching coefficients yield the expressions for F i and g j in (23) and (8), and A 2;j ¼ l j A ;j with l j ¼ r þ d þ l g l j ðm þ dþ 2 g jðg j Þs 2 : Solving Eq. (0) yields: For yaðy ðkþ; y 2 ðkþþ; q 2 ðyþ ¼C y b þ C 2 y b 2 þ ya H 2 ðaþ þ l 2 p ; r þ d þ l 2 where b and b 2 are the two roots of the quadratic equation H 2 ðbþ ¼0: The above set of equations shows that we have 6 unknowns: A ; ; A ;2 ; C ; C 2 ; y ; and y 2 : We thus need 6 equations to identify these variables. They are given by the boundary conditions (4) (7). Plugging the above functions q i ðyþ in the boundary conditions (4) and (5) yields A ; ðy Þg þ A ;2 ðy Þg 2 þ F ðy Þa ¼ p; ða:2þ g A ; ðy Þg þ g 2 A ;2 ðy Þg 2 þ af ðy Þa ¼ 0; ða:3þ

58 X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 C ðy 2 Þb þ C 2 ðy 2 Þb 2 þ ðy 2 Þa H 2 ðaþ þ l 2 p ¼ p r þ d þ l 2 ða:4þ b C ðy 2 Þb þ b 2 C 2 ðy 2 Þb 2 þ aðy 2 Þa ¼ 0: ða:5þ H 2 ðaþ The solution to this set of equations is A ; ¼ ðg 2 g Þðy ½g Þg 2p þða g 2 ÞF ðy Þa Š; ða:6þ A ;2 ¼ ðg g 2 Þðy ½g Þg 2 p þða g ÞF ðy Þa Š; ða:7þ ða b C ¼ 2 Þðy 2 Þa þ b 2ðr þ dþp ; ðb 2 b Þðy 2 Þb H 2 ðaþ r þ d þ l 2 ða:8þ ða b C 2 ¼ Þðy 2 Þa þ b ðr þ dþp : ðb b 2 Þðy 2 Þb 2 H 2 ðaþ r þ d þ l 2 ða:9þ Substituting these expressions in conditions (6) and (7) yields with Ry 2 ¼ y : ðy 2 Þa ¼ p b 2 R b b R b 2 b 2 b F 2 R a þ ða b ÞR b 2 ða b 2 ÞR b ðb 2 b ÞH 2 ðaþ rþd rþdþl 2 þ l 2 rþdþl 2 þ l 2g l g 2 g 2 g þ l ða g 2 Þ l 2 ða g Þ g 2 g F R a Ra H 2 ðaþ ða:0þ and ðy 2 Þa ¼ p b b 2 ðr b R b 2 Þ b 2 b af 2 R a þ b 2ða b ÞR b 2 b ða b 2 ÞR b ðb 2 b ÞH 2 ðaþ Combining (A.0) with (A.) yields Eq. (24). rþd rþdþl 2 þ g g 2 ðl 2 l Þ g 2 g þ g l ða g 2 Þ g 2 l 2 ða g Þ g 2 g F R a ara H 2 ðaþ : ða:þ References [] A. Abel, J. Eberly, Investment and q with fixed costs: an empirical analysis, unpublished manuscript, University of Pennsylvania, 200. [2] A. Abel, J. Eberly, The effects of irreversibility and uncertainty on capital accumulation, J. Mont. Econ. 44 (999) 339 377. [3] A. Abel, J. Eberly, Optimal investment with costly reversibility, Rev. Econ. Stud. 63 (996) 58 593. [4] A. Abel, J. Eberly, A unified model of investment under uncertainty, Amer. Econ. Rev. 84 (994) 369 384. [5] R. Bansal, H. Zhou, Term structure of interest rates with regime shifts, J. Finan. 57 (2002) 997 2043. [6] G. Bertola, R. Caballero, Irreversibility and aggregate investment, Rev. Econ. Stud. 6 (994) 223 246. [7] R. Caballero, E. Engel, Explaining investment dynamics in U.S. manufacturing: a generalized ðs; sþ approach, Econometrica 67 (999) 783 826.

X. Guo et al. / Journal of Economic Theory 22 (2005) 37 59 59 [8] R. Chirinko, Business fixed investment spending: modeling strategies, empirical results, and policy implications, J. Econ. Lit. 3 (993) 875 9. [9] A. Dixit, R. Pindyck, Investment Under Uncertainty, Princeton University Press, Princeton, NJ, 994. [0] J. Driffill, M. Sola, Option pricing and regime switching, unpublished manuscript, University of London, 2000. [] J. Driffill, M. Sola, Irreversible investment and changes in regime, unpublished manuscript, University of London, 200. [2] B. Dumas, Super contact and related optimality conditions, J. Econ. Dynam. Control 5 (200) 675 685. [3] J. Eberly, J. Van Mieghem, Multi-factor dynamic investment under uncertainty, J. Econ. Theory 75 (997) 345 387. [4] S. Grenadier, Option exercise games: an application to the equilibrium investment strategies of firms, Rev. Finan. Stud. 5 (2002) 69 72. [5] X. Guo, An explicit solution to an optimal stopping problem with regime switching, J. Appl. Prob. 38 (200) 464 48. [6] X. Guo, Inside information and stock fluctuations, Ph.D. Dissertation, Rutgers University, 999. [7] J. Hamilton, A newapproach to the economic analysis of nonstationary time series and the business cycle, Econometrica 57 (989) 357 384. [8] T. Harchaoui, P. Lasserre, Testing the option value theory of irreversible investment, Int. Econ. Rev. 42 (200) 4 66. [9] M. Harrison, T. Sellke, A. Taylor, Impulse control of Brownian motion, Math. Operations Res. 8 (983) 454 466. [20] F. Hayashi, Tobin s marginal q and average q: a neoclassical interpretation, Econometrica 50 (982) 23 224. [2] D. Jorgenson, Capital theory and investment behavior, Amer. Econ. Rev. Papers Proc. 53 (963) 247 259. [22] I. Karatzas, S. Shreve, Brownian Motion and Stochastic Calculus, 2nd Edition, Springer, New York, 99. [23] F. Kydland, E. Prescott, Time to build and aggregate fluctuations, Econometrica 50 (982) 345 370. [24] R. McDonald, D. Siegel, The value of waiting to invest, Quart. J. Econ. 0 (986) 707 728. [25] E. Morellec, Asset liquidity, capital structure and secured debt, J. Finan. Econ. 6 (200) 73 206. [26] R. Pindyck, Irreversible investment, capacity choice, and the value of the firm, Amer. Econ. Rev. 78 (988) 969 985.