FORWARD-BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS, LINEAR QUADRATIC STOCHASTIC OPTIMAL CONTROL AND NONZERO SUM DIFFERENTIAL GAMES
|
|
- Roderick Murphy
- 7 years ago
- Views:
Transcription
1 Vol. 18 No. Journal of Sysems Science and Complexiy Apr., 5 FORWARD-BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS, LINEAR QUADRATIC STOCHASTIC OPTIMAL CONTROL AND NONZERO SUM DIFFERENTIAL GAMES WU Zhen (School of Mahemaics and Sysems Science, Shandong Universiy, Jinan 51, China. wuzhen@sdu.edu.cn) Absrac. In his paper, we use he soluions of forward-backward sochasic differenial equaions o ge he explici form of he opimal conrol for linear quadraic sochasic opimal conrol problem and he open-loop Nash equilibrium poin for nonzero sum differenial games problem. We also discuss he solvabiliy of he generalized Riccai equaion sysem and give he linear feedback regulaor for he opimal conrol problem using he soluion of his kind of Riccai equaion sysem. Key words. Sochasic differenial equaions, sochasic opimal conrol, Riccai equaion, nonzero sum sochasic differenial game. 1 Inroducion Le (Ω, F, P ) be a probabiliy space and le {B } be a d-dimensional Brownian moion in his space. We denoe he naural filraion of his Brownian moion by F. We consider he following fully coupled forward-backward sochasic differenial equaions (abbrev. o FBSDE) x = a + b(s, x s, y s, z s )ds + σ(s, x s, y s, z s )db s, y = Φ(x T ) + f(s, x s, y s, z s )ds z s db s, [, T ], where (x, y, z) akes values in R n R n R n d, b, σ and f are mappings wih appropriae dimensions and are, for each fixed (x, y, z), F -progressively measurable. We assume ha hey are Lipschiz wih respec o (x, y, z). T > is an arbirarily prescribed number and he ime inerval is called he ime duraion. To our knowledge, acually here exis wo main mehods in he sudy of FBSDE. Using parial differenial equaion mehod which is sandardized as four seps scheme, J. Ma, P. Proer and J. Yong [1] obained he exisence and uniqueness resul of FBSDE in an arbirarily prescribed ime duraion. Bu hey need he equaion o be non-degenerae and require ha he coefficiens can no be randomly disurbed which is ofen he case in he pracical Received November 11,. Revised Sepember 3, 4. *This work is suppored by he Naional Naural Science Foundaion (Gran No ), he Youh Teacher Foundaion of Fok Ying Tung Educaion Foundaion, he Excellen Young Teachers Program and he Docoral Program Foundaion of MOE and Shandong Province, China.
2 18 WU ZHEN Vol. 18 siuaion such as in financial markes. Using probabilisic mehod, Y. Hu and Peng [] go he exisence and uniqueness resuls under some monoone assumpions when x and y ake he same dimension. Then Peng and Wu [3] exended hem o differen dimensional FBSDE and weakened he monoone assumpions so ha he resuls can be widely used especially in Hamilonian sysem arising in sochasic opimal problem when we apply he maximum principle. J. Yong [4] le he above mehod be sysemaic and called i he coninuaion mehod. In Secion of his paper we give one exisence and uniqueness resul of he FBSDE which is useful in sudying linear quadraic nonzero sum sochasic differenial games problems. Sochasic linear quadraic opimal conrol problems have been firs sudied by Wonham [5] and hen by Bismu [6] also. In [6], Bismu proved he exisence of he opimal conrol and also used he dual mehod o give he feedback form for he opimal conrol. In Secion 3 we use he soluion of he FBSDE o give an explici form of opimal conrol for linear quadraic problem when he coefficiens are random. Using he classical mehod we can also prove ha he opimal conrol is unique. Using square complee echnique S. Chen, X. Li and X. Zhou [7] sudied his problem wih indefinie conrol weigh coss. They gave he opimal feedback conrol using he soluion of one kind of sochasic Riccai equaion. This kind of equaion is so complicaed ha hey canno prove he exisence and uniqueness in random case, hey only give he resul for one special deerminisic case. In our paper, for random case we can use he exisence and uniqueness resul of he FBSDE in [3] o give an explici opimal conrol form. For deerminisic case i is naural o sudy he associaed Riccai equaion. We inroduce one kind of generalized Riccai equaion sysem and give he linear feedback form of opimal conrol using he soluion of his kind of generalized marix Riccai equaion sysem. This kind of Riccai equaion is novel and differen from ha in [6] and [7]. However, he equaion form is suiable o he naure of FBSDE. A similar form can be seen in [8]. The mehod in our paper is more direc and easy o undersand because of he inroducion of FBSDE. In Secion 4, we discuss he solvabiliy of his kind of generalized Riccai equaion and also give one simple example of he generalized Riccai equaion sysem which has a unique soluion. In Secion 5 we sudy he nonzero sum sochasic differenial game problem. For deerminisic case his problem was considered by Friedman [9], Bensoussan [1] and Eisele [11]. For sochasic case Hamadene [1] showed one exisence resul of Nash equilibrium poin under some more assumpions. In his secion we improve his resul. Using he preliminary resul of he FBSDE in Secion we give an explici form of Nash equilibrium poin. The resuls of his paper are clear and easy o undersand. They can be applied in pracice direcly. The Preliminary Resuls of FBSDE In his secion le us give one exisence and uniqueness resul of he FBSDE which is useful in sudying sochasic differenial game problems. We consider he following special kind of FBSDE: dx = b(, x, y )d + σ(, x, y )db, dy = f(, x, y, z )d z db, (.1) x = a, y T = Φ(x T ). For noaional simplificaion, we assume d = 1; here (x, y, z) R n+n+n, b, f and σ are mappings wih appropriae dimensions and are, for each fixed (x, y, z), F -progressively measurable. We
3 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 181 use he noaions u = x y z, A(, u) = f b (, u). σ We assume ha (i) A(, u) is uniformly Lipschiz wih respec o u; (ii) For each u, A(, u) is in M (, T ); (iii) Φ(x) is uniformly Lipschiz wih respec o x R n ; (iv) For each x, Φ(x) is in L (Ω, F T, P ) (H.1) wih he following monoone condiions: A(, u) A(, u), u u β 1 x β ŷ, Φ(x) Φ(x), x x µ 1 x, a.s. u = (x, y, z), u = (x, y, z), x = x x, ŷ = y y, ẑ = z z, (H.) where β 1, β and µ 1 are given nonnegaive consans wih β 1 + β >, µ 1 + β >. Then we have Theorem.1 We assume (H.1) and (H.). Then here exiss a unique riple u = (x, y, z ), [, T ], saisfying FBSDE (.1). Proof The uniqueness proof can be given by Theorem. in [3]. In order o prove he exisence, we consider he following family of FBSDE paramerized by α [, 1]: dx α = [ (1 α)β ( y α) + αb(, xα, yα ) + φ ] d, + [ ασ(, x α, yα ) + ψ ] db, dy α = [ (1 α)β 1 x α + αf(, uα ) + γ ] d z α db, x α = a, yα T = αφ(xα T ) + (1 α)x T + ξ, where φ, ψ and γ are given processes in M (, T ) wih values in R n. Clearly, when α = 1 he exisence of he soluion of equaion (.) implies ha of (.1). If α =, from Lemma.5 in [3], i is easy o obain he exisence and uniqueness resul. Then he following lemma gives a priori esimae for he exisence inerval of (.) wih respec o α [, 1]. Lemma. We assume (H.1) and (H.). Then here exiss a posiive consan δ such ha if, a priori, for an α [, 1) here exiss a soluion (x α, y α, z α ) of he equaion (.), hen for each δ [, δ ] here exiss a soluion (x α+δ, y α+δ, z α+δ ) of he equaion (.) for α = α + δ. The proof mehod is similar o ha for Lemma.4 and Lemma.7 in [3]. We omi i. When α =, he equaion (.) has a unique soluion. From Lemma., here exiss a posiive consan δ which only depends on he Lipschiz consans, β 1, β and T such ha for each δ [, δ ], equaion (.) for α = α + δ has a unique soluion. We can repea his process for N-imes wih 1 Nδ < 1 + δ. I hen follows ha, in paricular, equaion (.) for α = 1 wih φ s, γ s and ψ s has a unique soluion. The proof is compleed. (.)
4 18 WU ZHEN Vol Linear Quadraic Sochasic Opimal Conrol Problem We consider he following linear conrol sysem { dx = [A (ω)x + B (ω)v ]d + [C (ω)x + D (ω)v ]db, x = a, [, T ], where A (ω) and C (ω) are n n bounded progressively measurable marix-valued processes, v, [, T ], is an admissible conrol process, i.e. an F adaped square inegrable process aking values in a given subse U of R k, B (ω) and D (ω) are n k bounded progressively measurable marix-valued processes. We also assume ha here is no consrain imposed on he conrol processes: U = R k. A classical quadraic opimal conrol problem is o minimize he cos funcion J(v( )) = 1 [ ] E ( R (ω)x, x + N (ω)v, v )d + Q(ω)x T, x T (3.) over he se of admissible conrols, where Q(ω) is he F T measurable nonnegaive symmeric bounded marix and R (ω) is he n n nonnegaive symmeric bounded progressively measurable marix-valued process, N (ω) is an k k posiive symmeric bounded progressively measurable marix-valued process and he inverse N 1 (ω) is also bounded. In his secion we give an explici form of he opimal conrol using he soluion of he FBSDE and he following resul: Theorem 3.1 The funcion u = N 1 (ω)(b τ (ω)y + D τ(ω)z ), [, T ], is he unique opimal conrol for he linear quadraic conrol problem, where (x, y, z ) is he soluion of he following FBSDE: dx = [A (ω)x + B (ω)u ]d + [C (ω)x + D (ω)u ]db, dy = [A τ (ω)y + C τ (ω)z + R (ω)x ]d z db, (3.3) x = a, y T = Q(ω)x T. Proof We firs look a he FBSDE (3.3). From Theorem 3.1 in [3], he FBSDE (3.3) has a unique soluion (x, y, z ). Now we prove ha u is he opimal conrol. Denoing, v( ) R k, x v o be he corresponding rajecory of he sysem (3.1), hen J(v( )) J(u( )) = 1 [ E ( R (ω)x v, xv R (ω)x, x + N (ω)v, v N (ω)u, u )d ] + Q(ω)x v T, xv T Q(ω)x T, x T = 1 [ E ( R (ω)(x v x ), x v x + N (ω)(v u ), v u + R (ω)x, x v x + N (ω)u, v u )d ] + Q(ω)(x v T x T ), x v T x T + Q(ω)x T, x v T x T. From Qx T = y T, we use Iô s formula o x v T x T, y T and ge E x v T x T, y T = E (3.1) ( R (ω)x, x v x + B (ω)(v u ), y + D (ω)(v u ), z )d.
5 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 183 And hen, because of R and Q being nonnegaive, N being posiive, we have So E = E =. J(v( )) J(u( )) ( N (ω)u, v u + B (ω)(v u ), y + D (ω)(v u ), z )d ( N (ω)n 1 (ω)(b τ (ω)y + D τ (ω)z ), v u + B τ (ω)y, v u + D τ (ω)z, v u )d u = N 1 (ω)(b τ (ω)y + D τ (ω)z ) is he opimal conrol. To prove he uniqueness of he opimal conrol, he mehod is classical. We give he proof for he reader s convenience. We assume ha u 1 ( ) and u ( ) are boh opimal conrols, and he corresponding rajecories are x 1 and x. I is easy o know he rajecories corresponding o u 1 ( ) + u ( ) and u 1 ( ) u ( ) are x 1 ( ) + x ( ) x 1 ( ) x ( ) and respecively. Because of N being posiive, R and Q being nonnegaive, we know ha and J(u 1 ( )) = J(u ( )) = α α = J(u 1 ( )) + J(u ( )) ( u 1 ( ) + u ) [ ( ) T ( x 1 x = J + E R, x1 x + Q x1 T x T, x1 T ] x T ( u 1 ( ) + u ) ( ) T u 1 J + E N u, u1 u d α + δ 4 E u 1 u d. Here δ >. So u 1 u + N E u 1 u d and u 1 ( ) = u ( )., u1 u ) d Here all coefficiens are sochasic processes. Now we le A, B, C, D, R, N be deerminisic funcions, Q be he deerminisic marix, and wan o give he feedback form of he opimal
6 184 WU ZHEN Vol. 18 conrol i.e. he opimal linear feedback regulaor. We inroduce he following generalized n n marix-valued Riccai equaion sysem of (K(), M()), [, T ]: K() = A τ K() + K()A K()B N 1 B τ K() K()B N 1 D τ M() + C τ M() + R, (3.4) M() = K()C K()D N 1 B τ K() K()D N 1 D τ M(), K(T ) = Q, [, T ]. This is a kind of generalized marix-valued Riccai equaion sysem formed by a marixvalued ordinary differenial equaion and an algebraic equaion which is differen from he ones in [6] and [7]. In hose papers hey gave he opimal conrol even when N is indefinie by using he soluion of a kind of Riccai equaion direcly. Bu hey canno ge he exisence and uniqueness for ha kind of Riccai equaion in random case. For deerminisic case hey only sudied he special case: C =. However if he Riccai equaion in heir papers has no soluion, hey canno obain he opimal conrol whaever in random or deerminisic siuaion. In he nex secion we will discuss he solvabiliy of our Riccai equaion sysem (3.4). Some relaed echniques o deal wih his kind of equaion sysem are derived from [8]. We firs have Theorem 3. Suppose here exiss marix (K(), M()), [, T ], saisfying he generalized marix Riccai equaion sysem (3.4). Then he opimal linear feedback regulaor for he linear quadraic opimal problem is and he opimal value funcion is u = N 1 [B τ K() + Dτ M()]x, [, T ], (3.5) J(u( )) = 1 K()a, a. (3.6) Proof We le (K(), M()) be he soluion of (3.4). I is easy o check ha he soluion (x, y, z ) of (3.3) saisfies y = K()x, z = M()x, so he opimal conrol u( ) saisfies he equaion (3.5). We apply Iô s formula o x T, y T in J(u( )); i is easy o ge (3.6). Using he above opimal conrol as he linear feedback we can also ge he opimal sae rajecory x( ) from equaion (3.3). 4 Solvabiliy of he Generalized Riccai Equaion Sysem In Secion 3, we can obain he opimal linear feedback regulaor for linear quadraic opimal problem by he soluion of he generalized Riccai equaion (3.4). We will discuss he solvabiliy for his kind of equaion in his secion. We firs look a he special case: D = o seek some illuminaion. This is a simple case; (3.4) is reduced o he following ordinary equaion: K() = A τ K() + K()A K()B N 1 B τ K() +C τ K()C + R, (4.1) K(T ) = Q, M() = K()C, [, T ]. From he convenional Riccai equaion heory which can be seen in [13], equaion (4.1) has he unique soluion K( ) C(, T ; S n +), here S n + represening he space of all n n nonnegaive definie symmeric marices, and M() = K()C.
7 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 185 For he general case, we can sudy he following equaion: K() = A τ K() + K()A K()B N 1 B τ K() K(T ) = Q, +K()B N 1 K()B N 1 D τ (I n + K()D N 1 D τ ) 1 K()D N 1 B τ K() + R D τ (I n + K()D N 1 D τ ) 1 K()C +C T (I n + K()D N 1 D τ ) 1 K()C C T (I n + K()D N 1 D τ ) 1 K()D N 1 B T K(), I n + K()D N 1 D τ >, [, T ]. If we ge he soluion K() for (4.), hen we can le M() = (I n + K()D N 1 D τ ) 1 K()C (I n + K()D N 1 D τ ) 1 K()D N 1 B τ K() o ge he soluion of (3.4). Now we firs have he following uniqueness resul. Theorem 4.1 Riccai equaion (4.) has a mos one soluion K( ) C(, T ; S+ n ). Proof We suppose K is anoher soluion of (4.). Seing K = K K, hen K saisfies K() = A τ K() + K()A K()B N 1 B τ K() K()B N 1 B τ K() (4.) + K()B N 1 D τ (I n + K()D N 1 D τ ) 1 (I n + K()D N 1 D τ ) 1 K()D N 1 B τ K() +K()B N 1 (I n + K()D N 1 +K()B N 1 D τ (I n + K()D N 1 D τ ) 1 D τ) 1 K()D N 1 B τk() D τ (I n + K()D N 1 D τ ) 1 (I n + K()D N 1 D τ) 1 K()D N 1 B τ K() +I + II + III + IV, K(T ) =, [, T ]. Here I = K()B N 1 (I n + K()D N 1 K()B N 1 D τ (I n + K()D N 1 D τ ) 1 K()D N 1 (I n + K()D N 1 +K()B N 1 (I n + K()D N 1 +K()B N 1 (I n + K()D N 1 D τ) 1 K()D N 1 B τk() D τ D τ (I n + K()D N 1 D τ ) 1 K()D N 1 D τ) 1 K()D N 1 B τk() D τ(i n + K()D N 1 D τ ) 1 K()D N 1 D τ) 1 K()D N 1 B τk() D τ (I n + K()D N 1 D τ ) 1 K()D N 1 D τ ) 1 K()D N 1 B τ K(), D τ D τ D τ
8 186 WU ZHEN Vol. 18 II = K()B N 1 K()B N 1 K()B N 1 D τ (I n + K()D N 1 D τ ) 1 (I n + K()D N 1 D τ ) 1 K()C D τ (I n + K()D N 1 D τ ) 1 (I n + K()D N 1 D τ ) 1 K()C D τ (I n + K()D N 1 D τ ) 1 K()D N 1 (I n + K()D N 1 D τ ) 1 K()C +K()B N 1 D τ(i n + K()D N 1 D τ) 1 K()D N 1 (I n + K()D N 1 D τ ) 1 K()C K()B N 1 D τ(i n + K()D N 1 D τ) 1 K()D N 1 (I n + K()D N 1 D τ ) 1 K()C, III = C τ (I n + K()D N 1 C τ (I n + K()D N 1 + C τ (I n + K()D N 1 IV = C τ (I n + K()D N 1 C τ (I n + K()D N 1 +C τ (I n + K()D N 1 (I n + K()D N 1 C τ (I n + K()D N 1 (I n + K()D N 1 C τ (I n + K()D N 1 (I n + K()D N 1 D τ D τ D τ D τ ) 1 (I n + K()D N 1 D τ ) 1 K()C D τ) 1 K()D N 1 D τ (I n + K()D N 1 D τ ) 1 K()C D τ) 1 K()D N 1 D τ (I n + K()D N 1 D τ ) 1 K()C, D τ) 1 (I n + K()D N 1 D τ ) 1 K()D N 1 B τk() D τ) 1 (I n + K()D N 1 D τ ) 1 K()D N 1 B τ K() D τ ) 1 K()D N 1 D τ D τ) 1 K()D N 1 B τk() D τ ) 1 K()D N 1 D τ D τ) 1 K()D N 1 B τk() D τ ) 1 K()D N 1 D τ D τ) 1 K()D N 1 B τ K(), where I n +KD N 1 D τ > and I n +KD N 1 D τ >. Since (I n +KD N 1 D τ ) 1 and (I n + KD N 1 D τ ) 1 are uniformly bounded due o heir coninuiy, we can apply he Gronwall s inequaliy o ge K(). This proves he uniqueness. Now le us discuss he exisence of (4.) sep by sep. If we le Y () = F (K) = (I n + D τ ) 1 K, hen for any Y ( ) C(, T ; S+), n he following convenional Riccai equaion KD N 1 K() = A τ K() + K()A + C τ Y ()C + R K()[B N 1 B τ B N 1 D τ Y ()D N 1 B τ ]K() C τy ()D N 1 B τ K() K()B N 1 D τ Y ()C, K(T ) = Q, [, T ] (4.3) has a unique soluion K( ) C(, T ; S n + ) when [B N 1 B τ B N 1 D τ Y ()D N 1 B τ ] C(, T ; S+). n (4.4) We denoe by S n s he subspace of S n + formed by he symmeric marices saisfying (4.4), i.e. S n s = { Y ( ) : Y ( ) C(, T ; S n + ) and [B N 1 B τ B N 1 D τ Y ()D N 1 B τ ] C(, T ; Sn + )}.
9 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 187 Obviously, Y Ss n, so his definiion is reasonable. Thus we can define a mapping Ψ : C(, T ; Ss n) C(, T ; Sn + ) when K = Ψ(Y ) by he equaion (4.3). We firs have following wo lemmas: Lemma 4. The operaor F (K) is monoonely increasing when K >. Proof We noice, when K >, ha F (K) = (I n + KD N 1 D τ ) 1 K = [K 1 (I n + KD N 1 D τ )] 1 = (K 1 + D N 1 D τ ) 1. So, if K 1 K, hen F (K 1 ) F (K ). Lemma 4.3 The operaor Ψ is monoonely increasing and coninuous. Proof Le K = Ψ(Y ), K = Ψ(Y ) and K = K K. We rewrie (4.3) as K() = A τ K() + K()A K()B N 1 B τk() + R +[C D N 1 B τ K()]τ Y ()[C D N 1 B τ K()], K(T ) = Q, [, T ]. From Lemma 4. and Lemma 8. in [8], we know if Y Y, hen K K; his proves he monooniciy. On he oher hand, by a similar mehod wih he uniqueness proof and Gronwall inequaliy, i is easily seen ha, if Y Y, K K = K. This yields he coninuiy; he proof is compleed. Looking back a equaion (4.3), i is easy o know ha Theorem 4.4 If here is Y C(, T ; Ss n ) such ha (4.5) Y = (I n + Ψ(Y )D N 1 D τ ) 1 Ψ(Y ), (4.6) hen he Riccai equaion (4.) has a unique soluion. The following ask is o find he suiable Y C(, T ; Ss n ) saisfying (4.6). We need he following resul. Lemma 4.5 If here exis Y +, Y C(, T ; Ss n ) such ha Y + (I n + Ψ(Y + )D N 1 D τ ) 1 Ψ(Y + ) (I n + Ψ(Y )D N 1 D τ ) 1 Ψ(Y ) Y, (4.7) hen equaion (4.3) admis a soluion. Proof Le Y +, Y be given saisfying (4.7). We define he sequences Y + i, Y i, K + i, K i as follows: From (4.7), we have Y + = Y + S n s, Y = Y S n s, K+ = Ψ(Y + ), K = Ψ(Y ), Y + i+1 = (I n + K + i D N 1 D τ ) 1 K + i, Y i+1 = (I n + K i D N 1 D τ ) 1 K i, K + i+1 = Ψ(Y + i+1 ), K i+1 = Ψ(Y i+1 ), i =, 1,,. Y + (I n + Ψ(Y + )D N 1 D τ ) 1 Ψ(Y + ) = (I n + K + D N 1 D τ ) 1 K + = Y + 1 Y 1 Y.
10 188 WU ZHEN Vol. 18 From Lemma 4.3, K + K+ 1 K 1 K. By inducion, we obain and also Y + i, Y i Ss n. So we have From Lemma 4.3, we have K + K+ i K + i+1 K i+1 K i K, Y + Y + i Y + i+1 Y i+1 Y i Y, lim Y i + = Y + Ss n, lim i i K+ i = K + S+ n. K + = lim i K + i = lim Ψ(Y + i i ) = Ψ( lim i Y + i ) = Ψ(Y + ). So K + is one soluion of Riccai equaion (4.3) corresponding o Y = Y + ; hen Y + = (I n + K + D N 1 D τ ) 1 K + ; by Theorem 4.4, K + is one soluion of (4.). By he same sep, we also can ge K = lim i K i and Y = lim Yi, i so K is also a soluion of (4.); by he uniqueness resul in Theorem 4.1, K + = K. We only need o find Y + and Y saisfying (4.7). The exisence of Y is obvious; we can le Y =. By he convenional Riccai equaion heory, i saisfies (4.7). Now we need one sufficien condiion below o find Y + Ss n saisfying (4.7) and ensure he exisence of a soluion o Riccai equaion (4.). We assume ha There exiss Y ( ) Ss n, such ha D τ Y D = N and (I n + KD N 1 D τ ) 1 K Y, here K being he unique soluion of he following equaion : (H4.1) K() = A τ K() + K()A + R + C τ Y C C τ Y D N 1 B τ K() K()B N 1 D τ Y C, K(T ) = Q. Hence, we have he following resul. Theorem 4.6 We assume (H4.1). The generalized Riccai equaion (4.) has unique soluion (K, M) C 1 (, T ; S+) n L (, T ; R n n ). We noice ha when n = k and D is inverible, i is easy o check ha (H4.1) is saisfied. We can also give one simple example of he generalized Riccai equaion which has a unique soluion. Example 4.1 We assume he dimensions of he sae and conrol in conrol sysem (3.1) are he same i.e. k = n, and assume D = I n. Now we can le Y = N and hen o check (H4.1). Y = N, so Y D + KDN 1 D τ Y D KD, where K is he soluion of he following equaion: K() = A τ K() + K()A + R + C τ N C K(T ) = Q, C τn DN 1 B τk() K()B N 1 D τ N C,
11 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 189 and Y + KDN 1 D τ Y K, hen Y (I n + KDN 1 D τ ) 1 K. So from Theorem 4.6, he Riccai equaion (3.4), when k = n, D = I n, has a unique soluion. For his case, we can ge an explici form of he linear opimal feedback and he opimal value funcion for he linear quadraic opimal problem by Theorem 3., and also we can ge he opimal sae rajecory from he equaion (3.3). 5 Linear quadraic nonzero sum sochasic differenial games In his secion, we sudy linear quadraic nonzero sum sochasic differenial games problem. From he furher exisence and uniqueness resul of he FBSDE (Theorem.1), we improve a similar resul in Hamadene [1]. For noaional simplificaion, we only consider wo players; i is similar for n players. The conrol sysem is { dx v = [Ax v + B 1 v 1 + B v + α ]d + [Cx v + β ]db, (5.1) x v = a, where A and C are n n bounded marices, v 1 and v, [, T ], are wo admissible conrol processes, i.e. F -adaped square inegrable processes aking values in R k. B 1 and B are n k bounded marices. α and β are wo adaped square-inegrable processes. We denoe by J 1 (v( )) and J (v( )), v( ) = (v 1 ( ), v ( )), he cos funcions corresponding o he wo players 1 and : J 1 (v( )) = 1 [ ] E ( R 1 x v, x v + N 1 v 1, v 1 )d + Q 1 x v T, x v T, J (v( )) = 1 [ (5.) T E ( R x v, xv + N v, v )d + Q x v T, xv T ]. Here Q 1, Q, R 1 and R are n n nonnegaive symmeric bounded marices, N 1 and N are k k posiive symmeric bounded marices and he inverses (N 1 ) 1, (N ) 1 are also bounded. The problem is o look for (u 1 ( ), u ( )) R k R k which is called he Nash equilibrium poin for he game, such ha { J 1 (u 1 ( ), u ( )) J 1 (v 1 ( ), u ( )), v 1 ( ) R k ; (5.3) J (u 1 ( ), u ( )) J (u 1 ( ), v ( )), v ( ) R k. We need he following assumpions: { B i (N i ) 1 (B i ) τ A τ = A τ B i (N i ) 1 (B i ) τ, i = 1,, B i (N i ) 1 (B i ) τ C τ = C τ B i (N i ) 1 (B i ) τ, a.s. (H5.1) Now, using he soluion of FBSDE we can give an explici form of he Nash equilibrium poin for his problem. Theorem 5.1 The funcion (u 1, u ) = ( (N 1 ) 1 (B 1 ) τ y 1, (N ) 1 (B ) τ y ), [, T ],
12 19 WU ZHEN Vol. 18 is one Nash equilibrium poin for he above game problem, where (x, y 1, y, z 1, z ) is he soluion of he following differen dimensional FBSDE: dx = [Ax B 1 (N 1 ) 1 (B 1 ) τ y 1 B (N ) 1 (B ) τ y + α ]d +[Cx + β ]db, dy 1 = [Aτ y 1 + Cτ z 1 + R1 x ]d z 1dB, (5.4) dy = [Aτ y + Cτ z + R x ]d z db, x = a, yt 1 = Q1 x T, yt = Q x T. Proof We firs prove he exisence of he soluion of (5.4). We consider he following FBSDE: dx = [AX Y + α ]d + [CX + β ]db, dy = [A τ Y + (B 1 (N 1 ) 1 (B 1 ) τ R 1 + B (N ) 1 (B ) τ R )X (5.5) +C τ Z ]d Z db, X = a, Y T = [B 1 (N 1 ) 1 (B 1 ) τ Q 1 + B (N ) 1 (B ) τ Q ]X T. We noice ha if he (x, y 1, y, z 1, z ) is he soluion of (5.4), (X, Y, Z ) saisfies he FBSDE (5.5) from (H5.1). Here X = x, Y = B 1 (N 1 ) 1 (B 1 ) τ y 1 + B (N ) 1 (B ) τ y, Z = B 1 (N 1 ) 1 (B 1 ) τ z 1 + B (N ) 1 (B ) τ z. On he oher hand, we can firs use he FBSDE (5.5) o ge soluion X which is he forward soluion x of (5.4), hen obain (y 1, z 1 ) and (y, z ). I is easy o check ha he FBSDE (5.5) saisfies (H.1) and (H.); according o Theorem.1, here exiss a unique soluion (X, Y, Z ) of (5.5). Now, from Theorem 3.1 in [14], we can le (y 1, z 1 ) and (y, z ) be he soluions of he following backward sochasic differenial equaions (abbrev. o BSDE): dy 1 = [A τ y 1 + C τ z 1 + R 1 X ]d z 1 db, dy = [Aτ y + Cτ z + R X ]d z db, yt 1 = Q1 X T, yt = Q X T. We le Y = B 1 (N 1 ) 1 (B 1 ) τ y 1 + B (N ) 1 (B ) τ y, hen we ge Z = B 1 (N 1 ) 1 (B 1 ) τ z 1 + B (N ) 1 (B ) τ z ; dy = [A τ Y + (B 1 (N 1 ) 1 (B 1 ) τ R 1 +B (N ) 1 (B ) τ R )X + C τ Z ]d Z db, Y T = [B 1 N 1 ) 1 (B 1 ) τ Q 1 + B (N ) 1 (B ) τ Q ]X T. For fixed {X }, because of he exisence and uniqueness of he BSDE, we have Y = Y = B 1 (N 1 ) 1 (B 1 ) τ y 1 + B (N ) 1 (B ) τ y, Z = Z = B 1 (N 1 ) 1 (B 1 ) τ z 1 + B (N ) 1 (B ) τ z.
13 No. FBSDE, OPTIMAL CONTROL AND DIFFERENTIAL GAMES 191 Then (X, Y, Z ) saisfies he FBSDE (5.5) and is he unique soluion. So (X, y 1, y, z 1, z ) is one soluion of FBSDE (5.4). Now we ry o prove (u 1 ( ), u ( )) is one Nash equilibrium poin for our nonzero sum game problem. We only prove J 1 (u 1 ( ), u ( )) J 1 (v 1 ( ), u ( )), v 1 ( ) R k. I is similar o ge anoher inequaliy of (5.3). We denoe by x v1 he soluion of sysem: { dx v 1 x = a, = [Ax v1 + B 1 v 1 + B u + α ]d + [Cx v1 + β ]db, (5.6) J 1 (v 1 ( ), u ( )) J 1 (u 1 ( ), u ( )) = 1 E [ = 1 E [ ( R 1 x v1, xv1 + Q 1 x v1 T, xv1 T Q1 x T, x T ( R 1 (x v1 + Q 1 (x v1 T + R 1 x, x v1 R1 x, x + N 1 v 1, v1 N 1 u 1, u1 ) d ] x ), x v1 x + N 1 (v 1 u1 ), v1 u1 x T ), x v1 T x + N 1 u 1, v1 u1 ) d ] x T + Q 1 x T, x v1 T x T. From Q 1 x T = yt 1, we use Iô s formula o xv1 T x T, yt 1 and ge E x v1 T x T, y 1 T = E ( R 1 x, x v1 x + B 1 (v 1 u1 ), y1 ) d. Because of R 1 and Q 1 being nonnegaive, N 1 being posiive, we have So E = E J 1 (v 1 ( ), u ( )) J 1 (u 1 ( ), u ( )) ( N 1 u 1, v1 u1 + B1 (v 1 u1 ), y1 ) d ( N 1 (N 1 ) 1 (B 1 ) τ y 1, v 1 u 1 + (B 1 ) τ y 1, v 1 u 1 ) d =. (u 1, u ) = ( (N 1 ) 1 (B 1 ) τ y 1, (N ) 1 (B ) τ y ) is one Nash equilibrium poin for our nonzero sum game problem. References [1] J. Ma, P. Proer and J. Yong, Solving forward-backward sochasic differenial equaions explicily a four sep scheme, Proba. Theory and Relaed Fields, 1994, 98: [] Y. Hu, and S. Peng, Soluion of forward-backward sochasic differenial equaions, Proba. Theory and Relaed Fields, 1995, 13: [3] S. Peng and Z. Wu, Fully coupled forward-backward sochasic differenial equaions and applicaions o opimal conrol, SIAM J. Conrol Opim., 1999, 37:
14 19 WU ZHEN Vol. 18 [4] J. Yong, Finding adaped soluion of forward backward sochasic differenial equaions-mehod of coninuaion, Proba Theory and Relaed Fields, 1997, 17: [5] W. M. Wonham, On he separaion heorem of sochasic conrol, SIAM J. Conrol Opim., 1968, 6: [6] J. M. Bismu, Conrole des sysemes lineaires quadraiques: applicaions de l inegrale sochasique, Lecure Noes in Mahemaics, vol.649, Seminaire de Probabilies XII, Proceedings, Srasbourg, , Edie par C. Dellacherie, P. A. Meyer e M. Weil, Springer-Verlag, 1978, [7] S. Chen, X. Li and X. Zhou, Sochasic linear quadraic regulaors wih indefinie conrol weigh coss, SIAM J. Conrol Opim. 1998, 36: [8] S. Peng, Problem of eigenvalues of sochasic Hamilonian sysems wih boundary condiions, Sochasic Processes and Their Applicaions,, 88: [9] A. Friedman, Differenial Games, Wiley-Inerscience, New York, [1] A. Bensoussan, Poin de Nash dans de cas de foncionnelles quadraiques e jeux différeniels à N personnes, SIAM J. Conrol, 1974, 1(3). [11] T. Eisele, Nonexisence and nonuniqueness of open-loop equilibria in linear-quadraic differenial games, J. Mah. Anal. Appl., 198, 37: [1] S. Hamadène, Nonzero sum linear-quadraic sochasic differenial games and backward-forward equaions, Sochasic Anal. Appl. 1999, 14(). [13] W. T. Ried, Riccai Differenial Equaions, Mahemaics in Science and Engineering, Academic Press, New York, 197, 86. [14] E. Pardoux and S. Peng, Adaped soluion of a backward sochasic differenial equaion, Sysem and Conrol Leers, 199, 14:
Stochastic Optimal Control Problem for Life Insurance
Sochasic Opimal Conrol Problem for Life Insurance s. Basukh 1, D. Nyamsuren 2 1 Deparmen of Economics and Economerics, Insiue of Finance and Economics, Ulaanbaaar, Mongolia 2 School of Mahemaics, Mongolian
More informationA Probability Density Function for Google s stocks
A Probabiliy Densiy Funcion for Google s socks V.Dorobanu Physics Deparmen, Poliehnica Universiy of Timisoara, Romania Absrac. I is an approach o inroduce he Fokker Planck equaion as an ineresing naural
More informationDifferential Equations. Solving for Impulse Response. Linear systems are often described using differential equations.
Differenial Equaions Linear sysems are ofen described using differenial equaions. For example: d 2 y d 2 + 5dy + 6y f() d where f() is he inpu o he sysem and y() is he oupu. We know how o solve for y given
More informationThe Transport Equation
The Transpor Equaion Consider a fluid, flowing wih velociy, V, in a hin sraigh ube whose cross secion will be denoed by A. Suppose he fluid conains a conaminan whose concenraion a posiion a ime will be
More informationOptimal Investment and Consumption Decision of Family with Life Insurance
Opimal Invesmen and Consumpion Decision of Family wih Life Insurance Minsuk Kwak 1 2 Yong Hyun Shin 3 U Jin Choi 4 6h World Congress of he Bachelier Finance Sociey Torono, Canada June 25, 2010 1 Speaker
More informationChapter 7. Response of First-Order RL and RC Circuits
Chaper 7. esponse of Firs-Order L and C Circuis 7.1. The Naural esponse of an L Circui 7.2. The Naural esponse of an C Circui 7.3. The ep esponse of L and C Circuis 7.4. A General oluion for ep and Naural
More informationANALYSIS AND COMPARISONS OF SOME SOLUTION CONCEPTS FOR STOCHASTIC PROGRAMMING PROBLEMS
ANALYSIS AND COMPARISONS OF SOME SOLUTION CONCEPTS FOR STOCHASTIC PROGRAMMING PROBLEMS R. Caballero, E. Cerdá, M. M. Muñoz and L. Rey () Deparmen of Applied Economics (Mahemaics), Universiy of Málaga,
More informationMTH6121 Introduction to Mathematical Finance Lesson 5
26 MTH6121 Inroducion o Mahemaical Finance Lesson 5 Conens 2.3 Brownian moion wih drif........................... 27 2.4 Geomeric Brownian moion........................... 28 2.5 Convergence of random
More informationRandom Walk in 1-D. 3 possible paths x vs n. -5 For our random walk, we assume the probabilities p,q do not depend on time (n) - stationary
Random Walk in -D Random walks appear in many cones: diffusion is a random walk process undersanding buffering, waiing imes, queuing more generally he heory of sochasic processes gambling choosing he bes
More informationTechnical Appendix to Risk, Return, and Dividends
Technical Appendix o Risk, Reurn, and Dividends Andrew Ang Columbia Universiy and NBER Jun Liu UC San Diego This Version: 28 Augus, 2006 Columbia Business School, 3022 Broadway 805 Uris, New York NY 10027,
More informationOn the degrees of irreducible factors of higher order Bernoulli polynomials
ACTA ARITHMETICA LXII.4 (1992 On he degrees of irreducible facors of higher order Bernoulli polynomials by Arnold Adelberg (Grinnell, Ia. 1. Inroducion. In his paper, we generalize he curren resuls on
More informationOptimal Stock Selling/Buying Strategy with reference to the Ultimate Average
Opimal Sock Selling/Buying Sraegy wih reference o he Ulimae Average Min Dai Dep of Mah, Naional Universiy of Singapore, Singapore Yifei Zhong Dep of Mah, Naional Universiy of Singapore, Singapore July
More informationDYNAMIC MODELS FOR VALUATION OF WRONGFUL DEATH PAYMENTS
DYNAMIC MODELS FOR VALUATION OF WRONGFUL DEATH PAYMENTS Hong Mao, Shanghai Second Polyechnic Universiy Krzyszof M. Osaszewski, Illinois Sae Universiy Youyu Zhang, Fudan Universiy ABSTRACT Liigaion, exper
More informationAnalogue and Digital Signal Processing. First Term Third Year CS Engineering By Dr Mukhtiar Ali Unar
Analogue and Digial Signal Processing Firs Term Third Year CS Engineering By Dr Mukhiar Ali Unar Recommended Books Haykin S. and Van Veen B.; Signals and Sysems, John Wiley& Sons Inc. ISBN: 0-7-380-7 Ifeachor
More informationImproper Integrals. Dr. Philippe B. laval Kennesaw State University. September 19, 2005. f (x) dx over a finite interval [a, b].
Improper Inegrls Dr. Philippe B. lvl Kennesw Se Universiy Sepember 9, 25 Absrc Noes on improper inegrls. Improper Inegrls. Inroducion In Clculus II, sudens defined he inegrl f (x) over finie inervl [,
More informationCointegration: The Engle and Granger approach
Coinegraion: The Engle and Granger approach Inroducion Generally one would find mos of he economic variables o be non-saionary I(1) variables. Hence, any equilibrium heories ha involve hese variables require
More informationTWO OPTIMAL CONTROL PROBLEMS IN CANCER CHEMOTHERAPY WITH DRUG RESISTANCE
Annals of he Academy of Romanian Scieniss Series on Mahemaics and is Applicaions ISSN 266-6594 Volume 3, Number 2 / 211 TWO OPTIMAL CONTROL PROBLEMS IN CANCER CHEMOTHERAPY WITH DRUG RESISTANCE Werner Krabs
More informationTerm Structure of Prices of Asian Options
Term Srucure of Prices of Asian Opions Jirô Akahori, Tsuomu Mikami, Kenji Yasuomi and Teruo Yokoa Dep. of Mahemaical Sciences, Risumeikan Universiy 1-1-1 Nojihigashi, Kusasu, Shiga 525-8577, Japan E-mail:
More informationAP Calculus BC 2010 Scoring Guidelines
AP Calculus BC Scoring Guidelines The College Board The College Board is a no-for-profi membership associaion whose mission is o connec sudens o college success and opporuniy. Founded in, he College Board
More informationAppendix A: Area. 1 Find the radius of a circle that has circumference 12 inches.
Appendi A: Area worked-ou s o Odd-Numbered Eercises Do no read hese worked-ou s before aemping o do he eercises ourself. Oherwise ou ma mimic he echniques shown here wihou undersanding he ideas. Bes wa
More informationVerification Theorems for Models of Optimal Consumption and Investment with Retirement and Constrained Borrowing
MATHEMATICS OF OPERATIONS RESEARCH Vol. 36, No. 4, November 2, pp. 62 635 issn 364-765X eissn 526-547 364 62 hp://dx.doi.org/.287/moor..57 2 INFORMS Verificaion Theorems for Models of Opimal Consumpion
More information17 Laplace transform. Solving linear ODE with piecewise continuous right hand sides
7 Laplace ransform. Solving linear ODE wih piecewise coninuous righ hand sides In his lecure I will show how o apply he Laplace ransform o he ODE Ly = f wih piecewise coninuous f. Definiion. A funcion
More informationWorking Paper On the timing option in a futures contract. SSE/EFI Working Paper Series in Economics and Finance, No. 619
econsor www.econsor.eu Der Open-Access-Publikaionsserver der ZBW Leibniz-Informaionszenrum Wirschaf The Open Access Publicaion Server of he ZBW Leibniz Informaion Cenre for Economics Biagini, Francesca;
More informationDETERMINISTIC INVENTORY MODEL FOR ITEMS WITH TIME VARYING DEMAND, WEIBULL DISTRIBUTION DETERIORATION AND SHORTAGES KUN-SHAN WU
Yugoslav Journal of Operaions Research 2 (22), Number, 6-7 DEERMINISIC INVENORY MODEL FOR IEMS WIH IME VARYING DEMAND, WEIBULL DISRIBUION DEERIORAION AND SHORAGES KUN-SHAN WU Deparmen of Bussines Adminisraion
More informationLongevity 11 Lyon 7-9 September 2015
Longeviy 11 Lyon 7-9 Sepember 2015 RISK SHARING IN LIFE INSURANCE AND PENSIONS wihin and across generaions Ragnar Norberg ISFA Universié Lyon 1/London School of Economics Email: ragnar.norberg@univ-lyon1.fr
More informationOptimal Reinsurance/Investment Problems for General Insurance Models
Opimal Reinsurance/Invesmen Problems for General Insurance Models Yuping Liu and Jin Ma Absrac. In his paper he uiliy opimizaion problem for a general insurance model is sudied. he reserve process of he
More informationAn Optimal Control Approach to Inventory-Production Systems with Weibull Distributed Deterioration
Journal of Mahemaics and Saisics 5 (3):6-4, 9 ISSN 549-3644 9 Science Publicaions An Opimal Conrol Approach o Invenory-Producion Sysems wih Weibull Disribued Deerioraion Md. Aiul Baen and Anon Abdulbasah
More informationON THE PRICING OF EQUITY-LINKED LIFE INSURANCE CONTRACTS IN GAUSSIAN FINANCIAL ENVIRONMENT
Teor Imov r.amaem.sais. Theor. Probabiliy and Mah. Sais. Vip. 7, 24 No. 7, 25, Pages 15 111 S 94-9(5)634-4 Aricle elecronically published on Augus 12, 25 ON THE PRICING OF EQUITY-LINKED LIFE INSURANCE
More information= r t dt + σ S,t db S t (19.1) with interest rates given by a mean reverting Ornstein-Uhlenbeck or Vasicek process,
Chaper 19 The Black-Scholes-Vasicek Model The Black-Scholes-Vasicek model is given by a sandard ime-dependen Black-Scholes model for he sock price process S, wih ime-dependen bu deerminisic volailiy σ
More informationHow To Find Opimal Conracs In A Continuous Time Model
Appl Mah Opim (9) 59: 99 46 DOI.7/s45-8-95- OpimalCompensaionwihHiddenAcion and Lump-Sum Paymen in a Coninuous-Time Model Jakša Cvianić Xuhu Wan Jianfeng Zhang Published online: 6 June 8 Springer Science+Business
More information1. y 5y + 6y = 2e t Solution: Characteristic equation is r 2 5r +6 = 0, therefore r 1 = 2, r 2 = 3, and y 1 (t) = e 2t,
Homework6 Soluions.7 In Problem hrough 4 use he mehod of variaion of parameers o find a paricular soluion of he given differenial equaion. Then check your answer by using he mehod of undeermined coeffiens..
More informationMean Field Games. Math 581 Project
Mean Field Games Tiago Miguel Saldanha Salvador Mah 58 Projec April 23 Conens Inroducion 2 2 Analysis of second order MFG 3 2. On he Fokker-Plank equaion................................ 4 2.2 Exisence
More informationOptimal Control Formulation using Calculus of Variations
Lecure 5 Opimal Conrol Formulaion using Calculus o Variaions Dr. Radhakan Padhi Ass. Proessor Dep. o Aerospace Engineering Indian Insiue o Science - Bangalore opics Opimal Conrol Formulaion Objecive &
More informationSingle-machine Scheduling with Periodic Maintenance and both Preemptive and. Non-preemptive jobs in Remanufacturing System 1
Absrac number: 05-0407 Single-machine Scheduling wih Periodic Mainenance and boh Preempive and Non-preempive jobs in Remanufacuring Sysem Liu Biyu hen Weida (School of Economics and Managemen Souheas Universiy
More informationOn Galerkin Approximations for the Zakai Equation with Diffusive and Point Process Observations
On Galerkin Approximaions for he Zakai Equaion wih Diffusive and Poin Process Observaions An der Fakulä für Mahemaik und Informaik der Universiä Leipzig angenommene DISSERTATION zur Erlangung des akademischen
More informationA Generalized Bivariate Ornstein-Uhlenbeck Model for Financial Assets
A Generalized Bivariae Ornsein-Uhlenbeck Model for Financial Asses Romy Krämer, Mahias Richer Technische Universiä Chemniz, Fakulä für Mahemaik, 917 Chemniz, Germany Absrac In his paper, we sudy mahemaical
More informationA DYNAMIC PROGRAMMING APPROACH TO THE PARISI FUNCTIONAL
A DYNAMIC PROGRAMMING APPROACH TO THE PARISI FUNCTIONAL AUKOSH JAGANNATH AND IAN TOBASCO Absrac. G. Parisi prediced an imporan variaional formula for he hermodynamic limi of he inensive free energy for
More informationWhen to Cross the Spread? - Trading in Two-Sided Limit Order Books -
When o Cross he Spread? - rading in wo-sided Limi Order Books - Ulrich Hors and Felix Naujoka Insiu für Mahemaik Humbold-Universiä zu Berlin Uner den Linden 6, 0099 Berlin Germany e-mail: {hors,naujoka}@mah.hu-berlin.de
More informationDependent Interest and Transition Rates in Life Insurance
Dependen Ineres and ransiion Raes in Life Insurance Krisian Buchard Universiy of Copenhagen and PFA Pension January 28, 2013 Absrac In order o find marke consisen bes esimaes of life insurance liabiliies
More informationcooking trajectory boiling water B (t) microwave 0 2 4 6 8 101214161820 time t (mins)
Alligaor egg wih calculus We have a large alligaor egg jus ou of he fridge (1 ) which we need o hea o 9. Now here are wo accepable mehods for heaing alligaor eggs, one is o immerse hem in boiling waer
More informationWorking Paper When to cross the spread: Curve following with singular control
econsor www.econsor.eu Der Open-Access-Publikaionsserver der ZBW Leibniz-Informaionszenrum Wirschaf The Open Access Publicaion Server of he ZBW Leibniz Informaion Cenre for Economics Naujoka, Felix; Hors,
More informationDifferential Equations and Linear Superposition
Differenial Equaions and Linear Superposiion Basic Idea: Provide soluion in closed form Like Inegraion, no general soluions in closed form Order of equaion: highes derivaive in equaion e.g. dy d dy 2 y
More informationMultiprocessor Systems-on-Chips
Par of: Muliprocessor Sysems-on-Chips Edied by: Ahmed Amine Jerraya and Wayne Wolf Morgan Kaufmann Publishers, 2005 2 Modeling Shared Resources Conex swiching implies overhead. On a processing elemen,
More informationLife insurance cash flows with policyholder behaviour
Life insurance cash flows wih policyholder behaviour Krisian Buchard,,1 & Thomas Møller, Deparmen of Mahemaical Sciences, Universiy of Copenhagen Universiesparken 5, DK-2100 Copenhagen Ø, Denmark PFA Pension,
More informationAND BACKWARD SDE. Nizar Touzi nizar.touzi@polytechnique.edu. Ecole Polytechnique Paris Département de Mathématiques Appliquées
OPIMAL SOCHASIC CONROL, SOCHASIC ARGE PROBLEMS, AND BACKWARD SDE Nizar ouzi nizar.ouzi@polyechnique.edu Ecole Polyechnique Paris Déparemen de Mahémaiques Appliquées Chaper 12 by Agnès OURIN May 21 2 Conens
More informationSEMIMARTINGALE STOCHASTIC APPROXIMATION PROCEDURE AND RECURSIVE ESTIMATION. Chavchavadze Ave. 17 a, Tbilisi, Georgia, E-mail: toronj333@yahoo.
SEMIMARTINGALE STOCHASTIC APPROXIMATION PROCEDURE AND RECURSIVE ESTIMATION N. LAZRIEVA, 2, T. SHARIA 3, 2 AND T. TORONJADZE Georgian American Universiy, Business School, 3, Alleyway II, Chavchavadze Ave.
More informationOption Pricing Under Stochastic Interest Rates
I.J. Engineering and Manufacuring, 0,3, 8-89 ublished Online June 0 in MECS (hp://www.mecs-press.ne) DOI: 0.585/ijem.0.03. Available online a hp://www.mecs-press.ne/ijem Opion ricing Under Sochasic Ineres
More informationadaptive control; stochastic systems; certainty equivalence principle; long-term
COMMUICATIOS I IFORMATIO AD SYSTEMS c 2006 Inernaional Press Vol. 6, o. 4, pp. 299-320, 2006 003 ADAPTIVE COTROL OF LIEAR TIME IVARIAT SYSTEMS: THE BET O THE BEST PRICIPLE S. BITTATI AD M. C. CAMPI Absrac.
More informationSecond Order Linear Differential Equations
Second Order Linear Differenial Equaions Second order linear equaions wih consan coefficiens; Fundamenal soluions; Wronskian; Exisence and Uniqueness of soluions; he characerisic equaion; soluions of homogeneous
More informationCHARGE AND DISCHARGE OF A CAPACITOR
REFERENCES RC Circuis: Elecrical Insrumens: Mos Inroducory Physics exs (e.g. A. Halliday and Resnick, Physics ; M. Sernheim and J. Kane, General Physics.) This Laboraory Manual: Commonly Used Insrumens:
More informationABSTRACT KEYWORDS. Markov chain, Regulation of payments, Linear regulator, Bellman equations, Constraints. 1. INTRODUCTION
QUADRATIC OPTIMIZATION OF LIFE AND PENSION INSURANCE PAYMENTS BY MOGENS STEFFENSEN ABSTRACT Quadraic opimizaion is he classical approach o opimal conrol of pension funds. Usually he paymen sream is approximaed
More information11/6/2013. Chapter 14: Dynamic AD-AS. Introduction. Introduction. Keeping track of time. The model s elements
Inroducion Chaper 14: Dynamic D-S dynamic model of aggregae and aggregae supply gives us more insigh ino how he economy works in he shor run. I is a simplified version of a DSGE model, used in cuing-edge
More informationJournal Of Business & Economics Research September 2005 Volume 3, Number 9
Opion Pricing And Mone Carlo Simulaions George M. Jabbour, (Email: jabbour@gwu.edu), George Washingon Universiy Yi-Kang Liu, (yikang@gwu.edu), George Washingon Universiy ABSTRACT The advanage of Mone Carlo
More informationDynamic Information. Albina Danilova Department of Mathematical Sciences Carnegie Mellon University. September 16, 2008. Abstract
Sock Marke Insider Trading in Coninuous Time wih Imperfec Dynamic Informaion Albina Danilova Deparmen of Mahemaical Sciences Carnegie Mellon Universiy Sepember 6, 28 Absrac This paper sudies he equilibrium
More informationLectures # 5 and 6: The Prime Number Theorem.
Lecures # 5 and 6: The Prime Number Theorem Noah Snyder July 8, 22 Riemann s Argumen Riemann used his analyically coninued ζ-funcion o skech an argumen which would give an acual formula for π( and sugges
More informationRC (Resistor-Capacitor) Circuits. AP Physics C
(Resisor-Capacior Circuis AP Physics C Circui Iniial Condiions An circui is one where you have a capacior and resisor in he same circui. Suppose we have he following circui: Iniially, he capacior is UNCHARGED
More informationA UNIFIED APPROACH TO MATHEMATICAL OPTIMIZATION AND LAGRANGE MULTIPLIER THEORY FOR SCIENTISTS AND ENGINEERS
A UNIFIED APPROACH TO MATHEMATICAL OPTIMIZATION AND LAGRANGE MULTIPLIER THEORY FOR SCIENTISTS AND ENGINEERS RICHARD A. TAPIA Appendix E: Differeniaion in Absrac Spaces I should be no surprise ha he differeniaion
More informationConditional Default Probability and Density
Condiional Defaul Probabiliy and Densiy N. El Karoui, M. Jeanblanc, Y. Jiao, B. Zargari Absrac This paper proposes differen mehods o consruc condiional survival processes, i.e, families of maringales decreasing
More informationTime Consisency in Porfolio Managemen
1 Time Consisency in Porfolio Managemen Traian A Pirvu Deparmen of Mahemaics and Saisics McMaser Universiy Torono, June 2010 The alk is based on join work wih Ivar Ekeland Time Consisency in Porfolio Managemen
More informationDifferential Equations in Finance and Life Insurance
Differenial Equaions in Finance and Life Insurance Mogens Seffensen 1 Inroducion The mahemaics of finance and he mahemaics of life insurance were always inersecing. Life insurance conracs specify an exchange
More informationAP Calculus AB 2013 Scoring Guidelines
AP Calculus AB 1 Scoring Guidelines The College Board The College Board is a mission-driven no-for-profi organizaion ha connecs sudens o college success and opporuniy. Founded in 19, he College Board was
More informationINTEREST RATE FUTURES AND THEIR OPTIONS: SOME PRICING APPROACHES
INTEREST RATE FUTURES AND THEIR OPTIONS: SOME PRICING APPROACHES OPENGAMMA QUANTITATIVE RESEARCH Absrac. Exchange-raded ineres rae fuures and heir opions are described. The fuure opions include hose paying
More informationA general decomposition formula for derivative prices in stochastic volatility models
A general decomposiion formula for derivaive prices in sochasic volailiy models Elisa Alòs Universia Pompeu Fabra C/ Ramón rias Fargas, 5-7 85 Barcelona Absrac We see ha he price of an european call opion
More informationOn the Role of the Growth Optimal Portfolio in Finance
QUANTITATIVE FINANCE RESEARCH CENTRE QUANTITATIVE FINANCE RESEARCH CENTRE Research Paper 144 January 2005 On he Role of he Growh Opimal Porfolio in Finance Eckhard Plaen ISSN 1441-8010 www.qfrc.us.edu.au
More informationSignal Processing and Linear Systems I
Sanford Universiy Summer 214-215 Signal Processing and Linear Sysems I Lecure 5: Time Domain Analysis of Coninuous Time Sysems June 3, 215 EE12A:Signal Processing and Linear Sysems I; Summer 14-15, Gibbons
More informationKeldysh Formalism: Non-equilibrium Green s Function
Keldysh Formalism: Non-equilibrium Green s Funcion Jinshan Wu Deparmen of Physics & Asronomy, Universiy of Briish Columbia, Vancouver, B.C. Canada, V6T 1Z1 (Daed: November 28, 2005) A review of Non-equilibrium
More information1. Introduction. We consider a d-dimensional stochastic differential equation (SDE) defined by
SIAM J. CONROL OPIM. Vol. 43, No. 5, pp. 1676 1713 c 5 Sociey for Indusrial and Applied Mahemaics SENSIIVIY ANALYSIS USING IÔ MALLIAVIN CALCULUS AND MARINGALES, AND APPLICAION O SOCHASIC OPIMAL CONROL
More informationThe option pricing framework
Chaper 2 The opion pricing framework The opion markes based on swap raes or he LIBOR have become he larges fixed income markes, and caps (floors) and swapions are he mos imporan derivaives wihin hese markes.
More informationForecasting and Information Sharing in Supply Chains Under Quasi-ARMA Demand
Forecasing and Informaion Sharing in Supply Chains Under Quasi-ARMA Demand Avi Giloni, Clifford Hurvich, Sridhar Seshadri July 9, 2009 Absrac In his paper, we revisi he problem of demand propagaion in
More information4 Convolution. Recommended Problems. x2[n] 1 2[n]
4 Convoluion Recommended Problems P4.1 This problem is a simple example of he use of superposiion. Suppose ha a discree-ime linear sysem has oupus y[n] for he given inpus x[n] as shown in Figure P4.1-1.
More informationA Simple Introduction to Dynamic Programming in Macroeconomic Models
Economics Deparmen Economics orking Papers The Universiy of Auckland Year A Simple Inroducion o Dynamic Programming in Macroeconomic Models Ian King Universiy of Auckland, ip.king@auckland.ac.nz This paper
More informationDistributing Human Resources among Software Development Projects 1
Disribuing Human Resources among Sofware Developmen Proecs Macario Polo, María Dolores Maeos, Mario Piaini and rancisco Ruiz Summary This paper presens a mehod for esimaing he disribuion of human resources
More informationPROFIT TEST MODELLING IN LIFE ASSURANCE USING SPREADSHEETS PART ONE
Profi Tes Modelling in Life Assurance Using Spreadshees PROFIT TEST MODELLING IN LIFE ASSURANCE USING SPREADSHEETS PART ONE Erik Alm Peer Millingon 2004 Profi Tes Modelling in Life Assurance Using Spreadshees
More informationARCH 2013.1 Proceedings
Aricle from: ARCH 213.1 Proceedings Augus 1-4, 212 Ghislain Leveille, Emmanuel Hamel A renewal model for medical malpracice Ghislain Léveillé École d acuaria Universié Laval, Québec, Canada 47h ARC Conference
More informationPATHWISE PROPERTIES AND PERFORMANCE BOUNDS FOR A PERISHABLE INVENTORY SYSTEM
PATHWISE PROPERTIES AND PERFORMANCE BOUNDS FOR A PERISHABLE INVENTORY SYSTEM WILLIAM L. COOPER Deparmen of Mechanical Engineering, Universiy of Minnesoa, 111 Church Sree S.E., Minneapolis, MN 55455 billcoop@me.umn.edu
More informationHOW CLOSE ARE THE OPTION PRICING FORMULAS OF BACHELIER AND BLACK-MERTON-SCHOLES?
HOW CLOSE ARE THE OPTION PRICING FORMULAS OF BACHELIER AND BLACK-MERTON-SCHOLES? WALTER SCHACHERMAYER AND JOSEF TEICHMANN Absrac. We compare he opion pricing formulas of Louis Bachelier and Black-Meron-Scholes
More informationStochastic Calculus and Option Pricing
Sochasic Calculus and Opion Pricing Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Sochasic Calculus 15.450, Fall 2010 1 / 74 Ouline 1 Sochasic Inegral 2 Iô s Lemma 3 Black-Scholes
More informationDistributed and Secure Computation of Convex Programs over a Network of Connected Processors
DCDIS CONFERENCE GUELPH, ONTARIO, CANADA, JULY 2005 1 Disribued and Secure Compuaion of Convex Programs over a Newor of Conneced Processors Michael J. Neely Universiy of Souhern California hp://www-rcf.usc.edu/
More informationDuration and Convexity ( ) 20 = Bond B has a maturity of 5 years and also has a required rate of return of 10%. Its price is $613.
Graduae School of Business Adminisraion Universiy of Virginia UVA-F-38 Duraion and Convexiy he price of a bond is a funcion of he promised paymens and he marke required rae of reurn. Since he promised
More informationAP Calculus AB 2010 Scoring Guidelines
AP Calculus AB 1 Scoring Guidelines The College Board The College Board is a no-for-profi membership associaion whose mission is o connec sudens o college success and opporuniy. Founded in 1, he College
More informationOPTIMAL PRODUCTION SALES STRATEGIES FOR A COMPANY AT CHANGING MARKET PRICE
REVISA DE MAEMÁICA: EORÍA Y APLICACIONES 215 22(1) : 89 112 CIMPA UCR ISSN: 149-2433 (PRIN), 2215-3373 (ONLINE) OPIMAL PRODUCION SALES SRAEGIES FOR A COMPANY A CHANGING MARKE PRICE ESRAEGIAS ÓPIMAS DE
More informationNetwork Effects, Pricing Strategies, and Optimal Upgrade Time in Software Provision.
Nework Effecs, Pricing Sraegies, and Opimal Upgrade Time in Sofware Provision. Yi-Nung Yang* Deparmen of Economics Uah Sae Universiy Logan, UT 84322-353 April 3, 995 (curren version Feb, 996) JEL codes:
More informationOptimal Life Insurance, Consumption and Portfolio: A Dynamic Programming Approach
28 American Conrol Conference Wesin Seale Hoel, Seale, Washingon, USA June 11-13, 28 WeA1.5 Opimal Life Insurance, Consumpion and Porfolio: A Dynamic Programming Approach Jinchun Ye (Pin: 584) Absrac A
More informationOPTIMAL LIFE INSURANCE PURCHASE, CONSUMPTION AND INVESTMENT ON A FINANCIAL MARKET WITH MULTI-DIMENSIONAL DIFFUSIVE TERMS
OPTIMAL LIFE INSURANCE PURCHASE, CONSUMPTION AND INVESTMENT ON A FINANCIAL MARKET WITH MULTI-DIMENSIONAL DIFFUSIVE TERMS I. DUARTE, D. PINHEIRO, A. A. PINTO, AND S. R. PLISKA Absrac. We inroduce an exension
More informationMazee Marke And Invenory Sourcing
Opimal marke dealing under consrains Eienne Chevalier M hamed Gaïgi Vahana Ly Vah Mohamed Mnif June 25, 2015 Absrac We consider a marke dealer acing as a liquidiy provider by coninuously seing bid and
More informationMarkov Chain Modeling of Policy Holder Behavior in Life Insurance and Pension
Markov Chain Modeling of Policy Holder Behavior in Life Insurance and Pension Lars Frederik Brand Henriksen 1, Jeppe Woemann Nielsen 2, Mogens Seffensen 1, and Chrisian Svensson 2 1 Deparmen of Mahemaical
More informationLECTURE 7 Interest Rate Models I: Short Rate Models
LECTURE 7 Ineres Rae Models I: Shor Rae Models Spring Term 212 MSc Financial Engineering School of Economics, Mahemaics and Saisics Birkbeck College Lecurer: Adriana Breccia email: abreccia@emsbbkacuk
More informationSteps for D.C Analysis of MOSFET Circuits
10/22/2004 Seps for DC Analysis of MOSFET Circuis.doc 1/7 Seps for D.C Analysis of MOSFET Circuis To analyze MOSFET circui wih D.C. sources, we mus follow hese five seps: 1. ASSUME an operaing mode 2.
More informationEndpoint Strichartz estimates and global solutions for the nonlinear Dirac equation 1
Endpoin Sricharz esimaes and global soluions for he nonlinear Dirac equaion 1 Shuji Machihara, Makoo Nakamura, Kenji Nakanishi, and Tohru Ozawa Absrac. We prove endpoin Sricharz esimaes for he Klein-Gordon
More informationMonte Carlo Observer for a Stochastic Model of Bioreactors
Mone Carlo Observer for a Sochasic Model of Bioreacors Marc Joannides, Irène Larramendy Valverde, and Vivien Rossi 2 Insiu de Mahémaiques e Modélisaion de Monpellier (I3M UMR 549 CNRS Place Eugène Baaillon
More informationThe Application of Multi Shifts and Break Windows in Employees Scheduling
The Applicaion of Muli Shifs and Brea Windows in Employees Scheduling Evy Herowai Indusrial Engineering Deparmen, Universiy of Surabaya, Indonesia Absrac. One mehod for increasing company s performance
More informationEconomics Honors Exam 2008 Solutions Question 5
Economics Honors Exam 2008 Soluions Quesion 5 (a) (2 poins) Oupu can be decomposed as Y = C + I + G. And we can solve for i by subsiuing in equaions given in he quesion, Y = C + I + G = c 0 + c Y D + I
More informationThe Heisenberg group and Pansu s Theorem
The Heisenberg group and Pansu s Theorem July 31, 2009 Absrac The goal of hese noes is o inroduce he reader o he Heisenberg group wih is Carno- Carahéodory meric and o Pansu s differeniaion heorem. As
More informationANALYTIC PROOF OF THE PRIME NUMBER THEOREM
ANALYTIC PROOF OF THE PRIME NUMBER THEOREM RYAN SMITH, YUAN TIAN Conens Arihmeical Funcions Equivalen Forms of he Prime Number Theorem 3 3 The Relaionshi Beween Two Asymoic Relaions 6 4 Dirichle Series
More informationNewton s Laws of Motion
Newon s Laws of Moion MS4414 Theoreical Mechanics Firs Law velociy. In he absence of exernal forces, a body moves in a sraigh line wih consan F = 0 = v = cons. Khan Academy Newon I. Second Law body. The
More informationViscosity Solution of Optimal Stopping Problem for Stochastic Systems with Bounded Memory
Viscosiy Soluion of Opimal Sopping Problem for Sochasic Sysems wih Bounded Memory Mou-Hsiung Chang Tao Pang Mousapha Pemy April 5, 202 Absrac We consider a finie ime horizon opimal sopping problem for
More informationTask is a schedulable entity, i.e., a thread
Real-Time Scheduling Sysem Model Task is a schedulable eniy, i.e., a hread Time consrains of periodic ask T: - s: saring poin - e: processing ime of T - d: deadline of T - p: period of T Periodic ask T
More informationOptimal Consumption and Insurance: A Continuous-Time Markov Chain Approach
Opimal Consumpion and Insurance: A Coninuous-Time Markov Chain Approach Holger Kraf and Mogens Seffensen Absrac Personal financial decision making plays an imporan role in modern finance. Decision problems
More information9. Capacitor and Resistor Circuits
ElecronicsLab9.nb 1 9. Capacior and Resisor Circuis Inroducion hus far we have consider resisors in various combinaions wih a power supply or baery which provide a consan volage source or direc curren
More informationMarket Completion and Robust Utility Maximization
Marke Compleion and Robus Uiliy Maximizaion DISSERTATION zur Erlangung des akademischen Grades docor rerum nauralium (Dr. rer. na.) im Fach Mahemaik eingereich an der Mahemaisch-Naurwissenschaflichen Fakulä
More information