arxiv: v3 [math.pr] 5 Nov 2018

Transcription

1 Submitted article Algebraic Structures and Stochastic Differential Equations driven by Lévy processes Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese arxiv: v3 [math.pr] 5 Nov 218 5th November 218 Abstract We construct an efficient integrator for stochastic differential systems driven by Lévy processes. An efficient integrator is a strong approximation that is more accurate than the corresponding stochastic Taylor approximation, to all orders and independent of the governing vector fields. This holds provided the driving processes possess moments of all orders and the vector fields are sufficiently smooth. Moreover the efficient integrator in question is optimal within a broad class of perturbations for half-integer global root meansquare orders of convergence. We obtain these results using the quasi-shuffle algebra of multiple iterated integrals of independent Lévy processes. 1 Introduction We consider the simulation of Itô stochastic differential systems driven by independent Lévy processes possessing moments of all orders. Our goal is to derive a new strong numerical integration scheme for such systems that is Charles Curry Maxwell Institute for Mathematical Sciences and School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh EH14 4AS, UK. Present address: of Charles Curry Department of Mathematical Sciences, NTNU, 7491 Trondheim, Norway. Kurusch Ebrahimi Fard Department of Mathematical Sciences, NTNU, 7491 Trondheim, Norway. Simon J.A. Malham Maxwell Institute for Mathematical Sciences and School of Mathematical and Computer Sciences, Heriot Watt University, Edinburgh EH14 4AS, UK. Anke Wiese Maxwell Institute for Mathematical Sciences and School of Mathematical and Computer Sciences, Heriot Watt University, Edinburgh EH14 4AS, UK.

2 2 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese efficient in the following sense. The efficient scheme has a strong error at leading order that is always smaller than the strong error of the corresponding stochastic Taylor approximation. This is true for any such stochastic differential systems of any size, and for all orders of approximation. Moreover, for half-integer orders, our efficient integrator is optimal in the sense that its global root mean-square strong error realizes its smallest possible value in a broad class of perturbations compared to the error of the corresponding stochastic Taylor approximation. Lévy processes are a class of stochastic processes which are continuous in probability and possess stationary increments, independent of the past. They are examples of stochastic processes with a well understood structure that incorporate jump discontinuities. Due to the Lévy Itô decomposition of a Lévy process the systems we consider can be written in the form y t = y + d i= t V i (y s )dw i s + l i=d+1 t V i (y s )dj i s, for y t R N with N N; see for example Applebaum [2]. We assume all the governing autonomous vector fields V i : R N R N are smooth and in general non-commuting. Note that by convention we suppose Wt t. The system is thus driven by the independent Wiener processes W i for i = 1,...,d, and the purely discontinuous martingales J i for i = d+1,...,l which are expressible in the form t Jt i = vq i (dv,ds), R where Q i (dv,ds) := Q i (dv,ds) ρ i (dv)ds. The Q i are Poisson measures on R R + with intensity measures ρ i (dv)ds, where the ρ i are measures on R with ρ i ({}) = and R (1 v2 )ρ i (dv) <. Intuitively, Q i (B,(a,b]) counts the number of jumps of the process J i taking values in the set B in the time interval (a,b], whilst ρ i (B) measures the expected number of jumps per unit time the process J i accrues taking values in the set B. We emphasize that we assume that the J i possess moments of all orders. Let us outline our approach to the strong numerical simulation of Lévydriven stochastic differential systems via steps (1) (4) below. As we do so we will present the new results we prove in this paper and put them into context. We will also describe the algebraic approach we employ to prove the results and its usefulness. Step (1). We begin by studying strong integration schemes for stochastic differential systems such as those above. Such schemes are typically derived from the stochastic Taylor expansion for the solution given by y t = I w (t) [Ṽw (y )]. w A A derivation can be found in Platen & Bruti-Liberati [71]; also see Platen [69, 7] and Platen & Wagner [72]. It is produced via Picard iteration using the chain rule for the solution process y t. We show this explicitly at the beginning

3 SDEs driven by Lévy processes 3 of 2. In the expansion the set A consists of all the multi-indices (or words) that can be constructed from the set of letters A := {,1,...,d,d+1,...,l}. The terms I w (t) [ Ṽ w (y )] represent iterated integrals of the integrands Ṽw(y ) which involve compositions of the vector fields (as first order partial differential and difference operators) governing the Lévy-driven stochastic differential system. See the beginning of 2 and in particular Theorem 1 for a more precise prescription. For sufficiently smooth vector fields, integration schemes of arbitrary strong order of convergence may be constructed by truncating the series expansion to an appropriate number of terms. Platen & Bruti-Liberati[71] show which terms must be retained to obtain a strong integration scheme with a given strong order of convergence. We assume hereafter the governing vector fields are sufficiently smooth for the stochastic Taylor expansion to exist. Our first new result in this paper is Theorem 2 in 2 in which we show that the terms in the stochastic Taylor expansion above can be written in separated form as I w (t)ṽw(y ). We observe that the time-dependent stochastic information which is encoded in the now integrand-free multiple integrals I w are separated as scalar multiplicative factors of the structure information which is encoded in the terms Ṽw(y ) which involve compositions of the vector fields as first order partial differential operators only. Indeed the separated expansion is essentially achieved by Taylor expanding all the shift operators associated with the purely discontinuous terms in the original stochastic Taylor expansion. Note that the result of this is that the sum is over an expanded set of multi-indices/words A constructed from the alphabet A which contains A. The additional letters in A are compensated power brackets associated with the purely discontinuous terms. See 2 for more precise details as well as Curry, Ebrahimi Fard, Malham & Wiese [21]. The advantages of this separated form are: (i) the simulation of the stochastic components I w of the system, for which targeted generic simulation algorithms can be developed, is now separated from the inherent structure components; (ii) it provides the context/basis to develop the more general strong integrators we are about to discuss next and (iii) we can take advantage of well developed algebraic structures which underlie such expansions as we shall see. As is well known the order of a strong numerical scheme is determined by the set of multiple integrals I w retained in any approximation. We also emphasize here that in any Monte Carlo simulation, the bulk of the computational effort goes into simulating the higher order multiple integrals included, in particular those indexed by words of length two or more involving distinct non-zero letters though see Malham & Wiese [6] for new efficient methods for simulating the Lévy area. Once this set of multiple integrals is fixed (with its associated computational burden) the order of convergence is fixed, i.e. the power of the stepsize in the leading order term of the strong error. More accurate schemes correspond to those that generate smaller coefficients in the leading order term. Step (2). We then discuss how strong integrators based on truncations of the stochastic Taylor expansion are just one example of a more general class of integrators we shall call map-truncate-invert schemes. General map-truncate-

4 4 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese invert schemes were first introduced in Malham & Wiese [59] for Stratonovich drift-diffusion equations and are constructed as follows. We start with the flowmap ϕ t : y y t lying in Diff(R N ) which maps the initial data y to the solution y t at time t >. Here Diff(R N ) denotes the space of diffeomorphisms on R N. From our discussion above, the separated stochastic Taylor expansion for the flowmap has the form ϕ t = w A I w (t)ṽw. This separated form is key and crucial to all our subsequent developments herein. Now, given any invertible map f: Diff(R N ) Diff(R N ), the corresponding map-truncate-invert scheme is constructed thus: we expand the series f(ϕ t ), truncate according to a chosen grading and then apply f 1. See 3 for more details, in particular how to construct such integrators in the Lévy-driven context. The case f = log corresponds to the exponential Lie series integrator of Castell Gaines for Stratonovich drift-diffusion equations; see Castell & Gaines [13,14]. In practice the f = log case can be implemented as follows. The series ψ t = logϕ t lies in the Lie algebra generated by the underlying vector fields with the scalar coefficients given by combinations of multiple Stratonovich integrals. Any truncation ˆψ t with the multiple integrals replaced by suitable approximate samples is also a vector field. The corresponding solution approximation is ŷ t = exp ˆψ t y. This can be generated by solving the ordinary differential system u = ˆψ t u for u = u(τ) on τ [,1] with u() = y. Typically this is achieved using a suitable numerical scheme. The approximation u(1) represents ŷ t. Generally, apart from the low order cases stipulated below, the Castell Gaines method is not asymptotically efficient. This was shown by Malham & Wiese [59] who consequently considered the problem of designing so-called efficient integrators for Stratonovich driftdiffusion equations driven by multiple independent Wiener processes. Here, efficient integrators of a given order have leading order error which is always less than that for the corresponding stochastic Taylor scheme, independent of the governing vector fields. Malham & Wiese [59] then proved that an integration scheme based on the map f = sinhlog is efficient. These results were obtained in the absence of a drift term and extended to incorporate drift in Ebrahimi Fard, Lundervold, Malham, Munthe Kaas & Wiese [22]. It is the generalization of this latter result to Lévy-driven systems that we consider presently. Step (3). We temporarily revert our discussion to stochastic Taylor approximations. We prove a new result for such schemes which is an important step towards our main result. This concerns the relative accuracy of strong numerical methods for Lévy-driven stochastic differential systems generated by truncating the stochastic Taylor expansion according to word length or mean-square grading. The length of any word w A is the number of letters it contains while its mean-square grading is similar but zero letters are counted twice consistent with the L 2 -norm of I w. Suppose Rt wl(y ) and Rt ms (y ) are

5 SDEs driven by Lévy processes 5 the remainders generated by truncating the separated stochastic Taylor expansion for y t by keeping all words of length and mean-square grade less than or equal to n, respectively. Then in 4 (see Theorem 3) we prove that at leading order for all n we have R wl t (y ) 2 L 2 R ms t (y ) 2 L 2. There is computational effort involved in simulating any such word length stochastic Taylor approximation due to the extra iterated integrals included. However those that are included are indexed by words which include at least one drift(zero) letter, i.e. integrating with respect to dt, or repeated Lévy(nonzero) letters which are computationally less burdensome to compute than those indexed by words containing completely distinct non-zero letters. We assess the trade off of accuracy versus computational effort once we introduce our main result next. Step (4). Lastly, we present our new antisymmetric sign reverse integrator and prove that it is an efficient integrator for Lévy-driven systems; see Theorem 4(a). In addition, we prove that it is optimal at half-integer global root mean-square orders of convergence; see Theorem 4(b). It is an example of a map-truncate-invert scheme and the principle ideas underlying its construction and properties are as follows. To begin with we consider the result of applying the first two steps of the map-truncate-invert scheme as described above, i.e. considering a function f(ϕ t ) of the flowmap and then truncating the result according to a given grading up to and including terms of grade n. The pre-remainder is the remainder after truncating f(ϕ t ) in this way. We then show that for word length grading, at leading order, the pre-remainder is equal to the true remainder, i.e. equal to the remainder after applying f 1 to the truncated f(ϕ t ). Herein lies the room-for-manouver of which we take advantage. Naturally the map-truncate-invert scheme must emulate the scheme based on the corresponding stochastic Taylor expansion truncated according to the same grading. The question is thus, is the pre-remainder (and thus remainder) associated with the map-truncate-invert scheme at hand less than the remainder associated with the corresponding stochastic Taylor approximation to leading order in the mean-square measure? The answer is yes for the antisymmetric sign reverse integrator. This integrator is constructed by taking half the difference of the stochastic Taylor expansion and the stochastic Taylor expansion with all the words indexing the multiple integrals reversed in order and signed according to the length of the words. Hence the pre-remainder and thus remainder are Rt ASRI (y ) = ) 1 2( Iw I S(w) Vw (y ). w =n+1 Here w represents the length of the word w and S is the signed reversal map defined as S: a 1 a 2...a n ( 1) n a n a n 1...a 1 for any word consisting of letters a 1, a 2,..., a n from A. We naturally assume I w I w. Our principal

6 6 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese main result is thus R ASRI t (y ) 2 L R wl 2 t (y ) 2, L 2 for all y, all Lévy-driven systems, to all orders n. Using our result above this means the antisymmetric sign reverse integrator is more accurate than the corresponding stochastic Taylor approximation truncated according to meansquare grading. Furthermore we show that when n is odd, the inequality just above is optimal in the following sense. Suppose we perturb the antisymmetric sign reverse integrator by a general class of perturbations see 5 for more details. Then when n is odd we show that the difference between the two mean-square error measures for Rt wl(y ) and Rt ASRI (y ) above are minimized when the perturbation is zero. One further technical practical aspect comes into play. In the Castell Gaines case we compute f 1 = exp by solving an ordinary differential system. If all the underlyingvector fields are linear f 1 may be computed as a matrix-valued compositional inverse function; see Malham & Wiese [59]. However we cannot do this in general for map-truncate-invert schemes. To circumvent this issue we have developed direct-map-truncateinvert schemes with a special case being the direct antisymmetric sign reverse integrator. In direct-map-truncate-invert schemes we utilize the observation above that map-truncate-invert schemes naturally emulate the scheme based on the corresponding stochastic Taylor approximation to the same order, but have a different remainder at leading order as different terms at leading order in the remainder are included in the integrator. Thus in order to simulate a direct-map-truncate-invert scheme we simulate the corresponding stochastic Taylor approximation to the same order as well as the terms that lie in the difference between the stochastic Taylor approximation remainder and map-truncate-invert approximation remainder at leading order. These are additional terms indexed by words of length n+1, the terms concerned will not involve iterated integrals involving completely distinct letters (those would belong to the next order integrator). Our discussion above in the last paragraph on the computational burden involved thus applies here. Indeed we round off our results herein with global convergence results in 6 and numerical simulations demonstrating our conclusions in 7. We remark that several challenges are encountered upon generalising from drift-diffusions to Lévy-driven equations. The stochastic Taylor expansions derived by Platen & Bruti Liberati [71] do not display the separation of geometric and stochastic required for the deployment of map-truncate-invert schemes. Furthermore, due to the discontinuities of the driving paths, it is not possible to use Stratonovich integrals to obtain the usual product rule for iterated integrals. Algebraically, this means that we must use the quasishuffle algebra of iterated integrals with respect to Lévy processes (see Curry, Ebrahimi Fard, Malham & Wiese [21]) rather than the shuffle algebra used in the derivation of map-truncate-invert schemes for drift-diffusions. Further, it is rather intriguing that the efficient integrator in the Lévy-driven (quasishuffle) context herein is the antisymmetric sign reverse integrator, i.e. half the difference of the identity and sign-reverse endomorphisms. This coincides

7 SDEs driven by Lévy processes 7 with efficient integrator in the drift-diffusion (shuffle) case. In the shuffle case the sign-reverse endomorphism coincides with the antipode. However in the general quasi-shuffle case this is no longer true. We prove our key results above in the context of combinatorial algebras, in particular the quasi-shuffle Hopf algebra and the convolutional algebra of endomorphisms defined on the quasi-shuffle Hopf algebra. It is this abstraction that not only allowsus to proveour main results but alsoexplicitly identify the Efficient Integrator. These algebraic structures underlie the separated stochastic Taylor expansion for the flowmap associated with Lévy-driven stochastic differential systems and all the manipulations we apply to the separated stochastic Taylor expansion when we construct map-truncate-invert schemes and assess their properties. The separated stochastic Taylor expansion is the starting point for our analysis. Key for its derivation is the repeated application of Itô s formula. The stochastic information of our Lévy-driven system is thus given by the Wiener processes and by the purely discontinuous martingales in the Lévy Itô decomposition of the driving Lévy processes as well as by their quadratic variation processes and power brackets. We encode this stochastic information in our augmented alphabet A: each letter in A is associated with a Wiener processes or a purely discontinous processes driving the stochastic differential equation or with a compensated power bracket generated from these. For technical reasons it is opportune to use compensated power brackets rather than power brackets. Once we have constructed the alphabet, we can associate words constructed from this alphabet with the corresponding iterated integral. For example, for two Wiener processes W 1 and W 2, the word ω = 12 is associated with the iterated integral I 12 = τ 1 τ 2 t dw1 τ 1 dw 2 τ 2. For a Wiener process W 1 and purely discontinuous martingale J i with i {d+1,...,l}, the wordω = 1iisassociatedwiththeiteratedintegralI 1i = τ 1 τ 2 t dw1 τ 1 dj i τ 2. See Curry et al. [21] as well as 2 for more details on the necessity and construction of the augmented alphabet A. Associated with each member of the alphabet A constructed from the stochastic information is a corresponding partial differential operator. With each word we associate the partial differential operator obtained by compositions of the differential operators associated with thelettersconstitutingtheword(see 2formoredetails).Ourfirstmainresult is that the separated stochastic Taylor expansion for the flowmap above is the sum ϕ t = w A I w (t)ṽw over the real multiplication of the multiple integrals I w and differential operators Ṽw which are indexed by all words/multi-indices that can be constructed from the augmented alphabet A containing the original alphabet A. Now consider functions f: Diff(R N ) Diff(R N ) of the flowmap whichhavesimplepowerseriesexpansionssuchasf(ϕ) = k c kϕ k,forsome real coefficients c k. Applying such a function to the flowmap generates linear combinations of products of the multiple integrals and linear combinations of compositions of the differential operators, i.e. operations in the respective algebras generated by the multiple integrals and by the differential operators. The algebra generated by the multiple integrals can be identified with the quasi-shuffle algebra of the words constructed from A, again see Curry et al.

8 8 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese [21] as well as 2. The algebra generated by the composition of differential operators can be identified with a concatenation algebra of the words. Specifically, if we strip away the I s and Ṽ s we can represent the stochastic Taylor series for the flowmap by w w. w A This lies in a product algebra in which the bilinear product of two terms is given by (u x)(v y) = (u v) (xy), foranywordsu,v,x,y constructedfroma. Onthe left u v is thequasi-shuffle product of u and v representing the real product I u I v. On the right xy is the concatentation of x and y representing the composition of the differential operators Ṽx and Ṽy. Substituting the abstract series representation for the flowmap above into f(ϕ), where f has the power series expansion with real coefficients c k indicated above, by direct computation and rearrangement we have (see for example Ebrahimi Fard, et al. [22]), where F(w) = f(ϕ) = w c k k= w A F(w) w, u 1,...,u k A u 1...u k =w u 1 u k. Here F is a linear endomorphism on words. This last calculation shows us that we can encode functions of the flowmap f(ϕ) by endomorphisms F on the quasi-shuffle algebra of words. A fundamental building block of the endomorphism F is the action w u 1,...,u k A u 1...u k =w u 1 u k, i.e. the sum of the quasi-shuffle product u 1 u k of any possible separation of w into any subwords u 1,..., u k. This object is the k-th convolution power of the identity endomorphism id k acting on w. We can thus abstract the context one level further, and this abstraction is natural and key. The function f of the flowmap f(ϕ) can be represented by F(id) = k c kid k, where the action of id k is id k (w) = u 1...u k =w u 1 u k. Once the stochastic system under consideration is fixed, i.e. we have prescribed the driving Lévy processes and governing vector fields, the words are fixed. Different integrators are distinguished by their actions on those words and are represented by endomorphisms acting on them. The stochastic Taylor expansion itself corresponds to the case where F is the identity id endomorphism.

9 SDEs driven by Lévy processes 9 We thus utilize two consecutive levels of abstraction herein. The first abstraction is to the product algebra with quasi-shuffles on one side and concatenations on the other. The second abstraction is to the algebra of endomorphisms that act on the Hopf quasi-shuffle algebra. On this algebra we can define an inner product representing the L 2 inner product on stochastic processes. Our abstraction encapsules the information required for our problem under consideration, and we are naturally able to represent map-truncateinvert approximations succinctly and to analyse their properties independent of the underlying system, data and truncation order. This enables us to establish the general results we present. Lévy processes have many applications. Most notably though they appear in mathematical finance in the construction of models going beyond the Black Scholes Merton model to incorporate discontinuities in stock prices. See for example Cont & Tankov [19] and Barndorff Nielsen, Mikosch & Resnick [4] and the references therein. There are also applications to physical sciences, see for instance Barndorff Nielsen, Mikosch & Resnick [4]. Work on Euler type methods for simulating Lévy-driven stochastic differential systems including how to incorporate the jump processes can for example be found in Jacod [46], Fournier [27]. See Higham & Kloeden [37, 38] for implicit methods and Protter & Talay [74] for weak approximations. The monograph by Platen & Bruti-Liberati [71] provides a comprehensive introduction to numerical simulation schemes for stochastic differential systems driven by Lévy processes and includes financial applications. Barski [5] also develops general high order schemes for Lévy-driven systems. Pathwise integrals of Lévy processes have been constructed in the framework of rough paths by Friz & Shekhar [28]. The problem of minimizing the coefficient in the leading error term in stochastic Taylor integrators was considered by Clark [16] and Newton [67, 68] for drift-diffusion equations driven by a single Wiener process; also see Kloeden & Platen [48, Section 13.4]. They derived integration schemes that are asymptotically efficient in the sense that the coefficient of the leading order error is minimal among all schemes. For Stratonovich Wiener-driven stochastic differential equations, Castell & Gaines [13, 14] constructed integration schemes using the Chen-Strichartz exponential Lie series expansion (see Strichartz [8]). In the strong order one case for one driving Wiener process, and the strong order one-half case for two or more driving Wiener processes, their schemes are asymptotically efficient in the sense of Clark and Newton. The quasi-shuffle algebra of iterated stochastic integrals was considered by Gaines [3] for the case of multiple iterated integrals of Wiener processes back in A few years later Li & Liu [51] considered multiple iterated integrals of Wiener processes and standard Poisson processes. More recently Curry et al. [21] proved that the algebra of multiple integrals of a minimal family of semimartingales is isomorphic to the combinatorial quasi-shuffle algebra of words. A set of Lévy processes represents one example. The quasi-shuffle algebra is an extension of the shuffle algebra. Its historical development is of noteworthy interest. Indeed, it was introduced abstractly in a 1979 paper by Newman and Radford [66], where the authors attempt to endow the free coal-

10 1 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese gebra over an associative algebra with a Hopf algebra structure. A quarter of a century later, and independently from Gaines, in a sequence of papers, Hudson, Parthasarathy and collaborators presented a combinatorial product of iterated quantum stochastic integrals which is equivalent to the Gaines quasishuffle product; see Hudson & Parthasarathy [43,44,45] and Cohen, Eyre & Hudson [18]. This product was coined the sticky-shuffle, see Hudson [42], and was studied from a Hopf algebra viewpoint in Hudson [41]. Independently of these developments, Hoffman [39] comprehensively studied the quasi-shuffle product using a Hopf algebraic framework. The significance of the shuffle algebra was cemented in the work of Eilenberg & Maclane [25], Schützenberger [79] and Chen [15]. See Reutenauer [77] for more details. One advantage of abstracting to the quasi-shuffle algebra is that we can immediately identify the minimum set of iterated integrals that need to be simulated to implement a given accurate strong scheme. This optimizes the total computation time which is dominated by the strong simulation of the iterated integrals. Indeed, Radford [75] proved that the shuffle algebra is generated by Lyndon words. This was extended to the quasi-shuffle algebra by Newman & Radford [66] and independently later by Hoffman [39]. Gaines [3] established this independently for the case of Wiener processes, as did Li & Liu [51] for the case of Wiener processes and standard Poisson processes, while Sussmann [81] had considered a Hall basis. Hence the set of iterated integrals we need to simulate at any given order are identified by Lyndon words. The study and application of such structures in systems, control and stochastic processes can be traced back to the work of Chen [15], Magnus [56], Kunita[5], Fliess[26], Azencott[3], Sussmann[81], Strichartz[8], Ben Arous[7], Grossman & Larson [31], Reutenauer [77], Castell [12], Gaines [3], Lyons [54], Li & Liu [51], Burrage & Burrage [9], Kawski [47], Baudoin [6] and Lyons & Victoir [55]. Many of these authors focus on the exponential Lie series and its applications. A particular impetus of the study of such stuctures arose in the late nineties when Brouder [8] demonstrated the connection between the Hopf algebra used by Connes & Kreimer [17] for the renormalization problem in perturbative quantum field theory and the Butcher group used to study Runge Kutta methods by Butcher [1] in the late sixties and early seventies; see Hairer, Lubich & Wanner [36]. Hopf algebraic structures are now a natural lexicon in the study of (to name a few): (i) numerical methods for deterministic systems, such as Runge Kutta methods and geometric and symplectic integrators see for example Munthe Kaas & Wright [65], Lundervold & Munthe Kaas[53] and McLachlan, Modin, Munthe Kaas& Verdier[61];(ii) approximations for stochastic differential equations see for example Castell& Gaines [13, 14], Malham & Wiese [59], Ebrahimi Fard, et al. [22], Ebrahimi Fard, Malham, Patras & Wiese [23, 24]; (iii) rough paths see for example Hairer & Kelly [35] and Gubinelli & Tindel [33] and (iv) regularity structures for stochastic partial differential equations see for example Gubinelli [32] and Hairer [34]. In summary in this paper, what is new, representing our main results, is that we:

11 SDEs driven by Lévy processes Show the stochastic Taylor series expansion for the flowmap can be written in separated form, i.e. as a series of terms, each of which is decomposable into a multiple Itô integral and a composition of associated differential operators (see 2; in particular Theorem 2); 2. Describe the class of map-truncate-invert schemes for Lévy-driven equations and give an algebraic framework for encoding and comparing such schemes. These results generalize those in Malham& Wiese[59] and Ebrahimi Fard et al. [22] (see 3, Procedure 31); 3. Prove truncations according to the word length grading give more accurate schemes than approximations of the same order of convergence obtained by truncations according to the mean-square grading (see 4; in particular Theorem 3); 4. Show how to compute map-truncate-invert schemes in practice and how to deal with the inversion stage. We call these direct map-truncate-invert schemes (see 5, Corollary 1); 5. Introduce the antisymmetric sign reverse integrator, a new integration scheme for Lévy-driven equations, represented as half the difference of the identity and sign reverse endomorphisms on the vector space generated by words indexing multiple integrals. This scheme is efficient in the sense that its leading order mean-square error is less than that of the corresponding stochastic Taylor scheme, independent of the governing vector fields (see 5; in particular Theorem 4(a)); 6. Prove the antisymmetric sign reverse integrator is optimal in the sense outlined above at half-integer global root mean-square orders of convergence (see Theorem 4(b)). We round off this paper by establishing global convergence results from local error estimates in 6 and providing some explicit antisymmetric sign reverse integrators as well as numerical experiments demonstrating our results in 7. Further numerical results and details can be found in the electronic supplementary material, including an introduction to the role of quasi-shuffle algebras in the theory of stochastic differential equations. 2 Separated stochastic Taylor expansions Our setting is a complete, filtered probability space ( Ω,F,(F t ) t,p ), assumed to satisfy the usual hypotheses see Protter [73, p.3]. For the Itô stochastic differential system driven by Lévy processes presented in the introduction, we assume the initial data y L 2 (Ω,F,P). A stochastic Taylor expansion is an expression for the flowmap as a sum of iterated integrals. We write down the stochastic Taylor expansion for Lévydriven equations and show how and when it can be written in separated form. Recall the flowmap is defined as the map ϕ s,t : y s y t. It acts on sufficiently smooth functions f: R N R N as the pullback ϕ s,t (f(y s )) := f(y t ). We set ϕ t := ϕ,t. Itô s formula (see for example Applebaum [2, p. 23] or Protter [73,

12 12 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese p. 71]) implies f(y t ) = f(y )+ d i= t Ṽ i f(y s )dw i s + l i=d+1 t R (Ṽi f)(y s,v)q i (dv,ds), where for i = 1,...,l, the Ṽi are operators defined as follows { (Vi )f, if i = 1,...,d, Ṽ i f := f ( +vv i ( ) ) f( ), if i = d+1,...,l, and Ṽ is the operator defined by Ṽ f := (V )f+ 1 2 d N i=1 j,k=1 V j i V k i x j xk f+ l i=d+1 R [ ( Ṽ i f)(,v) v(v i )f ] ρ i (dv). Note for i = d+1,...,l, the Ṽi introduce an additional dependence on a real parameter v. The stochastic Taylor expansion is derived by expanding the integrands in the Lévy-driven equation using Itô s formula. This procedure is repeated iteratively, where the iterations are encoded as follows. Let A be the alphabet A := {,1,...,l}. For any such alphabet, we use A to denote the free monoid over A the set of words w = a 1...a m constructed from letters a i A. We write 1 for the empty word. For a given word w = a 1...a m define the operator Ṽw := Ṽa 1 Ṽa m. Let s(w) be the number of letters of w from the subset {d + 1,...,l} A. For a given integrand g(t,v): R + R s(w) R N, we define the iterated integrals I w (t)[g] inductively as follows. We write I 1 (t)[g] := g(t), and t I a1...a m 1 (s)[g]dws am, if a m =,1,...,d, I w (t)[g] := t I a1...a m 1 (s )[g(,v)]q am (dv,ds), if a m = d+1,...,l. R Iteratively applying the chain rule generates the following(see Platen & Bruti- Liberati [71]). Theorem 1 (Stochastic Taylor expansion) For a Lévy-driven equation the action of the flowmap ϕ t on sufficiently smooth functions f: R N R N can be expanded as follows ϕ t f = I w (t) [Ṽw f ]. w A Remark 1 (Stochastic Taylor expansion convergence) For integration schemes derived from the stochastic Taylor expansion to converge, it suffices that the terms Ṽw f included in the expansion, and those at leading order in the remainder, satisfy global Lipschitz and linear growth conditions (see Platen & Bruti-Liberati [71]). Hereafter we assume these conditions are satisfied.

13 SDEs driven by Lévy processes 13 Remark 2 (Platen and Bruti Liberati form) The stochastic Taylor expansion derived in Platen & Bruti-Liberati [71] is an equivalent though different representation; we show this in the electronic supplementary material. Given the stochastic Taylor expansion for the flowmap in Theorem 1, we now show how we can write it in separated form. One component of the separated form are iterated integrals which are free in the sense of having no integrand. We define these abstractly for an arbitrary given alphabet for the moment, the reason for this will be apparent presently. Definition 1 (Free multiple iterated integrals) Given a collection of stochastic processes {Zt ai } ai A, indexed by a given countable alphabet A, free multiple iterated integrals take the form I w (t) := dzτ a1 1 dzτ am m, <τ 1< <τ m<t where w = a 1...a m are words in A. We need to augment {W,W 1,...,W d,j d+1,...,j l } with a set of extended driving processes as follows. A key component in the characterization of the algebra generated by the vector space of free iterated integrals of the driving processes {W,W 1,...,W d,j d+1,...,j l } are the compensated power brackets defined for each i {d+1,..., l} and for p 2 by J i(p) t := t R v p Q i (dv,ds). Equivalently we have Jt i(p) = [J i ] (p) t R vp ρ i (dv), where [Jt i](p) is the pth order nested quadratic covariation bracket of Jt, i i.e. [Jt] i (2) := [Jt,J i t] i and [Jt i](p) := [Jt i,[ji t ](p 1) ] for p 3. Note that for p 3 the p-th power bracket [Jt i](p) equals the sum of the p-th power of the jumps of J i to time t. Importantly, the compensated power brackets have the property that if J i(p) is contained in the linear span of {t,jt i,ji(2) t,...,jt i(p 1) } for some p 2, then J i(q) is also in this linear span for all q p. Hence inductively for p 2, we augment our family {W,W 1,...,W d,j d+1,...,j l } to include the compensated power brackets J i(p) as long as they are not contained in the linear span of { } t,jt i,ji(2) t,...,jt i(p 1). By doing so, we obtain a possibly infinite family of stochastic processes. The iterated integrals of this extended family form the algebra generated by the iterated integrals of our driving processes. See Curry et al. [21] for further details. In summary we define our extended alphabet as follows. Definition 2 (Extended alphabet) We define our alphabet A to contain theletters,1,...,l,associatedtothedrivingprocesses{w,w 1,...,W d,j d+1,...,j l }, and the additional letters i (p) corresponding to any J i(p) contained in the extended family as described above.

14 14 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese Definition 3 (Separated stochastic Taylor expansion) The flowmap for a Lévy-driven stochastic differential equation possesses a separated stochastic Taylor expansion if it can be written in the form ϕ t = w A I w Ṽ w, where {I w } w A are the free iterated integrals associatedto the extended driving processes and Ṽw = Ṽa 1 Ṽa m are operators indexed by words that compose associatively. Remark 3 (Separated expansion for jump-diffusion equations) In the case of jump-diffusion equations, i.e. Lévy-driven equations for which all the discontinuous driving processes J i are standard Poisson processes, the stochastic Taylor expansion is of the separated form. Indeed, as standard Poisson processes have jumps of size one only, the operators Ṽi with i = d+1,...,l do not introduce a dependence on an additional parameter. The integrands are thus constant across the range of integration, and hence the expansion is separated. We can construct a separated stochastic Taylor expansion for the flowmap as follows. By Taylor expansion of the term f ( y+vv i (y) ) appearing in the shift Ṽ i f, we have (Ṽi f)(y,v) = m 1v m Ṽ i (m) f(y), where we write V i = ( Vi 1,...,V ) i N T ( and f = f 1,...,f N) T. We define the operators Ṽi (m) by Ṽ i (m) f j := k 1 i i k =m 1 m! V i1 i V i k i m f j y i1 y i, k where the i j N. The product in V i1 i V i k i is multiplication in R. We then have t (Ṽi (m) f ) djs i(m), I i (t)[(ṽi f)(,v)] = m 1 for i = d+1,...,l. Inserting the above into the relation I w (t) [ Ṽ w f ] = I a2...a m (t) [I a1 ( ) [ Ṽ a1 (Ṽa 2...a m f) ]] and iterating gives the separated expansion, where the operators Ṽa are those of the stochastic Taylor expansion for a {,1,...,d}, and for a = i (m) are given by the Ṽi (m) defined above. We have thus just established the following result. Theorem 2 (Separated stochastic Taylor expansion: existence) For a Lévy-driven equation suppose the terms Ṽw f in the stochastic Taylor expansion for the flowmap are analytic on R N. Then it can be written in separated form, i.e. as a separated stochastic Taylor expansion.

15 SDEs driven by Lévy processes 15 Remark 4 (Linear vector fields and linear diffeomorphisms) In this special case the separated expansion has an especially simple form; see the electronic supplementary material. Note that the identity map is a special case of a linear diffeomorphism. Hereafter we assume the existence of a separated Taylor expansion for the flowmap, and all iterated integrals are free iterated integrals. 3 Convolution algebras and map-truncate-invert schemes We now introduce a class of numerical integration schemes we call maptruncate-invert schemes and show how they can be encoded algebraically. The algebraic structures arise naturally from the products of iterated integrals and the composition of operators appearing in the separated stochastic Taylor expansion. Consider the class of numerical integration schemes obtained from the stochastic Taylor expansion by simulating truncations of the expansion on each subinterval of a uniform discretization of a given time domain [,T]. Definition 4 (Grading function and truncations) A grading function g: A N assigns a positive integer to each non-empty word w A and zero to the empty word. A truncation is specified by a grading function and truncation value n N. We write π g=n, π g n and π g n for the projections of A onto the following subsets: (i) π g=n (A ) := {w A : g(w) = n}; (ii) π g n (A ) := {w A : g(w) n} and (iii) π g n (A ) := {w A : g(w) n}. A numerical integration scheme based on the stochastic Taylor expansion is thus given by successive applications of the approximate flow I w (t)ṽw w π g n (A ) across the computational subintervals. Now more generally, consider a larger class of numerical schemes that are constructed as follows. For a given invertible map f: Diff(R N ) Diff(R N ), we construct a series expansion for f(ϕ t ) using the stochastic Taylor expansion for ϕ t. We truncate the series and simulate the retained iterated Itô integrals across each computational subinterval. An integration scheme is obtained by computing the inverse map f 1 of the simulated truncations at each step; see Malham & Wiese [59] and Ebrahimi Fard et al. [22]. We now develop an algebraic framework for studying such map-truncate-invert schemes. The starting point is the quasi-shuffle algebra; see Hudson [42] and Hoffman [39]. This gives an explicit description of the algebra of iterated integrals of the extended driving processes. Let RA denote the R-linear span of A, and let R A denote the vector space of polynomials in the non-commuting variables in A. Definition 5 (Quasi-shuffle product) For a given alphabet A, suppose [, ]: RA RA RA is a commutative, associative product on RA. The

16 16 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese quasi-shuffle product on R A, which is commutative, is generated inductively as follows: if 1 is the empty word then u 1 = 1 u = u and ua vb = (u vb)a+(ua v)b+(u v)[a,b], for all words u,v A and letters a,b A. Here ua denotes the concatenation of u and a. Remark 5 (Word-to-integral isomorphism) The word-to-integral map µ: w I w is an algebra isomorphism. Here the domain is the vector space R A equipped with the quasi-shuffle product. Iterated integrals indexed by polynomials are defined by linearity, i.e. I kuu+k vv = k u I u +k v I v, for any constants k u,k v R and words u,v A. This was proved in Curry et al. [21], it had already been established by Gaines [3] for drift-diffusions and Li & Liu [51] for jump-diffusions. Remark 6 (Shuffle product) The quasi-shuffle product is a deformation of the shuffle product on R A. The deformation is induced by an additional product [, ] defined on RA. If the product [, ] is identically zero, the quasi-shuffle product is just the shuffle product. Remark 7 (Quadratic covariation bracket) Hereweassociatetheproduct[, ]: RA RA RA underlying the quasi-shuffle with the pullback under the word-tointegral map µ of the quadratic covariation bracket of semimartingales. Explicitly, [,a] is zero for all a, and [i (p),j (q) ] = δ ij ( λ(i,p,q) + ( 1{d+1,...,l} (i) ) i (p+q)), where λ(i,p,q) = 1 if i {1,...,d}, and λ(i,p,q) = R vp+q ρ i (dv) if i {d + 1,...,l}. The refers to the letter A, and 1 {d+1,...,l} is the indicator function of the set {d+1,...,l}. Remark 8 (Word-to-operator homomorphism) The word-to-operator map κ: w Ṽ w is an algebra homomorphism. Here the domain is R A equipped with the concatenation product. This follows as R A equipped with the concatenation product is the free associative R-algebra over A, see Reutenauer [77], and each Ṽ w is given by the associative composition of operators Ṽa i. We write R A for the quasi-shuffle algebra, otherwise the product on R A is concatenation. The preceding observations combine to give an encoding of integration schemes in the algebra R A R A, where is the completed tensor product of Reutenauer [77, p. 18, 29]. Proposition 1 (Algebraic encoding of the flowmap) For a given Lévydriven equation, the map µ κ is a homomorphism from R A R A to the tensor product of the algebra of iterated integrals of the extended driving processes and the composition algebra generated by the set of operators Ṽw. Moreover, the flowmap of the equation is the image under µ κ of the element w A w w.

17 SDEs driven by Lévy processes 17 Truncations of this abstract series representation in R A R A generate approximations of the flowmap and hence classes of stochastic Taylor numerical integration schemes. Using this context, we now construct an abstract representation for f(ϕ t ) for any given map f: Diff(R N ) Diff(R N ) which is expressible as a power series. The key idea is that f(ϕ t ) may be rewritten as the image under µ κ of a series F(w) w, where F End(R A ), the space of R-linear maps from the quasi-shuffle algebra R A to itself; see Malham & Wiese [59] who established this in the shuffle product context. The explicit form of F End(R A ) is obtained using the convolution algebra associated to the quasi-shuffle product. Definition 6 (Quasi-shuffle convolution product) For a given quasishuffleproduct onr A,theconvolutionproduct off andginend(r A ) is given by F G := (F G), where is the deconcatenation coproduct that sends a word w to the sum of all its two-partitions u v and extends linearly to R A, i.e. explicitly for any word w A we have (w) = uv=wu v and ( ) F G (w) = F(u) G(v). uv=w The quasi-shuffle algebrar A together with the coproduct forms a bialgebra; see Hoffman [39] and Hudson [41]. In particular, when equipped with the convolution product, the space End(R A ) becomes a unital algebra, where the unit ν is given by the composition of the unit of the quasi-shuffle algebra and the counit of the deconcatenation coalgebra, see Abe [1]. Explicitly, ν is the linear map that sends non-empty words to zero and the empty word to itself. We define the embedding End(R A ) R A R A by F w A F(w) w. This is an algebra homomorphism for the quasi-shuffle convolution product; see Reutenauer [77], Curry [2] and Ebrahimi Fard et al. [24]. Given a power series f(x) = k c kx k with c k R, we define the convolution power series F (X) := k c kx k, where the X k are the kth convolution powers of X End(R A ). The following representation of f(ϕ t ) is immediate. Proposition 2 (Convolution power series)iff: R A R A R A R A has a power series f(x) = k c kx k, we have ( ) f w w = F (id)(w) w. w A w A Further, when the power series f has an inverse f 1 (x) = k b kx k with b k R, the compositional inverse of the convolution power series for F is given by the associated convolution power series F 1.

18 18 Charles Curry, Kurusch Ebrahimi Fard, Simon J.A. Malham and Anke Wiese In other words the pre-image under µ κ of f(ϕ t ) for any such f: Diff(R N ) Diff(R N ), which we also represent by f: R A R A R A R A, is given by the term on the left in the proposition, and thus f(ϕ t ) can be represented by F (id). Combining the algebraic encoding of the flowmap in Proposition 1 with Proposition 2, we construct the map-truncate-invert scheme associated to a given power series f as follows. Procedure 31 (Map-truncate-invert scheme) Let f: Diff(R N ) Diff(R N ) be an invertible map admitting an expansion as a power series. For a given truncation function π g n, the associated map-truncate-invert scheme across a fixed computational interval [, t] is obtained as follows. 1. Construct the series F (id); 2. Simulate the truncation π g n F (id) given by ˆσ t := w π g n (A ) I F (id)(w)(t)ṽw(id). 3. Compute the approximation f 1 (ˆσ t ) y. Remark 9 In ˆσ t in (ii) above: The identity map in F (id)(w) is the identity endomorphism in End(R A ), while the identity map in Ṽw(id) is the identity diffeomorphism on R N. Remark 1 (Map-truncate-invert endomorphism) Map-truncate-invert schemes are realizations of the integration scheme associated to the endomorphism F 1 π g n F (id) End(R A ). An endomorphism which will prove useful in what follows is the augmented ideal projector. Definition 7 (Augmented ideal projector) The augmented ideal projector denoted by J is given by J := id ν. In other words, it acts as the identity on non-empty words, but sends the empty word to zero. Example 1 (Exponential Lie series) Recall from the introduction that the motivating example of a map-truncate-invert scheme was the exponential Lie series integrator, corresponding to f = log. For any endomorphism X that maps the empty word to itself, log (X) is a power series in X ν. In particular, we have log (id) = J J 2 /2+ +( 1) k+1 J k /k +. Remark 11 For any word w, say of length k, we can naturally truncate a series in convolutional powers of J with real coefficients c 1, c 2, c 3 and so forth, to c 1 J+c 2 J 2 + +c k J k. This is because the action of J (k+1) and subsequent terms in the series is, by convention, zero as a word of length k cannot be partitioned into more than k non-empty parts. The computation of f 1 (ˆσ t ) from ˆσ t is in general non-trivial. For the exponential Lie series integrator, Castell & Gaines [13,14] proposed computing exp(ˆσ t )(y ) by numerical approximation of the ordinary differential equation u = ˆσ t (u), subject to the initial condition u() = y. An approximate solution may then be recovered from u(1). For the sinhlog integrator in the

19 SDEs driven by Lévy processes 19 shuffle product context, Malham & Wiese [59] showed that for linear constant coefficient equations, since ˆσ is a square matrix, the approximate flow expsinh 1 (ˆσ t ) = ˆσ t + ( id + ˆσ 2 t) 1/2 may be computed using a matrix square root. If the vector fields are nonlinear Malham & Wiese [59] suggested expanding the square root to sufficiently high degree terms. In 5 we introduce direct map-truncate-invert schemes which evaluate F 1 π g n F (id) directly and circumvent the step involving the computation of f 1 in general. 4 Endomorphism inner product, gradings and error analysis We establish convergence and accuracy of integration schemes at an algebraic level. We first define an inner product on the space of endomorphisms corresponding to the L 2 inner product of the associated approximate flows. We then define the mean-square grading and introduce stochastic Taylor schemes of a specific local and then global order. We subsequently consider word length grading. We show stochastic Taylor integration schemes of a given strong order obtained by truncating according to word length are always more accurate than those obtained by truncating according to the mean-square grade. We measure accuracy by the leading order term in the L 2 -norm of the remainder after truncation. To start, to define the endomorphism inner product, we require an algebraic encoding of the expectation of the iterated integrals. Definition 8 (Expectation map) For any word w A, the expectation map E: R A R[t] is defined by E: w t w / w! if w {} and is zero for all other words. Here w denotes the length of the word w, {} A is the free monoid over the letter and R[t] is the polynomial ring over a single indeterminate t commuting with R. Remark 12 (Expectation of iterated Itô integrals) The expectation map corresponds to the expectation of iterated Itô integrals as follows. First, integrals indexed by words not ending in the letter are martingales and hence have zero expectation. Second, consider integrals indexed by a word with at least one non-zero letter. Fubini s Theorem implies such integrals also have zero expectation; see Protter [73]. We now define an inner product on End(R A ), following Ebrahimi Fard et al. [22]. Suppose we apply two separate functions to the flowmap which are characterised by the endomorphisms F and G in End(R A ). The stochastic processes generated by these functions of the flowmap, for given initial data y, are w A I F(w)Ṽw(y ) and w A I G(w)Ṽw(y ). Our goal is to define an inner product F,G on End(R A ) which matches the L 2 -inner product of these two vector-valued stochastic processes. However we would like all of our results to be independent of the initial data y and the governing vector fields appearing in the Ṽw terms. We achieve this by replacing the vectors Ṽw(y ) with a set of indeterminate vectors indexed by words, {V w } w A. We write (u,v) for the inner product of V u and V v, i.e. (u,v) := V T u V v. Let V denote the infinite square matrix indexed by the words u,v A with entries (u,v).