A general formula for the method of steepest descent using Perron s formula



Similar documents
6. Define log(z) so that π < I log(z) π. Discuss the identities e log(z) = z and log(e w ) = w.

3 Contour integrals and Cauchy s Theorem

5.3 Improper Integrals Involving Rational and Exponential Functions

MATH 52: MATLAB HOMEWORK 2

Differentiation and Integration

Lecture 8: More Continuous Random Variables

1 The Brownian bridge construction

x a x 2 (1 + x 2 ) n.

Metric Spaces. Chapter Metrics

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties

1 if 1 x 0 1 if 0 x 1

Notes on metric spaces

2. Length and distance in hyperbolic geometry

Constrained optimization.

Chapter 2. Complex Analysis. 2.1 Analytic functions The complex plane

Vector and Matrix Norms

1 Sufficient statistics

Normal distribution. ) 2 /2σ. 2π σ

Math 319 Problem Set #3 Solution 21 February 2002

Solutions for Math 311 Assignment #1

MATH 381 HOMEWORK 2 SOLUTIONS

Unified Lecture # 4 Vectors

Practice with Proofs

4. Expanding dynamical systems

The Math Circle, Spring 2004

Lecture 21 and 22: The Prime Number Theorem

RAJALAKSHMI ENGINEERING COLLEGE MA 2161 UNIT I - ORDINARY DIFFERENTIAL EQUATIONS PART A

Chapter 3 RANDOM VARIATE GENERATION

Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur

1.7 Graphs of Functions


Linear Algebra Notes for Marsden and Tromba Vector Calculus

4. Complex integration: Cauchy integral theorem and Cauchy integral formulas. Definite integral of a complex-valued function of a real variable

1 Prior Probability and Posterior Probability

LINEAR INEQUALITIES. Mathematics is the art of saying many things in many different ways. MAXWELL

Mathematics. ( : Focus on free Education) (Chapter 5) (Complex Numbers and Quadratic Equations) (Class XI)

Undergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics

Vieta s Formulas and the Identity Theorem

COMPLEX NUMBERS. a bi c di a c b d i. a bi c di a c b d i For instance, 1 i 4 7i i 5 6i

SECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA

TOPIC 4: DERIVATIVES

t := maxγ ν subject to ν {0,1,2,...} and f(x c +γ ν d) f(x c )+cγ ν f (x c ;d).

BANACH AND HILBERT SPACE REVIEW

MA106 Linear Algebra lecture notes

COMPLEX NUMBERS AND SERIES. Contents

Maximum Likelihood Estimation

Lectures 5-6: Taylor Series

6.2 Permutations continued

Examples of Functions

Complex Numbers. w = f(z) z. Examples

Math 4310 Handout - Quotient Vector Spaces

General Theory of Differential Equations Sections 2.8, , 4.1

A characterization of trace zero symmetric nonnegative 5x5 matrices

Inner Product Spaces

Walrasian Demand. u(x) where B(p, w) = {x R n + : p x w}.

DIFFERENTIABILITY OF COMPLEX FUNCTIONS. Contents

Continued Fractions and the Euclidean Algorithm

About the Gamma Function

Homework 2 Solutions

CHAPTER 5 Round-off errors

Lecture L3 - Vectors, Matrices and Coordinate Transformations

G. GRAPHING FUNCTIONS

FIRST YEAR CALCULUS. Chapter 7 CONTINUITY. It is a parabola, and we can draw this parabola without lifting our pencil from the paper.

THE BANACH CONTRACTION PRINCIPLE. Contents

Section 1.3 P 1 = 1 2. = P n = 1 P 3 = Continuing in this fashion, it should seem reasonable that, for any n = 1, 2, 3,..., =

An Introduction to Partial Differential Equations in the Undergraduate Curriculum

A power series about x = a is the series of the form

Lecture 17: Conformal Invariance

Inequalities of Analysis. Andrejs Treibergs. Fall 2014

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

Elasticity. I. What is Elasticity?

Solutions to Practice Problems

Section 4.4 Inner Product Spaces

4.3 Lagrange Approximation

Solutions for Review Problems

Solutions to Homework 10

n k=1 k=0 1/k! = e. Example 6.4. The series 1/k 2 converges in R. Indeed, if s n = n then k=1 1/k, then s 2n s n = 1 n

EXIT TIME PROBLEMS AND ESCAPE FROM A POTENTIAL WELL

1. Prove that the empty set is a subset of every set.

Smooth functions statistics

MOP 2007 Black Group Integer Polynomials Yufei Zhao. Integer Polynomials. June 29, 2007 Yufei Zhao

Metric Spaces Joseph Muscat 2003 (Last revised May 2009)

Tilings of the sphere with right triangles III: the asymptotically obtuse families

Math 181 Handout 16. Rich Schwartz. March 9, 2010

36 CHAPTER 1. LIMITS AND CONTINUITY. Figure 1.17: At which points is f not continuous?

THE NUMBER OF GRAPHS AND A RANDOM GRAPH WITH A GIVEN DEGREE SEQUENCE. Alexander Barvinok

A Uniform Asymptotic Estimate for Discounted Aggregate Claims with Subexponential Tails

Differentiation of vectors

k, then n = p2α 1 1 pα k

Critical points of once continuously differentiable functions are important because they are the only points that can be local maxima or minima.

MMGF30, Transformteori och analytiska funktioner

Taylor and Maclaurin Series

5 Numerical Differentiation

Algebraic and Transcendental Numbers

Representation of functions as power series

Math 21a Curl and Divergence Spring, Define the operator (pronounced del ) by. = i

Online Appendix to Stochastic Imitative Game Dynamics with Committed Agents

The sample space for a pair of die rolls is the set. The sample space for a random number between 0 and 1 is the interval [0, 1].

Transcription:

A general formula for the method of steepest descent using Perron s formula James Mathews December 6, 3 Introduction The method of steepest descent is one of the most used techniques in applied mathematics and asymptotics, but is often one of the hardest to apply. We want to find an approximation for the integral I(k) = g(z)e kf(z) dz as k C where f and g are (usually) analytic functions, k is (usually) a real parameter. The general idea is to use Cauchy s theorem which allows deformation of contours in the complex plane to simplify the problem. The idea was proposed by Debye, and the basic idea is to choose a new contour D such that D passes through one of more zeros of f (z) The imaginary part of f(z) is constant on D Since the imaginary part of the integral is constant, then if f(z) = g(z) + ih then we instead need to evaluate. I(k)e ikh g(z)e kg(z) dz as k, which can then be treated by Laplace s method.. Laplace s method Laplace s method says that to evaluate J(k) = C b a f(t)e kφ(t) dt as k, where φ(t) has a stationary point at an interior point c with non-zero second derivative (so f (t) = and f (t) ), then πf(c)e xφ(c) J(k). kφ (c)

If c is in fact an end point then we need to multiply this expression by a factor of /. If in fact we have no stationary point then we have or J(k) f(a)ekφ(a), kφ (a) J(k) f(b)ekφ(b), kφ (b) with the first case corresponding to the maximum of φ being at a, so φ (a) <, and the second corresponding to the maximum being at b, so φ (b) >. Finally, if c is a maximum with φ (c) = φ (c) =... φ p (c) = and φ p (c) < then we get J(k) Γ(/p)(p!)/p p[ kφ p (c)] /p f(c)exφ(c). See [Bender and Orszag, 978] for the proofs and examples of this method.. Difficulties with the method The main difficulty of the method, is of course, finding the new contour. We suppose the contour is not closed, and has end points a and b. Often, this contour consists of three parts; D which goes through a and has imaginary part I[f(a)] D which goes through b and has imaginary part I[f(b)] D 3 which joins the two contours at infinity It is hoped that the contribution of the integral from D 3 will become zero as D 3 becomes more infinite, whilst the other two contours are evaluated using Laplace s method. The examples in [Bender and Orszag, 978] show how to apply the procedure, with the latter examples showing just how complicated the contours become. Whilst we can always apply this method, it can be time consuming, intricate and often we would just like a general formula to be able to estimate, say the leading behaviour. Also, sometimes our function f will depend on another parameter, say λ and we want to know what the asymptotic approximation is as we vary over λ. Rather than having to find various curves of steepest descent, which will depend on λ and properties might change dramatically, if we have a general formula then it will be easier. Essentially, we want to use reasoning somewhat similar to Laplace s method; we find where the function R[f(z)] has a maximum (or maximum s) along a chosen contour, then since k is large the only contributions to the integral will come from these points..3 First (wrong) attempt at a general formula A naive way to estimate the leading order behaviour is given below. It is based upon the notes sad, which is one of the first results you come across on google for saddle point methods. The method suggests that if z is a (non-degenerate) saddle point, then

( ) / [ ( π π I(k) = g(z)e kf(z) dz g(z C k f )e kf(z) exp i (z ) arg(f )] (z )). The reasoning given seems clear; you approximate f(z) by its Taylor expansion at z so f(z) f(z ) + f (z )(z z ) and g(z) by g(z ), then we just need to evaluate I(k) g(z )e kf(z ) exp k f (z )(z z ) dz. (.) We then switch to polar coordinates, extend the limits and perform the Gaussian integral to get the result. All this reasoning looks clear, until we examine it further and note two glaring problems: At no point did we use the fact that k is large, how can we construct an asymptotic approximation without using this property!? Just because f (z ) = does not mean that the real part of f(z) is maximised at z. These are in fact linked as explained above, we find where the real part of f(z) is maximised and then use the fact that k is large to show the only contribution to the integral is at this part. The argument above fails when we try and evaluate the integral in (.)..4 Example We end this section with a simple example showing why the general formula is useful, and why our first attempt is wrong. We consider the integral e k(z iz) dz. We can calculate that f(z) = z iz has a saddle point at z = i. The first attempt then suggest that the general behaviour can be calculated by only considering f(z) near the saddle point. But we can see that f( ) = + i, f(i) =, f() = i and at both end points and the saddle point R[f(z)] =, so we must consider the contribution from all the points, even though the endpoints are not saddle points. Using the formula we would say π e k(z iz) dz i k ek, which as we will see later, is plain wrong! If instead we try and solve the problem using the standard method of steepest descent, the contours we get are not so nice, but it will be possible to solve it. We can also see from Figure that there is going to very hard to pass through the saddle point using only curves of constant phase. In the Figure the curves of constant phase going through the points and are drawn in blue and green respectively. 3 Figure : Contours for method of steepest descent.

A general formula As our example clearly showed, the most important issue is showing that any point z we choose to approximate our integral at satisfies R[f(z) f(z )] < for all z on the contour we are integrating over, so we can in effect use Lapace s method. This critical condition, so often overlooked is the main point of this notes. If in fact R[f(z) f(z )] = for all z on the contour, then we can simply use the method of stationary phase, which is detailed in [Bender and Orszag, 978]. Our basic idea will be If R[f(z)] is maximised at one of the end points (or even both) then we can simply use Perron s Formula. If not, we find the saddle points of f, that is the points c i which satisfy f (c i ) =. We then deform the contour C to a new contour D which goes through the saddle points in the direction of steepest descent. We find the asymptotic points, that is the solutions to R[f (z i )] =, for z i which lie on the contour D, which has end points a and b. We also include a and b as asymptotic points. We order the z i into increasing order along the deformed contour (so if we start at a then as we go along the contour to b we will pass through the points in the order z, z,... z n ). We then split the deformed contour D in contours D [a,z ], D [z,z ],... C [zn,b], and if there is no z i then we simply take the deformed contour. Note that on each contour we have R[f(z) f(w)] < for all z on the contour D [zi,z i+ ], where w is either z i and z i+. We evaluate each of these integrals using Perron s formula. In the case where R[f(z)] is maximised at both end points a and b, we spilt the integral into two integrals by choosing an arbitary point c (a, b) and then applying Perron s formula to both. We assume that the R[f(z)] has only finitely many maxima and minima, and don t consider the case where we have infinitely many. We do this because it is unlikely the standard method of steepest descent would cope with this method. We also briefly recap how to find the direction of steepest descent at a saddle point c. If f is analytic at the critical point with f (c) = f (c) =... = f (N ) (c) = and f (N) = re iθ (with r > ) then the paths of steepest descent have direction (n + )π θ N for n =,,... N. In the case N = (so a non-degenerate saddle point) the paths of steepest descent have direction (π θ)/ and (3π θ)/.. Perron s Formula All that remains to be done is to evaluate integrals of the type I(k) = g(z)e kf(z) dz, (.) E 4

where E is a generic contour with end points a and b, and R[f(z) f(w)] < where w is either a or b. For simplicity we assume that it is at a for now. We now state Perron s formula (first described by Oscar Perron in 97) in the case that k is a real parameter, although with more assumptions we can state if for complex k. We also restrict to the case where f is analytic everywhere (or at least analytic at every z i ), which again simplifies the assumptions for the Theorem. The full theorem is stated in [Wong, ] and [Nemes, ], as well the proof, which we will not present here. Theorem. (Perron s Method) Assume that. D lies in the sector arg(f(a) f(z)) π/ δ for some fixed δ >. For all c a on D, there exists fixed ε(z) > such that f(z) f(a) ε(z) for all z on the contour between z = c and z = b. 3. In a neighbourhood of a, f(a) f(z) = a n (z a) n+α, where α N (since we have assumed f is analytic) and a. n= 4. In a neighbourhood of a, where β > and b. g(z) = b n (z a) n+β, n= Let 5. The integral (.) exists absolutely for each fixed k w = lim arg(z a), z D a then we require that for some fixed l we have the following inequality holds (to ensure the first condition holds) ( l ) ( π + δ arg a + αw l + ) π δ. Then where η s = I(k) e kf(a) αa (s+β)/α s! s m= s= b s m m! η s k (s+β)/α Γ ( s + β α ) e πil(s+β)/α, (.) [ d { ( a (z a) α ) }] (s+β)/α dz m f(a) f(z) The first two conditions are a slight strengthening of the condition R[f(z) f(a)] <, and can in most case be replaced by this condition. The third condition relates to the Taylor expansion of f at a, and we can see that if a is not a saddle point then α =, if a is a non-degenerate saddle point (f (a) = and f (a) ) then α =, and otherwise if f (a) = f (a) =... = f (n ) (a) = and f (n) (a) then α = n. Note also that a = f (α) (a)/α!, a = f (α+) (a)/(α + )! and a n = f (α+n) (a)/(α + n)!, 5 z=a (.3)

with the minus sign just comes since the left hand side is f(a) f(z) and not f(z) f(a). If g is analytic at a and g(a), then β = and b = g(a). Otherwise if g is analytic and g (a) = g (a) =... = g (m ) (a) = and g (m) (a) then we have β = m, and then b = g (β ) (a)/(β )!, b = g (β) (a)/β! and b n = g (β+n ) (a)/(β + n )!. The fifth condition ensures that the asymptotic approximation will make any sense!.. The first two coefficients Assuming that g is analytic, then we can calculate that the coefficient of leading order, η, will be given by η = b g (β ) (a)(α!) β/α = αa β/α α(β )![ f (α) (a)], β/α while the second coefficient is given by η = b αa (+β)/α ( + β)b a α a (+α+β)/α = g(β) (a)(α!) (+β)/α αβ![ f (α) (a)] (+β)/α + ( + β)g(β ) (a)f (α+) (a)(α!) (+β)/α (β )!α (α + )[ f (α) (a)] (+α+β)/α, with subsequent coefficients becoming more and more complicated. I think the third coefficient is given by [ ( + β)a η = b b b ( ) ( ( ) )] + β a + β αa α α + a αa (+β)/α.. Maximum at b If instead we have the maximum of the real part of f being at b rather than a, then the formula is modified slightly. We replace Conditions 3 and 4 in Theorem. by the conditions a a 3*. In a neighbourhood of b, where α N and c. 4*. In a neighbourhood of b, where β > and d. f(b) f(z) = c n (b z) n+α, n= g(z) = d n (b z) n+β, n= Then we have but we replace (.3) by η s = I(k) e kf(b) αc (s+β)/α s! s= η s k (s+β)/α Γ ( s + β α ) e πil(s+β)/α, (.4) [ { s ( ) }] d s m ( ) m d c (b z) α (s+β)/α m! dz m f(b) f(z) m= 6 z=b (.5)

We can caclulate that if g is analytic then we have c n = ( )α+n f (α+n) (b) (α + n)! and d n = ( )β+n g (β+n ) (b). (β + n )! In the case of the maximum being at the end point b, we can calculate that the coefficient of leading order, η, will be given by η = d αc β/α = ( )(β ) g (β ) (a)(α!) β/α α(β )![( ) (α ) f (α) (a)] β/α.. Special case: Contour is on the real line In the case where the contour is on the real line, w = thus we have l =. Furthermore, if we assume that g is analytic at a with g(a) then β = and to leading order we have kf(a) g(a)γ(/α)(α!)(/α) I(k) e α[ f (α) (a)] /α k /α g(a)γ(/α)(α!)(/α) + ekf(a) (.6) α[ f (α) (a)] /α k /α when the maximum is at the endpoint a. If instead g is analytic at b with g(b) then we have when the maximum is at the endpoint b. I(k) e kf(b) g(b)γ(/α)(α!) (/α), (.7) α[( ) (α ) f (α) (b)] /α k/α.3 Other attempts at a General Formula The same result is proved in [Ferreira et al., 7], under the same conditions, although they only calculate the order of the terms in the approximation, and not the constants (although the coefficients can be calculated using Laplace s method). The paper would also seem to suggest that the method is uniform in the sense that if f depends on a parameter that changes, then the approximation is uniformly valid. In Sections 3 and 4 of [Ferreira et al., 7], the authors suggest a different way to deal with multiple asymptotic points, rather than splitting the contour up. However, both methods still rely on calculating the asymptotic points, and in my opinion the method we have presented here is easier..4 Example (revisited) Returning to the example before, we can see that R[f(z)] = z has a maximum at both end points. We choose to split the integral at the point, but this is arbitary, and so we have I(k) = e k(z iz) dz = I (k) + I (k), where I (k) = e k(z iz) dz and I (k) = e k(z iz) dz. 7

Now I is of the form (.6) since the maximum occurs at the lower of the limits, and since f( ) = + i and f ( ) = i we have α = and hence I (k) ek(+i) ( + i)k. Similarly, I is of the form (.7) since the maximum occurs at the upper of the limits, and since f() = i and f () = i we have α = and hence Thus I(k) I (k) ek( i) ( i)k. ek(+i) ( + i)k + ek( i) ( i)k = ek [sin(k) + cos(k)]. k Below we plot I(k)/{ ek [sin(k) + cos(k)]}, and shows that the asymptotic approximation we k have chosen is indeed an asymptotic relation!.5.5 5 5 5 3 35 4 45 5 55 6 k The spikes are caused by the fact that the zeros of I(k) and ek [sin(k) + cos(k)] don t quite line k up until k gets large, but either way we have shown our method is easy to use for this example, and significantly easier than the standard method of steepest descent..5 Example We now take the example I(k) = z i ek(iz z) dz, This has asymptotic points at, and since f (z) = i z. Suppose we just split the integral up up into two integrals, I between and and I between and. This is not what out method says, but we try it anyway. Using Perron s method we see that α = β = at the end point, and furthermore f() =, f () = i and g() = i/. Hence we have I (k) 4k and I (k) 4k, 8

and hence when we sum the two asymptotic approximations they cancel! Furthermore, if we take the next term in Perron s method (using f () = and g () = /4 we have that I (k) 4k + 3 6k and I (k) 4k 6k, and they still cancel! We can numerically calculate the integral when k = as I(k) 7.97i, which is what we don t see at all from using Perron s method. The trouble is that the imaginary behaviour of the integral is asymptotically small compared to the real part, so we don t see it! Thus, we should deform the contour to go through the critical point in the direction of steepest descent first before worrying about splitting the integrals up. The critical point lies at z = i, so we deform the contour to go throught this point. To keep things simple, we have the new contour going from to + i, from + i to + i and then from + i to. We can check that indeed we have gone through the critical point in the direction of steepest descent. Thus, we need to evaluate the integrals I (k) = +i i z i ek(iz z) dz, I (k) = +i z i ek(iz z) dz and +i I 3 (k) = i z i ek(iz z) dz, I 4 (k) = +i z i ek(iz z) dz. We can write the second and third integrals as I (k) = x i ek( x ) dx, and I 3 (k) = x i ek( x ) dx, and then using Perron s method (or even just Laplace s method) we can calculate I (k) i π k e k and I 3 (k) i π k e k. We can write the first and fourth integrals as I (k) = i ix i ek[x x 4+4i(x )] dx, and I 4 (k) = i ix + i ek[x x 4+4i( x)] dx, and then using Perron s method with α =, β = since they both have the real part of the exponentianted function having amaximum at the end point x = we have and hence I (k) e 4k 4ik i 4(i 3)k and I 4(k) e 4k+4ik i 4(3 + i)k I (k) + I 4 (k) e 4k i 4k [ ] e 4ik i 3 e4ik i + 3 = e 4k i (sin(4k) + 3 cos(3k)), k and hence is expoentially smaller than contributions from I and I 3. Hence, we get the correct asympotic behavour of I(k) i π k e k. 9

References Saddle point notes. http://www.ph.ed.ac.uk/~dmarendu/momp/lecture5.pdf. Accessed: --3. Carl M Bender and Steven A Orszag. Advanced mathematical methods for scientists and engineers I: Asymptotic methods and perturbation theory, volume. Springer, 978. Chelo Ferreira, José L López, Pedro Pagola, and E Pérez Sinusía. The laplaces and steepest descents methods revisited. In Int. Math. Forum, volume, pages 97 34, 7. Gergo Nemes. Asymptotic expansions for integrals.. Roderick Wong. Asymptotic approximation of integrals, volume 34. SIAM,.