# arxiv:math/ v1 [math.pr] 18 Dec 2004

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Improving on bold play when the gambler is restricted arxiv:math/ v1 [math.pr] 18 Dec 2004 by Jason Schweinsberg February 1, 2008 Abstract Suppose a gambler starts with a fortune in (0, 1) and wishes to attain a fortune of 1 by making a sequence of bets. Assume that whenever the gambler stakes the amount s, the gambler s fortune increases by s with probability w and decreases by s with probability 1 w, where w < 1/2. Dubins and Savage showed that the optimal strategy, which they called bold play, is always to bet min{f, 1 f}, where f is the gambler s current fortune. Here we consider the problem in which the gambler may stake no more than l at one time. We show that the bold strategy of always betting min{l, f, 1 f} is not optimal if l is irrational, extending a result of Heath, Pruitt, and Sudderth. 1 Introduction and background Suppose a gambler starts with a fortune in (0,1) and wishes to attain a fortune of 1 by making a sequence of bets. If the gambler s current fortune is f, then the gambler may stake any amount less than or equal to f. The gambler wins the amount of the stake with probability w and loses the stake with probability 1 w. Following [8], we refer to this game as red-and-black. Clearly the gambler should never stake more than 1 f, which is enough to ensure that the gambler will reach the goal if the bet is won. The strategy in which the gambler always stakes min{f,1 f} is called bold play. In [8], Dubins and Savage developed a general theory for gambling problems. For red-andblack, they showed that if 0 < w < 1/2, which means that the game is subfair, then bold play is the optimal strategy, in the sense that it maximizes the probability that the gambler will eventually reach the goal. Their proof is also given in chapter 7 of [2] and chapter 24 of [10]. See [1] for some computations comparing the probability that a gambler will reach the goal using bold play to the probability that a gambler will reach the goal using other strategies. This result has been extended in several ways. Dubins and Savage [8] also considered primitive casinos, in which the gambler loses the stake s with probability 1 w and wins [(1 r)/r]s with probability w, where 0 < r < 1. Note that r = 1/2 is red-and-black. They showed that bold play is optimal when the game is subfair, which in this case means w < r. Chen [5] considered red-and-black with inflation, in which the goal is not to reach 1 but to reach (1 + α) n after n bets for some n. He showed that bold play is optimal when w 1/2. A different extension is to incorporate a discount factor, so that the gambler receives a utility of β n, where 0 < β 1, from Supported by an NSF Postdoctoral Fellowship 1

2 reaching 1 on the nth bet. Klugman [12] showed that bold play is optimal for subfair red-andblack with a discount factor. However, for some subfair primitive casinos, there exist discount factors for which bold play is not optimal (see [4] and [6]). See also [17] for a discussion of the optimality of bold play in some two-person games. Several authors have considered discrete versions of this problem in which the gambler s initial fortune and the amount of each bet must be integers and the gambler s goal is to attain a fortune of n. An extensive discussion of discrete gambling problems such as this can be found in [13]. Bold play remains optimal when w < 1/2. Ross [15] showed that the timid strategy of staking exactly 1 each time is optimal in the superfair case when w > 1/2. See also [16] for an analysis of the superfair case when the minimum bet is 2. Dubins [7] showed, however, that if the win probability is less than 1/2 but is allowed to depend on the gambler s fortune, then bold play need not be optimal. Another direction of work concerns gambling problems in which there is a limit to how much the gambler may bet. The simplest problem of this type involves red-and-black in which the gambler may bet no more than l (0,1/2) at one time. In this case, we define bold play as the strategy in which the gambler whose current fortune is f always stakes min{l,f,1 f}. Wilkins [18] showed that if w < 1/2 and l = 1/n for some positive integer n 3, then bold play maximizes the chance that the gambler will reach the goal. Chen [3] showed that bold play remains optimal when there is a discount factor in addition to a limit on the stake of 1/n. In [14], the optimality of bold play in continuous-time gambling problems was established under rather general restrictions on the gambler. However, Heath, Pruitt, and Sudderth [11] obtained an important negative result for discretetime red-and-black. They showed that if the gambler can stake at most l, and if 1/(n + 1) < l < 1/n for some n 3 or if l is irrational and 1/3 < l < 1/2, then there exists ǫ > 0 such that if 0 < w < ǫ, then bold play is not optimal. To see heuristically why this is true, suppose 1/4 < l < 1/3 and the gambler s initial fortune is f = 1/2 δ, where δ is small. If the gambler plays boldly and loses the first bet, then the gambler s fortune after one bet will be 1/2 l δ. The gambler s fortune can at most double to 1 2l 2δ after the second bet and therefore can be at most 1 2δ after two more wins. However, if the gambler first stakes l δ and plays boldly thereafter, then even with an initial loss, the gambler can reach the goal by winning the next three bets. Consequently, for sufficiently small δ, first betting l δ makes the gambler more likely to achieve the goal after winning three or fewer bets. As w 0, the probability that the gambler can win four bets before going bankrupt gets very small relative to the probability that the gambler wins three bets. Therefore, first betting l δ is a better strategy than bold play for sufficiently small w. The purpose of the present paper is to extend this result by showing that when l is irrational, bold play fails to be optimal for all w < 1/2, not just for very small w. The case of rational l remains open except when l = 1/n for some n 3. Note that when l is rational and 1/3 < l < 1/2, it is not even known whether one can improve on bold play for very small w. To state our result more precisely, define the function s : [0,1] [0,1] by s(f) = min{l,f,1 f}. We think of s(f) as the bold stake for a gambler whose fortune is f. Denote by X k the gambler s fortune after k bets, when the gambler plays boldly. Note that (X k ) k=0 is a Markov 2

3 chain whose transition probabilities are given by P(X k+1 = f + s(f) X k = f) = w, (1.1) P(X k+1 = f s(f) X k = f) = 1 w. (1.2) Define Q(f) = P(X k = 1 for some k X 0 = f), which is the probability that a gambler who starts with a fortune of f will eventually reach the goal. The following is our main result. Theorem 1.1. Suppose w < 1/2 and l is irrational. Then, there exist f (0,1) and ǫ (0,s(f)) such that wq(f + s(f) ǫ) + (1 w)q(f s(f) + ǫ) > Q(f). (1.3) If a gambler begins with a fortune of f and stakes s(f) ǫ, then the gambler s fortune after one bet will be f +s(f) ǫ with probability w and f s(f)+ǫ with probability 1 w. Consequently, the left-hand side of (1.3) is the probability that the gambler will eventually reach the goal using the strategy of first staking s(f) ǫ and playing boldly thereafter, while the right-hand side of (1.3) is the probability that the gambler will reach the goal using bold play. Therefore, (1.3) implies that the strategy of first staking s(f) ǫ and then playing boldly is superior to bold play, and hence bold play is not optimal. 2 Proof of Theorem 1.1 In this section, we prove Theorem 1.1. The key to the proof will be the following proposition. Here, and throughout the rest of the paper, all logarithms are assumed to be base 2. That is, we write log n instead of log 2 n. Proposition 2.1. Let S = {f : P(X k = 1 l for some k X 0 = f) > 0}. That is, S is the set of all f such that a gambler who starts with a fortune of f and plays boldly could have a fortune of exactly 1 l after a finite number of bets. 1. Suppose f S. Then there exists a constant C > 0 such that if 0 < ǫ < l, then Q(f) Q(f ǫ) C(1 w) log ǫ. 2. Suppose f / S. For all C > 0, there exists δ > 0 such that if 0 < ǫ < δ, then Q(f) Q(f ǫ) C(1 w) log ǫ. 3. If l is irrational, then there exists f (l,1 l) such that f l S and f + l / S. Proposition 2.1 implies that Q(f) Q(f ǫ) is larger when f S than when f / S. In other words, the difference between a fortune of f and a fortune of f ǫ matters more to the gambler when f S than when f / S. Part 3 of the proposition states that when l is irrational, we can find f such that f s(f) S and f + s(f) / S. We will show that if a gambler starts with a fortune slightly below f, then it is better to make slightly less than the bold stake so that the fortune will not fall below f s(f) if the bet is lost. This will imply Theorem 1.1. An important tool for the proof of Proposition 2.1 is a coupling construction in which we follow two gamblers simultaneously. We present this construction in subsection 2.1. We prove parts 1, 2, and 3 of Proposition 2.1 in subsections 2.2, 2.3, and 2.4 respectively. Then in subsection 2.5, we show how Theorem 1.1 follows from Proposition

4 2.1 A coupling construction Throughout this and the next two subsections, we consider two Markov chains (X k ) k=0 and (Y k ) k=0. We define X 0 = f 1 and Y 0 = f 2, where f 1 f 2. Both chains evolve with the transition probabilities given by (1.1) and (1.2). Consequently, we can think of X k as the fortune after k bets of a gambler whose initial fortune is f 1, while Y k is the fortune after k bets of a gambler whose initial fortune is f 2. We assume these sequences are coupled, so that both gamblers win and lose the same bets. To construct this coupling, we work with the probability space (Ω, F,P) defined as follows. Let Ω = {0,1}, and denote sequences in Ω by ω = (ω 1,ω 2,...), so ω ω i is the ith coordinate function. Let F 0 be the trivial σ-field, and for positive integers k, let F k be the σ-field generated by the first k coordinate functions. Let F = σ(f 1, F 2,...) be the product σ-field. Let P be the product probability measure with the property that P(ω i = 1) = w and P(ω i = 0) = 1 w for all i. We then say that the two gamblers win the ith bet if ω i = 1 and lose the ith bet if ω i = 0. In particular, for k 0, we define X k+1 (ω) = X k (ω)+s(x k (ω)) and Y k+1 (ω) = Y k (ω)+s(y k (ω)) if ω k+1 = 1, and we define X k+1 (ω) = X k (ω) s(x k (ω)) and Y k+1 (ω) = Y k (ω) s(y k (ω)) if ω k+1 = 0. We now make some remarks pertaining to this construction. 1. Since s(f) = min{l,f,1 f}, we see that if f g, then s(g) s(f) g f. Therefore, f + s(f) g + s(g) and f s(f) g s(g). It then follows by induction and the construction of the sequences (X k ) k=0 and (Y k) k=0 that X k Y k for all k. Likewise, the fact that s(g) s(f) g f implies that X k Y k 2 k (f 1 f 2 ) for all k. 2. The fact that X k Y k for all k means that if Y k = 1 then X k = 1. Since Q(f 1 ) = P(X k = 1 for some k) and Q(f 2 ) = P(Y k = 1 for some k), it follows that Q(f 1 ) Q(f 2 ). That is, the function f Q(f) is nondecreasing. 3. Note that E[X k+1 F k ] = w(x k + s(x k )) + (1 w)(x k s(x k )) = X k + (2w 1)s(X k ) X k, where the last inequality holds because w < 1/2. Therefore, (X k ) k=0 is a supermartingale with respect to (F k ) k=0. By the same argument, (Y k) k=0 is a supermartingale with respect to (F k ) k=0. By the Martingale Convergence Theorem (see chapter 4 of [9]), there exist random variables L 1 and L 2 such that X k L 1 a.s. and Y k L 2 a.s. as k. If 0 < ǫ < l, then s(f) > ǫ for f [ǫ,1 ǫ]. It follows that L 1 and L 2 must be {0,1}-valued random variables. Furthermore, it is easy to see that X k = 1 for sufficiently large k on {L 1 = 1} and Y k = 1 for sufficiently large k on {L 2 = 1}. Thus, Q(f 1 ) = P(L 1 = 1) and Q(f 2 ) = P(L 2 = 1), from which it follows that Q(f 1 ) Q(f 2 ) = P(L 1 = 1 and L 2 = 0). 2.2 Proof of part 1 of Proposition 2.1 We begin with the following Lemma, in which we compute the gambler s probability of reaching the goal starting from a sequence of fortunes approaching 1. Lemma 2.2. For all n 0, we have Q(1 2 n l) = 1 (1 w) n (1 Q(1 l)). 4

5 Proof. The statement is obvious when n = 0. Suppose the result holds for some n 0. Since s(1 2 (n+1) l) = 2 (n+1) l, a gambler whose fortune is 1 2 (n+1) l will, after the next bet, have a fortune of 1 with probability w and a fortune of 1 2 n l with probability 1 w. Thus, by the Markov property, Q(1 2 (n+1) l) = w + (1 w)q(1 2 n l) The lemma now follows by induction on n. = w + (1 w)(1 (1 w) n (1 Q(1 l))) = 1 (1 w) n+1 (1 Q(1 l)). Proof of part 1 of Proposition 2.1. Let f 1 = f and f 2 = f ǫ, where 0 < ǫ < l. Since f S, there exists a positive integer k such that if B denotes the event that X k = 1 l and X k+1 = 1, then P(B) > 0. Note that for 0 j < k, we have X j+1 Y j+1 X j Y j unless either X j > 1 l and X j+1 = 1, or Y j < l and Y j+1 = 0. Therefore, if B occurs, then Y k 1 l ǫ and thus Y k+1 1 ǫ. Combining this observation with remarks 2 and 3 in subsection 2.1, we get Q(f) Q(f ǫ) = P(L 1 = 1 and L 2 = 0) P(B)P(L 2 = 0 B) P(B)(1 Q(1 ǫ)). Choose a nonnegative integer n such that 2 (n+1) l < ǫ 2 n l, which implies that n log l log ǫ. By Lemma 2.2, Q(1 ǫ) Q(1 2 (n+1) l) = 1 (1 w) n+1 (1 Q(1 l)) 1 (1 w) 1+log l log ǫ (1 Q(1 l)). Thus, Q(f) Q(f ǫ) C(1 w) log ǫ, where C = P(B)(1 w) 1+log l (1 Q(1 l)). 2.3 Proof of part 2 of Proposition 2.1 Our next step is to prove part 2 of Proposition 2.1, which gives an upper bound for Q(f) Q(f ǫ) when f / S. We will compare the sequences (X k ) k=0 and (Y k) k=0 when f 1 = f and f 2 = f ǫ. Although (X k Y k ) k=0 is not a supermartingale, we will be able to construct a supermartingale by considering the differences between the gamblers fortunes at a sequence of stopping times. It will then follow that the gamblers fortunes stay close enough together for us to obtain the desired upper bound on Q(f) Q(f ǫ) when f / S. Given f and f such that 0 f f 1, define { h(f,f 1 if f = f ) = (s(f) s(f ))/(f f ) otherwise. Note that 1 h(f,f ) 1 for all f and f. If l f f 1 l, then s(f) = s(f ) = l, which means h(f,f ) = 0. If f l and f 1 l, then h(f,f ) 0. If f l and f 1 l, then h(f,f ) 0. Also, recall that ω k = 1 if the gamblers win the kth bet, and ω k = 0 if the gamblers lose the kth bet. We have X k+1 (ω) Y k+1 (ω) = { (1 + h(xk (ω),y k (ω)))(x k (ω) Y k (ω)) if ω k+1 = 1 (1 h(x k (ω),y k (ω)))(x k (ω) Y k (ω)) if ω k+1 = 0. (2.1) 5

6 Define W k = (1 w) log(x k Y k ) = (X k Y k ) log(1 w). (2.2) By (2.1), we have E[W k+1 F k ] = w(1 + h(x k,y k )) log(1 w) W k + (1 w)(1 h(x k,y k )) log(1 w) W k = g(h(x k,y k ))W k, (2.3) where g(x) = w(1 + x) log(1 w) + (1 w)(1 x) log(1 w) for 1 x 1. Note that g (x) = ( log(1 w)) ( w(1 + x) log(1 w) 1 (1 w)(1 x) log(1 w) 1). Suppose 0 < x < 1. Since 0 < log(1 w) < 1, we have (1 + x) log(1 w) 1 < 1 and (1 x) log(1 w) 1 > 1. Therefore, g (x) ( log(1 w))(w (1 w)) < 0. Since g(0) = 1, it follows that 0 < g(x) < 1 for x (0,1]. We now introduce four lemmas that will help us to define a supermartingale. Lemma 2.3. Suppose 1 l f 2 f 1 1. Then E[W 1 ] = W 0. Proof. We have s(f 1 ) = 1 f 1 and s(f 2 ) = 1 f 2. Therefore, h(f 1,f 2 ) = 1. Since g( 1) = 1, it follows from (2.3) that E[W 1 ] = W 0. Lemma 2.4. Suppose f 2 f 1 < 1 l. Define a stopping time R as follows. If h(f 1,f 2 ) 1/2, define R = 0. If h(f 1,f 2 ) < 1/2, then let R(ω) = inf{j : ω j = 1 or h(x j (ω),y j (ω)) 1/2}. Let L = 1 + (1 2l)/l. Then R L and E[W R ] W 0. Proof. Proceeding by contradiction, suppose R(ω) > L for some ω. Then the gamblers must lose the first L bets. However, by the definition of L, any gambler who starts with a fortune of at most 1 l and then loses L consecutive bets has a fortune of at most l. Therefore, there exists j L such that 0 < X j l. Since X j Y j, it follows that Y j l, and thus s(x j ) = X j and s(y j ) = Y j. However, this means that h(x j,y j ) = 1, and thus R j, a contradiction. Hence, R L. For j < R, we have Y j X j < 1 l, and therefore 0 h(x j,y j ) 1. Since g(x) 1 for x [0,1], we have, with the aid of (2.3), E[W (j+1) R F j ] = W j R 1 {R j} + E[W j+1 F j ]1 {R>j} = W j R 1 {R j} + g(h(x j,y j ))W j 1 {R>j} W j R. Therefore, (W j R ) j=0 is a supermartingale with respect to (F j) j=0. Note that 0 W j R 1 for all j, so the Optional Stopping Theorem (see chapter 4 of [9]) gives E[W R ] W 0. 6

7 Lemma 2.5. Suppose f 2 f 1 < 1 l. Let T(ω) = inf{j 1 : ω j = 1 or h(x j 1 (ω),y j 1 (ω)) 1/2}. Let L = 1 + (1 2l)/l as in Lemma 2.4. Then T L + 1 and E[W T ] αw 0, where α = 1 (1 g(1/2))(1 w) 2L. Proof. Define the stopping time R as in Lemma 2.4. Then T = R if and only if the gamblers win the Rth bet; otherwise, T = R + 1. Clearly T L + 1 by Lemma 2.4. Let A be the event that the gamblers win the Rth bet. Then E[W T ] = E[E[W T F R ]] = E[W R 1 A + E[W R+1 F R ]1 A c]. By the strong Markov property and (2.3), E[W R+1 F R ] = g(h(x R,Y R ))W R. If the gamblers lose the Rth bet, then h(x R,Y R ) 1/2. Therefore, since g is decreasing on [0,1], E[W R+1 F R ]1 A c g(1/2)w R 1 A c. Thus, E[W T ] E[W R 1 A + g(1/2)w R 1 A c] = E[W R (1 g(1/2))w R 1 A c]. (2.4) If A c occurs, then the gamblers lose the first R bets, and h(x j,y j ) < 1/2 for all j < R. If h(x j,y j ) < 1/2 and the gamblers lose the (j + 1)st bet, then X j+1 Y j+1 (X j Y j )/2. Thus, on A c we have X R Y R 2 R (f 1 f 2 ) 2 L (f 1 f 2 ). Thus, E[W R 1 A c] E[(2 L (f 1 f 2 )) log(1 w) 1 A c] = 2 L log(1 w) W 0 P(A c ) = P(A c )(1 w) L W 0. (2.5) Since A c occurs whenever the gamblers lose the first L bets, we have P(A c ) (1 w) L. Thus, since E[W R ] W 0 by Lemma 2.4, combining (2.4) and (2.5) gives E[W T ] E[W R ] (1 g(1/2))(1 w) 2L W 0 (1 (1 g(1/2))(1 w) 2L )W 0 = αw 0, which completes the proof. Lemma 2.6. Suppose f 2 < 1 l and 1 l f 1 < 1 l/2. Define the stopping time T by { 1 if ω1 = 1 T(ω) = inf{j 2 : ω j = 1 or h(x j 1 (ω),y j 1 (ω)) 1/2} otherwise. Let N(ω) = 1 α if ω 1 = 1, and let N(ω) = 1 if ω 1 = 0. Then T L + 2 and E[NW T ] W 0. Proof. Let A be the event that that the gamblers win the first bet, which means ω 1 = 1. We have E[NW T ] = E[E[NW T F 1 ]] = E[(1 α)w 1 1 A + E[W T F 1 ]1 A c]. 7

8 If the gamblers lose the first bet, then X 1 = f 1 s(f 1 ) = 2f 1 1 < 1 l. Therefore, Lemma 2.5 and the Markov property give T L + 2 and E[W T F 1 ]1 A c αw 1 1 A c. Thus, E[NW T ] E[(1 α)w 1 1 A + αw 1 1 A c] which completes the proof. = w(1 α)[(1 + h(f 1,f 2 ))(f 1 f 2 )] log(1 w) + (1 w)α[(1 h(f 1,f 2 ))(f 1 f 2 )] log(1 w) = [ w(1 α)(1 + h(f 1,f 2 )) log(1 w) + (1 w)α(1 h(f 1,f 2 )) log(1 w)] W 0 [ w(1 α)2 log(1 w) + (1 w)α2 log(1 w)] W 0 ( ) w = (1 α) + α W 0 W 0, 1 w By combining Lemmas 2.3, 2.5, and 2.6, we can obtain Proposition 2.7, in which we construct the supermartingale needed to prove part 2 of Proposition 2.1. We first inductively define a sequence of stopping times (T k ) k=0. Let T 0 = 0. Given T k, we define T k+1 according to the following rules: 1. If Y Tk (ω) 1 l, then let T k+1 (ω) = T k (ω) If X Tk (ω) < 1 l, let T k+1 (ω) = inf{j T k (ω) + 1 : ω j = 1 or h(x j 1 (ω),y j 1 (ω)) 1/2}. 3. Suppose Y Tk (ω) < 1 l and 1 l X Tk (ω) < 1 l/2. If ω Tk (ω)+1 = 1, meaning the gamblers win the (T k + 1)st bet, then let T k+1 (ω) = T k (ω) + 1. Otherwise, let T k+1 (ω) = inf{j T k (ω) + 2 : ω j = 1 or h(x j 1 (ω),y j 1 (ω)) 1/2}. 4. If Y Tk < 1 l and X Tk 1 l/2, then let T k+1 = T k. Proposition 2.7. Define the sequence of stopping times (T k ) k=0 as above. For k 0, let B k = #{j {0,1,...,k 1} : X Tj < 1 l}, where #S denotes the cardinality of the set S. Let N k = 1 α on the event that, for some j T k, we have Y j 1 < 1 l X j 1 and the gamblers win the jth bet. Otherwise, let N k = 1. Define Z k = α B kn k W Tk. Then (Z k ) k=0 is a supermartingale with respect to the filtration (F Tk ) k=0. Furthermore, T k+1 T k + L + 2 for all k 0. Proof. Let A 1,k be the event that Y Tk 1 l, and let A 2,k be the event that X Tk < 1 l. Let A 3,k be the event that Y Tk < 1 l and 1 l X Tk < 1 l/2. Let A 4,k be the event that Y Tk < 1 l and X Tk 1 l/2. Note that for all k, exactly one of these four events occurs. We consider the four cases separately. First, suppose A 1,k occurs. Then X Tk 1 l, so B k+1 = B k. Also, note that T k+1 = T k + 1 and Y Tk 1 l, so N k+1 = N k. Therefore, by Lemma 2.3 and the strong Markov property, E[Z k+1 1 A1,k F Tk ] = α B k N k E[W Tk+1 F Tk ]1 A1,k = α B k N k E[W Tk +1 F Tk ]1 A1,k = α B k N k W Tk 1 A1,k = Z k 1 A1,k. (2.6) 8

9 Next, suppose A 2,k occurs. Then X Tk < 1 l, so B k+1 = B k + 1. The gamblers lose bets T k + 1,...,T k+1 1, so X j < 1 l for T k j T k+1 1. Therefore, N k+1 = N k. By Lemma 2.5 and the strong Markov property, E[Z k+1 1 A2,k F Tk ] = α (B k+1) N k E[W Tk+1 F Tk ]1 A2,k α (B k+1) N k (αw Tk )1 A2,k = α B k N k W Tk 1 A2,k = Z k 1 A2,k. (2.7) Suppose A 3,k occurs. Then X Tk 1 l, so B k+1 = B k. Since X Tk < 1, we have N k = 1. If the gamblers win the (T k + 1)st bet, then N k+1 = 1 α. Otherwise, X Tk +1 = X Tk s(x Tk ) = 2X Tk 1 < 1 l and the gamblers lose bets T k + 2,...,T k+1 1, so N k+1 = 1. By Lemma 2.6 and the strong Markov property, E[Z k+1 1 A3,k F Tk ] = α B k E[N k+1 W Tk+1 F Tk ]1 A3,k α B k W Tk 1 A3,k = Z k 1 A3,k. (2.8) Finally, if A 4,k occurs, then T k+1 = T k. Therefore, N k+1 = N k and W Tk+1 = W Tk. Since X Tk > 1 l, we also have B k+1 = B k and thus Z k+1 = Z k. Therefore, E[Z k+1 1 A4,k F Tk ] = Z k 1 A4,k. This fact, combined with equations (2.6), (2.7), and (2.8), gives E[Z k+1 F Tk ] Z k. Hence, (Z k ) k=0 is a supermartingale with respect to the filtration (F T k ) k=0. To complete the proof, note that clearly T k+1 T k + L+2 if A 1,k or A 4,k occurs. The strong Markov property combined with Lemmas 2.5 and 2.6 implies that T k+1 T k + L + 2 if A 2,k or A 3,k occurs. We now use Proposition 2.7 to establish an upper bound on Q(f) Q(f ǫ) when f / S. We will need one more lemma. Lemma 2.8. Fix f / S, and let N be a positive integer. Then there exists a positive integer M and a positive real number δ such that if f 1 = f and f 2 = f ǫ where 0 < ǫ < δ, then the following hold: 1. If X k 1 l and Y k < 1 l, then k > M(L + 2), where L = 1 + (1 2l)/l. 2. Let D k = #{j {0,1,...,k 1} : X Tj < 1 l or X Tj = 1}. Then D M N. Proof. Let R k be the set of all possible values of X k, and let R k = k j=0 R j. Note that R k is a finite set because there are only 2 k possible outcomes for the first k bets. For all g [0,1), let v(g) be the number of consecutive bets that a gambler whose fortune is g must lose for the fortune to drop below 1 l. That is, v(g) = 0 when 0 g < 1 l and, for positive integers k, v(g) = k when 1 2 k+1 l g < 1 2 k l. Let V k = max{v(g) : g R k }. Let M 0 = 0. For i 0, let M i+1 = M i + V Mi (L+2) + 1. Let M = M N. Choose θ > 0 small enough that R M(L+2) (1 l,1 l + θ) =. Let δ = 2 M(L+2) θ. We will show that the two conditions of the lemma are satisfied for these choices of M and δ. Suppose k M(L+2). If X k 1 l, then X k 1 l+θ, since f / S and R k (1 l,1 l+θ) =. By the first remark in subsection 2.1, we have X k Y k 2 k ǫ < 2 M(L+2) δ = θ. Therefore, Y k 1 l. This proves the first part of the lemma. To prove the second part, we claim that for i = 0,1,...,N 1, we have D Mi +V Mi (L+2)+1 D Mi + 1. (2.9) 9

10 To see how (2.9) implies the second part of the lemma, first note that D M0 = D 0 = 0. Suppose D Mi i for some i 0. Then D Mi+1 = D Mi +V Mi (L+2)+1 D Mi + 1 i + 1 by (2.9). Hence, by induction, (2.9) implies that D M N. Thus, we need only to prove (2.9). First, suppose either X TMi < 1 l or X TMi = 1. Then D Mi +1 = D Mi + 1. Since (D i ) i=0 is a nonincreasing sequence and V Mi (L+2) 0, we have (2.9). Thus, it remains only to prove (2.9) when 1 l X TMi < 1. Write v for v(x TMi ). Note that v V TMi, and T Mi M i (L + 2) by Proposition 2.7. Therefore T Mi + v T Mi + V TMi M i (L + 2) + V Mi (L+2) (M i + V Mi (L+2))(L + 2) M(L + 2). (2.10) We now consider two cases. First, suppose the gamblers lose the bets T Mi +1,...,T Mi +v. Then X j 1 l for T Mi j T Mi +v 1 and X TMi +v < 1 l. Also, by (2.10) and the first part of the lemma, we have Y j 1 l for T Mi j T Mi +v 1. Therefore, by the definition of the sequence (T j ) j=0, we have T M i +k = T Mi + k for 1 k v. It follows that X < 1 l, TMi +v which means D Mi +v+1 = D Mi + 1. Thus, D Mi +V Mi (L+2)+1 D Mi +v+1 = D Mi + 1, which is (2.9). Finally, we consider the case in which, for some j {1,...,v}, the gamblers lose the bets T Mi + 1,...,T Mi + j 1 but win the bet T Mi + j. Then, X TMi +j = X TMi = 1 and +j D Mi +j+1 = D Mi + 1. Hence, D Mi +V Mi (L+2)+1 D Mi + 1, which is (2.9). Proof of part 2 of Proposition 2.1. Fix C > 0, and fix f / S. Since 0 < α < 1, there exists a positive integer N such that α N (1 α)(1 w) log(l/2) C 1. Define M and δ as in Lemma 2.8. Fix ǫ (0,δ). Define (T k ) k=0 and (Z k) k=0 as in Proposition 2.7, with f 1 = f and f 2 = f ǫ. By Remark 3 in subsection 2.1, there exist random variables L 1 and L 2 such that X k L 1 a.s. and Y k L 2 a.s. as k, and Q(f) Q(f ǫ) = P(L 1 = 1 and L 2 = 0). Let A be the event that L 1 = 1 and L 2 = 0. Then there is an integer-valued random variable K such that, on the event A, we have X TK 1 l/2 and Y TK < 1 l. By part 1 of Lemma 2.8, on the event A, we have T K > M(L + 2) and thus K M. It also follows from part 1 of Lemma 2.8 that if X Tj = 1 for j M, then Y Tj = 1, and therefore L 2 = 1. Consequently, on the event A, we can see from the definitions of (B i ) i=0 and (D i) i=0 that B M = D M and thus, using part 2 of Lemma 2.8, B K B M = D M N. Since (Z k ) k=0 is a nonnegative supermartingale, it follows from the Martingale Convergence Theorem (see Corollary 2.11 in chapter 4 of [9]) that there exists a random variable Z such that Z k Z a.s. and E[Z] E[Z 0 ]. On the event A, if j > K then T j = T K and thus Z j = Z K = Z. Hence, using (2.2), Z1 A = Z K 1 A = α B K N K (1 w) log(x T K Y TK ) 1 A α N (1 α)(1 w) log(l/2) 1 A C 1 1 A. It follows that E[Z] C 1 P(A). Thus, Q(f) Q(f ǫ) = P(A) CE[Z] CE[Z 0 ] = C(1 w) log ǫ, as claimed. 10

11 2.4 Proof of part 3 of Proposition 2.1 Let D 1 = S [0,l] and D 2 = S [1 l,1]. Define a sequence of stopping times (τ k ) k=0 by τ 0 = 0 and τ k+1 = inf{n > τ k : X n [0,l] [1 l,1]} for all k 0. Then define D k = {f : P(X τj = 1 l for some j k X 0 = f) > 0}. Let Dk 1 = D k [0,l] and Dk 2 = D k [1 l,l]. Note that D 1 = k=0 D1 k and D2 = k=0 D2 k. We have D0 1 = and D2 0 = {1 l}. For k 1, D 1 k = {f [0,l] : P(X τ 1 D k 1 X 0 = f) > 0} D 1 k 1 D 2 k = {f [1 l,1] : P(X τ 1 D k 1 X 0 = f) > 0} D 2 k 1. Suppose X 0 = f. If f (l,1 l), then s(f) = l for all k < τ 1. Therefore X τ1 = f + nl for some n Z. If instead f [0,l], then s(f) = f, in which case either X 1 = X τ1 = 0 or X 1 = 2f. If X 1 = 2f, then X τ1 = 2f + nl for some n Z, where n = 0 if 2f [0,l] [1 l,1]. Likewise, suppose f [1 l,l]. Then s(f) = 1 f, so either X 1 = X τ1 = 1 or X 1 = 2f 1. If X 1 = 2f 1, then X τ1 (f) = 2f 1 + nl for some n Z, where n = 0 if 2f 1 [0,l] [1 l,1]. We claim that if f D 1 D 2, then there exist integers a, b, and c such that f = 2 c (a + bl). Furthermore, we claim that if f 1 l, then we can choose a, b, and c such that c 1, a 1, a or b is odd, and a 2 if f D 2. We will prove these claims by induction on k. Note that D 0 = {1 l}, so for f D 0 we can take a = 1, b = 1, and c = 0. Now, suppose our claims hold when f D k 1, where k 1. To show that our claims hold when f D k, we consider two cases. First, suppose f D 1 k \ D k 1. Then P(X τ1 = g X 0 = f) > 0 for some g D k 1. Since 0 / S, we must have 2f + nl = g, or equivalently f = (g nl)/2, for some n Z and g D k 1. If g = 1 l, then f = (1 (n + 1)l)/2, so f = 2 c (a + bl), where a = 1, b = (n + 1), and c = 1. If g 1 l, then g = 2 c (a + bl), where c 1, a 1, and a or b is odd. Then f = 2 (c+1) (a + bl 2 c nl) = 2 (c+1) (a + (b 2 c n)l). Note that c + 1 1, a 1, and b 2 c n is odd if b is odd, so a or b 2 c n is odd. Next, suppose f D 2 k \D k 1. Then P(X τ1 = g X 0 = f) > 0 for some g D k 1. Since 1 / S, we have 2f 1 + nl = g, or equivalently f = (1 + g nl)/2, for some n Z and g D k 1. If g = 1 l, then f = (2 (n + 1)l)/2. If n + 1 were even, then f = 1 ml for some positive integer m; since D 2 [1 l,1], we would have f {1 l,1}, which is a contradiction because 1 / D 2 k and 1 l D k 1. Therefore, n + 1 is odd, so f = 2 c (a + bl), where c = 1, a = 2, and b is odd. If instead g 1 l, then g = 2 c (a + bl), where c 1, a 1, and a or b is odd. Then f = 2 (c+1) (2 c + a + bl 2 c nl) = 2 (c+1) [(2 c + a) + (b 2 c n)l]. Note that c + 1 1, 2 c + a 2, and either 2 c + a or b 2 c n is odd because 2 c and 2 c n are even and either a or b is odd. It now follows by induction that our claims hold for all f D 1 D 2. Since l < 1/2, we can choose a positive integer m such that 1 ml (l,2l]. We can then choose positive integers d and n such that 2 d (1 ml) < 1 2l and 2 d (1 l)+nl (1 2l,1 l). Let f = 2 d (1 ml)+nl. Note that f (l,1 l). Also, f l = 2 d (1 ml)+(n 1)l. Suppose a gambler who starts with a fortune of f l loses the first n 1 bets, then wins the next d+m 1. After the n 1 losses, the gambler s fortune will be 2 d (1 ml). Then after d wins, the fortune will be 1 ml. After m 1 additional wins, the gambler s fortune will be 1 l. Consequently, P(X n+m+d 2 = 1 l X 0 = f l) > 0, 11

12 which means f l S. We now show by contradiction that f + l / S, which will complete the proof. Suppose f + l S. Since f + l > 1 l, there exist integers a, b, and c such that a 2, c 1, a or b is odd, and f + l = 2 c (a + bl). We also have f + l = 2 d (1 + (2 d (n + 1) m)l). Therefore, 2 d (a + bl) = 2 c [1 + (2 d (n + 1) m)l], and so 2 d a 2 c = [2 c (2 d (n + 1) m) 2 d b]l. Since l is irrational, we must have 2 d a 2 c = 2 c (2 d (n + 1) m) 2 d b = 0. Thus, 2 d a = 2 c, and since a 2, it follows that a is even and c > d. Therefore, b is odd and b = 2 c d (2 d (n + 1) m), which is a contradiction. 2.5 Obtaining Theorem 1.1 from Proposition 2.1 Suppose l is irrational. By part 3 of Proposition 2.1, there exists f 0 (l,1 l) such that f 0 l S and f 0 + l / S. Let f = f 0 ǫ, where 0 < ǫ < l and ǫ is small enough that f (l,1 l). We will show that for sufficiently small ǫ, we have wq(f + l ǫ) + (1 w)q(f l + ǫ) > Q(f), (2.11) which implies Theorem 1.1 because s(f) = l. Note that wq(f + l ǫ) + (1 w)q(f l + ǫ) = wq(f 0 + l 2ǫ) + (1 w)q(f 0 l). (2.12) Since f Q(f) is nondecreasing, we have Q(f) = wq(f + l) + (1 w)q(f l) wq(f 0 + l) + (1 w)q(f 0 l ǫ). (2.13) Since f 0 l S, it follows from part 1 of Proposition 2.1 that there exists a constant C > 0 such that Q(f 0 l) Q(f 0 l ǫ) C(1 w) log ǫ. (2.14) Let C 0 = C(1 w). Since f 0 + l / S, part 2 of Proposition 2.1 implies that for sufficiently small ǫ, we have Q(f 0 + l) Q(f 0 + l 2ǫ) C 0 (1 w) log 2ǫ = C(1 w) log ǫ. (2.15) Let B = C(1 w) log ǫ. Equations (2.12)-(2.15) imply wq(f + l ǫ) + (1 w)q(f l + ǫ) Q(f) wb + (1 w)b = (1 2w)B > 0 for sufficiently small ǫ, which gives (2.11). Acknowledgments The author thanks Lester Dubins for introducing him to this area and for helpful discussions regarding this work. He also thanks David Gilat for bringing to his attention the reference [11] and two anonymous referees for their useful comments. 12

13 References [1] Bak, J. (2001). The anxious gambler s ruin. Math. Mag. 74, No. 3, [2] Billingsley, P. (1995). Probability and Measure, 3rd edn. Wiley, New York. [3] Chen, R. (1976). Subfair discounted red-and-black game with a house limit. J. Appl. Prob. 13, [4] Chen, R. (1977). Subfair primitive casino with a discount factor. Z. Wahrscheinlichkeitsth. 39, [5] Chen, R. (1978). Subfair red-and-black in the presence of inflation. Z. Wahrscheinlichkeitsth. 42, [6] Chen, R. and Zame, A. (1979). On discounted subfair primitive casino. Z. Wahrscheinlichkeitsth. 49, [7] Dubins, L. (1998). Discrete red-and-black with fortune-dependent win probabilities. Probab. Engrg. Inform. Sci. 12, [8] Dubins, L. and Savage, L.J. (1976). Inequalities for Stochastic Processes: How to Gamble if you Must. Dover, New York. (first edition: McGraw-Hill, 1965). [9] Durrett, R. (1996). Probability: Theory and Examples. 2nd edn. Duxbury Press, Belmont, CA. [10] Fristedt, B. and Gray, L. (1997). A Modern Approach to Probability Theory. Birkhäuser, Boston. [11] Heath, D., Pruitt, W., and Sudderth, W. (1972). Subfair red-and-black with a limit. Proc. Amer. Math. Soc. 35, [12] Klugman, S. (1977). Discounted and rapid subfair red-and-black. Ann. Statist. 5, [13] Maitra, A. and Sudderth, W. (1996). Discrete Gambling and Stochastic Games. Springer-Verlag, New York. [14] Pestien, V. and Sudderth, W. (1985). Continuous-time red and black: how to control a diffusion to a goal. Math. Operat. Res. 10, [15] Ross, S. (1974). Dynamic programming and gambling models. Adv. Appl. Prob. 6, [16] Ruth, K. (1999). Favorable red and black on the integers with a minimum bet. J. Appl. Prob. 36, [17] Secchi, P. (1997). Two-person red-and-black stochastic games. J. Appl. Prob. 34, [18] Wilkins, J.E. (1972). The bold strategy in presence of a house limit. Proc. Amer. Math. Soc. 32,

### Goal Problems in Gambling and Game Theory. Bill Sudderth. School of Statistics University of Minnesota

Goal Problems in Gambling and Game Theory Bill Sudderth School of Statistics University of Minnesota 1 Three problems Maximizing the probability of reaching a goal. Maximizing the probability of reaching

### arxiv:1112.0829v1 [math.pr] 5 Dec 2011

How Not to Win a Million Dollars: A Counterexample to a Conjecture of L. Breiman Thomas P. Hayes arxiv:1112.0829v1 [math.pr] 5 Dec 2011 Abstract Consider a gambling game in which we are allowed to repeatedly

### Gambling Systems and Multiplication-Invariant Measures

Gambling Systems and Multiplication-Invariant Measures by Jeffrey S. Rosenthal* and Peter O. Schwartz** (May 28, 997.. Introduction. This short paper describes a surprising connection between two previously

### How to Gamble If You Must

How to Gamble If You Must Kyle Siegrist Department of Mathematical Sciences University of Alabama in Huntsville Abstract In red and black, a player bets, at even stakes, on a sequence of independent games

### Finitely Additive Dynamic Programming and Stochastic Games. Bill Sudderth University of Minnesota

Finitely Additive Dynamic Programming and Stochastic Games Bill Sudderth University of Minnesota 1 Discounted Dynamic Programming Five ingredients: S, A, r, q, β. S - state space A - set of actions q(

### Week 4: Gambler s ruin and bold play

Week 4: Gambler s ruin and bold play Random walk and Gambler s ruin. Imagine a walker moving along a line. At every unit of time, he makes a step left or right of exactly one of unit. So we can think that

### MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore

MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore 1. Introduction The word martingale refers to a strap fastened belween the girth and the noseband of

### APPLICATIONS OF THE ORDER FUNCTION

APPLICATIONS OF THE ORDER FUNCTION LECTURE NOTES: MATH 432, CSUSM, SPRING 2009. PROF. WAYNE AITKEN In this lecture we will explore several applications of order functions including formulas for GCDs and

### 1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let

Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as

### About the inverse football pool problem for 9 games 1

Seventh International Workshop on Optimal Codes and Related Topics September 6-1, 013, Albena, Bulgaria pp. 15-133 About the inverse football pool problem for 9 games 1 Emil Kolev Tsonka Baicheva Institute

### Lecture 4: BK inequality 27th August and 6th September, 2007

CSL866: Percolation and Random Graphs IIT Delhi Amitabha Bagchi Scribe: Arindam Pal Lecture 4: BK inequality 27th August and 6th September, 2007 4. Preliminaries The FKG inequality allows us to lower bound

### Review Horse Race Gambling and Side Information Dependent horse races and the entropy rate. Gambling. Besma Smida. ES250: Lecture 9.

Gambling Besma Smida ES250: Lecture 9 Fall 2008-09 B. Smida (ES250) Gambling Fall 2008-09 1 / 23 Today s outline Review of Huffman Code and Arithmetic Coding Horse Race Gambling and Side Information Dependent

### The Kelly Betting System for Favorable Games.

The Kelly Betting System for Favorable Games. Thomas Ferguson, Statistics Department, UCLA A Simple Example. Suppose that each day you are offered a gamble with probability 2/3 of winning and probability

### TAKE-AWAY GAMES. ALLEN J. SCHWENK California Institute of Technology, Pasadena, California INTRODUCTION

TAKE-AWAY GAMES ALLEN J. SCHWENK California Institute of Technology, Pasadena, California L INTRODUCTION Several games of Tf take-away?f have become popular. The purpose of this paper is to determine the

### A REMARK ON ALMOST MOORE DIGRAPHS OF DEGREE THREE. 1. Introduction and Preliminaries

Acta Math. Univ. Comenianae Vol. LXVI, 2(1997), pp. 285 291 285 A REMARK ON ALMOST MOORE DIGRAPHS OF DEGREE THREE E. T. BASKORO, M. MILLER and J. ŠIRÁŇ Abstract. It is well known that Moore digraphs do

### Wald s Identity. by Jeffery Hein. Dartmouth College, Math 100

Wald s Identity by Jeffery Hein Dartmouth College, Math 100 1. Introduction Given random variables X 1, X 2, X 3,... with common finite mean and a stopping rule τ which may depend upon the given sequence,

### Lectures on Stochastic Processes. William G. Faris

Lectures on Stochastic Processes William G. Faris November 8, 2001 2 Contents 1 Random walk 7 1.1 Symmetric simple random walk................... 7 1.2 Simple random walk......................... 9 1.3

### n k=1 k=0 1/k! = e. Example 6.4. The series 1/k 2 converges in R. Indeed, if s n = n then k=1 1/k, then s 2n s n = 1 n + 1 +...

6 Series We call a normed space (X, ) a Banach space provided that every Cauchy sequence (x n ) in X converges. For example, R with the norm = is an example of Banach space. Now let (x n ) be a sequence

### SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH

31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,

### National Sun Yat-Sen University CSE Course: Information Theory. Gambling And Entropy

Gambling And Entropy 1 Outline There is a strong relationship between the growth rate of investment in a horse race and the entropy of the horse race. The value of side information is related to the mutual

### CHAPTER II THE LIMIT OF A SEQUENCE OF NUMBERS DEFINITION OF THE NUMBER e.

CHAPTER II THE LIMIT OF A SEQUENCE OF NUMBERS DEFINITION OF THE NUMBER e. This chapter contains the beginnings of the most important, and probably the most subtle, notion in mathematical analysis, i.e.,

### The minimal number with a given number of. divisors

The minimal number with a given number of divisors Ron Brown Department of Mathematics, 2565 McCarthy Mall, University of Hawaii, Honolulu, HI 96822, USA Phone (808) 956-4665 Fax (808) 956-9139 Email address:

### 6.042/18.062J Mathematics for Computer Science December 12, 2006 Tom Leighton and Ronitt Rubinfeld. Random Walks

6.042/8.062J Mathematics for Comuter Science December 2, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Random Walks Gambler s Ruin Today we re going to talk about one-dimensional random walks. In

### Section 3 Sequences and Limits, Continued.

Section 3 Sequences and Limits, Continued. Lemma 3.6 Let {a n } n N be a convergent sequence for which a n 0 for all n N and it α 0. Then there exists N N such that for all n N. α a n 3 α In particular

### Course 221: Analysis Academic year , First Semester

Course 221: Analysis Academic year 2007-08, First Semester David R. Wilkins Copyright c David R. Wilkins 1989 2007 Contents 1 Basic Theorems of Real Analysis 1 1.1 The Least Upper Bound Principle................

### How to build a probability-free casino

How to build a probability-free casino Adam Chalcraft CCR La Jolla dachalc@ccrwest.org Chris Freiling Cal State San Bernardino cfreilin@csusb.edu Randall Dougherty CCR La Jolla rdough@ccrwest.org Jason

### Betting systems: how not to lose your money gambling

Betting systems: how not to lose your money gambling G. Berkolaiko Department of Mathematics Texas A&M University 28 April 2007 / Mini Fair, Math Awareness Month 2007 Gambling and Games of Chance Simple

### ON INDUCED SUBGRAPHS WITH ALL DEGREES ODD. 1. Introduction

ON INDUCED SUBGRAPHS WITH ALL DEGREES ODD A.D. SCOTT Abstract. Gallai proved that the vertex set of any graph can be partitioned into two sets, each inducing a subgraph with all degrees even. We prove

### UNIFORM ASYMPTOTICS FOR DISCOUNTED AGGREGATE CLAIMS IN DEPENDENT RISK MODELS

Applied Probability Trust 2 October 2013 UNIFORM ASYMPTOTICS FOR DISCOUNTED AGGREGATE CLAIMS IN DEPENDENT RISK MODELS YANG YANG, Nanjing Audit University, and Southeast University KAIYONG WANG, Southeast

### x if x 0, x if x < 0.

Chapter 3 Sequences In this chapter, we discuss sequences. We say what it means for a sequence to converge, and define the limit of a convergent sequence. We begin with some preliminary results about the

### Markov Chains. Chapter Introduction and Definitions 110SOR201(2002)

page 5 SOR() Chapter Markov Chains. Introduction and Definitions Consider a sequence of consecutive times ( or trials or stages): n =,,,... Suppose that at each time a probabilistic experiment is performed,

### Stationary random graphs on Z with prescribed iid degrees and finite mean connections

Stationary random graphs on Z with prescribed iid degrees and finite mean connections Maria Deijfen Johan Jonasson February 2006 Abstract Let F be a probability distribution with support on the non-negative

### Markov Chains, part I

Markov Chains, part I December 8, 2010 1 Introduction A Markov Chain is a sequence of random variables X 0, X 1,, where each X i S, such that P(X i+1 = s i+1 X i = s i, X i 1 = s i 1,, X 0 = s 0 ) = P(X

### Reaching Goals by a Deadline: Digital Options and Continuous-Time Active Portfolio Management

Reaching Goals by a Deadline: Digital Options and Continuous-Time Active Portfolio Management Sad Browne * Columbia University Original: February 18, 1996 This Version: July 9, 1996 Abstract We study a

### Real Roots of Univariate Polynomials with Real Coefficients

Real Roots of Univariate Polynomials with Real Coefficients mostly written by Christina Hewitt March 22, 2012 1 Introduction Polynomial equations are used throughout mathematics. When solving polynomials

### Asymptotics for a discrete-time risk model with Gamma-like insurance risks. Pokfulam Road, Hong Kong

Asymptotics for a discrete-time risk model with Gamma-like insurance risks Yang Yang 1,2 and Kam C. Yuen 3 1 Department of Statistics, Nanjing Audit University, Nanjing, 211815, China 2 School of Economics

### Introduction to Finite Fields (cont.)

Chapter 6 Introduction to Finite Fields (cont.) 6.1 Recall Theorem. Z m is a field m is a prime number. Theorem (Subfield Isomorphic to Z p ). Every finite field has the order of a power of a prime number

### OPTIMAL SELECTION BASED ON RELATIVE RANK* (the "Secretary Problem")

OPTIMAL SELECTION BASED ON RELATIVE RANK* (the "Secretary Problem") BY Y. S. CHOW, S. MORIGUTI, H. ROBBINS AND S. M. SAMUELS ABSTRACT n rankable persons appear sequentially in random order. At the ith

### WHEN DOES A RANDOMLY WEIGHTED SELF NORMALIZED SUM CONVERGE IN DISTRIBUTION?

WHEN DOES A RANDOMLY WEIGHTED SELF NORMALIZED SUM CONVERGE IN DISTRIBUTION? DAVID M MASON 1 Statistics Program, University of Delaware Newark, DE 19717 email: davidm@udeledu JOEL ZINN 2 Department of Mathematics,

### ON LIMIT LAWS FOR CENTRAL ORDER STATISTICS UNDER POWER NORMALIZATION. E. I. Pancheva, A. Gacovska-Barandovska

Pliska Stud. Math. Bulgar. 22 (2015), STUDIA MATHEMATICA BULGARICA ON LIMIT LAWS FOR CENTRAL ORDER STATISTICS UNDER POWER NORMALIZATION E. I. Pancheva, A. Gacovska-Barandovska Smirnov (1949) derived four

### Gambling and Data Compression

Gambling and Data Compression Gambling. Horse Race Definition The wealth relative S(X) = b(x)o(x) is the factor by which the gambler s wealth grows if horse X wins the race, where b(x) is the fraction

### The Heat Equation. Lectures INF2320 p. 1/88

The Heat Equation Lectures INF232 p. 1/88 Lectures INF232 p. 2/88 The Heat Equation We study the heat equation: u t = u xx for x (,1), t >, (1) u(,t) = u(1,t) = for t >, (2) u(x,) = f(x) for x (,1), (3)

### Chapter 7: Proportional Play and the Kelly Betting System

Chapter 7: Proportional Play and the Kelly Betting System Proportional Play and Kelly s criterion: Investing in the stock market is, in effect, making a series of bets. Contrary to bets in a casino though,

### CURVES WHOSE SECANT DEGREE IS ONE IN POSITIVE CHARACTERISTIC. 1. Introduction

Acta Math. Univ. Comenianae Vol. LXXXI, 1 (2012), pp. 71 77 71 CURVES WHOSE SECANT DEGREE IS ONE IN POSITIVE CHARACTERISTIC E. BALLICO Abstract. Here we study (in positive characteristic) integral curves

### Lecture 13: Martingales

Lecture 13: Martingales 1. Definition of a Martingale 1.1 Filtrations 1.2 Definition of a martingale and its basic properties 1.3 Sums of independent random variables and related models 1.4 Products of

### FACTORING POLYNOMIALS IN THE RING OF FORMAL POWER SERIES OVER Z

FACTORING POLYNOMIALS IN THE RING OF FORMAL POWER SERIES OVER Z DANIEL BIRMAJER, JUAN B GIL, AND MICHAEL WEINER Abstract We consider polynomials with integer coefficients and discuss their factorization

### On the Union of Arithmetic Progressions

On the Union of Arithmetic Progressions Shoni Gilboa Rom Pinchasi August, 04 Abstract We show that for any integer n and real ɛ > 0, the union of n arithmetic progressions with pairwise distinct differences,

### F. ABTAHI and M. ZARRIN. (Communicated by J. Goldstein)

Journal of Algerian Mathematical Society Vol. 1, pp. 1 6 1 CONCERNING THE l p -CONJECTURE FOR DISCRETE SEMIGROUPS F. ABTAHI and M. ZARRIN (Communicated by J. Goldstein) Abstract. For 2 < p

### PUTNAM TRAINING POLYNOMIALS. Exercises 1. Find a polynomial with integral coefficients whose zeros include 2 + 5.

PUTNAM TRAINING POLYNOMIALS (Last updated: November 17, 2015) Remark. This is a list of exercises on polynomials. Miguel A. Lerma Exercises 1. Find a polynomial with integral coefficients whose zeros include

### Chapter 4 Lecture Notes

Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,

### Inner Product Spaces

Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and

### 1.3 Induction and Other Proof Techniques

4CHAPTER 1. INTRODUCTORY MATERIAL: SETS, FUNCTIONS AND MATHEMATICAL INDU 1.3 Induction and Other Proof Techniques The purpose of this section is to study the proof technique known as mathematical induction.

### 1 Limiting distribution for a Markov chain

Copyright c 2009 by Karl Sigman Limiting distribution for a Markov chain In these Lecture Notes, we shall study the limiting behavior of Markov chains as time n In particular, under suitable easy-to-check

### CONTINUED FRACTIONS AND PELL S EQUATION. Contents 1. Continued Fractions 1 2. Solution to Pell s Equation 9 References 12

CONTINUED FRACTIONS AND PELL S EQUATION SEUNG HYUN YANG Abstract. In this REU paper, I will use some important characteristics of continued fractions to give the complete set of solutions to Pell s equation.

### This chapter is all about cardinality of sets. At first this looks like a

CHAPTER Cardinality of Sets This chapter is all about cardinality of sets At first this looks like a very simple concept To find the cardinality of a set, just count its elements If A = { a, b, c, d },

### LECTURE 15: AMERICAN OPTIONS

LECTURE 15: AMERICAN OPTIONS 1. Introduction All of the options that we have considered thus far have been of the European variety: exercise is permitted only at the termination of the contract. These

### CONTRIBUTIONS TO ZERO SUM PROBLEMS

CONTRIBUTIONS TO ZERO SUM PROBLEMS S. D. ADHIKARI, Y. G. CHEN, J. B. FRIEDLANDER, S. V. KONYAGIN AND F. PAPPALARDI Abstract. A prototype of zero sum theorems, the well known theorem of Erdős, Ginzburg

### A simple criterion on degree sequences of graphs

Discrete Applied Mathematics 156 (2008) 3513 3517 Contents lists available at ScienceDirect Discrete Applied Mathematics journal homepage: www.elsevier.com/locate/dam Note A simple criterion on degree

### SEQUENCES OF MAXIMAL DEGREE VERTICES IN GRAPHS. Nickolay Khadzhiivanov, Nedyalko Nenov

Serdica Math. J. 30 (2004), 95 102 SEQUENCES OF MAXIMAL DEGREE VERTICES IN GRAPHS Nickolay Khadzhiivanov, Nedyalko Nenov Communicated by V. Drensky Abstract. Let Γ(M) where M V (G) be the set of all vertices

### פרויקט מסכם לתואר בוגר במדעים )B.Sc( במתמטיקה שימושית

המחלקה למתמטיקה Department of Mathematics פרויקט מסכם לתואר בוגר במדעים )B.Sc( במתמטיקה שימושית הימורים אופטימליים ע"י שימוש בקריטריון קלי אלון תושיה Optimal betting using the Kelly Criterion Alon Tushia

### Week 5: Expected value and Betting systems

Week 5: Expected value and Betting systems Random variable A random variable represents a measurement in a random experiment. We usually denote random variable with capital letter X, Y,. If S is the sample

### x a x 2 (1 + x 2 ) n.

Limits and continuity Suppose that we have a function f : R R. Let a R. We say that f(x) tends to the limit l as x tends to a; lim f(x) = l ; x a if, given any real number ɛ > 0, there exists a real number

### Probability Models.S1 Introduction to Probability

Probability Models.S1 Introduction to Probability Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard The stochastic chapters of this book involve random variability. Decisions are

### CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE

CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE With the notion of bijection at hand, it is easy to formalize the idea that two finite sets have the same number of elements: we just need to verify

### MOP 2007 Black Group Integer Polynomials Yufei Zhao. Integer Polynomials. June 29, 2007 Yufei Zhao yufeiz@mit.edu

Integer Polynomials June 9, 007 Yufei Zhao yufeiz@mit.edu We will use Z[x] to denote the ring of polynomials with integer coefficients. We begin by summarizing some of the common approaches used in dealing

### GREATEST COMMON DIVISOR

DEFINITION: GREATEST COMMON DIVISOR The greatest common divisor (gcd) of a and b, denoted by (a, b), is the largest common divisor of integers a and b. THEOREM: If a and b are nonzero integers, then their

### The Kelly criterion for spread bets

IMA Journal of Applied Mathematics 2007 72,43 51 doi:10.1093/imamat/hxl027 Advance Access publication on December 5, 2006 The Kelly criterion for spread bets S. J. CHAPMAN Oxford Centre for Industrial

### Properties of BMO functions whose reciprocals are also BMO

Properties of BMO functions whose reciprocals are also BMO R. L. Johnson and C. J. Neugebauer The main result says that a non-negative BMO-function w, whose reciprocal is also in BMO, belongs to p> A p,and

### MATH 56A SPRING 2008 STOCHASTIC PROCESSES 31

MATH 56A SPRING 2008 STOCHASTIC PROCESSES 3.3. Invariant probability distribution. Definition.4. A probability distribution is a function π : S [0, ] from the set of states S to the closed unit interval

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete

### Math 55: Discrete Mathematics

Math 55: Discrete Mathematics UC Berkeley, Fall 2011 Homework # 5, due Wednesday, February 22 5.1.4 Let P (n) be the statement that 1 3 + 2 3 + + n 3 = (n(n + 1)/2) 2 for the positive integer n. a) What

### FIRST YEAR CALCULUS. Chapter 7 CONTINUITY. It is a parabola, and we can draw this parabola without lifting our pencil from the paper.

FIRST YEAR CALCULUS WWLCHENW L c WWWL W L Chen, 1982, 2008. 2006. This chapter originates from material used by the author at Imperial College, University of London, between 1981 and 1990. It It is is

### Undergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics

Undergraduate Notes in Mathematics Arkansas Tech University Department of Mathematics An Introductory Single Variable Real Analysis: A Learning Approach through Problem Solving Marcel B. Finan c All Rights

### Corrected Diffusion Approximations for the Maximum of Heavy-Tailed Random Walk

Corrected Diffusion Approximations for the Maximum of Heavy-Tailed Random Walk Jose Blanchet and Peter Glynn December, 2003. Let (X n : n 1) be a sequence of independent and identically distributed random

### CHAPTER III - MARKOV CHAINS

CHAPTER III - MARKOV CHAINS JOSEPH G. CONLON 1. General Theory of Markov Chains We have already discussed the standard random walk on the integers Z. A Markov Chain can be viewed as a generalization of

### Statistics 100A Homework 4 Solutions

Chapter 4 Statistics 00A Homework 4 Solutions Ryan Rosario 39. A ball is drawn from an urn containing 3 white and 3 black balls. After the ball is drawn, it is then replaced and another ball is drawn.

### Asymptotics for ruin probabilities in a discrete-time risk model with dependent financial and insurance risks

1 Asymptotics for ruin probabilities in a discrete-time risk model with dependent financial and insurance risks Yang Yang School of Mathematics and Statistics, Nanjing Audit University School of Economics

### Racetrack Betting and Consensus of Subjective Probabilities

Racetrack Betting and Consensus of Subective Probabilities Lawrence D. Brown 1 and Yi Lin 2 University of Pennsylvania and University of Wisconsin, Madison Abstract In this paper we consider the dynamic

### A New Interpretation of Information Rate

A New Interpretation of Information Rate reproduced with permission of AT&T By J. L. Kelly, jr. (Manuscript received March 2, 956) If the input symbols to a communication channel represent the outcomes

### The Exponential Distribution

21 The Exponential Distribution From Discrete-Time to Continuous-Time: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding

### Reflection principle and Ocone martingales

Stochastic Processes and their Applications 119 29 3816 3833 www.elsevier.com/locate/spa Reflection principle and Ocone martingales L. Chaumont, L. Vostrikova LAREMA, Département de Mathématiques, Université

### Integer roots of quadratic and cubic polynomials with integer coefficients

Integer roots of quadratic and cubic polynomials with integer coefficients Konstantine Zelator Mathematics, Computer Science and Statistics 212 Ben Franklin Hall Bloomsburg University 400 East Second Street

### The last three chapters introduced three major proof techniques: direct,

CHAPTER 7 Proving Non-Conditional Statements The last three chapters introduced three major proof techniques: direct, contrapositive and contradiction. These three techniques are used to prove statements

### 1 Approximating Set Cover

CS 05: Algorithms (Grad) Feb 2-24, 2005 Approximating Set Cover. Definition An Instance (X, F ) of the set-covering problem consists of a finite set X and a family F of subset of X, such that every elemennt

### Ch. 13.3: More about Probability

Ch. 13.3: More about Probability Complementary Probabilities Given any event, E, of some sample space, U, of a random experiment, we can always talk about the complement, E, of that event: this is the

### N E W S A N D L E T T E R S

N E W S A N D L E T T E R S 73rd Annual William Lowell Putnam Mathematical Competition Editor s Note: Additional solutions will be printed in the Monthly later in the year. PROBLEMS A1. Let d 1, d,...,

### Lecture 15. Ranking Payoff Distributions: Stochastic Dominance. First-Order Stochastic Dominance: higher distribution

Lecture 15 Ranking Payoff Distributions: Stochastic Dominance First-Order Stochastic Dominance: higher distribution Definition 6.D.1: The distribution F( ) first-order stochastically dominates G( ) if

### FINITE DIMENSIONAL ORDERED VECTOR SPACES WITH RIESZ INTERPOLATION AND EFFROS-SHEN S UNIMODULARITY CONJECTURE AARON TIKUISIS

FINITE DIMENSIONAL ORDERED VECTOR SPACES WITH RIESZ INTERPOLATION AND EFFROS-SHEN S UNIMODULARITY CONJECTURE AARON TIKUISIS Abstract. It is shown that, for any field F R, any ordered vector space structure

### SCORE SETS IN ORIENTED GRAPHS

Applicable Analysis and Discrete Mathematics, 2 (2008), 107 113. Available electronically at http://pefmath.etf.bg.ac.yu SCORE SETS IN ORIENTED GRAPHS S. Pirzada, T. A. Naikoo The score of a vertex v in

### Probability II (MATH 2647)

Probability II (MATH 2647) Lecturer Dr. O. Hryniv email Ostap.Hryniv@durham.ac.uk office CM309 http://maths.dur.ac.uk/stats/courses/probmc2h/probability2h.html or via DUO This term we shall consider: Review

### 1. R In this and the next section we are going to study the properties of sequences of real numbers.

+a 1. R In this and the next section we are going to study the properties of sequences of real numbers. Definition 1.1. (Sequence) A sequence is a function with domain N. Example 1.2. A sequence of real

### Theorem (The division theorem) Suppose that a and b are integers with b > 0. There exist unique integers q and r so that. a = bq + r and 0 r < b.

Theorem (The division theorem) Suppose that a and b are integers with b > 0. There exist unique integers q and r so that a = bq + r and 0 r < b. We re dividing a by b: q is the quotient and r is the remainder,

### Markov Chains, Stochastic Processes, and Advanced Matrix Decomposition

Markov Chains, Stochastic Processes, and Advanced Matrix Decomposition Jack Gilbert Copyright (c) 2014 Jack Gilbert. Permission is granted to copy, distribute and/or modify this document under the terms

### Mathematical Finance

Mathematical Finance Option Pricing under the Risk-Neutral Measure Cory Barnes Department of Mathematics University of Washington June 11, 2013 Outline 1 Probability Background 2 Black Scholes for European

### International Journal of Information Technology, Modeling and Computing (IJITMC) Vol.1, No.3,August 2013

FACTORING CRYPTOSYSTEM MODULI WHEN THE CO-FACTORS DIFFERENCE IS BOUNDED Omar Akchiche 1 and Omar Khadir 2 1,2 Laboratory of Mathematics, Cryptography and Mechanics, Fstm, University of Hassan II Mohammedia-Casablanca,

### Notes on Factoring. MA 206 Kurt Bryan

The General Approach Notes on Factoring MA 26 Kurt Bryan Suppose I hand you n, a 2 digit integer and tell you that n is composite, with smallest prime factor around 5 digits. Finding a nontrivial factor

### Ex. 2.1 (Davide Basilio Bartolini)

ECE 54: Elements of Information Theory, Fall 00 Homework Solutions Ex.. (Davide Basilio Bartolini) Text Coin Flips. A fair coin is flipped until the first head occurs. Let X denote the number of flips

### Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction