# Wald s Identity. by Jeffery Hein. Dartmouth College, Math 100

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Wald s Identity by Jeffery Hein Dartmouth College, Math Introduction Given random variables X 1, X 2, X 3,... with common finite mean and a stopping rule τ which may depend upon the given sequence, we will be interested in finding conditions such that the following holds: EX X τ = EX 1 Eτ; 1 this is known as Wald s Identity. The beauty of Wald s Identity lies in its simplicity and intuitive nature: anyone could conjecture 1 after a few experiments. It wasn t until Wald established a framework in [2, 3] that our intuition was shown to be valid. Up to that point, intuition and experimentation suggested the validity of Wald s Identity, but intuition and experiment could only take us so far in the absence of rigor. In this paper, we seek modest conditions for which Wald s Identity will hold, three in total. These conditions will by no means be the weakest conditions possible, but nonetheless they will provide us a starting point. To arrive at these conditions, we will consider three example, each failing to achieve one condition while satisfying the remaining two. In doing so, we will justify each hypothesis and emphasize their mutual dependence. 2. Interpretations As we ll see in the forthcoming examples, there are two important ways to interpret Wald s Identity: gambling and random walks. In the gambling interpretation, we take each X n as the incremental gain or loss of a gambler during his n-th game, so that X 1 + +X n is the gambler s aggregate winnings up to and including the n-th game. We can then treat τ as the the point at which the gambler decides to stop gambling. If the gambler plays a fair game, then EX 1 = 0 and so EX X τ = 0 by Wald; in other words, no stopping strategy will give the gambler an advantage. The benefit of this interpretation is that it actually suggests one of the three conditions under which we will show that 1 holds: the gambler may not rely upon a stopping rule which depends upon the outcome of games which he has not yet played. This is intuitively obvious, no one would accept a bet against someone that can see infinitely far into the future. In the random walk interpretation, we can treat X 1 + +X n as our current position in the random walk after n steps, and τ as the duration of our random walk. 3. Hypothesis #1 In our first counterexample, we will consider the random walk interpretation.

2 Wald s Identity Example Let X n = {±1} with equal probability, and interpret P n = X X n as our position after n steps during a simple random walk on the one-dimensional lattice of integers, wherein we began our walk at the origin. Our stopping rule will then be taken to be the first point at which P τ = 1; in other words, when our random walk reaches +1. Since random walks on the one-dimensional lattice are recurrent, we will reach +1 in finite time with probability 1. Having conditioned on X X τ = 1, then the conditioned expectation EX 1 + +X τ = 1 is evident; furthermore, having assumed that X n = ±1 with equal probability, we easily see that EX 1 = 0. Under these observations, assuming Wald s Identity, we obtain an immediate contradiction. 3.2 Remarks The contradiction above depends upon a curious fact about simple random walks on the unbounded one-dimensional lattice: there is a finite-time random walk between any two vertices, but the expected time of such a walk is infinite. In other words, we are guaranteed to reach any destination, but there is no guarantee that we will be alive when we arrive, no matter how close it is! With knowledge that Eτ = in this example, our first hypothesis becomes evident: 4. Hypothesis #2 Assume our stopping rule τ has finite expected value. We will employ a gambling interpretation for this example. 4.1 Example A gambler bets on a sequence of fair coin flips and calls heads each time, stopping upon his first win. He bets \$1 on the first coin flip and doubles his bet upon each successive coin flip. Employing this system, we can set X n = {±2 n 1 } with equal probability. If W n = X X n is the gambler s current winnings up to and including the n-th coin flip, taking τ to be the time at which the first head appears, it is easily seen that W τ = 1, and so EX X τ = 1. Since the gambler is merely waiting for the first occurence of heads, this defines a Bernoulli trial and so Eτ = 2. This observation tells us that our first hypothesis holds, and Wald s Identity says us that 1 = 2 EX 1. However, this is a contradiction in light of the fact that EX n = Remarks This example emphasizes the fact that X 1, X 2,... having common finite mean is too weak an assumption for 1 to hold. Additionally, the assumption that Eτ is finite is not strong enough either. We are then forced to consider the distribution of our random variables. First, they are not identically distributed. Second, their expected absolute values take on all nonnegative powers of 2; in other words, E X n = 2 n 1. These observations lead us to our second hypothesis:

3 Wald s Identity 3 Assume our random variables X 1, X 2,... are identically distributed and E X n = E X 1 <. We noted in the introduction that we would be making stronger assumptions than are needed in general, this is one such case. In general, it is possible to prove Wald s Identity without the assumption that X 1, X 2,... are identically distributed. We make the stronger assumption for two reasons: 1 the method of proof presented in this paper will require it, and 2 the chosen method of proof is more straightforward and transparent with this assumption. 5. Hypothesis #3 We ve already discussed the third hypothesis in the interpretations section, and so here we will present an example of Wald s Identity failing when the stopping rule depends upon events X τ+1, X τ+2, Example We know that a simple random walk on the interval [0, m] Z is recurrent, i.e. a walk which begins at zero will eventually return to zero; such a walk is called an excursion. It is likewise evident that if we let X 1, X 2, X 3,... be the lengths of such excursions of a simple random walk on [0, m] Z, then this is an i.i.d. sequence of random variables. Furthermore, we know that the expected length of such an excursion, EX 1 = 2m, this is just the reciprocal of the stationary state distribution at zero, which we know to be 1/2m. Since X n > 0 for all n, then we plainly see that E X n = EX n and so our two previously discussed hypotheses are satisfied. All that remains is to define our stopping rule. Given the sequence X 1, X 2,... we can ask whether or not the excursion associated to each X n reached the point m, or in other words, whether the excursion covered the interval [0, m] Z. Let τ be such that X τ+1 is the first such excursion which covers the interval, so that Eτ = m 1. Wald s Identity then tells us that EX X τ = 2mm 1. Fixing m = 2, we find that Eτ = 1 and EX X τ = 4; however, there is only one excursion which does not cover {0, 1, 2}: the excursion of length 2. This tells us that EX X τ = 2τ, which therefore fixes τ = 2, and this contradicts our observation that Eτ = Remarks This example highlights the failure of Wald s Identity when we are allowed to define our stopping rule based on the outcome of future events. While the example above is not a fair game, we could let Y n = X n 2m, so that EY n = 0, thereby supporting our intuition that it is possible for clairvoyant gamblers to construct stopping rules to give themselves an advantage in an otherwise fair game. This is a reason that insider trading is not allowed on the stock market: if we assume that trading stocks is a fair

4 Wald s Identity 4 game, then insider trading gives brokers a means in which to gain an unfair advantage over competition. This of course leads us to our third and final hypothesis: Assume our stopping rule τ is independent of X τ+1, X τ+2, X τ+3, Proof of Wald s Identity Taking a quick look back at the first two examples, we can easily see that each example satisfies the other two hypotheses, yet fails the third. And so omission of any one hypothesis is insufficient to prove Wald s Identity, as we have provided counterexamples to each possibility. We will now turn our attention toward the proof that our hypotheses are sufficient to show that Wald s Identity holds. First, however, we will require two supplementary theorems of Kolmogorov which will aid us: The Strong Law of Large Numbers and The Converse to the Strong Law. Theorem 6.1 Strong Law of Large Numbers. Let X 1, X 2,... be i.i.d. random variables with common finite mean with E X n = E X 1 <. Then X X k = EX 1 = 1. Theorem 6.2 Converse to SLLN. Let X 1, X 2,... be i.i.d. common mean. If X X k exists = 1, then E X n = E X 1 <. random variables with Theorem 6.3 Wald s Identity. Let X 1, X 2,... be i.i.d. random variables with common finite mean with E X n = E X 1 <, and let τ be a stopping rule which is independent of X τ+1, X τ+2,... for which Eτ <, then EX X τ = EτEX 1. The proof we present here is a proof of David Blackwell from his 1946 paper [1]. Proof. We begin by inductively defining a sequence of stopping times τ 1, τ 2,... from our initial sequence X 1, X 2,... of random variables. Let τ 1 = τ and note that Pτ 1 = n X τ+1, X τ+2,... = Pτ 1 = n by hypothesis for all n. Disregarding X 1,..., X τ, we can apply our stopping rule to the remaining infinite sequence X τ+1, X τ+2,..., and so let τ 2 be the stopping time for this sequence, noting that Pτ 2 = n X τ1 +τ 2 +1, X τ1 +τ 2 +2,... = Pτ 2 = n.

5 Wald s Identity 5 Repeating this process inductively, we obtain the desired sequence τ 1, τ 2,.... We can then easily verify that Pτ n+1 = α n+1 τ 1 = α 1,..., τ n = α n = Pτ n+1 = α n+1, τ 1 = α 1,..., τ n = α n Pτ 1 = α 1,..., τ n = α n = Pτ n+1 = α n+1 Pτ 1 = α 1,..., τ n = α n Pτ 1 = α 1,..., τ n = α n = Pτ n+1 = α n+1, therefore τ 1, τ 2,... is an i.i.d. sequence of random variables. Having established independence of the sequence of stopping times, we now define another sequence of random variables. Put S 1 = X X τ1 S 2 = X τ X τ1 +τ 2 S 3 = X τ1 +τ X τ1 +τ 2 +τ 3. By reasoning similar to the sequence of τ s, we see that S 1, S 2,... is an i.i.d. sequence of random variables. We would like to be able to apply the Strong Law of Large Numbers to this sequence, but we do not yet know that E S n = E S 1 <, we merely know that they have common mean. If we were to show that we could apply the Converse to S 1, S 2,..., we would then be able to apply the Strong Law. To do this, we consider the following: S S k lim S S k N N k = lim lim k N N k where we have multiplied by 1 within the limit and separated the product. By definition of S 1,..., S k, we observe that the leftmost term in 2 is equal to X X τ1 + +τ lim k, k N N k which is merely a subsequence of the sequence of averages of the X s. By the Strong Law, we know that X X k = EX 1 = 1, and so the subsequence above must also converge to a common limit with probability 1. Likewise, applying the Strong Law to the rightmost term in 2, we find that N N k = Eτ = 1. 2 Together, these facts imply that P lim k S S k k = EτEX 1 = 1, 3

6 Wald s Identity 6 hence the limit exists with probability 1. By the Converse to SLLN, we find that E S n = E S 1 < and so we can apply the Strong Law to our sequence of sums S 1, S 2,..., obtaining S S k = ES 1 = 1. 4 Putting 3 and 4 together, we are left to conclude that as desired. EX X τ = EτEX 1 References [1] Blackwell, D., On an equation of Wald, Annals of Math. Stat., Vol. 17, 1946, pp [2] Wald, A., On cumulative sums of random variables, Annals of Math. Stat., Vol. 15, 1944, pp [3] Wald, A., Some generalizations of the theory of cumulative sums of random variables, Annals of Math. Stat., Vol. 16, 1945, pp

### 1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let

Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as

### Gambling Systems and Multiplication-Invariant Measures

Gambling Systems and Multiplication-Invariant Measures by Jeffrey S. Rosenthal* and Peter O. Schwartz** (May 28, 997.. Introduction. This short paper describes a surprising connection between two previously

### arxiv:1112.0829v1 [math.pr] 5 Dec 2011

How Not to Win a Million Dollars: A Counterexample to a Conjecture of L. Breiman Thomas P. Hayes arxiv:1112.0829v1 [math.pr] 5 Dec 2011 Abstract Consider a gambling game in which we are allowed to repeatedly

### Lecture 13: Martingales

Lecture 13: Martingales 1. Definition of a Martingale 1.1 Filtrations 1.2 Definition of a martingale and its basic properties 1.3 Sums of independent random variables and related models 1.4 Products of

### HOMEWORK 5 SOLUTIONS. n!f n (1) lim. ln x n! + xn x. 1 = G n 1 (x). (2) k + 1 n. (n 1)!

Math 7 Fall 205 HOMEWORK 5 SOLUTIONS Problem. 2008 B2 Let F 0 x = ln x. For n 0 and x > 0, let F n+ x = 0 F ntdt. Evaluate n!f n lim n ln n. By directly computing F n x for small n s, we obtain the following

### Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80)

Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80) CS 30, Winter 2016 by Prasad Jayanti 1. (10 points) Here is the famous Monty Hall Puzzle. Suppose you are on a game show, and you

### How to build a probability-free casino

How to build a probability-free casino Adam Chalcraft CCR La Jolla dachalc@ccrwest.org Chris Freiling Cal State San Bernardino cfreilin@csusb.edu Randall Dougherty CCR La Jolla rdough@ccrwest.org Jason

### 6.042/18.062J Mathematics for Computer Science December 12, 2006 Tom Leighton and Ronitt Rubinfeld. Random Walks

6.042/8.062J Mathematics for Comuter Science December 2, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Random Walks Gambler s Ruin Today we re going to talk about one-dimensional random walks. In

### Collatz Sequence. Fibbonacci Sequence. n is even; Recurrence Relation: a n+1 = a n + a n 1.

Fibonacci Roulette In this game you will be constructing a recurrence relation, that is, a sequence of numbers where you find the next number by looking at the previous numbers in the sequence. Your job

### Probability and Statistics

CHAPTER 2: RANDOM VARIABLES AND ASSOCIATED FUNCTIONS 2b - 0 Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be

### Induction. Margaret M. Fleck. 10 October These notes cover mathematical induction and recursive definition

Induction Margaret M. Fleck 10 October 011 These notes cover mathematical induction and recursive definition 1 Introduction to induction At the start of the term, we saw the following formula for computing

### LOOKING FOR A GOOD TIME TO BET

LOOKING FOR A GOOD TIME TO BET LAURENT SERLET Abstract. Suppose that the cards of a well shuffled deck of cards are turned up one after another. At any time-but once only- you may bet that the next card

### Probability Generating Functions

page 39 Chapter 3 Probability Generating Functions 3 Preamble: Generating Functions Generating functions are widely used in mathematics, and play an important role in probability theory Consider a sequence

### Phantom bonuses. November 22, 2004

Phantom bonuses November 22, 2004 1 Introduction The game is defined by a list of payouts u 1, u 2,..., u l, and a list of probabilities p 1, p 2,..., p l, p i = 1. We allow u i to be rational numbers,

### Sums of Independent Random Variables

Chapter 7 Sums of Independent Random Variables 7.1 Sums of Discrete Random Variables In this chapter we turn to the important question of determining the distribution of a sum of independent random variables

### The Exponential Distribution

21 The Exponential Distribution From Discrete-Time to Continuous-Time: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding

### Law of Large Numbers. Alexandra Barbato and Craig O Connell. Honors 391A Mathematical Gems Jenia Tevelev

Law of Large Numbers Alexandra Barbato and Craig O Connell Honors 391A Mathematical Gems Jenia Tevelev Jacob Bernoulli Life of Jacob Bernoulli Born into a family of important citizens in Basel, Switzerland

### P (A) = lim P (A) = N(A)/N,

1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or non-deterministic experiments. Suppose an experiment can be repeated any number of times, so that we

### Chapter 4 Lecture Notes

Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,

### . (3.3) n Note that supremum (3.2) must occur at one of the observed values x i or to the left of x i.

Chapter 3 Kolmogorov-Smirnov Tests There are many situations where experimenters need to know what is the distribution of the population of their interest. For example, if they want to use a parametric

### SECTION 10-2 Mathematical Induction

73 0 Sequences and Series 6. Approximate e 0. using the first five terms of the series. Compare this approximation with your calculator evaluation of e 0.. 6. Approximate e 0.5 using the first five terms

### 1 Short Introduction to Time Series

ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The

### Goal Problems in Gambling and Game Theory. Bill Sudderth. School of Statistics University of Minnesota

Goal Problems in Gambling and Game Theory Bill Sudderth School of Statistics University of Minnesota 1 Three problems Maximizing the probability of reaching a goal. Maximizing the probability of reaching

### Series Convergence Tests Math 122 Calculus III D Joyce, Fall 2012

Some series converge, some diverge. Series Convergence Tests Math 22 Calculus III D Joyce, Fall 202 Geometric series. We ve already looked at these. We know when a geometric series converges and what it

### Lectures on Stochastic Processes. William G. Faris

Lectures on Stochastic Processes William G. Faris November 8, 2001 2 Contents 1 Random walk 7 1.1 Symmetric simple random walk................... 7 1.2 Simple random walk......................... 9 1.3

### Revised Version of Chapter 23. We learned long ago how to solve linear congruences. ax c (mod m)

Chapter 23 Squares Modulo p Revised Version of Chapter 23 We learned long ago how to solve linear congruences ax c (mod m) (see Chapter 8). It s now time to take the plunge and move on to quadratic equations.

### MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore

MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore 1. Introduction The word martingale refers to a strap fastened belween the girth and the noseband of

### ST 371 (IV): Discrete Random Variables

ST 371 (IV): Discrete Random Variables 1 Random Variables A random variable (rv) is a function that is defined on the sample space of the experiment and that assigns a numerical variable to each possible

### Solutions for Practice problems on proofs

Solutions for Practice problems on proofs Definition: (even) An integer n Z is even if and only if n = 2m for some number m Z. Definition: (odd) An integer n Z is odd if and only if n = 2m + 1 for some

### ONE-DIMENSIONAL RANDOM WALKS 1. SIMPLE RANDOM WALK

ONE-DIMENSIONAL RANDOM WALKS 1. SIMPLE RANDOM WALK Definition 1. A random walk on the integers with step distribution F and initial state x is a sequence S n of random variables whose increments are independent,

### Math 55: Discrete Mathematics

Math 55: Discrete Mathematics UC Berkeley, Fall 2011 Homework # 5, due Wednesday, February 22 5.1.4 Let P (n) be the statement that 1 3 + 2 3 + + n 3 = (n(n + 1)/2) 2 for the positive integer n. a) What

### Statistics 100A Homework 4 Solutions

Chapter 4 Statistics 00A Homework 4 Solutions Ryan Rosario 39. A ball is drawn from an urn containing 3 white and 3 black balls. After the ball is drawn, it is then replaced and another ball is drawn.

### How to Gamble If You Must

How to Gamble If You Must Kyle Siegrist Department of Mathematical Sciences University of Alabama in Huntsville Abstract In red and black, a player bets, at even stakes, on a sequence of independent games

### Homework until Test #2

MATH31: Number Theory Homework until Test # Philipp BRAUN Section 3.1 page 43, 1. It has been conjectured that there are infinitely many primes of the form n. Exhibit five such primes. Solution. Five such

### t := maxγ ν subject to ν {0,1,2,...} and f(x c +γ ν d) f(x c )+cγ ν f (x c ;d).

1. Line Search Methods Let f : R n R be given and suppose that x c is our current best estimate of a solution to P min x R nf(x). A standard method for improving the estimate x c is to choose a direction

### SOME ASPECTS OF GAMBLING WITH THE KELLY CRITERION. School of Mathematical Sciences. Monash University, Clayton, Victoria, Australia 3168

SOME ASPECTS OF GAMBLING WITH THE KELLY CRITERION Ravi PHATARFOD School of Mathematical Sciences Monash University, Clayton, Victoria, Australia 3168 In this paper we consider the problem of gambling with

### Appendix F: Mathematical Induction

Appendix F: Mathematical Induction Introduction In this appendix, you will study a form of mathematical proof called mathematical induction. To see the logical need for mathematical induction, take another

### The Mean Value Theorem

The Mean Value Theorem THEOREM (The Extreme Value Theorem): If f is continuous on a closed interval [a, b], then f attains an absolute maximum value f(c) and an absolute minimum value f(d) at some numbers

### Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

### 1 Gambler s Ruin Problem

Coyright c 2009 by Karl Sigman 1 Gambler s Ruin Problem Let N 2 be an integer and let 1 i N 1. Consider a gambler who starts with an initial fortune of \$i and then on each successive gamble either wins

### TAKE-AWAY GAMES. ALLEN J. SCHWENK California Institute of Technology, Pasadena, California INTRODUCTION

TAKE-AWAY GAMES ALLEN J. SCHWENK California Institute of Technology, Pasadena, California L INTRODUCTION Several games of Tf take-away?f have become popular. The purpose of this paper is to determine the

### IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS

IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS There are four questions, each with several parts. 1. Customers Coming to an Automatic Teller Machine (ATM) (30 points)

### 3. INNER PRODUCT SPACES

. INNER PRODUCT SPACES.. Definition So far we have studied abstract vector spaces. These are a generalisation of the geometric spaces R and R. But these have more structure than just that of a vector space.

### In a triangle with a right angle, there are 2 legs and the hypotenuse of a triangle.

PROBLEM STATEMENT In a triangle with a right angle, there are legs and the hypotenuse of a triangle. The hypotenuse of a triangle is the side of a right triangle that is opposite the 90 angle. The legs

### Binomial lattice model for stock prices

Copyright c 2007 by Karl Sigman Binomial lattice model for stock prices Here we model the price of a stock in discrete time by a Markov chain of the recursive form S n+ S n Y n+, n 0, where the {Y i }

### The Binomial Distribution

The Binomial Distribution James H. Steiger November 10, 00 1 Topics for this Module 1. The Binomial Process. The Binomial Random Variable. The Binomial Distribution (a) Computing the Binomial pdf (b) Computing

### Lectures 5-6: Taylor Series

Math 1d Instructor: Padraic Bartlett Lectures 5-: Taylor Series Weeks 5- Caltech 213 1 Taylor Polynomials and Series As we saw in week 4, power series are remarkably nice objects to work with. In particular,

### Exercises with solutions (1)

Exercises with solutions (). Investigate the relationship between independence and correlation. (a) Two random variables X and Y are said to be correlated if and only if their covariance C XY is not equal

### Section 6-2 Mathematical Induction

6- Mathematical Induction 457 In calculus, it can be shown that e x k0 x k k! x x x3!! 3!... xn n! where the larger n is, the better the approximation. Problems 6 and 6 refer to this series. Note that

### The Kelly Betting System for Favorable Games.

The Kelly Betting System for Favorable Games. Thomas Ferguson, Statistics Department, UCLA A Simple Example. Suppose that each day you are offered a gamble with probability 2/3 of winning and probability

### x if x 0, x if x < 0.

Chapter 3 Sequences In this chapter, we discuss sequences. We say what it means for a sequence to converge, and define the limit of a convergent sequence. We begin with some preliminary results about the

### SOME APPLICATIONS OF MARTINGALES TO PROBABILITY THEORY

SOME APPLICATIONS OF MARTINGALES TO PROBABILITY THEORY WATSON LADD Abstract. Martingales are a very simple concept with wide application in probability. We introduce the concept of a martingale, develop

### Decision Theory. 36.1 Rational prospecting

36 Decision Theory Decision theory is trivial, apart from computational details (just like playing chess!). You have a choice of various actions, a. The world may be in one of many states x; which one

### THE FUNDAMENTAL THEOREM OF ARBITRAGE PRICING

THE FUNDAMENTAL THEOREM OF ARBITRAGE PRICING 1. Introduction The Black-Scholes theory, which is the main subject of this course and its sequel, is based on the Efficient Market Hypothesis, that arbitrages

### CS 103X: Discrete Structures Homework Assignment 3 Solutions

CS 103X: Discrete Structures Homework Assignment 3 s Exercise 1 (20 points). On well-ordering and induction: (a) Prove the induction principle from the well-ordering principle. (b) Prove the well-ordering

Expectations Expectations. (See also Hays, Appendix B; Harnett, ch. 3). A. The expected value of a random variable is the arithmetic mean of that variable, i.e. E() = µ. As Hays notes, the idea of the

### A Hajós type result on factoring finite abelian groups by subsets II

Comment.Math.Univ.Carolin. 51,1(2010) 1 8 1 A Hajós type result on factoring finite abelian groups by subsets II Keresztély Corrádi, Sándor Szabó Abstract. It is proved that if a finite abelian group is

### CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE

CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE With the notion of bijection at hand, it is easy to formalize the idea that two finite sets have the same number of elements: we just need to verify

### Lecture 8: Random Walk vs. Brownian Motion, Binomial Model vs. Log-Normal Distribution

Lecture 8: Random Walk vs. Brownian Motion, Binomial Model vs. Log-ormal Distribution October 4, 200 Limiting Distribution of the Scaled Random Walk Recall that we defined a scaled simple random walk last

### IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem

IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem Time on my hands: Coin tosses. Problem Formulation: Suppose that I have

### SOLUTIONS TO ASSIGNMENT 1 MATH 576

SOLUTIONS TO ASSIGNMENT 1 MATH 576 SOLUTIONS BY OLIVIER MARTIN 13 #5. Let T be the topology generated by A on X. We want to show T = J B J where B is the set of all topologies J on X with A J. This amounts

### Stationary random graphs on Z with prescribed iid degrees and finite mean connections

Stationary random graphs on Z with prescribed iid degrees and finite mean connections Maria Deijfen Johan Jonasson February 2006 Abstract Let F be a probability distribution with support on the non-negative

### Further Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1

Further Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1 J. Zhang Institute of Applied Mathematics, Chongqing University of Posts and Telecommunications, Chongqing

### Stanford Math Circle: Sunday, May 9, 2010 Square-Triangular Numbers, Pell s Equation, and Continued Fractions

Stanford Math Circle: Sunday, May 9, 00 Square-Triangular Numbers, Pell s Equation, and Continued Fractions Recall that triangular numbers are numbers of the form T m = numbers that can be arranged in

### Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction

### Taylor and Maclaurin Series

Taylor and Maclaurin Series In the preceding section we were able to find power series representations for a certain restricted class of functions. Here we investigate more general problems: Which functions

### Master s Theory Exam Spring 2006

Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem

### U.C. Berkeley CS276: Cryptography Handout 0.1 Luca Trevisan January, 2009. Notes on Algebra

U.C. Berkeley CS276: Cryptography Handout 0.1 Luca Trevisan January, 2009 Notes on Algebra These notes contain as little theory as possible, and most results are stated without proof. Any introductory

### You know from calculus that functions play a fundamental role in mathematics.

CHPTER 12 Functions You know from calculus that functions play a fundamental role in mathematics. You likely view a function as a kind of formula that describes a relationship between two (or more) quantities.

### 6.042/18.062J Mathematics for Computer Science. Expected Value I

6.42/8.62J Mathematics for Computer Science Srini Devadas and Eric Lehman May 3, 25 Lecture otes Expected Value I The expectation or expected value of a random variable is a single number that tells you

### 6 Scalar, Stochastic, Discrete Dynamic Systems

47 6 Scalar, Stochastic, Discrete Dynamic Systems Consider modeling a population of sand-hill cranes in year n by the first-order, deterministic recurrence equation y(n + 1) = Ry(n) where R = 1 + r = 1

### People have thought about, and defined, probability in different ways. important to note the consequences of the definition:

PROBABILITY AND LIKELIHOOD, A BRIEF INTRODUCTION IN SUPPORT OF A COURSE ON MOLECULAR EVOLUTION (BIOL 3046) Probability The subject of PROBABILITY is a branch of mathematics dedicated to building models

### Integer roots of quadratic and cubic polynomials with integer coefficients

Integer roots of quadratic and cubic polynomials with integer coefficients Konstantine Zelator Mathematics, Computer Science and Statistics 212 Ben Franklin Hall Bloomsburg University 400 East Second Street

### Notes on Factoring. MA 206 Kurt Bryan

The General Approach Notes on Factoring MA 26 Kurt Bryan Suppose I hand you n, a 2 digit integer and tell you that n is composite, with smallest prime factor around 5 digits. Finding a nontrivial factor

### Estimating the Frequency Distribution of the. Numbers Bet on the California Lottery

Estimating the Frequency Distribution of the Numbers Bet on the California Lottery Mark Finkelstein November 15, 1993 Department of Mathematics, University of California, Irvine, CA 92717. Running head:

### Load Balancing and Switch Scheduling

EE384Y Project Final Report Load Balancing and Switch Scheduling Xiangheng Liu Department of Electrical Engineering Stanford University, Stanford CA 94305 Email: liuxh@systems.stanford.edu Abstract Load

### CHAPTER 3. Methods of Proofs. 1. Logical Arguments and Formal Proofs

CHAPTER 3 Methods of Proofs 1. Logical Arguments and Formal Proofs 1.1. Basic Terminology. An axiom is a statement that is given to be true. A rule of inference is a logical rule that is used to deduce

### Random Fibonacci-type Sequences in Online Gambling

Random Fibonacci-type Sequences in Online Gambling Adam Biello, CJ Cacciatore, Logan Thomas Department of Mathematics CSUMS Advisor: Alfa Heryudono Department of Mathematics University of Massachusetts

### International Journal of Information Technology, Modeling and Computing (IJITMC) Vol.1, No.3,August 2013

FACTORING CRYPTOSYSTEM MODULI WHEN THE CO-FACTORS DIFFERENCE IS BOUNDED Omar Akchiche 1 and Omar Khadir 2 1,2 Laboratory of Mathematics, Cryptography and Mechanics, Fstm, University of Hassan II Mohammedia-Casablanca,

### A Note on Proebsting s Paradox

A Note on Proebsting s Paradox Leonid Pekelis March 8, 2012 Abstract Proebsting s Paradox is two-stage bet where the naive Kelly gambler (wealth growth rate maximizing) can be manipulated in some disconcertingly

### Stochastic Processes and Advanced Mathematical Finance. Laws of Large Numbers

Steven R. Dunbar Department of Mathematics 203 Avery Hall University of Nebraska-Lincoln Lincoln, NE 68588-0130 http://www.math.unl.edu Voice: 402-472-3731 Fax: 402-472-8466 Stochastic Processes and Advanced

### Cycles in a Graph Whose Lengths Differ by One or Two

Cycles in a Graph Whose Lengths Differ by One or Two J. A. Bondy 1 and A. Vince 2 1 LABORATOIRE DE MATHÉMATIQUES DISCRÉTES UNIVERSITÉ CLAUDE-BERNARD LYON 1 69622 VILLEURBANNE, FRANCE 2 DEPARTMENT OF MATHEMATICS

### APPLICATIONS OF THE ORDER FUNCTION

APPLICATIONS OF THE ORDER FUNCTION LECTURE NOTES: MATH 432, CSUSM, SPRING 2009. PROF. WAYNE AITKEN In this lecture we will explore several applications of order functions including formulas for GCDs and

### Mathematical Induction

Mathematical Induction (Handout March 8, 01) The Principle of Mathematical Induction provides a means to prove infinitely many statements all at once The principle is logical rather than strictly mathematical,

### Chapter 7. Sealed-bid Auctions

Chapter 7 Sealed-bid Auctions An auction is a procedure used for selling and buying items by offering them up for bid. Auctions are often used to sell objects that have a variable price (for example oil)

### x a x 2 (1 + x 2 ) n.

Limits and continuity Suppose that we have a function f : R R. Let a R. We say that f(x) tends to the limit l as x tends to a; lim f(x) = l ; x a if, given any real number ɛ > 0, there exists a real number

### Some Polynomial Theorems. John Kennedy Mathematics Department Santa Monica College 1900 Pico Blvd. Santa Monica, CA 90405 rkennedy@ix.netcom.

Some Polynomial Theorems by John Kennedy Mathematics Department Santa Monica College 1900 Pico Blvd. Santa Monica, CA 90405 rkennedy@ix.netcom.com This paper contains a collection of 31 theorems, lemmas,

### Section 3 Sequences and Limits, Continued.

Section 3 Sequences and Limits, Continued. Lemma 3.6 Let {a n } n N be a convergent sequence for which a n 0 for all n N and it α 0. Then there exists N N such that for all n N. α a n 3 α In particular

### Proof of Infinite Number of Fibonacci Primes. Stephen Marshall. 22 May Abstract

Proof of Infinite Number of Fibonacci Primes Stephen Marshall 22 May 2014 Abstract This paper presents a complete and exhaustive proof of that an infinite number of Fibonacci Primes exist. The approach

### STOCHASTIC MODELING. Math3425 Spring 2012, HKUST. Kani Chen (Instructor)

STOCHASTIC MODELING Math3425 Spring 212, HKUST Kani Chen (Instructor) Chapters 1-2. Review of Probability Concepts Through Examples We review some basic concepts about probability space through examples,

### Math 55: Discrete Mathematics

Math 55: Discrete Mathematics UC Berkeley, Spring 2012 Homework # 9, due Wednesday, April 11 8.1.5 How many ways are there to pay a bill of 17 pesos using a currency with coins of values of 1 peso, 2 pesos,

### Homework 4 - KEY. Jeff Brenion. June 16, 2004. Note: Many problems can be solved in more than one way; we present only a single solution here.

Homework 4 - KEY Jeff Brenion June 16, 2004 Note: Many problems can be solved in more than one way; we present only a single solution here. 1 Problem 2-1 Since there can be anywhere from 0 to 4 aces, the

### MA651 Topology. Lecture 6. Separation Axioms.

MA651 Topology. Lecture 6. Separation Axioms. This text is based on the following books: Fundamental concepts of topology by Peter O Neil Elements of Mathematics: General Topology by Nicolas Bourbaki Counterexamples

### A New Interpretation of Information Rate

A New Interpretation of Information Rate reproduced with permission of AT&T By J. L. Kelly, jr. (Manuscript received March 2, 956) If the input symbols to a communication channel represent the outcomes

### k=1 k2, and therefore f(m + 1) = f(m) + (m + 1) 2 =

Math 104: Introduction to Analysis SOLUTIONS Alexander Givental HOMEWORK 1 1.1. Prove that 1 2 +2 2 + +n 2 = 1 n(n+1)(2n+1) for all n N. 6 Put f(n) = n(n + 1)(2n + 1)/6. Then f(1) = 1, i.e the theorem

### Mathematical Induction. Lecture 10-11

Mathematical Induction Lecture 10-11 Menu Mathematical Induction Strong Induction Recursive Definitions Structural Induction Climbing an Infinite Ladder Suppose we have an infinite ladder: 1. We can reach

### Worksheet for Teaching Module Probability (Lesson 1)

Worksheet for Teaching Module Probability (Lesson 1) Topic: Basic Concepts and Definitions Equipment needed for each student 1 computer with internet connection Introduction In the regular lectures in

### Statistics 100A Homework 3 Solutions

Chapter Statistics 00A Homework Solutions Ryan Rosario. Two balls are chosen randomly from an urn containing 8 white, black, and orange balls. Suppose that we win \$ for each black ball selected and we