Be sure this exam has 12 pages including the cover. The University of British Columbia
|
|
- Nancy Caldwell
- 7 years ago
- Views:
Transcription
1 Be sure this exam has 1 pages including the cover The University of British Columbia Sessional Exams 11 Term Mathematics 33 Introduction to Stochastic Processes Dr. D. Brydges Last Name: First Name: Student Number: This exam consists of 8 questions worth 1 marks each so that the total is 8. No aids are permitted. Please show all work and calculations. On some parts no explanation will mean no marks. Numerical answers need not be simplified. Problem total possible score total 8 1. Each candidate should be prepared to produce his library/ams card upon request.. Read and observe the following rules: No candidate shall be permitted to enter the examination room after the expiration of one half hour, or to leave during the first half hour of the examination. Candidates are not permitted to ask questions of the invigilators, except in cases of supposed errors or ambiguities in examination questions. CAUTION - Candidates guilty of any of the following or similar practices shall be immediately dismissed from the examination and shall be liable to disciplinary action. a Making use of any books, papers or memoranda, other than those authorized by the examiners. b Speaking or communicating with other candidates. c Purposely exposing written papers to the view of other candidates. The plea of accident or forgetfulness shall not be received. 3. Smoking is not permitted during examinations.
2 April 4 1 Math 33 Final Exam Page of 1 1. Consider the Markov chain X n, n =, 1,.. whose seven states and transitions of positive probability are as indicated in the diagram points a What are the communicating classes? {1,, 3, 4}, {5, 6, }, {7} 1 points b Does this Markov chain have a stationary distribution? Briefly explain. π i = { 1 i = 7 else is a stationary distribution. 1 points c Suppose X = 1. Does lim n Pi,j n exist when i = 1? Briefly explain. No. If we start the chain in state 1 then it stays in states {1,, 3, 4} and with only these states it is irreducible but in the next part you find it is not aperiodic. 3 points d Define the period of a state and use your definition to determine the periods of the recurrent states. The period of state i is the greatest common divisor of the times for which return to i is possible, in other words d i = gcd{n 1 : P i X n = i > }. The states {1,, 3, 4} have period and 7 has period one. The remaining states {5, 6} are transient. points e Suppose PX = i = ρ i for every state i where ρ i, i = 1,,..., 7 are given probabilities. Give a formula for PX 1 = 7 in terms of ρ i and the transition probability matrix P ij. i ρ ip i,7 or ρ 6 P 6,7 + ρ 7 P 7,7
3 April 4 1 Math 33 Final Exam Page 3 of 1. A soap opera has N characters. In each episode some are evil and the others are good. Before making each episode the director tosses a coin which has probability p of showing heads. If the result is heads then a character is chosen at random and, if evil, becomes good, if good, remains good; if the result is tails then a character is chosen at random and, if good, becomes evil, if evil, remains evil. For n = 1,,..., let X n denote the number of good characters in episode n. For n = set X n =. points a Draw the transition diagram of the Markov chain X n n when N = 4, showing the transitions of positive probability. You need not insert the probabilities points b Find the nonzero transition probabilities P ij. For N = P i,i+1 = p N i, i =, 1,..., N 1, N P i,i 1 = 1 p i, i = 1,..., N, N P i,i = p i i + 1 pn, i =,..., N. N N P,1 = p, P 1, = p, P 1, = 1 1 p, P,1 = 1 p, P, = 1 p, P 1,1 = 1, P, = 1 p 5 points c This soap opera has run for a very long time. Find, as a formula involving the number of characters N, the proportion of episodes in which there are exactly two good characters. What is the answer for N =? As we saw in MT problem an MC with states that are connected in a line is reversible. In this case we want π where π i solves equations of detailed balance,
4 April 4 1 Math 33 Final Exam Page 4 of 1 π i P ij = π j P ji. π p = π 1 1 p 1 N p N, π 1 = π 1 1 p π 1 p N 1 N = π 1 p N p N, π = π 1 p π p N N = π 31 p 3 N p N, π 3 = π 3 1 p πi = 1 and binomial theorem leads to π = 1 p N. 3 π i = N p i 1 p N i, π = i N p 1 p N = p for N=.
5 April 4 1 Math 33 Final Exam Page 5 of 1 3. An urn contains four balls, which can be black or white. At each time n =, 1,,... a ball is chosen at random from the urn and replaced by a ball of the opposite colour. 3 points a What does it mean to say that a state is positively recurrent? Are all the states in this Markov chain positively recurrent? A state is positively recurrent if it is recurrent and the expected time to return is finite. In this case there is one class of recurrent states. Theorem: recurrent states are positively recurrent when there are finitely many states. Therefore answer to second part is YES. points b For this Markov chain, running forever, all four balls are white for 1 16 of the times. If we start the sytem in the state where all the balls are white, what is the expected time before they are again all white? 16 because π all white = 1 ET all white. 5 points c Initially there is one white ball and three black balls. What is the probability that they all become white before they are all black? Hint. Gamblers ruin. For i =, 1,, 3, 4, starting with i white balls, let p i be the probability that all the balls become white before they all become black. As in gamblers ruin, there are some boundary conditions and playing one game leads to equations, p 4 = 1, p =, p 1 = 1 4 p p, p = 4 p p 3, p 3 = 3 4 p p 4, These can be solved. The fast way is that by symmetry p = 1, so p 1 = = 3 8.
6 April 4 1 Math 33 Final Exam Page 6 of 1 4. Let S n be the position at time n of symmetric simple random walk on Z with S =. 4 points a Thinking of steps to the left and the right what is the formula for PS n = in terms of n? n PS n = = n }{{} choose which steps 1 n }{{} prob with steps specified. 1 points b Let N = #{n : S n = } be the number of visits to the origin. State and prove the formula that relates EN to PS n =. Hint. Indicator functions. N = n I Sn= EN = n EI Sn= = n PS n = 3 points c Define what it means for state to be recurrent. What is the relation to EN? Probability of return to the origin is one. Theorem: recurrent iff EN =. points d Prove that the origin is recurrent. n! πnn n e n. is divergent because n n 1 EN = n n = n! n! EI Sn= = n 1 n πn πn and n> 1 n is a p series with p 1. PS n = = n n n e n n n e n n n 1 n 4 1 n πn = = 1 πn πn 5
7 April 4 1 Math 33 Final Exam Page 7 of 1 5. Bacteria reproduce by cell division. In a unit of time, a bacterium will either die with probability 1 4, stay the same with probability 1 4, or split into bacteria with probability 4. Interpret this as a branching process. Let Z n be the number of bacteria at time n =, 1,,... and let G n s be the generating function for Z n. points a Suppose initially there is only one bacterium. Find G 1 s as a function of s. G 1 s = s + 4 s 4 points b Suppose initially there is only one bacterium. Find G s as a function of s. Since Z = 1, Gs = G 1 s and G s = GG 1 s = s + 4 s s + 4 s. I am happy with this answer but it can be multiplied out to get s+ 9 3 s s s4. There is less good way to get this by finding PZ = i for all i by hand. points c Suppose that initially there are 1 bacteria. What is the expected number in generation n. 1µ n where µ = Eξ = = 5 4. points d Suppose that initially there are 1 bacteria. What is the probability that the population goes extinct. The solutions of s = s + 4 s are 1 and 1. Therefore extinction probability starting with one bacterium is 1. Starting with 1 is 1 1.
8 April 4 1 Math 33 Final Exam Page 8 of 1 5 points 6. a One of the standard definitions of a Poisson process Nt of rate r, involves a statement about Ns + h Ns when h is small. Write out this definition 1 explaining the meaning of terms in it such as increment and oh. The Poisson process with rate r is a non-negative integer valued process Nt such that 1. N =. Nt Ns and Nt 1 Ns 1 are independent random variables when the intervals s 1, t 1 and s, t are disjoint rh oh n =, PNs + h Ns = n = rh + oh n = 1, oh n > 1. oh denotes a function fh that does not depend on s such that fh/h as h. 6 points b Suppose that crimes in a large city occur according to a rate r Poisson process Nt. For each crime, the criminal responsible for the crime is sent to prison with probability 1/5. Ignoring the delay between the crime and the beginning of the prison sentence, what process P t describes the arrivals of new prisoners? What assumption not yet mentioned are you making? Assume that each criminal is independently sent to prison with probability. Then P t is a rate r/5 Poisson process points c Partly justify your answer in part b by showing that P t satisfies a Ns + h Ns axiom as in part a. With p = 1/5, P P s + h P s = 1 = 7 pp N 1 s + h N 1 s = 1 + p1 pp N 1 s + h N 1 s = + 8 = prh + h 9 Similarly P P s + h P s = oh which verifies that P t satisfies axiom 3 for a rate r/5 Poisson process. 1 This term in class I presented this as a theorem to reduce confusion the book gives two definitions.
9 April 4 1 Math 33 Final Exam Page 9 of 1 7. Blackbirds come to a bird feeder according to a Poisson process Bt with rate b per hour; robins come to the same bird feeder according to an independent Poisson process Rt with rate r per hour. 4 points a What is the probability that exactly four birds arrive between 1 and 1:3pm? The combined process Nt is a rate b + r process. PN1/ = 4 = b+r 4 e b+r. 4! points b Exactly one bird arrived during the first hour. What is the probability that it actually arrived during the first quarter of an hour. Conditional on Nt = 1 the arrival time is uniform in, t so the answer is 1 4. Or P N 1 4 = 1 N1 = 1 = P N 1 4 = 1, N1 = 1 P N1 = 1 = r/4e r/4 e 3r/4 re r = 1 4 = P N 1 4 = 1 P N 3 4 = P N1 = 1 points c Suppose that the first robin arrives at time S 1 and the second robin arrives at time S. What is the probability that S > 4S 1? Write S = S 1 + T where T is the time between the arrival of the first and the second robins. S 1 and S are independent Exp r. P S 1 + T > 4S 1 = P T > 3S 1 = I t>3s re rt re rs dt ds = re rt dt re rs ds = e r3s re rs ds = re 4rs ds = 1 4 3s points d What is the probability that exactly one blackbird arrives before the first robin? t n e at dt = n!a n 1. Let T R be the time to first robin. Condition on T R = t P BT R = 1 = = P BT R = 1 T R = t re rt dt = bt 1! e bt re rt dt = br te b+rt dt = P Bt = 1 re rt dt br b + r
10 April 4 1 Math 33 Final Exam Page 1 of 1 Or use memoryless property, restarting the Poisson process after the first robin arrives, P S B,1 < S R,1, S B, > S R,1 = P SB, > S R,1 S B,1 < S R,1 P SB,1 < S R,1 = P r b S B,1 > S R,1 P SB,1 < S R,1 = r + b r + b
11 April 4 1 Math 33 Final Exam Page 11 of 1 8. Students arrive at a help centre according to a rate r Poisson process. When there are n 1 students in the centre, the first one to leave does so at a random Exp r time. points a Let X t be the number of students in the centre at continuous time t. Regarding this as a birth/death process, what are the parameters λ n and µ n for n = and for n = 1,,...? λ n = r, n =, 1,..., { r n = 1,,... µ n = n = points b For n =, 1,,..., if there are presently n students in the centre, what is the expected time to the next transition? The minimum of an Exp r and an Exp r is an Exp r + r so { 1 r+r n = 1,,... 1 r n = points c For n =, 1,,..., if there are presently n students in the centre, what is the probability that the next transition will be to n + 1 students? { r r+r n = 1,,... 1 n = 4 points d Suppose that there are presently no students in the centre. What is the expected time until there are two students? Let T be the random time until there are two students, starting with none, let t = 1 r, t = 1 r be the expected times in states, 1 before next transition. Write an equation for ET by thinking about the additional time to reach state after reaching state 1: if the next transition is to then it is the time in state 1 plus nothing; if the next transition is to it is the time in state 1 plus the time to reach if you start in so ET = t + P 1, t 1 + P 1, t 1 + ET = t + t 1 + P 1, ET
12 April 4 1 Math 33 Final Exam Page 1 of 1 where we know t 1 from part b and P 1, = 1 P 1, from part c. Solve for ET, ET = 1 1 t + t 1 = 3 1 P 1, r + 1 = 4 3r r
1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let
Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as
More informationFEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL
FEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL STATIsTICs 4 IV. RANDOm VECTORs 1. JOINTLY DIsTRIBUTED RANDOm VARIABLEs If are two rom variables defined on the same sample space we define the joint
More informationSolved Problems. Chapter 14. 14.1 Probability review
Chapter 4 Solved Problems 4. Probability review Problem 4.. Let X and Y be two N 0 -valued random variables such that X = Y + Z, where Z is a Bernoulli random variable with parameter p (0, ), independent
More informationMarkov Chains. Chapter 4. 4.1 Stochastic Processes
Chapter 4 Markov Chains 4 Stochastic Processes Often, we need to estimate probabilities using a collection of random variables For example, an actuary may be interested in estimating the probability that
More informationIEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS
IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS There are four questions, each with several parts. 1. Customers Coming to an Automatic Teller Machine (ATM) (30 points)
More informationProbability Generating Functions
page 39 Chapter 3 Probability Generating Functions 3 Preamble: Generating Functions Generating functions are widely used in mathematics, and play an important role in probability theory Consider a sequence
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationLecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett
Lecture Note 1 Set and Probability Theory MIT 14.30 Spring 2006 Herman Bennett 1 Set Theory 1.1 Definitions and Theorems 1. Experiment: any action or process whose outcome is subject to uncertainty. 2.
More informationLECTURE 4. Last time: Lecture outline
LECTURE 4 Last time: Types of convergence Weak Law of Large Numbers Strong Law of Large Numbers Asymptotic Equipartition Property Lecture outline Stochastic processes Markov chains Entropy rate Random
More informationM/M/1 and M/M/m Queueing Systems
M/M/ and M/M/m Queueing Systems M. Veeraraghavan; March 20, 2004. Preliminaries. Kendall s notation: G/G/n/k queue G: General - can be any distribution. First letter: Arrival process; M: memoryless - exponential
More informationBasic Probability Concepts
page 1 Chapter 1 Basic Probability Concepts 1.1 Sample and Event Spaces 1.1.1 Sample Space A probabilistic (or statistical) experiment has the following characteristics: (a) the set of all possible outcomes
More informationIntroduction to Markov Chain Monte Carlo
Introduction to Markov Chain Monte Carlo Monte Carlo: sample from a distribution to estimate the distribution to compute max, mean Markov Chain Monte Carlo: sampling using local information Generic problem
More informationSection 1.3 P 1 = 1 2. = 1 4 2 8. P n = 1 P 3 = Continuing in this fashion, it should seem reasonable that, for any n = 1, 2, 3,..., = 1 2 4.
Difference Equations to Differential Equations Section. The Sum of a Sequence This section considers the problem of adding together the terms of a sequence. Of course, this is a problem only if more than
More information1 Gambler s Ruin Problem
Coyright c 2009 by Karl Sigman 1 Gambler s Ruin Problem Let N 2 be an integer and let 1 i N 1. Consider a gambler who starts with an initial fortune of $i and then on each successive gamble either wins
More informationChapter 3. Cartesian Products and Relations. 3.1 Cartesian Products
Chapter 3 Cartesian Products and Relations The material in this chapter is the first real encounter with abstraction. Relations are very general thing they are a special type of subset. After introducing
More informationRandom variables, probability distributions, binomial random variable
Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that
More informationPeople have thought about, and defined, probability in different ways. important to note the consequences of the definition:
PROBABILITY AND LIKELIHOOD, A BRIEF INTRODUCTION IN SUPPORT OF A COURSE ON MOLECULAR EVOLUTION (BIOL 3046) Probability The subject of PROBABILITY is a branch of mathematics dedicated to building models
More informationThe Exponential Distribution
21 The Exponential Distribution From Discrete-Time to Continuous-Time: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding
More information1/3 1/3 1/3 0.4 0.4 0.4 0.4 0.4 0.4 0.4 0 1 2 3 4 5 6 7 8 0.6 0.6 0.6 0.6 0.6 0.6 0.6
HOMEWORK 4: SOLUTIONS. 2. A Markov chain with state space {, 2, 3} has transition probability matrix /3 /3 /3 P = 0 /2 /2 0 0 Show that state 3 is absorbing and, starting from state, find the expected
More informationTutorial: Stochastic Modeling in Biology Applications of Discrete- Time Markov Chains. NIMBioS Knoxville, Tennessee March 16-18, 2011
Tutorial: Stochastic Modeling in Biology Applications of Discrete- Time Markov Chains Linda J. S. Allen Texas Tech University Lubbock, Texas U.S.A. NIMBioS Knoxville, Tennessee March 16-18, 2011 OUTLINE
More informationExponential Distribution
Exponential Distribution Definition: Exponential distribution with parameter λ: { λe λx x 0 f(x) = 0 x < 0 The cdf: F(x) = x Mean E(X) = 1/λ. f(x)dx = Moment generating function: φ(t) = E[e tx ] = { 1
More informationProbability density function : An arbitrary continuous random variable X is similarly described by its probability density function f x = f X
Week 6 notes : Continuous random variables and their probability densities WEEK 6 page 1 uniform, normal, gamma, exponential,chi-squared distributions, normal approx'n to the binomial Uniform [,1] random
More informationRandom access protocols for channel access. Markov chains and their stability. Laurent Massoulié.
Random access protocols for channel access Markov chains and their stability laurent.massoulie@inria.fr Aloha: the first random access protocol for channel access [Abramson, Hawaii 70] Goal: allow machines
More informationProbabilistic Strategies: Solutions
Probability Victor Xu Probabilistic Strategies: Solutions Western PA ARML Practice April 3, 2016 1 Problems 1. You roll two 6-sided dice. What s the probability of rolling at least one 6? There is a 1
More informationTenth Problem Assignment
EECS 40 Due on April 6, 007 PROBLEM (8 points) Dave is taking a multiple-choice exam. You may assume that the number of questions is infinite. Simultaneously, but independently, his conscious and subconscious
More informationOn the mathematical theory of splitting and Russian roulette
On the mathematical theory of splitting and Russian roulette techniques St.Petersburg State University, Russia 1. Introduction Splitting is an universal and potentially very powerful technique for increasing
More informationREPEATED TRIALS. The probability of winning those k chosen times and losing the other times is then p k q n k.
REPEATED TRIALS Suppose you toss a fair coin one time. Let E be the event that the coin lands heads. We know from basic counting that p(e) = 1 since n(e) = 1 and 2 n(s) = 2. Now suppose we play a game
More informationBinomial lattice model for stock prices
Copyright c 2007 by Karl Sigman Binomial lattice model for stock prices Here we model the price of a stock in discrete time by a Markov chain of the recursive form S n+ S n Y n+, n 0, where the {Y i }
More informationNormal distribution. ) 2 /2σ. 2π σ
Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a
More informationOverview of Monte Carlo Simulation, Probability Review and Introduction to Matlab
Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab 1 Overview of Monte Carlo Simulation 1.1 Why use simulation?
More informationS on n elements. A good way to think about permutations is the following. Consider the A = 1,2,3, 4 whose elements we permute with the P =
Section 6. 1 Section 6. Groups of Permutations: : The Symmetric Group Purpose of Section: To introduce the idea of a permutation and show how the set of all permutations of a set of n elements, equipped
More informationMATH 289 PROBLEM SET 4: NUMBER THEORY
MATH 289 PROBLEM SET 4: NUMBER THEORY 1. The greatest common divisor If d and n are integers, then we say that d divides n if and only if there exists an integer q such that n = qd. Notice that if d divides
More informationQuestion: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?
ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the
More informationE3: PROBABILITY AND STATISTICS lecture notes
E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................
More informationEssentials of Stochastic Processes
i Essentials of Stochastic Processes Rick Durrett 70 60 50 10 Sep 10 Jun 10 May at expiry 40 30 20 10 0 500 520 540 560 580 600 620 640 660 680 700 Almost Final Version of the 2nd Edition, December, 2011
More information6.263/16.37: Lectures 5 & 6 Introduction to Queueing Theory
6.263/16.37: Lectures 5 & 6 Introduction to Queueing Theory Massachusetts Institute of Technology Slide 1 Packet Switched Networks Messages broken into Packets that are routed To their destination PS PS
More information6.041/6.431 Spring 2008 Quiz 2 Wednesday, April 16, 7:30-9:30 PM. SOLUTIONS
6.4/6.43 Spring 28 Quiz 2 Wednesday, April 6, 7:3-9:3 PM. SOLUTIONS Name: Recitation Instructor: TA: 6.4/6.43: Question Part Score Out of 3 all 36 2 a 4 b 5 c 5 d 8 e 5 f 6 3 a 4 b 6 c 6 d 6 e 6 Total
More information6.4 Normal Distribution
Contents 6.4 Normal Distribution....................... 381 6.4.1 Characteristics of the Normal Distribution....... 381 6.4.2 The Standardized Normal Distribution......... 385 6.4.3 Meaning of Areas under
More informationWhen factoring, we look for greatest common factor of each term and reverse the distributive property and take out the GCF.
Factoring: reversing the distributive property. The distributive property allows us to do the following: When factoring, we look for greatest common factor of each term and reverse the distributive property
More informationWHERE DOES THE 10% CONDITION COME FROM?
1 WHERE DOES THE 10% CONDITION COME FROM? The text has mentioned The 10% Condition (at least) twice so far: p. 407 Bernoulli trials must be independent. If that assumption is violated, it is still okay
More informationMath/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability
Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock
More informationMath 526: Brownian Motion Notes
Math 526: Brownian Motion Notes Definition. Mike Ludkovski, 27, all rights reserved. A stochastic process (X t ) is called Brownian motion if:. The map t X t (ω) is continuous for every ω. 2. (X t X t
More informationMath 202-0 Quizzes Winter 2009
Quiz : Basic Probability Ten Scrabble tiles are placed in a bag Four of the tiles have the letter printed on them, and there are two tiles each with the letters B, C and D on them (a) Suppose one tile
More information= 2 + 1 2 2 = 3 4, Now assume that P (k) is true for some fixed k 2. This means that
Instructions. Answer each of the questions on your own paper, and be sure to show your work so that partial credit can be adequately assessed. Credit will not be given for answers (even correct ones) without
More informationHomework set 4 - Solutions
Homework set 4 - Solutions Math 495 Renato Feres Problems R for continuous time Markov chains The sequence of random variables of a Markov chain may represent the states of a random system recorded at
More information4. Continuous Random Variables, the Pareto and Normal Distributions
4. Continuous Random Variables, the Pareto and Normal Distributions A continuous random variable X can take any value in a given range (e.g. height, weight, age). The distribution of a continuous random
More informationStatistics 100A Homework 3 Solutions
Chapter Statistics 00A Homework Solutions Ryan Rosario. Two balls are chosen randomly from an urn containing 8 white, black, and orange balls. Suppose that we win $ for each black ball selected and we
More informationMath 431 An Introduction to Probability. Final Exam Solutions
Math 43 An Introduction to Probability Final Eam Solutions. A continuous random variable X has cdf a for 0, F () = for 0 <
More informationSensitivity analysis of utility based prices and risk-tolerance wealth processes
Sensitivity analysis of utility based prices and risk-tolerance wealth processes Dmitry Kramkov, Carnegie Mellon University Based on a paper with Mihai Sirbu from Columbia University Math Finance Seminar,
More information6.3 Conditional Probability and Independence
222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted
More informationMonte Carlo Methods in Finance
Author: Yiyang Yang Advisor: Pr. Xiaolin Li, Pr. Zari Rachev Department of Applied Mathematics and Statistics State University of New York at Stony Brook October 2, 2012 Outline Introduction 1 Introduction
More information6 PROBABILITY GENERATING FUNCTIONS
6 PROBABILITY GENERATING FUNCTIONS Certain derivations presented in this course have been somewhat heavy on algebra. For example, determining the expectation of the Binomial distribution (page 5.1 turned
More informationLECTURE 16. Readings: Section 5.1. Lecture outline. Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process
LECTURE 16 Readings: Section 5.1 Lecture outline Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process Number of successes Distribution of interarrival times The
More informationSums of Independent Random Variables
Chapter 7 Sums of Independent Random Variables 7.1 Sums of Discrete Random Variables In this chapter we turn to the important question of determining the distribution of a sum of independent random variables
More informationPractice Problems for Homework #8. Markov Chains. Read Sections 7.1-7.3. Solve the practice problems below.
Practice Problems for Homework #8. Markov Chains. Read Sections 7.1-7.3 Solve the practice problems below. Open Homework Assignment #8 and solve the problems. 1. (10 marks) A computer system can operate
More informationNotes on Continuous Random Variables
Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes
More informationBisimulation and Logical Preservation for Continuous-Time Markov Decision Processes
Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes Martin R. Neuhäußer 1,2 Joost-Pieter Katoen 1,2 1 RWTH Aachen University, Germany 2 University of Twente, The Netherlands
More informationuation of a Poisson Process for Emergency Care
QUEUEING THEORY WITH APPLICATIONS AND SPECIAL CONSIDERATION TO EMERGENCY CARE JAMES KEESLING. Introduction Much that is essential in modern life would not be possible without queueing theory. All communication
More informationStatistics 100A Homework 4 Solutions
Chapter 4 Statistics 00A Homework 4 Solutions Ryan Rosario 39. A ball is drawn from an urn containing 3 white and 3 black balls. After the ball is drawn, it is then replaced and another ball is drawn.
More informationWald s Identity. by Jeffery Hein. Dartmouth College, Math 100
Wald s Identity by Jeffery Hein Dartmouth College, Math 100 1. Introduction Given random variables X 1, X 2, X 3,... with common finite mean and a stopping rule τ which may depend upon the given sequence,
More informationProbability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of sample space, event and probability function. 2. Be able to
More informationChapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS. Part 3: Discrete Uniform Distribution Binomial Distribution
Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 3: Discrete Uniform Distribution Binomial Distribution Sections 3-5, 3-6 Special discrete random variable distributions we will cover
More informationName: Math 29 Probability. Practice Second Midterm Exam 1. 1. Show all work. You may receive partial credit for partially completed problems.
Name: Math 29 Probability Practice Second Midterm Exam 1 Instructions: 1. Show all work. You may receive partial credit for partially completed problems. 2. You may use calculators and a one-sided sheet
More informationACMS 10140 Section 02 Elements of Statistics October 28, 2010. Midterm Examination II
ACMS 10140 Section 02 Elements of Statistics October 28, 2010 Midterm Examination II Name DO NOT remove this answer page. DO turn in the entire exam. Make sure that you have all ten (10) pages of the examination
More informationThe Math. P (x) = 5! = 1 2 3 4 5 = 120.
The Math Suppose there are n experiments, and the probability that someone gets the right answer on any given experiment is p. So in the first example above, n = 5 and p = 0.2. Let X be the number of correct
More informationElementary Number Theory and Methods of Proof. CSE 215, Foundations of Computer Science Stony Brook University http://www.cs.stonybrook.
Elementary Number Theory and Methods of Proof CSE 215, Foundations of Computer Science Stony Brook University http://www.cs.stonybrook.edu/~cse215 1 Number theory Properties: 2 Properties of integers (whole
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special Distributions-VI Today, I am going to introduce
More informationWeek 4: Gambler s ruin and bold play
Week 4: Gambler s ruin and bold play Random walk and Gambler s ruin. Imagine a walker moving along a line. At every unit of time, he makes a step left or right of exactly one of unit. So we can think that
More informationImportant Probability Distributions OPRE 6301
Important Probability Distributions OPRE 6301 Important Distributions... Certain probability distributions occur with such regularity in real-life applications that they have been given their own names.
More informationIntegers are positive and negative whole numbers, that is they are; {... 3, 2, 1,0,1,2,3...}. The dots mean they continue in that pattern.
INTEGERS Integers are positive and negative whole numbers, that is they are; {... 3, 2, 1,0,1,2,3...}. The dots mean they continue in that pattern. Like all number sets, integers were invented to describe
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More informationSolving Linear Equations in One Variable. Worked Examples
Solving Linear Equations in One Variable Worked Examples Solve the equation 30 x 1 22x Solve the equation 30 x 1 22x Our goal is to isolate the x on one side. We ll do that by adding (or subtracting) quantities
More information3.2 Roulette and Markov Chains
238 CHAPTER 3. DISCRETE DYNAMICAL SYSTEMS WITH MANY VARIABLES 3.2 Roulette and Markov Chains In this section we will be discussing an application of systems of recursion equations called Markov Chains.
More informationSTAT 315: HOW TO CHOOSE A DISTRIBUTION FOR A RANDOM VARIABLE
STAT 315: HOW TO CHOOSE A DISTRIBUTION FOR A RANDOM VARIABLE TROY BUTLER 1. Random variables and distributions We are often presented with descriptions of problems involving some level of uncertainty about
More informationMathematical Induction
Mathematical Induction In logic, we often want to prove that every member of an infinite set has some feature. E.g., we would like to show: N 1 : is a number 1 : has the feature Φ ( x)(n 1 x! 1 x) How
More informationCharacteristics of Binomial Distributions
Lesson2 Characteristics of Binomial Distributions In the last lesson, you constructed several binomial distributions, observed their shapes, and estimated their means and standard deviations. In Investigation
More informationIEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem
IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem Time on my hands: Coin tosses. Problem Formulation: Suppose that I have
More informationFinancial Mathematics and Simulation MATH 6740 1 Spring 2011 Homework 2
Financial Mathematics and Simulation MATH 6740 1 Spring 2011 Homework 2 Due Date: Friday, March 11 at 5:00 PM This homework has 170 points plus 20 bonus points available but, as always, homeworks are graded
More informationACMS 10140 Section 02 Elements of Statistics October 28, 2010 Midterm Examination II Answers
ACMS 10140 Section 02 Elements of Statistics October 28, 2010 Midterm Examination II Answers Name DO NOT remove this answer page. DO turn in the entire exam. Make sure that you have all ten (10) pages
More informationMAS108 Probability I
1 QUEEN MARY UNIVERSITY OF LONDON 2:30 pm, Thursday 3 May, 2007 Duration: 2 hours MAS108 Probability I Do not start reading the question paper until you are instructed to by the invigilators. The paper
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More information1 Introduction to Option Pricing
ESTM 60202: Financial Mathematics Alex Himonas 03 Lecture Notes 1 October 7, 2009 1 Introduction to Option Pricing We begin by defining the needed finance terms. Stock is a certificate of ownership of
More informationMTH6120 Further Topics in Mathematical Finance Lesson 2
MTH6120 Further Topics in Mathematical Finance Lesson 2 Contents 1.2.3 Non-constant interest rates....................... 15 1.3 Arbitrage and Black-Scholes Theory....................... 16 1.3.1 Informal
More informationFinancial Mathematics for Actuaries. Chapter 2 Annuities
Financial Mathematics for Actuaries Chapter 2 Annuities Learning Objectives 1. Annuity-immediate and annuity-due 2. Present and future values of annuities 3. Perpetuities and deferred annuities 4. Other
More informationFinal Mathematics 5010, Section 1, Fall 2004 Instructor: D.A. Levin
Final Mathematics 51, Section 1, Fall 24 Instructor: D.A. Levin Name YOU MUST SHOW YOUR WORK TO RECEIVE CREDIT. A CORRECT ANSWER WITHOUT SHOWING YOUR REASONING WILL NOT RECEIVE CREDIT. Problem Points Possible
More informationHow To Find Out How Much Money You Get From A Car Insurance Claim
Chapter 11. Poisson processes. Section 11.4. Superposition and decomposition of a Poisson process. Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ 1/18 Superposition
More information10 Evolutionarily Stable Strategies
10 Evolutionarily Stable Strategies There is but a step between the sublime and the ridiculous. Leo Tolstoy In 1973 the biologist John Maynard Smith and the mathematician G. R. Price wrote an article in
More informationUnified Lecture # 4 Vectors
Fall 2005 Unified Lecture # 4 Vectors These notes were written by J. Peraire as a review of vectors for Dynamics 16.07. They have been adapted for Unified Engineering by R. Radovitzky. References [1] Feynmann,
More informationThursday, October 18, 2001 Page: 1 STAT 305. Solutions
Thursday, October 18, 2001 Page: 1 1. Page 226 numbers 2 3. STAT 305 Solutions S has eight states Notice that the first two letters in state n +1 must match the last two letters in state n because they
More informationLemma 5.2. Let S be a set. (1) Let f and g be two permutations of S. Then the composition of f and g is a permutation of S.
Definition 51 Let S be a set bijection f : S S 5 Permutation groups A permutation of S is simply a Lemma 52 Let S be a set (1) Let f and g be two permutations of S Then the composition of f and g is a
More information13.0 Central Limit Theorem
13.0 Central Limit Theorem Discuss Midterm/Answer Questions Box Models Expected Value and Standard Error Central Limit Theorem 1 13.1 Box Models A Box Model describes a process in terms of making repeated
More informationChapter 3. Distribution Problems. 3.1 The idea of a distribution. 3.1.1 The twenty-fold way
Chapter 3 Distribution Problems 3.1 The idea of a distribution Many of the problems we solved in Chapter 1 may be thought of as problems of distributing objects (such as pieces of fruit or ping-pong balls)
More information1 Error in Euler s Method
1 Error in Euler s Method Experience with Euler s 1 method raises some interesting questions about numerical approximations for the solutions of differential equations. 1. What determines the amount of
More informationminimal polyonomial Example
Minimal Polynomials Definition Let α be an element in GF(p e ). We call the monic polynomial of smallest degree which has coefficients in GF(p) and α as a root, the minimal polyonomial of α. Example: We
More informationALGEBRA. sequence, term, nth term, consecutive, rule, relationship, generate, predict, continue increase, decrease finite, infinite
ALGEBRA Pupils should be taught to: Generate and describe sequences As outcomes, Year 7 pupils should, for example: Use, read and write, spelling correctly: sequence, term, nth term, consecutive, rule,
More informationThe normal approximation to the binomial
The normal approximation to the binomial The binomial probability function is not useful for calculating probabilities when the number of trials n is large, as it involves multiplying a potentially very
More informationMATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.
MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0-534-40596-7. Systems of Linear Equations Definition. An n-dimensional vector is a row or a column
More informationSolutions to Math 51 First Exam January 29, 2015
Solutions to Math 5 First Exam January 29, 25. ( points) (a) Complete the following sentence: A set of vectors {v,..., v k } is defined to be linearly dependent if (2 points) there exist c,... c k R, not
More informationCHAPTER 7 SECTION 5: RANDOM VARIABLES AND DISCRETE PROBABILITY DISTRIBUTIONS
CHAPTER 7 SECTION 5: RANDOM VARIABLES AND DISCRETE PROBABILITY DISTRIBUTIONS TRUE/FALSE 235. The Poisson probability distribution is a continuous probability distribution. F 236. In a Poisson distribution,
More informationMathematics (Project Maths Phase 1)
2012. M128 S Coimisiún na Scrúduithe Stáit State Examinations Commission Leaving Certificate Examination, 2012 Sample Paper Mathematics (Project Maths Phase 1) Paper 2 Ordinary Level Time: 2 hours, 30
More information