UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006


 Reynard Anderson
 2 years ago
 Views:
Transcription
1 Exam format UC Bereley Departmet of Electrical Egieerig ad Computer Sciece EE 6: Probablity ad Radom Processes Solutios 9 Sprig 006 The secod midterm will be held o Wedesday May 7; CHECK the fial exam schedule You are permitted to brig a calculator, ad three sheets of hadwritte otes o 85 paper Questios o the exam ca be based o ay material from Chapters through to the END of chapter 7, as discussed i lectures # through #30, covered i homewors # through #, ad all discussio sectios Review problems Problem 9 Let X ad Y be idepedet radom variables that are uiformly distributed o [0, ] (a) Fid the mea ad variace of X Y (b) Let A be the evet {X Y } Fid the coditioal PDF of X give that A occurred (A fully labeled setch will suffice) Solutio: (a) We have that E[X Y ] = E[X] E[Y ] = = ad (b) We are ased to compute Var[X Y ] = Var[X] + 4Var[Y ] = + 4 = 5 f X X Y (x) = d [ PX X Y (X x X Y ) ] dx [ ] P (X x, X Y ) = d dx P (X Y ) [ = d x x dx = ( x)[0 x ] [0 x ] ]
2 Problem 9 Male ad female patiets arrive at a emergecy room accordig to idepedet Poisso processes, with each process havig a rate of 3 per hour Let M t,t be the umber of male arrivals betwee t ad t Let F t,t be the umber of female arrivals betwee time t ad t (a) Write dow the PMF of M 3,5 + F 4,6 (b) Calculate the variace of M 3,5 + M 4,6 (c) What is the expectatio of the arrival time of the last patiet to arrive before 4 pm? (d) Startig from a particular time, what is the expected time util there is a arrival of at least oe male ad at least oe female patiet? Solutio: (a) Sice M 3,5 ad F 4,6 are idepedet Poisso radom variables with parameter λt = 6, M 3,5 + F 4,6 is Poisso with parameter (b) M 3,5 + M 4,6 = M 3,4 + M 4,5 + M 5,6 = X + Y + Z, where X,Y ad Z are idepedet radom variables with parameters 3 So, Var[M 3,5 +M 4,6 ] = Var[X]+4Var[Y ]+Var[Z] = 3( ) = 8 (c) We are ased to compute the expected time of the first arrival i the merged process goig bacwards i time The merged process has parameter 6, so the expectatio of the arrival time of the last patiet to arrive before 4 pm is 4 pm  6 hours (d) Let X m ad X f be the iterarrival times of male ad female patiets processes X m ad X f are idepedet rvs expoetially distributed with parameter 6 We are ased to compute E[Z] = E[max X m, X f ] = The calculatio is doe i more geerality i Problem 98 (d) Problem 93 Cosider a factory that produces X 0 gadgets o day The X are idepedet idetically distributed radom variables with mea 5, variace 9, E[X 3 ] = 4, ad E[X 4 ] < Furthermore, we are told that P(X = 0) > 0 (a) Fid a approximatio to the probability that the total umber of gadgets produced i 00 days is less tha 440 (b) Fid (approximately) the largest value of such that P(X + +X 00+5) 005 (c) For each defiitio of Z give below, state whether the sequece Z coverges i probability (Aswer yes or o, oly) (a) Z = X + +X (b) Z = X + +X 5 (c) Z = X + +X
3 (d) Z = X X X Solutio: (a) Φ ( ) ( = Φ ) 30 = 007 ( ) ( ) (b) P X ++X 5 3 > = Φ ( ) (c) P(N 0) = P(S 9 000) = P S9 5(9) (9) (a) Yes, to E[X] (SLLN) (b) No (c) Yes, to E[X ] (SLLN) (d) Yes, to 0 ( ) = Φ = Problem 94 Cosider the Marov chai specified by the followig state trasitio diagram Let X be the value of the state at time (a) For all states i = 0,,, 6, fid µ i the expected time to absorptio startig from state i, (ie eterig a recurret state) (b) Fid lim P(X = X 0 = 3) Solutio: (a) By defiitio, µ i = 0 for i = 0,,, 5, 6 I fact, states 0,,,5,6 are recurret Fially, u 3 ad u 4 ca be obtaied by solvig the system of equatios u 3 = + u 4 u 4 = + 0 u 4 from which u 3 = 5 3 ad u 4 = 4 3 (b) Fix 0,, as absorbig states, cosider the absorptio probability a i that 0,, are evetually reached startig from state i We have that lim P(X = X 0 = 3) = π a 3 where π is the steady state distributio of the recurret class 0,, Solvig the system of equatios π = π 0 π = π π 0 + π + π = 3
4 we get π = 7 Ad a 3 ca be obtaied solvig this system of equatios a 3 = a 4 + a 4 = 0 a 3 from which, a 3 = 5 9 Hece, lim P(X = X 0 = 3) = Problem 95 The radom variable X is distributed as a biomial radom variable with parameters > ad 0 < p < The pair of radom variables (Y, Z) taes values o the set {(0, ), (, 0), (0, ), (, 0)} with equal probability if X / Similarly, (Y, Z) taes values o the set with equal probability if X > / (a) Are X ad Y idepedet? (b) Are Y ad Z idepedet? {(, ), (, ), (, ), (, )} (c) Coditioed o X beig eve, are Y ad Z idepedet? (d) Coditioed o Y =, are X ad Z idepedet? (e) Coditioed o Z = 0, are X ad Y idepedet? Solutio: (a) No Suppose eve P (Y = ) = P (Y = X < /)P (X < /)+P (Y = X /)P (X /) = 4 + But P (Y = X = ) = 4 (b) No Suppose eve P (Z = ) = P (Z = X < /)P (X < /)+P (Z = X /)P (X /) = 4 + But P (Z = Y = ) = = 3 8 = 3 8 4
5 (c) No Suppose eve, such that P (X < / X eve) = P (X / X eve) = / The, (d) No P (Y = X eve) = P (Y = X < /, X eve)p (X < / X eve) But P (Y = X eve, Z = ) = + P (Y = X /, X eve)p (X / X eve) = P (Y = X < /)P (X < / X eve) + P (Y = X /)P (X / X eve) = 4 + = 3 8 P (X > / Y = ) = P (Y = X > /)P (X > /) P (Y = ) = 3 However, P (X > / Y =, Z = 0) = 0 (e) No P (Y = Z = 0, X > /) = 0 However, P (Y = Z = 0) > 0 Problem 96 Cosider N + idepedet Poisso arrival processes, such that the i th process has arrival rate λ i = iλ, for i =,,, (N + ) Let N be a biomial radom variable, idepedet of all the Poisso arrival processes; E[N] = µ ad var(n) = v (a) Assume that N represets the umber of successes i idepedet Beroulli trials, each with a probability p of success Fid ad p i terms of µ ad v (b) Fid, i terms of λ, µ ad v, the mea of the umber of total arrivals from the sum of the processes, i a time iterval of legth t Solutio: (a) Sice µ = p amd v = mp( p), we get = µ µ v ad p = µ v µ (b) The total arrivals from the sum of the processes ca be writte ad Z = N+ i= Y i, where Y i is a Poisso distributio with parameter λit From the law of total expectatio, we 5
6 have E[Z] = E[E[Z N]] = P (N = j)e = j=0 j=0 i= [ j+ ] Y i i= j+ P (N = j) E[Y i ] ( j+ = )p j (i p) j λit j j=0 i= ( ) = λt p j j (j + )(j + ) (i p) j j=0 ( ) = λt p j (i p) j j + 3j + j j=0 [ E[N ] = λt + 3E[N] ] + [ p( p + p) = λt + 3p ] + Problem 97 Let X, X, be a iid sequece of ormal radom variables with mea µ ad variace σ i= Further, let Y =P X i for =,, (a) Usig the Chebyshev iequality, give a upper boud for P( Y E[Y ] ɛ) (b) Evaluate P( Y E[Y ] ɛ) exactly i terms of Φ, the CDF of the stadard ormal radom variable (c) Hece compute P( Y E[Y ] ɛ) ad its Chebyshev upper boud for ɛ/σ = 05, ɛ/σ = 0, ad ɛ/σ = 0 (d) For >, fid the liear least squares estimate of Y give Y = y ad its mea squared error Solutio: (a) We have Hece, by the Chebyshev iequality, var(y ) = var ( i= X i) = σ = σ P ( Y E[Y ] ɛ) var(y ) ɛ = σ ɛ 6
7 (b) Sice Y is a liear fuctio of idepedet ormal radom variables, it is ormal Hece ( ) Y E[Y ] P ( Y E[Y ] ɛ) = P ɛ ( ( ɛ )) = Φ var(y ) σ σ (c) ɛ/σ P ( Y E[Y ] ɛ) Chebyshev boud 05 ( Φ(05)) = ( 0695) = ( Φ(0)) = ( 0843) = ( Φ(0)) = ( 0977) = (d) We have Y = Y + i=+ X i Therefore, the least squares estimate of Y give Y = y is give by [ Y + i=+ E[Y Y = y] = E X ] i y + ( )µ Y = y =, which, beig a liear fuctio of y, must be equal to the liear least squares estimate Alteratively, we compute ( ) cov(y, Y ) = cov Y, Y Now, cov ( i=+ + cov X ) ( ) i, Y = cov Y, Y ( ) [( [ ]) ] Y, Y = E Y E Y (Y E[Y ]) = var(y ) Hece the liear least squares estimate of Y give Y = y is give by E[Y ] + cov(y, Y ) (y E[Y ]) = µ + var(y ) (y y + ( )µ µ) = The mea square error of the estimate is ( Y + E i=+ X ) i y + ( )µ Y = y = i=+ var(x i) = ( ) σ Problem 98 The BART is broe, so that oly two ids of vehicles go from Bereley to Sa Fracisco: taxis ad buses The iterarrival time of taxis, i miutes, is a idepedet expoetial radom variable with parameter λ, ie its PDF is f IT (t) = λ e λ t for t 0, while the iterarrival time of buses, i miutes, is a idepedet expoetial radom variable with parameter λ, ie, its PDF is f IB (t) = λ e λ t for t 0 Suppose Joe ad Harry arrive at Bereley at 7:00 am 7
8 (a) What is the average time before they see the first vehicle? (b) What is the probability that the first vehicle they see is a bus, ad what is the probability that the first vehicle they see is a taxi? I a taxi, the travel time to Sa Fracisco, i miutes, is a idepedet expoetial radom variable with parameter µ, ie, its PDF is f DT (t) = µ e µ t for t 0 O the other had, i a bus, the travel time to Sa Fracisco, i miutes, is a a idepedet expoetial radom variable with parameter µ, ie, its PDF is f DB (t) = µ e µ t for t 0 (c) Suppose Joe ad Harry arrive at dowtow Bereley at 7:00 am, tae the first vehicle that passes, ad arrive i Sa Fracisco X miutes later Fid the trasform of X (d) Suppose that a taxi ad a bus arrive simultaeously, ad Joe taes the taxi while Harry taes the bus Let Y be the umber of miutes from their departure from Bereley till they meet agai i Sa Fracisco Fid Exs[Y ] There are, i fact, two differet ids of buses: fast buses ad slow buses For ay bus that arrives at Bereley dowtow, it is a fast bus with probability p, ad it is a slow bus with probability p Whether a bus is fast or slow is idepedet of everythig else (e) If they stay at Bereley for l miutes, how may fast buses will they see o average? (f) If they stay idefiitely, what is the probability that they will see fast buses before they see slow buses? Solutio: (a) Vehicles arrive accordig to a Poisso process with rate λ + λ Owig to the memorylessess of the Poisso process, the time util the first vehicle after 7:00 am is distributed as a expoetial radom variable with parameter λ + λ Therefore, the average time before they see the first vehicle is /(λ + λ ) (b) By the properties of merged Poisso processes, we have P (first vehicle is a taxi) = λ λ + λ, ad P (first vehicle is a bus) = λ λ + λ (c) We have X = W + D, where W is the time util the arrival of the first vehicle, ad D is the travel time Now, M W (s) = λ + λ λ + λ s, 8
9 sice, as established i part (a), W is a expoetial radom variable with parameter λ + λ As for D, we have M D (s) = E [ e sd] Therefore, = E [ e sd ] λ first vehicle is a taxi + E [ e sd ] λ first vehicle is a bus λ + λ λ + λ λ λ = M DT (s) + M DB (s) = µ + µ λ + λ λ + λ µ s λ + λ µ s λ + λ M X (s) = M W (s)m D (s) = λ + λ λ + λ s ( µ λ λ λ + µ ) λ µ s λ + λ µ s λ + λ (d) We have Y = max(d T, D B ) We write Y = Y + Y, where Y = mi(d T, D B ) deotes the time till the arrival of the first vehicle, ad Y = Y Y deotes the time from the arrival of the first vehicle till the arrival of the secod vehicle First, we have The So E[Y ] = µ + µ E[Y ] = E[Y D T < D B ]P (D T < D B ) + E[Y D T D B ]P (D T D B ) = µ µ µ + µ + µ µ µ + µ E[Y ] = µ + µ ( + µ + µ ) µ µ (e) Fast buses arrive accordig to a Poisso process with rate pλ umber of fast buses they will see is lpλ Hece the average (f) The probability that exactly i slow buses arrive before the arrival of the th fast bus is the probability that the fast bus is the ( + i)th bus, which, usig the Pascal PMF, is give by ( ) + i p ( p) i The probability that they see fast buses before they see slow buses is the probability that strictly less tha slow buses arrive before the arrival of the th fast bus, which is therefore give by ( ) + i p ( p) i i=0 Alteratively, the probability of seeig fast buses before slow buses is equivalet to the probability of seeig or more fast buses i the first buses, which is give by i= ( i ) p i ( p) i 9
10 Problem 99 A hugry mouse is trapped i a cage with three doors At each tur, the mouse gets to ope oe of the three doors ad eat a piece of cheese behid the door if oe is preset Each door is chose w ith equal probability o each tur, regardless of whether a piece of cheese was foud o the previous tur If o cheese was foud o the previous tur, there is a probability of 3/4 that cheese will be foud behid each door o the curret tur If cheese was foud o the previous tur ad the same door is chose o the curret tur, the there is a probability of 0 that cheese will be foud; whilst if cheese was foud o the previous tur ad a differet door is chose o the curret tur, the there is a probability of that cheese will be foud (a) If you observe the mouse s behavior over 000 turs, i approximately what fractio of turs do you expect the mouse to eat a piece of cheese? (b) Suppose o cheese was foud o the previous tur What is the expected umber of turs before the mouse eats a piece of cheese? (c) Suppose o cheese was foud o the previous tur What is the expected umber of turs before the mouse eats pieces of cheese? (d) Suppose cheese was foud o the previous tur Usig the Cetral Limit Theorem, approximate the probability that the umber of turs before the mouse eats 00 pieces of cheese exceeds 5 (e) You loo ito the cage ad observe the mouse eatig a piece of cheese from behid door umber What is the probability that, if you observe the mouse three turs later, it will agai be eatig a piece of cheese from behid door umber? Solutio: (a) We model the problem with the followig twostate Marov chai, where C represets the state where cheese is foud, ad N represets the state where o cheese is foud /3 /3 C N /4 3/4 Therefore, the steadystate probabilities satisfy ad 3 π C = 3 4 π N π C + π N =, whece we coclude that π N = 4/3 ad π C = 9/3 Thus, over 000 turs, we expect that the mouse eats a piece of cheese i approximately 9/3 of them 0
11 (b) We wish to ow the mea first passage time t N to reach state C from state N We have t N = + 4 t N, which implies that t N = 4/3 (c) We wish to ow the mea first passage time to reach state C from state N followed by ( ) recurrece times of state C The mea recurrece time t C of state C is give by t C = + 3 t N = = 3 9 Hece the expected umber of turs util the mouse eats pieces of cheese is 4/3 + ( )3/9 (d) Let Y 00 be the umber of turs before the mouse eats 00 pieces of cheese The, Y 00 = 00 i= R i, where R i deotes the umber of turs from eatig the (i )th piece of cheese till eatig the ith piece of cheese The radom variable R i is equal to with probability /3 (trasitio from C to C) ad equal to + S with probability /3 (trasitio from C to T ), where S is a geometric radom variable with parameter 3/4 We have already established that E[R i ] = 3/9 Therefore, E[Ri ] = 3 + E[( + S) ] 3 = ( + E[S] + E[S ]) = ( + E[S] + var(s) + (E[S]) ) = 3 + ( /4 (3/4) + 6 ) 9 = 7 7 Hece var(r i ) = 7 7 ( ) 3 = Sice it is clear that R, R,, R 00 is a iid sequece, it follows by the Cetral Limit Theorem that ( ) ( ) Y 00 E[Y 00 ] /9 P (Y 00 > 5) = P > var(y00 ) 0 44/8 Y 00 E[Y 00 ] 89 = P > var(y00 ) 75 Φ(03) = = 055 (e) We ow model the problem with a fourstate Marov chai The states are C, C, C3, ad N, where C, C, ad C3 represet the states where cheese is foud behid the first, secod, ad third doors, respectively, ad N represets the state where o cheese is foud The trasitio probabilities are { /3 if j i, p CiCj = for all i, j =,, 3, 0 otherwise, p CiN = /3, for all i =,, 3, p NCi = /4, for all i =,, 3,
12 ad p NN = /4 There are seve threetrasitio paths from state C to state C, which are (i) C C C3 C, (ii) C C N C, (iii) C C3 C C, (iv) C C3 N C, (v) C N C C, (vi) C N C3 C, ad (vii) C N N C Paths (i) ad (iii) occur with probability /7, paths (ii), (iv), (v), ad (vi) occur with probability /36, ad path (vii) occurs with probability /48 Therefore, the probability of goig from state C to state C i three trasitios is = 89 43
Overview of some probability distributions.
Lecture Overview of some probability distributios. I this lecture we will review several commo distributios that will be used ofte throughtout the class. Each distributio is usually described by its probability
More informationChapter 6: Variance, the law of large numbers and the MonteCarlo method
Chapter 6: Variace, the law of large umbers ad the MoteCarlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value
More informationProperties of MLE: consistency, asymptotic normality. Fisher information.
Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout
More informationUniversity of California, Los Angeles Department of Statistics. Distributions related to the normal distribution
Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Istructor: Nicolas Christou Three importat distributios: Distributios related to the ormal distributio Chisquare (χ ) distributio.
More informationJoint Probability Distributions and Random Samples
STAT5 Sprig 204 Lecture Notes Chapter 5 February, 204 Joit Probability Distributios ad Radom Samples 5. Joitly Distributed Radom Variables Chapter Overview Joitly distributed rv Joit mass fuctio, margial
More informationI. Chisquared Distributions
1 M 358K Supplemet to Chapter 23: CHISQUARED DISTRIBUTIONS, TDISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad tdistributios, we first eed to look at aother family of distributios, the chisquared distributios.
More informationChapter 5 Discrete Probability Distributions
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide Chapter 5 Discrete Probability Distributios Radom Variables Discrete Probability Distributios Epected Value ad Variace Poisso Distributio
More informationAsymptotic Growth of Functions
CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll
More informationChapter 7  Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas:
Chapter 7  Samplig Distributios 1 Itroductio What is statistics? It cosist of three major areas: Data Collectio: samplig plas ad experimetal desigs Descriptive Statistics: umerical ad graphical summaries
More information0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5
Sectio 13 KolmogorovSmirov test. Suppose that we have a i.i.d. sample X 1,..., X with some ukow distributio P ad we would like to test the hypothesis that P is equal to a particular distributio P 0, i.e.
More informationMIDTERM EXAM  MATH 563, SPRING 2016
MIDTERM EXAM  MATH 563, SPRING 2016 NAME: SOLUTION Exam rules: There are 5 problems o this exam. You must show all work to receive credit, state ay theorems ad defiitios clearly. The istructor will NOT
More informationCase Study. Normal and t Distributions. Density Plot. Normal Distributions
Case Study Normal ad t Distributios Bret Halo ad Bret Larget Departmet of Statistics Uiversity of Wiscosi Madiso October 11 13, 2011 Case Study Body temperature varies withi idividuals over time (it ca
More informationChapter 7 Methods of Finding Estimators
Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Chapter 7 Methods of Fidig Estimators Sectio 7.1 Itroductio Defiitio 7.1.1 A poit estimator is ay fuctio W( X) W( X1, X,, X ) of
More informationKey Ideas Section 81: Overview hypothesis testing Hypothesis Hypothesis Test Section 82: Basics of Hypothesis Testing Null Hypothesis
Chapter 8 Key Ideas Hypothesis (Null ad Alterative), Hypothesis Test, Test Statistic, Pvalue Type I Error, Type II Error, Sigificace Level, Power Sectio 81: Overview Cofidece Itervals (Chapter 7) are
More informationDiscreteTime Markov Chains
Markov Chais DiscreteTime Markov Chais A discretetime Markov chai is a discretetime, discretevalue radom sequece such that the ext radom variable X +1 depeds oly o X X through the trasitio probability
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Chapter 3 3.1
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More information8 The Poisson Distribution
8 The Poisso Distributio Let X biomial, p ). Recall that this meas that X has pmf ) p,p k) p k k p ) k for k 0,,...,. ) Agai, thik of X as the umber of successes i a series of idepedet experimets, each
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio 05/0/07 Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should
More information3. Continuous Random Variables
Statistics ad probability: 31 3. Cotiuous Radom Variables A cotiuous radom variable is a radom variable which ca take values measured o a cotiuous scale e.g. weights, stregths, times or legths. For ay
More informationSoving Recurrence Relations
Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree
More informationTHE ABRACADABRA PROBLEM
THE ABRACADABRA PROBLEM FRANCESCO CARAVENNA Abstract. We preset a detailed solutio of Exercise E0.6 i [Wil9]: i a radom sequece of letters, draw idepedetly ad uiformly from the Eglish alphabet, the expected
More informationMath C067 Sampling Distributions
Math C067 Samplig Distributios Sample Mea ad Sample Proportio Richard Beigel Some time betwee April 16, 2007 ad April 16, 2007 Examples of Samplig A pollster may try to estimate the proportio of voters
More information3. Covariance and Correlation
Virtual Laboratories > 3. Expected Value > 1 2 3 4 5 6 3. Covariace ad Correlatio Recall that by takig the expected value of various trasformatios of a radom variable, we ca measure may iterestig characteristics
More informationNPTEL STRUCTURAL RELIABILITY
NPTEL Course O STRUCTURAL RELIABILITY Module # 0 Lecture 1 Course Format: Web Istructor: Dr. Aruasis Chakraborty Departmet of Civil Egieerig Idia Istitute of Techology Guwahati 1. Lecture 01: Basic Statistics
More informationContinued Fractions continued. 3. Best rational approximations
Cotiued Fractios cotiued 3. Best ratioal approximatios We hear so much about π beig approximated by 22/7 because o other ratioal umber with deomiator < 7 is closer to π. Evetually 22/7 is defeated by 333/06
More informationA probabilistic proof of a binomial identity
A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two
More informationAn example of nonquenched convergence in the conditional central limit theorem for partial sums of a linear process
A example of oqueched covergece i the coditioal cetral limit theorem for partial sums of a liear process Dalibor Volý ad Michael Woodroofe Abstract A causal liear processes X,X 0,X is costructed for which
More informationLecture 4: Cauchy sequences, BolzanoWeierstrass, and the Squeeze theorem
Lecture 4: Cauchy sequeces, BolzaoWeierstrass, ad the Squeeze theorem The purpose of this lecture is more modest tha the previous oes. It is to state certai coditios uder which we are guarateed that limits
More informationA Recursive Formula for Moments of a Binomial Distribution
A Recursive Formula for Momets of a Biomial Distributio Árpád Béyi beyi@mathumassedu, Uiversity of Massachusetts, Amherst, MA 01003 ad Saverio M Maago smmaago@psavymil Naval Postgraduate School, Moterey,
More information7 b) 0. Guided Notes for lesson P.2 Properties of Exponents. If a, b, x, y and a, b, 0, and m, n Z then the following properties hold: 1 n b
Guided Notes for lesso P. Properties of Expoets If a, b, x, y ad a, b, 0, ad m, Z the the followig properties hold:. Negative Expoet Rule: b ad b b b Aswers must ever cotai egative expoets. Examples: 5
More informationThe Stable Marriage Problem
The Stable Marriage Problem William Hut Lae Departmet of Computer Sciece ad Electrical Egieerig, West Virgiia Uiversity, Morgatow, WV William.Hut@mail.wvu.edu 1 Itroductio Imagie you are a matchmaker,
More informationSection IV.5: Recurrence Relations from Algorithms
Sectio IV.5: Recurrece Relatios from Algorithms Give a recursive algorithm with iput size, we wish to fid a Θ (best big O) estimate for its ru time T() either by obtaiig a explicit formula for T() or by
More informationSequences II. Chapter 3. 3.1 Convergent Sequences
Chapter 3 Sequeces II 3. Coverget Sequeces Plot a graph of the sequece a ) = 2, 3 2, 4 3, 5 + 4,...,,... To what limit do you thik this sequece teds? What ca you say about the sequece a )? For ǫ = 0.,
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationDerivation of the Poisson distribution
Gle Cowa RHUL Physics 1 December, 29 Derivatio of the Poisso distributio I this ote we derive the fuctioal form of the Poisso distributio ad ivestigate some of its properties. Cosider a time t i which
More informationThe second difference is the sequence of differences of the first difference sequence, 2
Differece Equatios I differetial equatios, you look for a fuctio that satisfies ad equatio ivolvig derivatives. I differece equatios, istead of a fuctio of a cotiuous variable (such as time), we look for
More informationEntropy Rates of a Stochastic Process
Etropy Rates of a Stochastic Process Best Achievable Data Compressio Radu Trîmbiţaş October 2012 1 Etropy Rates of a Stochastic Process Etropy rates The AEP states that H(X) bits suffice o the average
More informationReview of Markov Chain Theory
Queuig Aalysis: Review of Markov Chai Theory Hogwei Zhag http://www.cs.waye.edu/~hzhag Ackowledgemet: this lecture is partially based o the slides of Dr. Yais A. Korilis. Outlie Markov Chai DiscreteTime
More informationModule 4: Mathematical Induction
Module 4: Mathematical Iductio Theme 1: Priciple of Mathematical Iductio Mathematical iductio is used to prove statemets about atural umbers. As studets may remember, we ca write such a statemet as a predicate
More informationCHAPTER 7: Central Limit Theorem: CLT for Averages (Means)
CHAPTER 7: Cetral Limit Theorem: CLT for Averages (Meas) X = the umber obtaied whe rollig oe six sided die oce. If we roll a six sided die oce, the mea of the probability distributio is X P(X = x) Simulatio:
More informationEngineering 323 Beautiful Homework Set 3 1 of 7 Kuszmar Problem 2.51
Egieerig 33 eautiful Homewor et 3 of 7 Kuszmar roblem.5.5 large departmet store sells sport shirts i three sizes small, medium, ad large, three patters plaid, prit, ad stripe, ad two sleeve legths log
More informationLecture 5: Span, linear independence, bases, and dimension
Lecture 5: Spa, liear idepedece, bases, ad dimesio Travis Schedler Thurs, Sep 23, 2010 (versio: 9/21 9:55 PM) 1 Motivatio Motivatio To uderstad what it meas that R has dimesio oe, R 2 dimesio 2, etc.;
More informationFIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix
FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. Powers of a matrix We begi with a propositio which illustrates the usefuless of the diagoalizatio. Recall that a square matrix A is diogaalizable if
More informationSequences and Series
CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their
More informationDefinition. A variable X that takes on values X 1, X 2, X 3,...X k with respective frequencies f 1, f 2, f 3,...f k has mean
1 Social Studies 201 October 13, 2004 Note: The examples i these otes may be differet tha used i class. However, the examples are similar ad the methods used are idetical to what was preseted i class.
More informationIn nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008
I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces
More informationCOMP 251 Assignment 2 Solutions
COMP 251 Assigmet 2 Solutios Questio 1 Exercise 8.34 Treat the umbers as 2digit umbers i radix. Each digit rages from 0 to 1. Sort these 2digit umbers ith the RADIXSORT algorithm preseted i Sectio
More informationHypergeometric Distributions
7.4 Hypergeometric Distributios Whe choosig the startig lieup for a game, a coach obviously has to choose a differet player for each positio. Similarly, whe a uio elects delegates for a covetio or you
More informationORDERS OF GROWTH KEITH CONRAD
ORDERS OF GROWTH KEITH CONRAD Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really wat to uderstad their behavior It also helps you better grasp topics i calculus
More informationSection 11.3: The Integral Test
Sectio.3: The Itegral Test Most of the series we have looked at have either diverged or have coverged ad we have bee able to fid what they coverge to. I geeral however, the problem is much more difficult
More informationSAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx
SAMPLE QUESTIONS FOR FINAL EXAM REAL ANALYSIS I FALL 006 3 4 Fid the followig usig the defiitio of the Riema itegral: a 0 x + dx 3 Cosider the partitio P x 0 3, x 3 +, x 3 +,......, x 3 3 + 3 of the iterval
More informationLinear Algebra II. Notes 6 25th November 2010
MTH6140 Liear Algebra II Notes 6 25th November 2010 6 Quadratic forms A lot of applicatios of mathematics ivolve dealig with quadratic forms: you meet them i statistics (aalysis of variace) ad mechaics
More informationNATIONAL SENIOR CERTIFICATE GRADE 12
NATIONAL SENIOR CERTIFICATE GRADE MATHEMATICS P EXEMPLAR 04 MARKS: 50 TIME: 3 hours This questio paper cosists of 8 pages ad iformatio sheet. Please tur over Mathematics/P DBE/04 NSC Grade Eemplar INSTRUCTIONS
More informationMaximum Likelihood Estimators.
Lecture 2 Maximum Likelihood Estimators. Matlab example. As a motivatio, let us look at oe Matlab example. Let us geerate a radom sample of size 00 from beta distributio Beta(5, 2). We will lear the defiitio
More information1 Computing the Standard Deviation of Sample Means
Computig the Stadard Deviatio of Sample Meas Quality cotrol charts are based o sample meas ot o idividual values withi a sample. A sample is a group of items, which are cosidered all together for our aalysis.
More informationHypothesis testing. Null and alternative hypotheses
Hypothesis testig Aother importat use of samplig distributios is to test hypotheses about populatio parameters, e.g. mea, proportio, regressio coefficiets, etc. For example, it is possible to stipulate
More informationWeek 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable
Week 3 Coditioal probabilities, Bayes formula, WEEK 3 page 1 Expected value of a radom variable We recall our discussio of 5 card poker hads. Example 13 : a) What is the probability of evet A that a 5
More informationMA2108S Tutorial 5 Solution
MA08S Tutorial 5 Solutio Prepared by: LuJigyi LuoYusheg March 0 Sectio 3. Questio 7. Let x := / l( + ) for N. (a). Use the difiitio of limit to show that lim(x ) = 0. Proof. Give ay ɛ > 0, sice ɛ > 0,
More information, a Wishart distribution with n 1 degrees of freedom and scale matrix.
UMEÅ UNIVERSITET Matematiskstatistiska istitutioe Multivariat dataaalys D MSTD79 PA TENTAMEN 00409 LÖSNINGSFÖRSLAG TILL TENTAMEN I MATEMATISK STATISTIK Multivariat dataaalys D, 5 poäg.. Assume that
More information1 The Binomial Theorem: Another Approach
The Biomial Theorem: Aother Approach Pascal s Triagle I class (ad i our text we saw that, for iteger, the biomial theorem ca be stated (a + b = c a + c a b + c a b + + c ab + c b, where the coefficiets
More informationM06/5/MATME/SP2/ENG/TZ2/XX MATHEMATICS STANDARD LEVEL PAPER 2. Thursday 4 May 2006 (morning) 1 hour 30 minutes INSTRUCTIONS TO CANDIDATES
IB MATHEMATICS STANDARD LEVEL PAPER 2 DIPLOMA PROGRAMME PROGRAMME DU DIPLÔME DU BI PROGRAMA DEL DIPLOMA DEL BI 22067304 Thursday 4 May 2006 (morig) 1 hour 30 miutes INSTRUCTIONS TO CANDIDATES Do ot ope
More informationChapter Suppose you wish to use the Principle of Mathematical Induction to prove that 1 1! + 2 2! + 3 3! n n! = (n + 1)! 1 for all n 1.
Chapter 4. Suppose you wish to prove that the followig is true for all positive itegers by usig the Priciple of Mathematical Iductio: + 3 + 5 +... + ( ) =. (a) Write P() (b) Write P(7) (c) Write P(73)
More informationCS103X: Discrete Structures Homework 4 Solutions
CS103X: Discrete Structures Homewor 4 Solutios Due February 22, 2008 Exercise 1 10 poits. Silico Valley questios: a How may possible sixfigure salaries i whole dollar amouts are there that cotai at least
More informationFourier Series and the Wave Equation Part 2
Fourier Series ad the Wave Equatio Part There are two big ideas i our work this week. The first is the use of liearity to break complicated problems ito simple pieces. The secod is the use of the symmetries
More informationInfinite Sequences and Series
CHAPTER 4 Ifiite Sequeces ad Series 4.1. Sequeces A sequece is a ifiite ordered list of umbers, for example the sequece of odd positive itegers: 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29...
More informationDistributions of Order Statistics
Chapter 2 Distributios of Order Statistics We give some importat formulae for distributios of order statistics. For example, where F k: (x)=p{x k, x} = I F(x) (k, k + 1), I x (a,b)= 1 x t a 1 (1 t) b 1
More informationMATH 361 Homework 9. Royden Royden Royden
MATH 61 Homework 9 Royde..9 First, we show that for ay subset E of the real umbers, E c + y = E + y) c traslatig the complemet is equivalet to the complemet of the traslated set). Without loss of geerality,
More information7. Sample Covariance and Correlation
1 of 8 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 7. Sample Covariace ad Correlatio The Bivariate Model Suppose agai that we have a basic radom experimet, ad that X ad Y
More informationNormal Distribution.
Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued
More informationSimulation and Monte Carlo integration
Chapter 3 Simulatio ad Mote Carlo itegratio I this chapter we itroduce the cocept of geeratig observatios from a specified distributio or sample, which is ofte called Mote Carlo geeratio. The ame of Mote
More informationIncremental calculation of weighted mean and variance
Icremetal calculatio of weighted mea ad variace Toy Fich faf@cam.ac.uk dot@dotat.at Uiversity of Cambridge Computig Service February 009 Abstract I these otes I eplai how to derive formulae for umerically
More informationif A S, then X \ A S, and if (A n ) n is a sequence of sets in S, then n A n S,
Lecture 5: Borel Sets Topologically, the Borel sets i a topological space are the σalgebra geerated by the ope sets. Oe ca build up the Borel sets from the ope sets by iteratig the operatios of complemetatio
More informationMeasures of Central Tendency
Measures of Cetral Tedecy A studet s grade will be determied by exam grades ( each exam couts twice ad there are three exams, HW average (couts oce, fial exam ( couts three times. Fid the average if the
More informationMeasures of Spread and Boxplots Discrete Math, Section 9.4
Measures of Spread ad Boxplots Discrete Math, Sectio 9.4 We start with a example: Example 1: Comparig Mea ad Media Compute the mea ad media of each data set: S 1 = {4, 6, 8, 10, 1, 14, 16} S = {4, 7, 9,
More information1 Notes on Little s Law (l = λw)
Copyright c 29 by Karl Sigma Notes o Little s Law (l λw) We cosider here a famous ad very useful law i queueig theory called Little s Law, also kow as l λw, which asserts that the time average umber of
More informationConfidence Intervals for the Mean of Nonnormal Data Class 23, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Cofidece Itervals for the Mea of Noormal Data Class 23, 8.05, Sprig 204 Jeremy Orloff ad Joatha Bloom Learig Goals. Be able to derive the formula for coservative ormal cofidece itervals for the proportio
More informationCS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations
CS3A Hadout 3 Witer 00 February, 00 Solvig Recurrece Relatios Itroductio A wide variety of recurrece problems occur i models. Some of these recurrece relatios ca be solved usig iteratio or some other ad
More informationChapter 4 Multivariate distributions
Chapter 4 Multivariate distributios k Multivariate Distributios All the results derived for the bivariate case ca be geeralized to RV. The joit CDF of,,, k will have the form: P(x, x,, x k ) whe the RVs
More informationThe following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles
The followig eample will help us uderstad The Samplig Distributio of the Mea Review: The populatio is the etire collectio of all idividuals or objects of iterest The sample is the portio of the populatio
More informationTopics in Probability Theory and Stochastic Processes Steven R. Dunbar. The Weak Law of Large Numbers
Steve R. Dubar Departmet o Mathematics 203 Avery Hall Uiversity o NebrasaLicol Licol, NE 685880130 http://www.math.ul.edu Voice: 4024723731 Fax: 4024728466 Topics i Probability Theory ad Stochastic
More informationPROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUSMALUS SYSTEM
PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY Physical ad Mathematical Scieces 2015, 1, p. 15 19 M a t h e m a t i c s AN ALTERNATIVE MODEL FOR BONUSMALUS SYSTEM A. G. GULYAN Chair of Actuarial Mathematics
More informationwhen n = 1, 2, 3, 4, 5, 6, This list represents the amount of dollars you have after n days. Note: The use of is read as and so on.
Geometric eries Before we defie what is meat by a series, we eed to itroduce a related topic, that of sequeces. Formally, a sequece is a fuctio that computes a ordered list. uppose that o day 1, you have
More informationReview for College Algebra Final Exam
Review for College Algebra Fial Exam (Please remember that half of the fial exam will cover chapters 14. This review sheet covers oly the ew material, from chapters 5 ad 7.) 5.1 Systems of equatios i
More informationChapter 5: Inner Product Spaces
Chapter 5: Ier Product Spaces Chapter 5: Ier Product Spaces SECION A Itroductio to Ier Product Spaces By the ed of this sectio you will be able to uderstad what is meat by a ier product space give examples
More informationSampling Distribution And Central Limit Theorem
() Samplig Distributio & Cetral Limit Samplig Distributio Ad Cetral Limit Samplig distributio of the sample mea If we sample a umber of samples (say k samples where k is very large umber) each of size,
More informationThe shaded region above represents the region in which z lies.
GCE A Level H Maths Solutio Paper SECTION A (PURE MATHEMATICS) (i) Im 3 Note: Uless required i the questio, it would be sufficiet to just idicate the cetre ad radius of the circle i such a locus drawig.
More informationMethods of Evaluating Estimators
Math 541: Statistical Theory II Istructor: Sogfeg Zheg Methods of Evaluatig Estimators Let X 1, X 2,, X be i.i.d. radom variables, i.e., a radom sample from f(x θ), where θ is ukow. A estimator of θ is
More informationA Simplified Binet Formula for kgeneralized Fibonacci Numbers
A Simplified Biet Formula for kgeeralized Fiboacci Numbers Gregory P. B. Dresde Departmet of Mathematics Washigto ad Lee Uiversity Lexigto, VA 440 dresdeg@wlu.edu Abstract I this paper, we preset a particularly
More information1. MATHEMATICAL INDUCTION
1. MATHEMATICAL INDUCTION EXAMPLE 1: Prove that for ay iteger 1. Proof: 1 + 2 + 3 +... + ( + 1 2 (1.1 STEP 1: For 1 (1.1 is true, sice 1 1(1 + 1. 2 STEP 2: Suppose (1.1 is true for some k 1, that is 1
More informationSolutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork
Solutios to Selected Problems I: Patter Classificatio by Duda, Hart, Stork Joh L. Weatherwax February 4, 008 Problem Solutios Chapter Bayesia Decisio Theory Problem radomized rules Part a: Let Rx be the
More informationConvexity, Inequalities, and Norms
Covexity, Iequalities, ad Norms Covex Fuctios You are probably familiar with the otio of cocavity of fuctios. Give a twicedifferetiable fuctio ϕ: R R, We say that ϕ is covex (or cocave up) if ϕ (x) 0 for
More informationAQA STATISTICS 1 REVISION NOTES
AQA STATISTICS 1 REVISION NOTES AVERAGES AND MEASURES OF SPREAD www.mathsbox.org.uk Mode : the most commo or most popular data value the oly average that ca be used for qualitative data ot suitable if
More informationsum of all values n x = the number of values = i=1 x = n n. When finding the mean of a frequency distribution the mean is given by
Statistics Module Revisio Sheet The S exam is hour 30 miutes log ad is i two sectios Sectio A 3 marks 5 questios worth o more tha 8 marks each Sectio B 3 marks questios worth about 8 marks each You are
More informationRiemann Sums y = f (x)
Riema Sums Recall that we have previously discussed the area problem I its simplest form we ca state it this way: The Area Problem Let f be a cotiuous, oegative fuctio o the closed iterval [a, b] Fid
More informationGregory Carey, 1998 Linear Transformations & Composites  1. Linear Transformations and Linear Composites
Gregory Carey, 1998 Liear Trasformatios & Composites  1 Liear Trasformatios ad Liear Composites I Liear Trasformatios of Variables Meas ad Stadard Deviatios of Liear Trasformatios A liear trasformatio
More informationChapter Gaussian Elimination
Chapter 04.06 Gaussia Elimiatio After readig this chapter, you should be able to:. solve a set of simultaeous liear equatios usig Naïve Gauss elimiatio,. lear the pitfalls of the Naïve Gauss elimiatio
More information23 The Remainder and Factor Theorems
 The Remaider ad Factor Theorems Factor each polyomial completely usig the give factor ad log divisio 1 x + x x 60; x + So, x + x x 60 = (x + )(x x 15) Factorig the quadratic expressio yields x + x x
More informationEstimating the Mean and Variance of a Normal Distribution
Estimatig the Mea ad Variace of a Normal Distributio Learig Objectives After completig this module, the studet will be able to eplai the value of repeatig eperimets eplai the role of the law of large umbers
More informationMath Discrete Math Combinatorics MULTIPLICATION PRINCIPLE:
Math 355  Discrete Math 4.14.4 Combiatorics Notes MULTIPLICATION PRINCIPLE: If there m ways to do somethig ad ways to do aother thig the there are m ways to do both. I the laguage of set theory: Let
More information