Normal distribution Approximating binomial distribution by normal 2.10 Central Limit Theorem


 Naomi McDonald
 2 years ago
 Views:
Transcription
1 1.1.2 Normal distribution Approimating binomial distribution by normal 2.1 Central Limit Theorem Prof. Tesler Math 283 October 22, 214 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
2 Normal distribution a.k.a. Bell curve and Gaussian distribution The normal distribution is a continuous distribution. Parameters: µ = mean (center) σ = standard deviation (width) ( ) PDF: f X () = 1 σ ep ( µ)2 for < <. 2π 2σ 2 Normal distribution N(2, 5): µ = 2, σ = Normal µ µ ± σ The normal distribution is symmetric about = µ, so median = mean = µ. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
3 Applications of normal distribution Applications Many natural quantities are modelled by it: e.g., a histogram of the heights or weights of everyone in a large population often follows a normal distribution. Many distributions such as binomial, Poisson,... are closely approimated by it when the parameters are large enough. Sums and averages of huge quantities of data are often modelled by it. Coverage in DNA sequencing Illumina GA II sequencing of E. coli at 6 coverage. Chitsaz et al. (211), Nature Biotechnology % of positions with coverage Empirical distribution of coverage Coverage Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
4 Cumulative distribution function It turns out that the integral for total probability does equal 1: ) 1 ( σ 2π ep ( µ)2 2σ 2 d = 1 However, it s a tricky integral; see a Calculus tetbook in the section on double integrals in polar coordinates. The cumulative distribution function is the integral F X () = P(X ) = ) 1 ( σ 2π ep (t µ)2 2σ 2 dt This integral cannot be done symbollically in terms of the usual functions (polynomials, eponentials, logs, trig functions, etc.). It can be done via numerical integration or Taylor series. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
5 Standard normal distribution Standard normal distribution N(, 1): µ =, σ = 1 CDF of standard normal distribution..2.4 Normal µ µ ± σ cdf..4.8 Normal µ µ ± σ z The standard normal distribution is the normal distribution for µ =, σ = 1. Use the variable name Z: PDF: φ(z) = f Z (z) = e z2 /2 2π for < z < CDF: Φ(z) = F Z (z) = P(Z z) = 1 z e t2 /2 dt 2π The integral can t be done in terms of ordinary functions, but it can be done using numerical methods. In the past, people used lookup tables. We ll use functions for it in Matlab and R. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36 z
6 Matlab and R commands For the standard normal: Φ(1.96).975 Φ 1 (.975) 1.96 Matlab: normcdf(1.96) norminv(.975) R: pnorm(1.96) qnorm(.975) We will see shortly how to convert between an arbitrary normal distribution (any µ, σ) and the standard normal distribution. The commands above allow additional arguments to specify µ and σ, e.g., normcdf(1.96,,1). R also can work with the right tail directly: pnorm(1.96, lower.tail = FALSE).975 qnorm(.975, lower.tail = FALSE) 1.96 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
7 Standard normal distribution areas.4 Standard Normal Curve.3.2.1!5 a b 5 z The area between z = a and z = b is P(a Z b) = 1 2π b a e t2 /2 dt = Φ(b) Φ(a) P(1.51 Z 1.62) = Φ(1.62) Φ(1.51) = =.129 Matlab: normcdf(1.62) normcdf(1.51) R: pnorm(1.62) pnorm(1.51) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
8 Standard normal distribution symmetries of areas.4 Area! on the right "#$ &'()*!*+,*.(*/( "#! z!!2 2 z "!%!!! " %! Area right of z is P(Z > z) = 1 Φ(z). By symmetry, the area left of z and the area right of z are equal: Φ( z) = 1 Φ(z) Φ( 1.51) = 1 Φ(1.51) = =.655 Area between z = ±1.51 is Φ(1.51) Φ( 1.51) = 2Φ(1.51) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
9 Central area Area between z = ±1 is 68.27%. Area between z = ±2 is 95.45%. Area between z = ±3 is 99.73%..4.2 Area! split half on each tail!z!/2 z!/2!2 z 2 Find the center part containing 95% of the area Put 2.5% of the area at the upper tail, 2.5% at the lower tail, and 95% in the middle. The value of z putting 2.5% at the top gives Φ(z) = 1.25 =.975. Notation: z.25 = The area between z = ±1.96 is about 95%. For 99% in the middle,.5% on each side, use z Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
10 Areas on normal curve for arbitrary µ, σ P(a X b) = b a ) 1 ( σ 2π ep ( µ)2 2σ 2 d Substitute z = µ σ (or = σz + µ) into the integral to turn it into the standard normal integral: ( a µ P X µ b µ ) ( a µ = P Z b µ ) σ σ σ σ σ ( ) ( ) b µ a µ = Φ Φ σ σ The zscore of is z = µ σ. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
11 Binomial distribution Compute P(43 X 51) when n = 6, p = 3/4 Binomial: n = 6, p = 3/4 k P(X = k) = ( ) 6 k (.75) k (.25) 6 k Total.7544 Mean µ = np = 6(3/4) = 45 Standard deviation σ= np(1 p) = 6(3/4)(1/4) = Mode (k with ma ) np + p = 6(3/4) + (3/4) = = 45 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
12 Mode of a distribution The mode of random variable X is the value k at which the is maimum. Mode of binomial distribution when < p < 1 The mode is (n + 1)p. Eception: If (n + 1)p is an integer then (n + 1)p and (n + 1)p 1 are tied as the mode. The mode is within 1 of the mean np. When np is an integer, the mode equals the mean. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
13 Binomial and normal distributions Binomial Normal approimation to binomial k P(X = k).15 Binomial: n=6, p=3/4 Binomial P(43! X! 51) Normal: µ=45,"= Total P(X = k) shown as a rectangle: height P(X = k), etent k ± 1/2. The binomial distribution is only defined at the integers, and is very close to the normal distribution shown. We will approimate the probability P(43 X 51) we had above by the corresponding one for the normal distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
14 Normal approimation to binomial, step 1 Compute corresponding parameters We want to approimate P(a X b) in a binomial distribution. We ll use n = 6, p = 3/4 and approimate P(43 X 51). Determine µ, σ: µ = np = 6(3/4) = 45 σ = np(1 p) = The normal distribution with those same values of µ, σ is a good approimation to the binomial distribution provided µ ± 3σ are both between and n. Check: µ 3σ 45 3(3.354) = µ + 3σ (3.354) = are both between and 6, so we may proceed. Note: Some applications are more strict and may require µ ± 5σ or more to be between and n. Since µ + 5σ , this would fail at that level of strictness. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
15 Normal approimation to binomial, step 2 Continuity correction Normal approimation to binomial Binomial: n=6, p=3/4 Binomial P(43! X! 51) Normal: µ=45,"=3.35 The binomial distribution is discrete (X = integers) but the normal distribution is continuous The sum P(X = 43) + + P(X = 51) has 9 terms, corresponding to the area of the 9 rectangles in the picture. The area under the normal distribution curve from 42.5 X 51.5 approimates the area of those rectangles. Change P(43 X 51) to P(42.5 X 51.5). Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
16 Normal approimation to binomial, steps Convert to zscores 4. Use the normal distribution to approimately evaluate it For random variable X with mean µ and standard deviation σ, The zscore of a value is z = E(X) SD(X) The random variable Z is Z = X E(X) SD(X) Convert to zscores: P(42.5 X 51.5) = P = µ σ. = X µ σ. ( X ) = P( Z ) Approimate this by the standard normal distribution cdf: Φ( ) Φ( ) This is close to the true answer (apart from rounding errors) P(43 X 51) =.7544 we got from the binomial distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
17 Estimating fraction of successes instead of number of successes What is the value of p in the binomial distribution? Estimate it: flip a coin n times and divide the # heads by n. Let X = binomial distribution for n flips, probability p of heads. Let X = X/n be the fraction of flips that are heads. X is discrete, with possible values n, 1 n, 2 n,..., n n {(. n ) P(X = k n ) = P(X = k) = k p k (1 p) n k for k =, 1,..., n; otherwise. Mean E(X) = E(X/n) = E(X)/n = np/n = p. Variance Var(X) = Var ( ) X n = Var(X) n 2 Standard deviation SD(X) = p(1 p)/n. = np(1 p) n 2 = p(1 p) n. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
18 Normal approimation for fraction of successes n flips, probability p of heads, X=observed fraction of heads Mean E(X) = p Variance Var(X) = p(1 p)/n Standard deviation SD(X) = p(1 p)/n The Z transformation of X is Z = X E(X) SD(X) = X p p(1 p)/n and value X = has zscore z = p p(1 p)/n. For k heads in n flips, The zscore of X = k is z 1 = k np. np(1 p) The zscore of X = k/n is z 2 = (k/n) p p(1 p)/n. These are equal! Divide the numerator and denominator of z 1 by n to get z 2. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
19 Normal approimation for fraction of successes For n = 6 flips of a coin with p = 3 4, we ll estimate P ( 43 6 The eact answer equals P(43 X 51) X 51 6). Step 1: Determine mean and SD E(X) = p =.75 SD(X) = p(1 p)/n = (.75)(.25)/6 = Verify approimation is valid: Mean ± 3 SD between and 1 Mean 3 SD = Mean + 3 SD =.9177 Both are between and 1. Step 2: Continuity correction P ( ) ( X 6 = P Step 3: zscores X Step 4: Evaluate approimate answer using normal distribution Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36 )
20 Normal approimation for fraction of successes P ( 43 6 ) ( 51 X 6 = P X = P(.7833 X.85833) (.7833 E(X) = P SD(X) ) X E(X) SD(X) = P ( Z = P( Z ) E(X) SD(X) ) ) = Φ( ) Φ(.74535) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
21 Mean and SD of sums and averages of i.i.d. random variables Let X 1,..., X n be n i.i.d. (independent identically distributed) random variables, each with mean µ and standard deviation σ. Let S n = X X n be their sum and X n = (X X n )/n = S n /n be their average. Means: Sum: E(S n ) = E(X 1 ) + + E(X n ) = n E(X 1 ) = nµ Avg: E(X n ) = E(S n /n) = nµ/n = µ Variance: Sum: Var(S n ) = Var(X 1 ) + + Var(X n ) = n Var(X 1 ) = nσ 2 Avg: Var(X n ) = Var(S n )/n 2 = nσ 2 /n 2 = σ 2 /n Standard deviation: Sum: SD(S n ) = σ n Avg: SD(X n ) = σ/ n Terminology for different types of standard deviation The standard deviation (SD) of a trial (each X i ) is σ The standard error (SE) of the sum is σ n The standard error (SE) of the average is σ/ n Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
22 Theorem (Central Limit Theorem abbreviated CLT) For n i.i.d. random variables X 1,..., X n with sum S n = X X n and average X n = S n /n, and any real numbers a < b, P ( a S n nµ σ n ) b = P ( a X ) n µ σ/ n b Φ(b) Φ(a) if n is large enough. As n, the approimation becomes eact equality. 1.5 Binomial n=1,p=.75; µ=.75,!= Binomial n=6,p=.75; µ=45.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
23 Interpretation of Central Limit Theorem As n increases, the more and more closely resembles a normal distribution. However, the is defined as inbetween the red points shown, if it s a discrete distribution. The cdfs are approimately equal everywhere on the continuum. Probabilities of intervals for sums or averages of enough i.i.d. variables can be approimately evaluated using the normal distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
24 Repeated rolls of a die One roll: µ = 3.5, σ = 35/ Average of 1 roll of die; µ=3.5,!= Average of 2 rolls of die; µ=3.5,!= Average of 3 rolls of die; µ=3.5,!= Average of 1 rolls of die; µ=3.5,!=.17 Die average Normal dist. µ µ±! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
25 Repeated rolls of a die Find n so that at least 95% of the time, the average of n rolls of a die is between 3 and 4. ( ) P(3 X 4) = P 3 µ σ/ X µ n σ/ 4 µ n σ/ n Plug in µ = 3.5 and σ = 35/12. ( P(3 X 4) = P 1/2 Z 35/(12n) ) 1/2 35/(12n) Recall the center 95% of the area on the standard normal curve is between z = ± / n (1.96) 2 35/ /(12n) (1/2) 2 n is an integer so n 45 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
26 Sawtooth distribution (made up as demo) One trial: µ = 4, σ 2.24 Average of 1 trial; µ=4.,!=2.24 Average of 2 trials; µ=4.,!= Average of 3 trials; µ=4.,!= Average of 1 trials; µ=4.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
27 Binomial distribution (n, p) A Bernoulli trial is to flip a coin once and count the number of heads, { 1 probability p; X 1 = probability 1 p. Mean E(X 1 ) = p, standard deviation SD(X 1 ) = p(1 p). The binomial distribution is the sum of n i.i.d. Bernoulli trials. Mean µ = np, standard deviation σ = np(1 p). The binomial distribution is approimated pretty well by the normal distribution when µ ± 3σ are between and n. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
28 Binomial distribution (n, p) One flip: µ = p =.75, σ = p(1 p) = Binomial n=1,p=.75; µ=.75,!= Binomial n=6,p=.75; µ=4.5,!= Binomial n=3,p=.75; µ=22.5,!= Binomial n=6,p=.75; µ=45.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
29 Poisson distribution (µ or µ = λ d) Mean: µ (same as the Poisson parameter) Standard deviation: σ = µ. It is approimated pretty well by the normal distribution when µ 5. The reason the Central Limit Theorem applies is that a Poisson distribution with parameter µ equals the sum of n i.i.d. Poissons with parameter µ/n. The Poisson distribution has infinite range =, 1, 2,... and the normal distribution has infinite range < < (reals). Both are truncated in the plots. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
30 Poisson distribution (µ) Poisson µ=1;!= Poisson µ=6;!= Poisson µ=3;!= Poisson µ=6;!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
31 Geometric and negative binomial distributions Geometric distribution (p) X is the number of flips { until the first heads, (1 p) 1 p if = 1, 2, 3,... ; p X () = otherwise. The plot doesn t resemble the normal distribution at all. Mean: µ = 1/p Negative binomial distribution (r, p) Standard deviation: σ = 1 p/p r = 1 is same as geometric distribution. r > 2: The has a bell like shape, but is not close to the normal distribution unless r is very large. Mean: µ = r/p Standard deviation: σ = r(1 p)/p Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
32 Geometric and negative binomial distributions Heads with probability p =.1 Geometric p=.1; µ=1.,!= Neg. bin. r=6,p=.1; µ=6.,!= Neg. bin. r=3,p=.1; µ=3.,!= Neg. bin. r=6,p=.1; µ=6.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
33 Eponential and gamma distributions Eponential distribution (λ) The eponential distribution doesn t resemble the normal distribution at all. Mean: µ = 1/λ Standard deviation: σ = 1/λ Gamma distribution (r, λ) The gamma distribution for r = 1 is the eponential distribution. The gamma distribution for r > 1 does have a bell like shape, but it is not close to the normal distribution until r is very large. There is a generalization to allow r to be real numbers, not just integers. Mean: µ = r/λ Standard deviation: σ = r/λ Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
34 Eponential and gamma distributions Rate λ =.1 Eponential!=.1; µ=1.,"= Gamma r=6,p=.1; µ=6.,!= Gamma r=3,p=.1; µ=3.,!= ! Gamma r=6,p=.1; µ=6.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
35 Geometric/Negative binomial vs. Eponential/Gamma p = λ gives same means for geometric and eponential. p = 1 e λ gives same eponential decay rate for both geometric and eponential distributions. 1 e λ λ when λ is small. This corespondence carries over to the gamma and negative binomial distributions. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
36 Geometric/negative binomial vs. Eponential/gamma This is for p =.1 vs. λ =.1; a better fit for λ =.1 would be p = 1 e λ.95 Geometric p=.1; µ=1.,!=9.49 Eponential!=.1; µ=1.,"= Neg. bin. r=3,p=.1; µ=3.,!= Gamma r=3,p=.1; µ=3.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
Continuous Random Variables
Continuous Random Variables COMP 245 STATISTICS Dr N A Heard Contents 1 Continuous Random Variables 2 11 Introduction 2 12 Probability Density Functions 3 13 Transformations 5 2 Mean, Variance and Quantiles
More informationContinuous Distributions
MAT 2379 3X (Summer 2012) Continuous Distributions Up to now we have been working with discrete random variables whose R X is finite or countable. However we will have to allow for variables that can take
More informationStatistics 100 Binomial and Normal Random Variables
Statistics 100 Binomial and Normal Random Variables Three different random variables with common characteristics: 1. Flip a fair coin 10 times. Let X = number of heads out of 10 flips. 2. Poll a random
More informationRandom variables, probability distributions, binomial random variable
Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that
More information3. Continuous Random Variables
3. Continuous Random Variables A continuous random variable is one which can take any value in an interval (or union of intervals) The values that can be taken by such a variable cannot be listed. Such
More informationProf. Tesler. Math 186 and 283 Winter Prof. Tesler Poisson & Exponential Distributions Math 186 / Winter / 31
Math 186: 4.2 Poisson Distribution: Counting Crossovers in Meiosis 4.2 Exponential and 4.6 Gamma Distributions: Distance Between Crossovers Math 283: Ewens & Grant 1.3.7, 4.14.2 Prof. Tesler Math 186
More informationChapter 3: Discrete Random Variable and Probability Distribution. January 28, 2014
STAT511 Spring 2014 Lecture Notes 1 Chapter 3: Discrete Random Variable and Probability Distribution January 28, 2014 3 Discrete Random Variables Chapter Overview Random Variable (r.v. Definition Discrete
More informationContinuous Random Variables and Probability Distributions. Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4  and Cengage
4 Continuous Random Variables and Probability Distributions Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4  and Cengage Continuous r.v. A random variable X is continuous if possible values
More informationYou flip a fair coin four times, what is the probability that you obtain three heads.
Handout 4: Binomial Distribution Reading Assignment: Chapter 5 In the previous handout, we looked at continuous random variables and calculating probabilities and percentiles for those type of variables.
More informationTopic 2: Scalar random variables. Definition of random variables
Topic 2: Scalar random variables Discrete and continuous random variables Probability distribution and densities (cdf, pmf, pdf) Important random variables Expectation, mean, variance, moments Markov and
More informationthe number of organisms in the squares of a haemocytometer? the number of goals scored by a football team in a match?
Poisson Random Variables (Rees: 6.8 6.14) Examples: What is the distribution of: the number of organisms in the squares of a haemocytometer? the number of hits on a web site in one hour? the number of
More informationExpectation Discrete RV  weighted average Continuous RV  use integral to take the weighted average
PHP 2510 Expectation, variance, covariance, correlation Expectation Discrete RV  weighted average Continuous RV  use integral to take the weighted average Variance Variance is the average of (X µ) 2
More informationMATH 201. Final ANSWERS August 12, 2016
MATH 01 Final ANSWERS August 1, 016 Part A 1. 17 points) A bag contains three different types of dice: four 6sided dice, five 8sided dice, and six 0sided dice. A die is drawn from the bag and then rolled.
More informationProbability density function : An arbitrary continuous random variable X is similarly described by its probability density function f x = f X
Week 6 notes : Continuous random variables and their probability densities WEEK 6 page 1 uniform, normal, gamma, exponential,chisquared distributions, normal approx'n to the binomial Uniform [,1] random
More informationThe ChiSquare Distributions
MATH 183 The ChiSquare Distributions Dr. Neal, WKU The chisquare distributions can be used in statistics to analyze the standard deviation " of a normally distributed measurement and to test the goodness
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 101634501 Probability and Statistics for Engineers Winter 20102011 Contents 1 Joint Probability Distributions 1 1.1 Two Discrete
More informationUniversity of California, Berkeley, Statistics 134: Concepts of Probability
University of California, Berkeley, Statistics 134: Concepts of Probability Michael Lugo, Spring 211 Exam 2 solutions 1. A fair twentysided die has its faces labeled 1, 2, 3,..., 2. The die is rolled
More informationPHP 2510 Central limit theorem, confidence intervals. PHP 2510 October 20,
PHP 2510 Central limit theorem, confidence intervals PHP 2510 October 20, 2008 1 Distribution of the sample mean Case 1: Population distribution is normal For an individual in the population, X i N(µ,
More informationCSE 312, 2011 Winter, W.L.Ruzzo. 7. continuous random variables
CSE 312, 2011 Winter, W.L.Ruzzo 7. continuous random variables continuous random variables Discrete random variable: takes values in a finite or countable set, e.g. X {1,2,..., 6} with equal probability
More informationPractice Exam 1: Long List 18.05, Spring 2014
Practice Eam : Long List 8.05, Spring 204 Counting and Probability. A full house in poker is a hand where three cards share one rank and two cards share another rank. How many ways are there to get a fullhouse?
More informationSome continuous and discrete distributions
Some continuous and discrete distributions Table of contents I. Continuous distributions and transformation rules. A. Standard uniform distribution U[0, 1]. B. Uniform distribution U[a, b]. C. Standard
More informationReview. Lecture 3: Probability Distributions. Poisson Distribution. May 8, 2012 GENOME 560, Spring Su In Lee, CSE & GS
Lecture 3: Probability Distributions May 8, 202 GENOME 560, Spring 202 Su In Lee, CSE & GS suinlee@uw.edu Review Random variables Discrete: Probability mass function (pmf) Continuous: Probability density
More informationContinuous Random Variables. and Probability Distributions. Continuous Random Variables and Probability Distributions ( ) ( ) Chapter 4 4.
UCLA STAT 11 A Applied Probability & Statistics for Engineers Instructor: Ivo Dinov, Asst. Prof. In Statistics and Neurology Teaching Assistant: Neda Farzinnia, UCLA Statistics University of California,
More informationProbability Distributions
Learning Objectives Probability Distributions Section 1: How Can We Summarize Possible Outcomes and Their Probabilities? 1. Random variable 2. Probability distributions for discrete random variables 3.
More informationAnswers to some even exercises
Answers to some even eercises Problem  P (X = ) = P (white ball chosen) = /8 and P (X = ) = P (red ball chosen) = 7/8 E(X) = (P (X = ) + P (X = ) = /8 + 7/8 = /8 = /9 E(X ) = ( ) (P (X = ) + P (X = )
More informationLecture.7 Poisson Distributions  properties, Normal Distributions properties. Theoretical Distributions. Discrete distribution
Lecture.7 Poisson Distributions  properties, Normal Distributions properties Theoretical distributions are Theoretical Distributions 1. Binomial distribution 2. Poisson distribution Discrete distribution
More informationMATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS
MATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS CONTENTS Sample Space Accumulative Probability Probability Distributions Binomial Distribution Normal Distribution Poisson Distribution
More information4: Probability. What is probability? Random variables (RVs)
4: Probability b binomial µ expected value [parameter] n number of trials [parameter] N normal p probability of success [parameter] pdf probability density function pmf probability mass function RV random
More informationProbability is concerned with quantifying the likelihoods of various events in situations involving elements of randomness or uncertainty.
Chapter 1 Probability Spaces 11 What is Probability? Probability is concerned with quantifying the likelihoods of various events in situations involving elements of randomness or uncertainty Example 111
More information4. Continuous Random Variables, the Pareto and Normal Distributions
4. Continuous Random Variables, the Pareto and Normal Distributions A continuous random variable X can take any value in a given range (e.g. height, weight, age). The distribution of a continuous random
More informationFor a partition B 1,..., B n, where B i B j = for i. A = (A B 1 ) (A B 2 ),..., (A B n ) and thus. P (A) = P (A B i ) = P (A B i )P (B i )
Probability Review 15.075 Cynthia Rudin A probability space, defined by Kolmogorov (19031987) consists of: A set of outcomes S, e.g., for the roll of a die, S = {1, 2, 3, 4, 5, 6}, 1 1 2 1 6 for the roll
More informationImportant Probability Distributions OPRE 6301
Important Probability Distributions OPRE 6301 Important Distributions... Certain probability distributions occur with such regularity in reallife applications that they have been given their own names.
More informationReview Solutions, Exam 3, Math 338
Review Solutions, Eam 3, Math 338. Define a random sample: A random sample is a collection of random variables, typically indeed as X,..., X n.. Why is the t distribution used in association with sampling?
More informationChapter 4 Lecture Notes
Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a realvalued function defined on the sample space of some experiment. For instance,
More informationThe Normal Distribution. Alan T. Arnholt Department of Mathematical Sciences Appalachian State University
The Normal Distribution Alan T. Arnholt Department of Mathematical Sciences Appalachian State University arnholt@math.appstate.edu Spring 2006 R Notes 1 Copyright c 2006 Alan T. Arnholt 2 Continuous Random
More informationCommon probability distributionsi Math 217/218 Probability and Statistics Prof. D. Joyce, 2016
Introduction. ommon probability distributionsi Math 7/8 Probability and Statistics Prof. D. Joyce, 06 I summarize here some of the more common distributions used in probability and statistics. Some are
More informationMath 431 An Introduction to Probability. Final Exam Solutions
Math 43 An Introduction to Probability Final Eam Solutions. A continuous random variable X has cdf a for 0, F () = for 0 <
More informationDISCRETE RANDOM VARIABLES
DISCRETE RANDOM VARIABLES DISCRETE RANDOM VARIABLES Documents prepared for use in course B01.1305, New York University, Stern School of Business Definitions page 3 Discrete random variables are introduced
More informationRandom Variables and Their Expected Values
Discrete and Continuous Random Variables The Probability Mass Function The (Cumulative) Distribution Function Discrete and Continuous Random Variables The Probability Mass Function The (Cumulative) Distribution
More informationMAS108 Probability I
1 QUEEN MARY UNIVERSITY OF LONDON 2:30 pm, Thursday 3 May, 2007 Duration: 2 hours MAS108 Probability I Do not start reading the question paper until you are instructed to by the invigilators. The paper
More informationThe basics of probability theory. Distribution of variables, some important distributions
The basics of probability theory. Distribution of variables, some important distributions 1 Random experiment The outcome is not determined uniquely by the considered conditions. For example, tossing a
More informationEE 302 Division 1. Homework 5 Solutions.
EE 32 Division. Homework 5 Solutions. Problem. A fair foursided die (with faces labeled,, 2, 3) is thrown once to determine how many times a fair coin is to be flipped: if N is the number that results
More informationEE 322: Probabilistic Methods for Electrical Engineers. Zhengdao Wang Department of Electrical and Computer Engineering Iowa State University
EE 322: Probabilistic Methods for Electrical Engineers Zhengdao Wang Department of Electrical and Computer Engineering Iowa State University Discrete Random Variables 1 Introduction to Random Variables
More informationDiscrete probability and the laws of chance
Chapter 8 Discrete probability and the laws of chance 8.1 Introduction In this chapter we lay the groundwork for calculations and rules governing simple discrete probabilities. These steps will be essential
More informationChapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS
Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 4: Geometric Distribution Negative Binomial Distribution Hypergeometric Distribution Sections 37, 38 The remaining discrete random
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special DistributionsVI Today, I am going to introduce
More information3 Multiple Discrete Random Variables
3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f
More informationSampling Distribution of a Normal Variable
Ismor Fischer, 5/9/01 5.1 5. Formal Statement and Examples Comments: Sampling Distribution of a Normal Variable Given a random variable. Suppose that the population distribution of is known to be normal,
More informationProbability & Statistics Primer Gregory J. Hakim University of Washington 2 January 2009 v2.0
Probability & Statistics Primer Gregory J. Hakim University of Washington 2 January 2009 v2.0 This primer provides an overview of basic concepts and definitions in probability and statistics. We shall
More informationContinuous Distributions, Mainly the Normal Distribution
Continuous Distributions, Mainly the Normal Distribution 1 Continuous Random Variables STA 281 Fall 2011 Discrete distributions place probability on specific numbers. A Bin(n,p) distribution, for example,
More informationContents. TTM4155: Teletraffic Theory (Teletrafikkteori) Probability Theory Basics. Yuming Jiang. Basic Concepts Random Variables
TTM4155: Teletraffic Theory (Teletrafikkteori) Probability Theory Basics Yuming Jiang 1 Some figures taken from the web. Contents Basic Concepts Random Variables Discrete Random Variables Continuous Random
More informationCopyright 2013 by Laura Schultz. All rights reserved. Page 1 of 6
Using Your TINSpire Calculator: Binomial Probability Distributions Dr. Laura Schultz Statistics I This handout describes how to use the binompdf and binomcdf commands to work with binomial probability
More informationChapter 5. Random variables
Random variables random variable numerical variable whose value is the outcome of some probabilistic experiment; we use uppercase letters, like X, to denote such a variable and lowercase letters, like
More informationMinitab Guide. This packet contains: A Friendly Guide to Minitab. Minitab StepByStep
Minitab Guide This packet contains: A Friendly Guide to Minitab An introduction to Minitab; including basic Minitab functions, how to create sets of data, and how to create and edit graphs of different
More informationStatistics  Written Examination MEC Students  BOVISA
Statistics  Written Examination MEC Students  BOVISA Prof.ssa A. Guglielmi 26.0.2 All rights reserved. Legal action will be taken against infringement. Reproduction is prohibited without prior consent.
More informationLecture 5 : The Poisson Distribution. Jonathan Marchini
Lecture 5 : The Poisson Distribution Jonathan Marchini Random events in time and space Many experimental situations occur in which we observe the counts of events within a set unit of time, area, volume,
More informationSummary of Probability
Summary of Probability Mathematical Physics I Rules of Probability The probability of an event is called P(A), which is a positive number less than or equal to 1. The total probability for all possible
More informationAn Introduction to Basic Statistics and Probability
An Introduction to Basic Statistics and Probability Shenek Heyward NCSU An Introduction to Basic Statistics and Probability p. 1/4 Outline Basic probability concepts Conditional probability Discrete Random
More informationA frequency distribution is a table used to describe a data set. A frequency table lists intervals or ranges of data values called data classes
A frequency distribution is a table used to describe a data set. A frequency table lists intervals or ranges of data values called data classes together with the number of data values from the set that
More informationStatistics 100A Homework 4 Solutions
Problem 1 For a discrete random variable X, Statistics 100A Homework 4 Solutions Ryan Rosario Note that all of the problems below as you to prove the statement. We are proving the properties of epectation
More informationExpected Value. Let X be a discrete random variable which takes values in S X = {x 1, x 2,..., x n }
Expected Value Let X be a discrete random variable which takes values in S X = {x 1, x 2,..., x n } Expected Value or Mean of X: E(X) = n x i p(x i ) i=1 Example: Roll one die Let X be outcome of rolling
More informationCHAPTER 3. Statistics
CHAPTER 3 Statistics Statistics has many aspects. These include: data gathering data analysis statistical inference. For instance, politicians may wish to see whether a new law will be popular. They as
More informationChapter 6 Random Variables
Chapter 6 Random Variables Day 1: 6.1 Discrete Random Variables Read 340344 What is a random variable? Give some examples. A numerical variable that describes the outcomes of a chance process. Examples:
More informationNormal distribution. ) 2 /2σ. 2π σ
Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a
More informationMath 151. Rumbos Spring 2014 1. Solutions to Assignment #22
Math 151. Rumbos Spring 2014 1 Solutions to Assignment #22 1. An experiment consists of rolling a die 81 times and computing the average of the numbers on the top face of the die. Estimate the probability
More informationChapter 2. The Normal Distribution
Chapter 2 The Normal Distribution Lesson 21 Density Curve Review Graph the data Calculate a numerical summary of the data Describe the shape, center, spread and outliers of the data Histogram with Curve
More informationChapter 5. Section 5.1: Central Tendency. Mode: the number or numbers that occur most often. Median: the number at the midpoint of a ranked data.
Chapter 5 Section 5.1: Central Tendency Mode: the number or numbers that occur most often. Median: the number at the midpoint of a ranked data. Example 1: The test scores for a test were: 78, 81, 82, 76,
More informationContinuous random variables
Continuous random variables So far we have been concentrating on discrete random variables, whose distributions are not continuous. Now we deal with the socalled continuous random variables. A random
More informationDiscrete and Continuous Random Variables. Summer 2003
Discrete and Continuous Random Variables Summer 003 Random Variables A random variable is a rule that assigns a numerical value to each possible outcome of a probabilistic experiment. We denote a random
More informationLecture 8: More Continuous Random Variables
Lecture 8: More Continuous Random Variables 26 September 2005 Last time: the eponential. Going from saying the density e λ, to f() λe λ, to the CDF F () e λ. Pictures of the pdf and CDF. Today: the Gaussian
More informationSummary of Formulas and Concepts. Descriptive Statistics (Ch. 14)
Summary of Formulas and Concepts Descriptive Statistics (Ch. 14) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume
More informationQuestion: What is the probability that a fivecard poker hand contains a flush, that is, five cards of the same suit?
ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the
More informationProbability Models for Continuous Random Variables
Density Probability Models for Continuous Random Variables At right you see a histogram of female length of life. (Births and deaths are recorded to the nearest minute. The data are essentially continuous.)
More informationStats on the TI 83 and TI 84 Calculator
Stats on the TI 83 and TI 84 Calculator Entering the sample values STAT button Left bracket { Right bracket } Store (STO) List L1 Comma Enter Example: Sample data are {5, 10, 15, 20} 1. Press 2 ND and
More informationIEOR 4106: Introduction to Operations Research: Stochastic Models. SOLUTIONS to Homework Assignment 1
IEOR 4106: Introduction to Operations Research: Stochastic Models SOLUTIONS to Homework Assignment 1 Probability Review: Read Chapters 1 and 2 in the textbook, Introduction to Probability Models, by Sheldon
More informationCommonly Used Probability Distributions
Chapter Four 4.1 Introduction As we have seen in Charter 3, a probability density function (pdf) or a cumulative distribution function (cdf) can completely describe a random variable. Because of the physical
More informationJoint Continuous Distributions
Joint Continuous Distributions Statistics 11 Summer 6 Copright c 6 b Mark E. Irwin Joint Continuous Distributions Not surprisingl we can look at the joint distribution of or more continuous RVs. For eample,
More information10 BIVARIATE DISTRIBUTIONS
BIVARIATE DISTRIBUTIONS After some discussion of the Normal distribution, consideration is given to handling two continuous random variables. The Normal Distribution The probability density function f(x)
More informationSufficient Statistics and Exponential Family. 1 Statistics and Sufficient Statistics. Math 541: Statistical Theory II. Lecturer: Songfeng Zheng
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Sufficient Statistics and Exponential Family 1 Statistics and Sufficient Statistics Suppose we have a random sample X 1,, X n taken from a distribution
More informationQuestion 1 Question 2 Question 3 Question 4 Question 5 Question 6. Math 144 tutorial April, 2010
Math 144 tutorial 7 12 April, 2010 1. Let us define S 2 = 1 n n i=1 (X i X) 2. Show that E(S 2 ) = n 1 n σ2. 1. Let us define S 2 = 1 n n i=1 (X i X) 2. Show that E(S 2 ) = n 1 n σ2. 1. Let us define S
More information1.1 Introduction, and Review of Probability Theory... 3. 1.1.1 Random Variable, Range, Types of Random Variables... 3. 1.1.2 CDF, PDF, Quantiles...
MATH4427 Notebook 1 Spring 2016 prepared by Professor Jenny Baglivo c Copyright 20092016 by Jenny A. Baglivo. All Rights Reserved. Contents 1 MATH4427 Notebook 1 3 1.1 Introduction, and Review of Probability
More informationNormal Approximation. Contents. 1 Normal Approximation. 1.1 Introduction. Anthony Tanbakuchi Department of Mathematics Pima Community College
Introductory Statistics Lectures Normal Approimation To the binomial distribution Department of Mathematics Pima Community College Redistribution of this material is prohibited without written permission
More informationMath 58. Rumbos Fall Solutions to Assignment #5
Math 58. Rumbos Fall 2008 1 Solutions to Assignment #5 1. (Typographical Errors 1 ) Typographical and spelling errors can be either nonword errors or word errors. A nonword error is not a real word, as
More informationMonte Carlo Method: Probability
John (ARC/ICAM) Virginia Tech... Math/CS 4414: The Monte Carlo Method: PROBABILITY http://people.sc.fsu.edu/ jburkardt/presentations/ monte carlo probability.pdf... ARC: Advanced Research Computing ICAM:
More informationHypothesis tests, confidence intervals, and bootstrapping
Hypothesis tests, confidence intervals, and bootstrapping Business Statistics 41000 Fall 2015 1 Topics 1. Hypothesis tests Testing a mean: H0 : µ = µ 0 Testing a proportion: H0 : p = p 0 Testing a difference
More informationECE302 Spring 2006 HW4 Solutions February 6, 2006 1
ECE302 Spring 2006 HW4 Solutions February 6, 2006 1 Solutions to HW4 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More informationMath 141. Lecture 5: Expected Value. Albyn Jones 1. jones/courses/ Library 304. Albyn Jones Math 141
Math 141 Lecture 5: Expected Value Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 History The early history of probability theory is intimately related to questions arising
More informationBinomial Probabilities
Lab 8: Break free from tables! STT 421: Summer, 2004 Vince Melfi For many years published tables of probabilities, like Tables A F of Normal, Binomial, etc., probabilites, were indispensible to statisticians.
More informationPROBABILITIES AND PROBABILITY DISTRIBUTIONS
Published in "Random Walks in Biology", 1983, Princeton University Press PROBABILITIES AND PROBABILITY DISTRIBUTIONS Howard C. Berg Table of Contents PROBABILITIES PROBABILITY DISTRIBUTIONS THE BINOMIAL
More informationChapter 6 Continuous Probability Distributions
Continuous Probability Distributions Learning Objectives 1. Understand the difference between how probabilities are computed for discrete and continuous random variables. 2. Know how to compute probability
More informationProbability. Gather data by probabilistic (random) mechanism. Use probability to predict results of experiment under assumptions.
Probability Role of probability in statistics: Gather data by probabilistic (random) mechanism. Use probability to predict results of experiment under assumptions. Compute probability of error larger than
More informationExpected Value 10/11/2005
Expected Value 10/11/2005 Definition Let X be a numericallyvalued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω xm(x), provided
More informationLecture Note 7 Random Sample. MIT Spring 2006 Herman Bennett
Lecture Note 7 Random Sample MIT 14.30 Spring 2006 Herman Bennett 17 Definitions 17.1 Random Sample Let X 1,..., X n be mutually independent RVs such that f Xi (x) = f Xj (x) i = j. Denote f Xi (x) = f(x).
More informationCA200 Quantitative Analysis for Business Decisions. File name: CA200_Section_04A_StatisticsIntroduction
CA200 Quantitative Analysis for Business Decisions File name: CA200_Section_04A_StatisticsIntroduction Table of Contents 4. Introduction to Statistics... 1 4.1 Overview... 3 4.2 Discrete or continuous
More informationCOM2023 Mathematics Methods for Computing II
COM223 Mathematics Methods for Computing II Lecture 11& 12 Gianne Derks Department of Mathematics (36AA4) http://www.maths.surrey.ac.uk/modules/com223 Autumn 21 Use channel 4 on your EVS handset Overview................................................................
More informationContents. 3 Survival Distributions: Force of Mortality 37 Exercises Solutions... 51
Contents 1 Probability Review 1 1.1 Functions and moments...................................... 1 1.2 Probability distributions...................................... 2 1.2.1 Bernoulli distribution...................................
More informationNotes on Continuous Random Variables
Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes
More informationRandom Variables of The Discrete Type
Random Variables of The Discrete Type Definition: Given a random experiment with an outcome space S, a function X that assigns to each element s in S one and only one real number x X(s) is called a random
More informationPO906: Quantitative Data Analysis and Interpretation
PO906: Quantitative Data Analysis and Interpretation Vera E. Troeger Office: 1.129 Email: v.e.troeger@warwick.ac.uk Office Hours: appointment by email Quantitative Data Analysis Descriptive statistics:
More informationIEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem
IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem Time on my hands: Coin tosses. Problem Formulation: Suppose that I have
More information