Normal distribution Approximating binomial distribution by normal 2.10 Central Limit Theorem
|
|
- Naomi McDonald
- 7 years ago
- Views:
Transcription
1 1.1.2 Normal distribution Approimating binomial distribution by normal 2.1 Central Limit Theorem Prof. Tesler Math 283 October 22, 214 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
2 Normal distribution a.k.a. Bell curve and Gaussian distribution The normal distribution is a continuous distribution. Parameters: µ = mean (center) σ = standard deviation (width) ( ) PDF: f X () = 1 σ ep ( µ)2 for < <. 2π 2σ 2 Normal distribution N(2, 5): µ = 2, σ = Normal µ µ ± σ The normal distribution is symmetric about = µ, so median = mean = µ. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
3 Applications of normal distribution Applications Many natural quantities are modelled by it: e.g., a histogram of the heights or weights of everyone in a large population often follows a normal distribution. Many distributions such as binomial, Poisson,... are closely approimated by it when the parameters are large enough. Sums and averages of huge quantities of data are often modelled by it. Coverage in DNA sequencing Illumina GA II sequencing of E. coli at 6 coverage. Chitsaz et al. (211), Nature Biotechnology % of positions with coverage Empirical distribution of coverage Coverage Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
4 Cumulative distribution function It turns out that the integral for total probability does equal 1: ) 1 ( σ 2π ep ( µ)2 2σ 2 d = 1 However, it s a tricky integral; see a Calculus tetbook in the section on double integrals in polar coordinates. The cumulative distribution function is the integral F X () = P(X ) = ) 1 ( σ 2π ep (t µ)2 2σ 2 dt This integral cannot be done symbollically in terms of the usual functions (polynomials, eponentials, logs, trig functions, etc.). It can be done via numerical integration or Taylor series. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
5 Standard normal distribution Standard normal distribution N(, 1): µ =, σ = 1 CDF of standard normal distribution..2.4 Normal µ µ ± σ cdf..4.8 Normal µ µ ± σ z The standard normal distribution is the normal distribution for µ =, σ = 1. Use the variable name Z: PDF: φ(z) = f Z (z) = e z2 /2 2π for < z < CDF: Φ(z) = F Z (z) = P(Z z) = 1 z e t2 /2 dt 2π The integral can t be done in terms of ordinary functions, but it can be done using numerical methods. In the past, people used lookup tables. We ll use functions for it in Matlab and R. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36 z
6 Matlab and R commands For the standard normal: Φ(1.96).975 Φ 1 (.975) 1.96 Matlab: normcdf(1.96) norminv(.975) R: pnorm(1.96) qnorm(.975) We will see shortly how to convert between an arbitrary normal distribution (any µ, σ) and the standard normal distribution. The commands above allow additional arguments to specify µ and σ, e.g., normcdf(1.96,,1). R also can work with the right tail directly: pnorm(1.96, lower.tail = FALSE).975 qnorm(.975, lower.tail = FALSE) 1.96 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
7 Standard normal distribution areas.4 Standard Normal Curve.3.2.1!5 a b 5 z The area between z = a and z = b is P(a Z b) = 1 2π b a e t2 /2 dt = Φ(b) Φ(a) P(1.51 Z 1.62) = Φ(1.62) Φ(1.51) = =.129 Matlab: normcdf(1.62) normcdf(1.51) R: pnorm(1.62) pnorm(1.51) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
8 Standard normal distribution symmetries of areas.4 Area! on the right "#$ &'()*!*+,*-.(*/( "#! z!!2 2 z "!%!!! " %! Area right of z is P(Z > z) = 1 Φ(z). By symmetry, the area left of z and the area right of z are equal: Φ( z) = 1 Φ(z) Φ( 1.51) = 1 Φ(1.51) = =.655 Area between z = ±1.51 is Φ(1.51) Φ( 1.51) = 2Φ(1.51) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
9 Central area Area between z = ±1 is 68.27%. Area between z = ±2 is 95.45%. Area between z = ±3 is 99.73%..4.2 Area! split half on each tail!z!/2 z!/2!2 z 2 Find the center part containing 95% of the area Put 2.5% of the area at the upper tail, 2.5% at the lower tail, and 95% in the middle. The value of z putting 2.5% at the top gives Φ(z) = 1.25 =.975. Notation: z.25 = The area between z = ±1.96 is about 95%. For 99% in the middle,.5% on each side, use z Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
10 Areas on normal curve for arbitrary µ, σ P(a X b) = b a ) 1 ( σ 2π ep ( µ)2 2σ 2 d Substitute z = µ σ (or = σz + µ) into the integral to turn it into the standard normal integral: ( a µ P X µ b µ ) ( a µ = P Z b µ ) σ σ σ σ σ ( ) ( ) b µ a µ = Φ Φ σ σ The z-score of is z = µ σ. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
11 Binomial distribution Compute P(43 X 51) when n = 6, p = 3/4 Binomial: n = 6, p = 3/4 k P(X = k) = ( ) 6 k (.75) k (.25) 6 k Total.7544 Mean µ = np = 6(3/4) = 45 Standard deviation σ= np(1 p) = 6(3/4)(1/4) = Mode (k with ma ) np + p = 6(3/4) + (3/4) = = 45 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
12 Mode of a distribution The mode of random variable X is the value k at which the is maimum. Mode of binomial distribution when < p < 1 The mode is (n + 1)p. Eception: If (n + 1)p is an integer then (n + 1)p and (n + 1)p 1 are tied as the mode. The mode is within 1 of the mean np. When np is an integer, the mode equals the mean. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
13 Binomial and normal distributions Binomial Normal approimation to binomial k P(X = k).15 Binomial: n=6, p=3/4 Binomial P(43! X! 51) Normal: µ=45,"= Total P(X = k) shown as a rectangle: height P(X = k), etent k ± 1/2. The binomial distribution is only defined at the integers, and is very close to the normal distribution shown. We will approimate the probability P(43 X 51) we had above by the corresponding one for the normal distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
14 Normal approimation to binomial, step 1 Compute corresponding parameters We want to approimate P(a X b) in a binomial distribution. We ll use n = 6, p = 3/4 and approimate P(43 X 51). Determine µ, σ: µ = np = 6(3/4) = 45 σ = np(1 p) = The normal distribution with those same values of µ, σ is a good approimation to the binomial distribution provided µ ± 3σ are both between and n. Check: µ 3σ 45 3(3.354) = µ + 3σ (3.354) = are both between and 6, so we may proceed. Note: Some applications are more strict and may require µ ± 5σ or more to be between and n. Since µ + 5σ , this would fail at that level of strictness. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
15 Normal approimation to binomial, step 2 Continuity correction Normal approimation to binomial Binomial: n=6, p=3/4 Binomial P(43! X! 51) Normal: µ=45,"=3.35 The binomial distribution is discrete (X = integers) but the normal distribution is continuous The sum P(X = 43) + + P(X = 51) has 9 terms, corresponding to the area of the 9 rectangles in the picture. The area under the normal distribution curve from 42.5 X 51.5 approimates the area of those rectangles. Change P(43 X 51) to P(42.5 X 51.5). Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
16 Normal approimation to binomial, steps Convert to z-scores 4. Use the normal distribution to approimately evaluate it For random variable X with mean µ and standard deviation σ, The z-score of a value is z = E(X) SD(X) The random variable Z is Z = X E(X) SD(X) Convert to z-scores: P(42.5 X 51.5) = P = µ σ. = X µ σ. ( X ) = P( Z ) Approimate this by the standard normal distribution cdf: Φ( ) Φ( ) This is close to the true answer (apart from rounding errors) P(43 X 51) =.7544 we got from the binomial distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
17 Estimating fraction of successes instead of number of successes What is the value of p in the binomial distribution? Estimate it: flip a coin n times and divide the # heads by n. Let X = binomial distribution for n flips, probability p of heads. Let X = X/n be the fraction of flips that are heads. X is discrete, with possible values n, 1 n, 2 n,..., n n {(. n ) P(X = k n ) = P(X = k) = k p k (1 p) n k for k =, 1,..., n; otherwise. Mean E(X) = E(X/n) = E(X)/n = np/n = p. Variance Var(X) = Var ( ) X n = Var(X) n 2 Standard deviation SD(X) = p(1 p)/n. = np(1 p) n 2 = p(1 p) n. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
18 Normal approimation for fraction of successes n flips, probability p of heads, X=observed fraction of heads Mean E(X) = p Variance Var(X) = p(1 p)/n Standard deviation SD(X) = p(1 p)/n The Z transformation of X is Z = X E(X) SD(X) = X p p(1 p)/n and value X = has z-score z = p p(1 p)/n. For k heads in n flips, The z-score of X = k is z 1 = k np. np(1 p) The z-score of X = k/n is z 2 = (k/n) p p(1 p)/n. These are equal! Divide the numerator and denominator of z 1 by n to get z 2. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
19 Normal approimation for fraction of successes For n = 6 flips of a coin with p = 3 4, we ll estimate P ( 43 6 The eact answer equals P(43 X 51) X 51 6). Step 1: Determine mean and SD E(X) = p =.75 SD(X) = p(1 p)/n = (.75)(.25)/6 = Verify approimation is valid: Mean ± 3 SD between and 1 Mean 3 SD = Mean + 3 SD =.9177 Both are between and 1. Step 2: Continuity correction P ( ) ( X 6 = P Step 3: z-scores X Step 4: Evaluate approimate answer using normal distribution Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36 )
20 Normal approimation for fraction of successes P ( 43 6 ) ( 51 X 6 = P X = P(.7833 X.85833) (.7833 E(X) = P SD(X) ) X E(X) SD(X) = P ( Z = P( Z ) E(X) SD(X) ) ) = Φ( ) Φ(.74535) Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
21 Mean and SD of sums and averages of i.i.d. random variables Let X 1,..., X n be n i.i.d. (independent identically distributed) random variables, each with mean µ and standard deviation σ. Let S n = X X n be their sum and X n = (X X n )/n = S n /n be their average. Means: Sum: E(S n ) = E(X 1 ) + + E(X n ) = n E(X 1 ) = nµ Avg: E(X n ) = E(S n /n) = nµ/n = µ Variance: Sum: Var(S n ) = Var(X 1 ) + + Var(X n ) = n Var(X 1 ) = nσ 2 Avg: Var(X n ) = Var(S n )/n 2 = nσ 2 /n 2 = σ 2 /n Standard deviation: Sum: SD(S n ) = σ n Avg: SD(X n ) = σ/ n Terminology for different types of standard deviation The standard deviation (SD) of a trial (each X i ) is σ The standard error (SE) of the sum is σ n The standard error (SE) of the average is σ/ n Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
22 Theorem (Central Limit Theorem abbreviated CLT) For n i.i.d. random variables X 1,..., X n with sum S n = X X n and average X n = S n /n, and any real numbers a < b, P ( a S n nµ σ n ) b = P ( a X ) n µ σ/ n b Φ(b) Φ(a) if n is large enough. As n, the approimation becomes eact equality. 1.5 Binomial n=1,p=.75; µ=.75,!= Binomial n=6,p=.75; µ=45.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
23 Interpretation of Central Limit Theorem As n increases, the more and more closely resembles a normal distribution. However, the is defined as in-between the red points shown, if it s a discrete distribution. The cdfs are approimately equal everywhere on the continuum. Probabilities of intervals for sums or averages of enough i.i.d. variables can be approimately evaluated using the normal distribution. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
24 Repeated rolls of a die One roll: µ = 3.5, σ = 35/ Average of 1 roll of die; µ=3.5,!= Average of 2 rolls of die; µ=3.5,!= Average of 3 rolls of die; µ=3.5,!= Average of 1 rolls of die; µ=3.5,!=.17 Die average Normal dist. µ µ±! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
25 Repeated rolls of a die Find n so that at least 95% of the time, the average of n rolls of a die is between 3 and 4. ( ) P(3 X 4) = P 3 µ σ/ X µ n σ/ 4 µ n σ/ n Plug in µ = 3.5 and σ = 35/12. ( P(3 X 4) = P 1/2 Z 35/(12n) ) 1/2 35/(12n) Recall the center 95% of the area on the standard normal curve is between z = ± / n (1.96) 2 35/ /(12n) (1/2) 2 n is an integer so n 45 Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
26 Sawtooth distribution (made up as demo) One trial: µ = 4, σ 2.24 Average of 1 trial; µ=4.,!=2.24 Average of 2 trials; µ=4.,!= Average of 3 trials; µ=4.,!= Average of 1 trials; µ=4.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
27 Binomial distribution (n, p) A Bernoulli trial is to flip a coin once and count the number of heads, { 1 probability p; X 1 = probability 1 p. Mean E(X 1 ) = p, standard deviation SD(X 1 ) = p(1 p). The binomial distribution is the sum of n i.i.d. Bernoulli trials. Mean µ = np, standard deviation σ = np(1 p). The binomial distribution is approimated pretty well by the normal distribution when µ ± 3σ are between and n. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
28 Binomial distribution (n, p) One flip: µ = p =.75, σ = p(1 p) = Binomial n=1,p=.75; µ=.75,!= Binomial n=6,p=.75; µ=4.5,!= Binomial n=3,p=.75; µ=22.5,!= Binomial n=6,p=.75; µ=45.,!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
29 Poisson distribution (µ or µ = λ d) Mean: µ (same as the Poisson parameter) Standard deviation: σ = µ. It is approimated pretty well by the normal distribution when µ 5. The reason the Central Limit Theorem applies is that a Poisson distribution with parameter µ equals the sum of n i.i.d. Poissons with parameter µ/n. The Poisson distribution has infinite range =, 1, 2,... and the normal distribution has infinite range < < (reals). Both are truncated in the plots. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
30 Poisson distribution (µ) Poisson µ=1;!= Poisson µ=6;!= Poisson µ=3;!= Poisson µ=6;!= Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
31 Geometric and negative binomial distributions Geometric distribution (p) X is the number of flips { until the first heads, (1 p) 1 p if = 1, 2, 3,... ; p X () = otherwise. The plot doesn t resemble the normal distribution at all. Mean: µ = 1/p Negative binomial distribution (r, p) Standard deviation: σ = 1 p/p r = 1 is same as geometric distribution. r > 2: The has a bell -like shape, but is not close to the normal distribution unless r is very large. Mean: µ = r/p Standard deviation: σ = r(1 p)/p Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
32 Geometric and negative binomial distributions Heads with probability p =.1 Geometric p=.1; µ=1.,!= Neg. bin. r=6,p=.1; µ=6.,!= Neg. bin. r=3,p=.1; µ=3.,!= Neg. bin. r=6,p=.1; µ=6.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
33 Eponential and gamma distributions Eponential distribution (λ) The eponential distribution doesn t resemble the normal distribution at all. Mean: µ = 1/λ Standard deviation: σ = 1/λ Gamma distribution (r, λ) The gamma distribution for r = 1 is the eponential distribution. The gamma distribution for r > 1 does have a bell -like shape, but it is not close to the normal distribution until r is very large. There is a generalization to allow r to be real numbers, not just integers. Mean: µ = r/λ Standard deviation: σ = r/λ Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
34 Eponential and gamma distributions Rate λ =.1 Eponential!=.1; µ=1.,"= Gamma r=6,p=.1; µ=6.,!= Gamma r=3,p=.1; µ=3.,!= ! Gamma r=6,p=.1; µ=6.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
35 Geometric/Negative binomial vs. Eponential/Gamma p = λ gives same means for geometric and eponential. p = 1 e λ gives same eponential decay rate for both geometric and eponential distributions. 1 e λ λ when λ is small. This corespondence carries over to the gamma and negative binomial distributions. Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
36 Geometric/negative binomial vs. Eponential/gamma This is for p =.1 vs. λ =.1; a better fit for λ =.1 would be p = 1 e λ.95 Geometric p=.1; µ=1.,!=9.49 Eponential!=.1; µ=1.,"= Neg. bin. r=3,p=.1; µ=3.,!= Gamma r=3,p=.1; µ=3.,!= ! Prof. Tesler , 2.1 Normal distribution Math 283 / October 22, / 36
Random variables, probability distributions, binomial random variable
Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that
More informationYou flip a fair coin four times, what is the probability that you obtain three heads.
Handout 4: Binomial Distribution Reading Assignment: Chapter 5 In the previous handout, we looked at continuous random variables and calculating probabilities and percentiles for those type of variables.
More information4. Continuous Random Variables, the Pareto and Normal Distributions
4. Continuous Random Variables, the Pareto and Normal Distributions A continuous random variable X can take any value in a given range (e.g. height, weight, age). The distribution of a continuous random
More informationProbability density function : An arbitrary continuous random variable X is similarly described by its probability density function f x = f X
Week 6 notes : Continuous random variables and their probability densities WEEK 6 page 1 uniform, normal, gamma, exponential,chi-squared distributions, normal approx'n to the binomial Uniform [,1] random
More informationImportant Probability Distributions OPRE 6301
Important Probability Distributions OPRE 6301 Important Distributions... Certain probability distributions occur with such regularity in real-life applications that they have been given their own names.
More informationFor a partition B 1,..., B n, where B i B j = for i. A = (A B 1 ) (A B 2 ),..., (A B n ) and thus. P (A) = P (A B i ) = P (A B i )P (B i )
Probability Review 15.075 Cynthia Rudin A probability space, defined by Kolmogorov (1903-1987) consists of: A set of outcomes S, e.g., for the roll of a die, S = {1, 2, 3, 4, 5, 6}, 1 1 2 1 6 for the roll
More informationProbability Distributions
Learning Objectives Probability Distributions Section 1: How Can We Summarize Possible Outcomes and Their Probabilities? 1. Random variable 2. Probability distributions for discrete random variables 3.
More informationThe Normal Distribution. Alan T. Arnholt Department of Mathematical Sciences Appalachian State University
The Normal Distribution Alan T. Arnholt Department of Mathematical Sciences Appalachian State University arnholt@math.appstate.edu Spring 2006 R Notes 1 Copyright c 2006 Alan T. Arnholt 2 Continuous Random
More informationChapter 4 Lecture Notes
Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,
More informationMAS108 Probability I
1 QUEEN MARY UNIVERSITY OF LONDON 2:30 pm, Thursday 3 May, 2007 Duration: 2 hours MAS108 Probability I Do not start reading the question paper until you are instructed to by the invigilators. The paper
More informationMath 431 An Introduction to Probability. Final Exam Solutions
Math 43 An Introduction to Probability Final Eam Solutions. A continuous random variable X has cdf a for 0, F () = for 0 <
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special Distributions-VI Today, I am going to introduce
More informationChapter 5. Random variables
Random variables random variable numerical variable whose value is the outcome of some probabilistic experiment; we use uppercase letters, like X, to denote such a variable and lowercase letters, like
More informationNormal distribution. ) 2 /2σ. 2π σ
Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a
More informationStatistics 100A Homework 4 Solutions
Problem 1 For a discrete random variable X, Statistics 100A Homework 4 Solutions Ryan Rosario Note that all of the problems below as you to prove the statement. We are proving the properties of epectation
More informationNormal Approximation. Contents. 1 Normal Approximation. 1.1 Introduction. Anthony Tanbakuchi Department of Mathematics Pima Community College
Introductory Statistics Lectures Normal Approimation To the binomial distribution Department of Mathematics Pima Community College Redistribution of this material is prohibited without written permission
More informationAn Introduction to Basic Statistics and Probability
An Introduction to Basic Statistics and Probability Shenek Heyward NCSU An Introduction to Basic Statistics and Probability p. 1/4 Outline Basic probability concepts Conditional probability Discrete Random
More informationSummary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)
Summary of Formulas and Concepts Descriptive Statistics (Ch. 1-4) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume
More informationMath 151. Rumbos Spring 2014 1. Solutions to Assignment #22
Math 151. Rumbos Spring 2014 1 Solutions to Assignment #22 1. An experiment consists of rolling a die 81 times and computing the average of the numbers on the top face of the die. Estimate the probability
More informationLecture 8: More Continuous Random Variables
Lecture 8: More Continuous Random Variables 26 September 2005 Last time: the eponential. Going from saying the density e λ, to f() λe λ, to the CDF F () e λ. Pictures of the pdf and CDF. Today: the Gaussian
More informationECE302 Spring 2006 HW4 Solutions February 6, 2006 1
ECE302 Spring 2006 HW4 Solutions February 6, 2006 1 Solutions to HW4 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More informationQuestion: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?
ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the
More informationMath 461 Fall 2006 Test 2 Solutions
Math 461 Fall 2006 Test 2 Solutions Total points: 100. Do all questions. Explain all answers. No notes, books, or electronic devices. 1. [105+5 points] Assume X Exponential(λ). Justify the following two
More informationStats on the TI 83 and TI 84 Calculator
Stats on the TI 83 and TI 84 Calculator Entering the sample values STAT button Left bracket { Right bracket } Store (STO) List L1 Comma Enter Example: Sample data are {5, 10, 15, 20} 1. Press 2 ND and
More informationWhat is Statistics? Lecture 1. Introduction and probability review. Idea of parametric inference
0. 1. Introduction and probability review 1.1. What is Statistics? What is Statistics? Lecture 1. Introduction and probability review There are many definitions: I will use A set of principle and procedures
More informationReview of Random Variables
Chapter 1 Review of Random Variables Updated: January 16, 2015 This chapter reviews basic probability concepts that are necessary for the modeling and statistical analysis of financial data. 1.1 Random
More information1.1 Introduction, and Review of Probability Theory... 3. 1.1.1 Random Variable, Range, Types of Random Variables... 3. 1.1.2 CDF, PDF, Quantiles...
MATH4427 Notebook 1 Spring 2016 prepared by Professor Jenny Baglivo c Copyright 2009-2016 by Jenny A. Baglivo. All Rights Reserved. Contents 1 MATH4427 Notebook 1 3 1.1 Introduction, and Review of Probability
More informationLecture 8. Confidence intervals and the central limit theorem
Lecture 8. Confidence intervals and the central limit theorem Mathematical Statistics and Discrete Mathematics November 25th, 2015 1 / 15 Central limit theorem Let X 1, X 2,... X n be a random sample of
More informationJoint Exam 1/P Sample Exam 1
Joint Exam 1/P Sample Exam 1 Take this practice exam under strict exam conditions: Set a timer for 3 hours; Do not stop the timer for restroom breaks; Do not look at your notes. If you believe a question
More informationChapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS. Part 3: Discrete Uniform Distribution Binomial Distribution
Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 3: Discrete Uniform Distribution Binomial Distribution Sections 3-5, 3-6 Special discrete random variable distributions we will cover
More informationIntroduction to Probability
Introduction to Probability EE 179, Lecture 15, Handout #24 Probability theory gives a mathematical characterization for experiments with random outcomes. coin toss life of lightbulb binary data sequence
More information0 x = 0.30 x = 1.10 x = 3.05 x = 4.15 x = 6 0.4 x = 12. f(x) =
. A mail-order computer business has si telephone lines. Let X denote the number of lines in use at a specified time. Suppose the pmf of X is as given in the accompanying table. 0 2 3 4 5 6 p(.0.5.20.25.20.06.04
More informationUNIT I: RANDOM VARIABLES PART- A -TWO MARKS
UNIT I: RANDOM VARIABLES PART- A -TWO MARKS 1. Given the probability density function of a continuous random variable X as follows f(x) = 6x (1-x) 0
More informationCA200 Quantitative Analysis for Business Decisions. File name: CA200_Section_04A_StatisticsIntroduction
CA200 Quantitative Analysis for Business Decisions File name: CA200_Section_04A_StatisticsIntroduction Table of Contents 4. Introduction to Statistics... 1 4.1 Overview... 3 4.2 Discrete or continuous
More informationNotes on Continuous Random Variables
Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes
More informationIEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem
IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem Time on my hands: Coin tosses. Problem Formulation: Suppose that I have
More informationMath 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 2 Solutions
Math 70/408, Spring 2008 Prof. A.J. Hildebrand Actuarial Exam Practice Problem Set 2 Solutions About this problem set: These are problems from Course /P actuarial exams that I have collected over the years,
More informationSTA 130 (Winter 2016): An Introduction to Statistical Reasoning and Data Science
STA 130 (Winter 2016): An Introduction to Statistical Reasoning and Data Science Mondays 2:10 4:00 (GB 220) and Wednesdays 2:10 4:00 (various) Jeffrey Rosenthal Professor of Statistics, University of Toronto
More informationSTT315 Chapter 4 Random Variables & Probability Distributions KM. Chapter 4.5, 6, 8 Probability Distributions for Continuous Random Variables
Chapter 4.5, 6, 8 Probability Distributions for Continuous Random Variables Discrete vs. continuous random variables Examples of continuous distributions o Uniform o Exponential o Normal Recall: A random
More informationExploratory Data Analysis
Exploratory Data Analysis Johannes Schauer johannes.schauer@tugraz.at Institute of Statistics Graz University of Technology Steyrergasse 17/IV, 8010 Graz www.statistics.tugraz.at February 12, 2008 Introduction
More informationProbability Distributions
CHAPTER 6 Probability Distributions Calculator Note 6A: Computing Expected Value, Variance, and Standard Deviation from a Probability Distribution Table Using Lists to Compute Expected Value, Variance,
More information5. Continuous Random Variables
5. Continuous Random Variables Continuous random variables can take any value in an interval. They are used to model physical characteristics such as time, length, position, etc. Examples (i) Let X be
More informationSection 5 Part 2. Probability Distributions for Discrete Random Variables
Section 5 Part 2 Probability Distributions for Discrete Random Variables Review and Overview So far we ve covered the following probability and probability distribution topics Probability rules Probability
More informationWHERE DOES THE 10% CONDITION COME FROM?
1 WHERE DOES THE 10% CONDITION COME FROM? The text has mentioned The 10% Condition (at least) twice so far: p. 407 Bernoulli trials must be independent. If that assumption is violated, it is still okay
More informationChapter 9 Monté Carlo Simulation
MGS 3100 Business Analysis Chapter 9 Monté Carlo What Is? A model/process used to duplicate or mimic the real system Types of Models Physical simulation Computer simulation When to Use (Computer) Models?
More informatione.g. arrival of a customer to a service station or breakdown of a component in some system.
Poisson process Events occur at random instants of time at an average rate of λ events per second. e.g. arrival of a customer to a service station or breakdown of a component in some system. Let N(t) be
More informationThe normal approximation to the binomial
The normal approximation to the binomial The binomial probability function is not useful for calculating probabilities when the number of trials n is large, as it involves multiplying a potentially very
More informationThe normal approximation to the binomial
The normal approximation to the binomial In order for a continuous distribution (like the normal) to be used to approximate a discrete one (like the binomial), a continuity correction should be used. There
More informationThe Math. P (x) = 5! = 1 2 3 4 5 = 120.
The Math Suppose there are n experiments, and the probability that someone gets the right answer on any given experiment is p. So in the first example above, n = 5 and p = 0.2. Let X be the number of correct
More informationProbability and Statistics Vocabulary List (Definitions for Middle School Teachers)
Probability and Statistics Vocabulary List (Definitions for Middle School Teachers) B Bar graph a diagram representing the frequency distribution for nominal or discrete data. It consists of a sequence
More information4.1 4.2 Probability Distribution for Discrete Random Variables
4.1 4.2 Probability Distribution for Discrete Random Variables Key concepts: discrete random variable, probability distribution, expected value, variance, and standard deviation of a discrete random variable.
More information3.4. The Binomial Probability Distribution. Copyright Cengage Learning. All rights reserved.
3.4 The Binomial Probability Distribution Copyright Cengage Learning. All rights reserved. The Binomial Probability Distribution There are many experiments that conform either exactly or approximately
More informationECE302 Spring 2006 HW3 Solutions February 2, 2006 1
ECE302 Spring 2006 HW3 Solutions February 2, 2006 1 Solutions to HW3 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More informationProbability. Distribution. Outline
7 The Normal Probability Distribution Outline 7.1 Properties of the Normal Distribution 7.2 The Standard Normal Distribution 7.3 Applications of the Normal Distribution 7.4 Assessing Normality 7.5 The
More informationOrder Statistics. Lecture 15: Order Statistics. Notation Detour. Order Statistics, cont.
Lecture 5: Statistics 4 Let X, X 2, X 3, X 4, X 5 be iid random variables with a distribution F with a range of a, b). We can relabel these X s such that their labels correspond to arranging them in increasing
More informationWEEK #22: PDFs and CDFs, Measures of Center and Spread
WEEK #22: PDFs and CDFs, Measures of Center and Spread Goals: Explore the effect of independent events in probability calculations. Present a number of ways to represent probability distributions. Textbook
More information6 PROBABILITY GENERATING FUNCTIONS
6 PROBABILITY GENERATING FUNCTIONS Certain derivations presented in this course have been somewhat heavy on algebra. For example, determining the expectation of the Binomial distribution (page 5.1 turned
More informationThe Binomial Probability Distribution
The Binomial Probability Distribution MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2015 Objectives After this lesson we will be able to: determine whether a probability
More information6.4 Normal Distribution
Contents 6.4 Normal Distribution....................... 381 6.4.1 Characteristics of the Normal Distribution....... 381 6.4.2 The Standardized Normal Distribution......... 385 6.4.3 Meaning of Areas under
More informationChapter 5. Discrete Probability Distributions
Chapter 5. Discrete Probability Distributions Chapter Problem: Did Mendel s result from plant hybridization experiments contradicts his theory? 1. Mendel s theory says that when there are two inheritable
More information10.1. Solving Quadratic Equations. Investigation: Rocket Science CONDENSED
CONDENSED L E S S O N 10.1 Solving Quadratic Equations In this lesson you will look at quadratic functions that model projectile motion use tables and graphs to approimate solutions to quadratic equations
More informationThe Exponential Distribution
21 The Exponential Distribution From Discrete-Time to Continuous-Time: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding
More informationECE302 Spring 2006 HW5 Solutions February 21, 2006 1
ECE3 Spring 6 HW5 Solutions February 1, 6 1 Solutions to HW5 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics
More informationRandom variables P(X = 3) = P(X = 3) = 1 8, P(X = 1) = P(X = 1) = 3 8.
Random variables Remark on Notations 1. When X is a number chosen uniformly from a data set, What I call P(X = k) is called Freq[k, X] in the courseware. 2. When X is a random variable, what I call F ()
More informationDef: The standard normal distribution is a normal probability distribution that has a mean of 0 and a standard deviation of 1.
Lecture 6: Chapter 6: Normal Probability Distributions A normal distribution is a continuous probability distribution for a random variable x. The graph of a normal distribution is called the normal curve.
More informationChapter 4. Probability Distributions
Chapter 4 Probability Distributions Lesson 4-1/4-2 Random Variable Probability Distributions This chapter will deal the construction of probability distribution. By combining the methods of descriptive
More informationLOGNORMAL MODEL FOR STOCK PRICES
LOGNORMAL MODEL FOR STOCK PRICES MICHAEL J. SHARPE MATHEMATICS DEPARTMENT, UCSD 1. INTRODUCTION What follows is a simple but important model that will be the basis for a later study of stock prices as
More informationSums of Independent Random Variables
Chapter 7 Sums of Independent Random Variables 7.1 Sums of Discrete Random Variables In this chapter we turn to the important question of determining the distribution of a sum of independent random variables
More informationApproximation of Aggregate Losses Using Simulation
Journal of Mathematics and Statistics 6 (3): 233-239, 2010 ISSN 1549-3644 2010 Science Publications Approimation of Aggregate Losses Using Simulation Mohamed Amraja Mohamed, Ahmad Mahir Razali and Noriszura
More informationExample 1: Dear Abby. Stat Camp for the Full-time MBA Program
Stat Camp for the Full-time MBA Program Daniel Solow Lecture 4 The Normal Distribution and the Central Limit Theorem 188 Example 1: Dear Abby You wrote that a woman is pregnant for 266 days. Who said so?
More informationWEEK #23: Statistics for Spread; Binomial Distribution
WEEK #23: Statistics for Spread; Binomial Distribution Goals: Study measures of central spread, such interquartile range, variance, and standard deviation. Introduce standard distributions, including the
More informationTEACHER NOTES MATH NSPIRED
Math Objectives Students will understand that normal distributions can be used to approximate binomial distributions whenever both np and n(1 p) are sufficiently large. Students will understand that when
More informationStat 20: Intro to Probability and Statistics
Stat 20: Intro to Probability and Statistics Lecture 16: More Box Models Tessa L. Childers-Day UC Berkeley 22 July 2014 By the end of this lecture... You will be able to: Determine what we expect the sum
More informationChapter 3 RANDOM VARIATE GENERATION
Chapter 3 RANDOM VARIATE GENERATION In order to do a Monte Carlo simulation either by hand or by computer, techniques must be developed for generating values of random variables having known distributions.
More informationAMS 5 CHANCE VARIABILITY
AMS 5 CHANCE VARIABILITY The Law of Averages When tossing a fair coin the chances of tails and heads are the same: 50% and 50%. So if the coin is tossed a large number of times, the number of heads and
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationSUNY ECC. ACCUPLACER Preparation Workshop. Algebra Skills
SUNY ECC ACCUPLACER Preparation Workshop Algebra Skills Gail A. Butler Ph.D. Evaluating Algebraic Epressions Substitute the value (#) in place of the letter (variable). Follow order of operations!!! E)
More informationPROBABILITY AND SAMPLING DISTRIBUTIONS
PROBABILITY AND SAMPLING DISTRIBUTIONS SEEMA JAGGI AND P.K. BATRA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi - 0 0 seema@iasri.res.in. Introduction The concept of probability
More informationOverview of Monte Carlo Simulation, Probability Review and Introduction to Matlab
Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab 1 Overview of Monte Carlo Simulation 1.1 Why use simulation?
More informationThe Normal Approximation to Probability Histograms. Dice: Throw a single die twice. The Probability Histogram: Area = Probability. Where are we going?
The Normal Approximation to Probability Histograms Where are we going? Probability histograms The normal approximation to binomial histograms The normal approximation to probability histograms of sums
More informationST 371 (IV): Discrete Random Variables
ST 371 (IV): Discrete Random Variables 1 Random Variables A random variable (rv) is a function that is defined on the sample space of the experiment and that assigns a numerical variable to each possible
More information13.0 Central Limit Theorem
13.0 Central Limit Theorem Discuss Midterm/Answer Questions Box Models Expected Value and Standard Error Central Limit Theorem 1 13.1 Box Models A Box Model describes a process in terms of making repeated
More informationTABLE OF CONTENTS. 4. Daniel Markov 1 173
TABLE OF CONTENTS 1. Survival A. Time of Death for a Person Aged x 1 B. Force of Mortality 7 C. Life Tables and the Deterministic Survivorship Group 19 D. Life Table Characteristics: Expectation of Life
More informationNormal Distribution as an Approximation to the Binomial Distribution
Chapter 1 Student Lecture Notes 1-1 Normal Distribution as an Approximation to the Binomial Distribution : Goals ONE TWO THREE 2 Review Binomial Probability Distribution applies to a discrete random variable
More informationMATH 10: Elementary Statistics and Probability Chapter 5: Continuous Random Variables
MATH 10: Elementary Statistics and Probability Chapter 5: Continuous Random Variables Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides,
More informationLecture Notes 1. Brief Review of Basic Probability
Probability Review Lecture Notes Brief Review of Basic Probability I assume you know basic probability. Chapters -3 are a review. I will assume you have read and understood Chapters -3. Here is a very
More informationBowerman, O'Connell, Aitken Schermer, & Adcock, Business Statistics in Practice, Canadian edition
Bowerman, O'Connell, Aitken Schermer, & Adcock, Business Statistics in Practice, Canadian edition Online Learning Centre Technology Step-by-Step - Excel Microsoft Excel is a spreadsheet software application
More informationMATH BOOK OF PROBLEMS SERIES. New from Pearson Custom Publishing!
MATH BOOK OF PROBLEMS SERIES New from Pearson Custom Publishing! The Math Book of Problems Series is a database of math problems for the following courses: Pre-algebra Algebra Pre-calculus Calculus Statistics
More informationStatistical Distributions in Astronomy
Data Mining In Modern Astronomy Sky Surveys: Statistical Distributions in Astronomy Ching-Wa Yip cwyip@pha.jhu.edu; Bloomberg 518 From Data to Information We don t just want data. We want information from
More informationThe Normal Distribution
Chapter 6 The Normal Distribution 6.1 The Normal Distribution 1 6.1.1 Student Learning Objectives By the end of this chapter, the student should be able to: Recognize the normal probability distribution
More information5/31/2013. 6.1 Normal Distributions. Normal Distributions. Chapter 6. Distribution. The Normal Distribution. Outline. Objectives.
The Normal Distribution C H 6A P T E R The Normal Distribution Outline 6 1 6 2 Applications of the Normal Distribution 6 3 The Central Limit Theorem 6 4 The Normal Approximation to the Binomial Distribution
More informationBinomial Distribution n = 20, p = 0.3
This document will describe how to use R to calculate probabilities associated with common distributions as well as to graph probability distributions. R has a number of built in functions for calculations
More informationNegative Binomial. Paul Johnson and Andrea Vieux. June 10, 2013
Negative Binomial Paul Johnson and Andrea Vieux June, 23 Introduction The Negative Binomial is discrete probability distribution, one that can be used for counts or other integervalued variables. It gives
More informationLecture 6: Discrete & Continuous Probability and Random Variables
Lecture 6: Discrete & Continuous Probability and Random Variables D. Alex Hughes Math Camp September 17, 2015 D. Alex Hughes (Math Camp) Lecture 6: Discrete & Continuous Probability and Random September
More informationTransformations and Expectations of random variables
Transformations and Epectations of random variables X F X (): a random variable X distributed with CDF F X. Any function Y = g(x) is also a random variable. If both X, and Y are continuous random variables,
More informationMath 0980 Chapter Objectives. Chapter 1: Introduction to Algebra: The Integers.
Math 0980 Chapter Objectives Chapter 1: Introduction to Algebra: The Integers. 1. Identify the place value of a digit. 2. Write a number in words or digits. 3. Write positive and negative numbers used
More informationLecture 3: Continuous distributions, expected value & mean, variance, the normal distribution
Lecture 3: Continuous distributions, expected value & mean, variance, the normal distribution 8 October 2007 In this lecture we ll learn the following: 1. how continuous probability distributions differ
More information2 Binomial, Poisson, Normal Distribution
2 Binomial, Poisson, Normal Distribution Binomial Distribution ): We are interested in the number of times an event A occurs in n independent trials. In each trial the event A has the same probability
More informationBNG 202 Biomechanics Lab. Descriptive statistics and probability distributions I
BNG 202 Biomechanics Lab Descriptive statistics and probability distributions I Overview The overall goal of this short course in statistics is to provide an introduction to descriptive and inferential
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More information