Common Probability Distributions. Shyue Ping Ong
|
|
- Tiffany Wilkins
- 7 years ago
- Views:
Transcription
1 Common Probability Distributions Shyue Ping Ong
2 Readings Chapters
3 Overview Discrete Uniform Bernoulli Binomial Geometric Negative Binomial Poisson Continuous Uniform Exponential Normal/Gaussian 3
4 Uniform distribution! # p X (x) = " # $ Uniform Discrete RV 1 for all x in the valid range, where n is the number of possible values n 0 otherwise 1/n comes from the normalization property. Example: Uniform Continuous RV # % f X (x) = $ % & # % F X (x) = $ % &% E[X] = b + a 2 (b a)2 var(x) = 12 1 if a x b b a 0 otherwise 0 if x < a x a if a x b b a 1 if x > b 4
5 Bernoulli Random Variable Used to model one-off probabilistic experiments with only two outcomes Result of a coin toss Medical test result (positive / negative) Status of network link (up / down) p if x = 1 p X (x) = 1 p if x = 0 E[X] = p var(x) = p(1 p) Derivation of E[X] and var(x). 5
6 Binomial Random Variable Random variable defining the number of successes in a sequence of n repetitions of a Bernoulli trial, e.g., number of heads in n tosses of a coin. Denoted as X~B(n, p), where n and p are the parameters specifying the binomial distribution. p X (k) = E[X] = np n k var(x) = np(1 p) pk (1 p) n k where k = 0,1,2,...,n and Derive E[X] and var(x). Hint: How is the binomial RV related to the Bernoilli RV? n k = n! k!(n k)! 6
7 Binomial Distribution for different n and p n = 10 p = 0.5 p = 0.1 n = 100 7
8 Example Samples of 20 parts from a metal punching process are selected every hour. Typically, 1% of the parts require rework. Let X denote the number of parts in the sample of 20 that require rework. A process problem is suspected if X exceeds its mean by more than 3 standard deviations. If the percentage of parts that require rework remains at 1%, what is the probability that X exceeds its mean by more than 3 standard deviations? 8
9 Geometric random variable Random variable defining the number of successive Bernoulli trials before obtaining a successful result, e.g., number of tosses of a coin before resulting in a head. If the probability of success in a Bernoulli trial is p, the PMF is given by k-1 failures Success on k th trial p X (k) = (1 p) k 1 p where k = 1,2,..., p = 0.5 E[X] = 1 p var(x) = 1 p p 2 Proof that p x (k) is a legitimate probability law. 9
10 Negative Binomial Random Variable Random variable describing the number of successes before reach r failures in a sequence of Bernoulli experiments. Number of ways to select x successes out of first x-1+r trials. The final trial is a success by definition. x successes r failures p X (x) = x + r 1 x E[X] = pr 1 r pr var(x) = (1 p) 2 px (1 p) r where x = 0,1,2,3,... r = 3, p =
11 Poisson process Stochastic process that counts the number of events and the time points at which these events occur in a given time interval τ, with the following properties: The probability of more than one event in a subinterval tends to zero. The probability of one event in a subinterval tends to λτ. The event in each subinterval is independent of other subintervals. 11
12 Random variables associated with Poisson process Probability distribution of the number of events N τ in a given subinterval is a discrete Poisson distribution with mean λτ, where λ is known as the rate parameter. p Nτ (k) = e λτ (λτ ) k where k = 0, 1, 2, 3, 4,... k! E[N τ ] = var(n τ ) = λτ Note: A potential source of confusion is that sometimes, λ is denote the mean of the Poisson distribution. In the Poisson process, the variable λ denotes the rate, which is multiplied by the time interval τ to get the average number of events. Probability distribution of the waiting time until the next occurrence is a continuous exponential distribution. #% f T (t) = $ &% λe λt if t 0 0 otherwise 12
13 Poisson random variable Expresses the probability of a given number of events occurring in a fixed interval of time and/or space if these events occur with a known average rate and independently of the time since the last event. Example: If a network receives on average λ packets per hour. If the packets are independent of each other, a reasonable assumption is that the number of pieces of packets received per hour obeys a Poisson distribution. Can also be used for the number of events in other kinds of intervals such as distance, volume, etc. (λτ ) k p X (k) = e λτ where k = 0,1,2,3... k! λτ is the mean and λ is the rate of the process. Proof that p x (k) is a legitimate probability law. 13
14 Poisson distribution for different λ λ = 0.5 λ = 2 λ =10 B(100, 0.1) Poisson distribution is good approximation for B(n, p) when np = λ and n is large and p is small! 14
15 Example Inclusions are defects in poured metal caused by contaminants. The number of (large) inclusions in cast iron follows a Poisson distribution with a mean of 2.5 per cubic millimeter. Determine the following: a) Probability of at least one inclusion in a cubic millimeter. b) Probability of at least four inclusions in 5.0 cubic millimeters. c) Volume of material to inspect such that the probability of at least one inclusion is
16 Exponential distribution " $ f T (t) = # %$ " $ F T (t) = # %$ λe λt if t > 0 0 otherwise 0 if t < 0 1 e λt if t 0 E[T ] = 1 λ var(t ) = 1 λ 2 16
17 Memorylessness The exponential distribution has the property of memorylessness: P(X > x +δ X > x) = P(X > δ) E.g., if X is the waiting time for an event to occur relative to an initial time, memorylessness implies that, if X is conditioned on a failure to observe the event over a initial period of x, the distribution of the remaining waiting time is the same as the original unconditional distribution. 17
18 Random processes in nature The exponential distribution used to model many processes in nature: Radioactive decay Distance between mutations on DNA strands Memorylessness property is particularly useful in modeling failure rates in engineering and manufacturing. 18
19 Relationship between half-life and λ In science, you often encounter the term half-life instead of the rate constant, especially in radioactive decay. Half life is essentially the time at which the cumulative probability of the exponential distribution is exactly 0.5, i.e., a 50% chance of the event occurring within the half-life. For a sizable sample of atoms, that means half the sample would have decayed by that time, hence the origin of the term half-life. The relationship between the half-life and the rate constant can be derived as follows: 19
20 Example Let X denote the time between detections of a particle with a Geiger counter and assume that X has an exponential distribution with E[X] = 60 seconds. i. What is the probability of detecting a particle within 30 seconds of starting the counter? ii. Suppose that we turn on the Geiger counter and wait 2 minutes without detecting a particle. What is the probability that a particle is detected in the next 30 seconds? 20
21 Another example carbon dating All living organisms contains carbon in a constant ratio of C 14 to C 12. due to constant exchange of carbon with the environment. When an organism dies, the C 14 begins to decay with a half-life of 5730 years. By checking the quantity of C 14 in a fossil, we can determine its age, a process known as carbon dating. Consider a fossil specimen that today contains 12g of C 14. It has been estimated that it initially contained 32g of C 14. Estimate its age. 21
22 Normal distribution 22
23 Normal Random Variable Probably the most widely used model for a continuous random variable Also known as the Gaussian distribution or the Bell curve Sample mean for a large number of independent experiments follows a normal distribution (central limit theorem). Arises in the study of numerous basic physical phenomena. E.g., the velocities of gas molecules in thermal equilibrium, position of a diffusing particle, etc. Other random variables with different means and variances can be modeled by normal probability density functions with appropriate choices of the center and width of the curve. Denoted as N(µ, σ 2 ) 1 f Z (z) = σ 2π e (z µ ) 2 2σ 2 E[Z] = µ, var(z) = σ 2 PDF CDF 23
24 Properties of the normal distribution 1. Symmetric Implies that the Normal distribution is not a good model for variables that are inherently skewed, e.g., price of a finanicial derivative. 2. Non-zero over entire real line 3. Preserved under linear transformations, i.e., If X ~ Ν(µ,σ ), then Y = ax + b ~ N(aµ + b, aσ ). This last property is particularly important as it means we only need to know the values for one normal distribution, and we can easily then map all other normal distributions with different means and variances to it. 24
25 The Standard Normal N(0, 1), i.e., the normal distribution with mean 0 and variance 1. PDF: f Z (z) = 1 2π e z 2 2 CDF: Φ(z) = P(Z z) = 1 2π z t 2 2 e dt The CDF cannot be easily written as an algebraic expression. Instead, its values are tabulated in a standard normal table (one is provided in class wiki -> resources, but widely available in different versions on internet). 25
26 Using the standard normal table Let s calculate the following probabilities for a standard normal random variable: i. P(Z<0.25) ii. P(Z>-1.23) iii. iv. P(Z>1) P(-1<Z<1) v. P(-2.25<Z<1.25) For the purposes of these examples, we will only use the table for positive z to illustrate various properties of the standard normal. This is how the tables were provided in the past, though nowadays you can use computers. It is important for you to understand these properties and you should refrain from using computers for solutions (which will not be allowed in the exams). 26
27 Portion of Standard normal table 27
28 The reverse problem How do we compute a Z value given a probability? Find the values of z that have the following probabilities: i. P(Z < z) = 0.95 ii. P(-z < Z < z) =
29 Normal random variables with arbitrary mean and variance We can standardize normal random variables with arbitrary means and variances Consider a normal random variable X with mean µ and variance σ 2. Let us now define a new random variable Z as follows: Z = X µ σ Since this is a linear function, we know Z must be normally distributed with mean: E[Z] = E[X] µ σ = 0 var(z) = var(x) σ 2 =1 i.e., Z has the standard normal distribution! 29
30 Example You are measuring the yield strength of a large number of samples of a form of steel. If the measured yield strength is normally distributed with mean 200 MPa and standard deviation 50 MPa, what is the probability that a random sample chosen has measured yield strength: i. Greater than 300 MPa? ii. Between 100 and 250 MPa? 30
31 Rules of thumb for the Normal distribution ~68% of samples are within one standard deviation from mean ~95% of samples are within two standard deviations from mean 31
32 Using statistical software to compute probabilities Most scientific / statistic software packages contain methods to calculate normal probabilities Python + scipy z µ σ Matlab has a similar function called normcdf, with the same arguments. 32
33 Central limit theorem Let {X 1,, X n } be a random sample of size n of i.i.d. random variables drawn from any distribution of expected value given by µ and finite variance given by σ 2. The sample average is given by: Type equation here. S n = X 1 + X X n n The central limit theorem implies that for sufficient large n, SS n ~ N(µ, σ n ) 1 ~N(μ, σ8 n ) 33
34 Application of Central Limit Theorem Surprisingly general. Only assumptions are independence and finite mean and variance. Implies that the normal distribution is a good model in many science and engineering applications: Independent repeated experiments Noise S S n ~ N(µ, σ 1 ~N(μ, σ8 n ) n ) Variance decreases as n increases, which means with more independent experiments, you become increasingly confident that the measured sample mean is close to the true population mean. 34
35 Example You are conducting nanoindentation experiments to measure the hardness of carbon steel. The steel is known to have a hardness of 80 HV5 (HV5 is the unit of hardness) with a standard deviation of 10 HV5. If you perform 30 experiments on samples of the steel, what is the probability that the average hardness measured differs from the population average by more than 5%? 35
36 Another example You are still performing the nanoindentation experiments. How many experiments do you need to perform to ensure that the probability that your measured sample average differs from the population mean by more than 1% is less than 5%? 36
37 Binomial distribution when n is large Normal distribution can be used to approximate the binomial distribution (a discrete distribution!) when n is large Particularly effective in situations where straightforward computation of the binomial probability is challenging E.g., you are performing high throughput testing on the fracture of a material. Let s say the material fractures with probability p. If you perform tests, when is the probability that there are more than 1000 fractured samples? P(X >1000) = x=1001! # " x $ & p x (1 p) x % 9000 sums (or 1000 sums if you use the complement)! 37
38 Binomial Distribution for different n and p n=10 p = 0.5 p = 0.1 n=100 Normal approximation is valid when np is large. 38
39 de Moivre Laplace approximation If X is a binomial random variable with parameters n and p, the distribution of X can be approximated as: P(X x) P(Z P(X x) P(Z x np np(1 p) ) x 0.5 np np(1 p) ) Mean of B(n,p) Var of B(n,p) The approximation is good for np > 5 and n(1 p) > 5. Continuity corrections 39
40 Example Using the previous example, let s say p=0.095 Side note: You may say, well, I can nowadays compute the binomial probability exactly by writing a short computer program. That is true only up to a certain extent. Computing even the first term! # " $ & % will test the precision limits of most computers! 40
41 Approximating the Poisson distribution Given that we have shown earlier that the Poisson distribution is a good approximation for the binomial distribution when n is large, it follows that the Normal distribution is a good approximation for the Poisson distribution when n is large as well. If X is a Poisson random variable with parameters λ, the distribution of X can be approximated as: P(X x) P(Z x λ λ ) The approximation is good for λ > 5. 41
5. Continuous Random Variables
5. Continuous Random Variables Continuous random variables can take any value in an interval. They are used to model physical characteristics such as time, length, position, etc. Examples (i) Let X be
More informatione.g. arrival of a customer to a service station or breakdown of a component in some system.
Poisson process Events occur at random instants of time at an average rate of λ events per second. e.g. arrival of a customer to a service station or breakdown of a component in some system. Let N(t) be
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationRandom variables, probability distributions, binomial random variable
Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that
More informationImportant Probability Distributions OPRE 6301
Important Probability Distributions OPRE 6301 Important Distributions... Certain probability distributions occur with such regularity in real-life applications that they have been given their own names.
More informationLecture 8. Confidence intervals and the central limit theorem
Lecture 8. Confidence intervals and the central limit theorem Mathematical Statistics and Discrete Mathematics November 25th, 2015 1 / 15 Central limit theorem Let X 1, X 2,... X n be a random sample of
More informationNormal distribution. ) 2 /2σ. 2π σ
Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a
More informationFor a partition B 1,..., B n, where B i B j = for i. A = (A B 1 ) (A B 2 ),..., (A B n ) and thus. P (A) = P (A B i ) = P (A B i )P (B i )
Probability Review 15.075 Cynthia Rudin A probability space, defined by Kolmogorov (1903-1987) consists of: A set of outcomes S, e.g., for the roll of a die, S = {1, 2, 3, 4, 5, 6}, 1 1 2 1 6 for the roll
More informationFEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL
FEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL STATIsTICs 4 IV. RANDOm VECTORs 1. JOINTLY DIsTRIBUTED RANDOm VARIABLEs If are two rom variables defined on the same sample space we define the joint
More information4. Continuous Random Variables, the Pareto and Normal Distributions
4. Continuous Random Variables, the Pareto and Normal Distributions A continuous random variable X can take any value in a given range (e.g. height, weight, age). The distribution of a continuous random
More informationChapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS. Part 3: Discrete Uniform Distribution Binomial Distribution
Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 3: Discrete Uniform Distribution Binomial Distribution Sections 3-5, 3-6 Special discrete random variable distributions we will cover
More informationOverview of Monte Carlo Simulation, Probability Review and Introduction to Matlab
Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab 1 Overview of Monte Carlo Simulation 1.1 Why use simulation?
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special Distributions-VI Today, I am going to introduce
More informationMath 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 2 Solutions
Math 70/408, Spring 2008 Prof. A.J. Hildebrand Actuarial Exam Practice Problem Set 2 Solutions About this problem set: These are problems from Course /P actuarial exams that I have collected over the years,
More informationMath 431 An Introduction to Probability. Final Exam Solutions
Math 43 An Introduction to Probability Final Eam Solutions. A continuous random variable X has cdf a for 0, F () = for 0 <
More informationChapter 5. Random variables
Random variables random variable numerical variable whose value is the outcome of some probabilistic experiment; we use uppercase letters, like X, to denote such a variable and lowercase letters, like
More informationMAS108 Probability I
1 QUEEN MARY UNIVERSITY OF LONDON 2:30 pm, Thursday 3 May, 2007 Duration: 2 hours MAS108 Probability I Do not start reading the question paper until you are instructed to by the invigilators. The paper
More informationWhat is Statistics? Lecture 1. Introduction and probability review. Idea of parametric inference
0. 1. Introduction and probability review 1.1. What is Statistics? What is Statistics? Lecture 1. Introduction and probability review There are many definitions: I will use A set of principle and procedures
More informationIEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem
IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem Time on my hands: Coin tosses. Problem Formulation: Suppose that I have
More information3.4. The Binomial Probability Distribution. Copyright Cengage Learning. All rights reserved.
3.4 The Binomial Probability Distribution Copyright Cengage Learning. All rights reserved. The Binomial Probability Distribution There are many experiments that conform either exactly or approximately
More informationSTAT 315: HOW TO CHOOSE A DISTRIBUTION FOR A RANDOM VARIABLE
STAT 315: HOW TO CHOOSE A DISTRIBUTION FOR A RANDOM VARIABLE TROY BUTLER 1. Random variables and distributions We are often presented with descriptions of problems involving some level of uncertainty about
More informationNotes on Continuous Random Variables
Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes
More informationCHAPTER 6: Continuous Uniform Distribution: 6.1. Definition: The density function of the continuous random variable X on the interval [A, B] is.
Some Continuous Probability Distributions CHAPTER 6: Continuous Uniform Distribution: 6. Definition: The density function of the continuous random variable X on the interval [A, B] is B A A x B f(x; A,
More informationTenth Problem Assignment
EECS 40 Due on April 6, 007 PROBLEM (8 points) Dave is taking a multiple-choice exam. You may assume that the number of questions is infinite. Simultaneously, but independently, his conscious and subconscious
More informationProbability density function : An arbitrary continuous random variable X is similarly described by its probability density function f x = f X
Week 6 notes : Continuous random variables and their probability densities WEEK 6 page 1 uniform, normal, gamma, exponential,chi-squared distributions, normal approx'n to the binomial Uniform [,1] random
More informationLecture 3: Continuous distributions, expected value & mean, variance, the normal distribution
Lecture 3: Continuous distributions, expected value & mean, variance, the normal distribution 8 October 2007 In this lecture we ll learn the following: 1. how continuous probability distributions differ
More informationAn Introduction to Basic Statistics and Probability
An Introduction to Basic Statistics and Probability Shenek Heyward NCSU An Introduction to Basic Statistics and Probability p. 1/4 Outline Basic probability concepts Conditional probability Discrete Random
More informationLecture Notes 1. Brief Review of Basic Probability
Probability Review Lecture Notes Brief Review of Basic Probability I assume you know basic probability. Chapters -3 are a review. I will assume you have read and understood Chapters -3. Here is a very
More informationECE302 Spring 2006 HW4 Solutions February 6, 2006 1
ECE302 Spring 2006 HW4 Solutions February 6, 2006 1 Solutions to HW4 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More informationLecture 7: Continuous Random Variables
Lecture 7: Continuous Random Variables 21 September 2005 1 Our First Continuous Random Variable The back of the lecture hall is roughly 10 meters across. Suppose it were exactly 10 meters, and consider
More information2. Discrete random variables
2. Discrete random variables Statistics and probability: 2-1 If the chance outcome of the experiment is a number, it is called a random variable. Discrete random variable: the possible outcomes can be
More information0 x = 0.30 x = 1.10 x = 3.05 x = 4.15 x = 6 0.4 x = 12. f(x) =
. A mail-order computer business has si telephone lines. Let X denote the number of lines in use at a specified time. Suppose the pmf of X is as given in the accompanying table. 0 2 3 4 5 6 p(.0.5.20.25.20.06.04
More informationUNIT I: RANDOM VARIABLES PART- A -TWO MARKS
UNIT I: RANDOM VARIABLES PART- A -TWO MARKS 1. Given the probability density function of a continuous random variable X as follows f(x) = 6x (1-x) 0
More informationCA200 Quantitative Analysis for Business Decisions. File name: CA200_Section_04A_StatisticsIntroduction
CA200 Quantitative Analysis for Business Decisions File name: CA200_Section_04A_StatisticsIntroduction Table of Contents 4. Introduction to Statistics... 1 4.1 Overview... 3 4.2 Discrete or continuous
More informationSection 5.1 Continuous Random Variables: Introduction
Section 5. Continuous Random Variables: Introduction Not all random variables are discrete. For example:. Waiting times for anything (train, arrival of customer, production of mrna molecule from gene,
More informationStats on the TI 83 and TI 84 Calculator
Stats on the TI 83 and TI 84 Calculator Entering the sample values STAT button Left bracket { Right bracket } Store (STO) List L1 Comma Enter Example: Sample data are {5, 10, 15, 20} 1. Press 2 ND and
More informationStatistics 100A Homework 4 Solutions
Problem 1 For a discrete random variable X, Statistics 100A Homework 4 Solutions Ryan Rosario Note that all of the problems below as you to prove the statement. We are proving the properties of epectation
More informationECE302 Spring 2006 HW3 Solutions February 2, 2006 1
ECE302 Spring 2006 HW3 Solutions February 2, 2006 1 Solutions to HW3 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More information6.041/6.431 Spring 2008 Quiz 2 Wednesday, April 16, 7:30-9:30 PM. SOLUTIONS
6.4/6.43 Spring 28 Quiz 2 Wednesday, April 6, 7:3-9:3 PM. SOLUTIONS Name: Recitation Instructor: TA: 6.4/6.43: Question Part Score Out of 3 all 36 2 a 4 b 5 c 5 d 8 e 5 f 6 3 a 4 b 6 c 6 d 6 e 6 Total
More informationLECTURE 16. Readings: Section 5.1. Lecture outline. Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process
LECTURE 16 Readings: Section 5.1 Lecture outline Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process Number of successes Distribution of interarrival times The
More informationProbability Generating Functions
page 39 Chapter 3 Probability Generating Functions 3 Preamble: Generating Functions Generating functions are widely used in mathematics, and play an important role in probability theory Consider a sequence
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 18. A Brief Introduction to Continuous Probability
CS 7 Discrete Mathematics and Probability Theory Fall 29 Satish Rao, David Tse Note 8 A Brief Introduction to Continuous Probability Up to now we have focused exclusively on discrete probability spaces
More informationREPEATED TRIALS. The probability of winning those k chosen times and losing the other times is then p k q n k.
REPEATED TRIALS Suppose you toss a fair coin one time. Let E be the event that the coin lands heads. We know from basic counting that p(e) = 1 since n(e) = 1 and 2 n(s) = 2. Now suppose we play a game
More informationJoint Exam 1/P Sample Exam 1
Joint Exam 1/P Sample Exam 1 Take this practice exam under strict exam conditions: Set a timer for 3 hours; Do not stop the timer for restroom breaks; Do not look at your notes. If you believe a question
More informationThe Binomial Distribution
The Binomial Distribution James H. Steiger November 10, 00 1 Topics for this Module 1. The Binomial Process. The Binomial Random Variable. The Binomial Distribution (a) Computing the Binomial pdf (b) Computing
More informationSummary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)
Summary of Formulas and Concepts Descriptive Statistics (Ch. 1-4) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume
More informationThe normal approximation to the binomial
The normal approximation to the binomial The binomial probability function is not useful for calculating probabilities when the number of trials n is large, as it involves multiplying a potentially very
More informationIntroduction to Probability
Introduction to Probability EE 179, Lecture 15, Handout #24 Probability theory gives a mathematical characterization for experiments with random outcomes. coin toss life of lightbulb binary data sequence
More informationPROBABILITY AND SAMPLING DISTRIBUTIONS
PROBABILITY AND SAMPLING DISTRIBUTIONS SEEMA JAGGI AND P.K. BATRA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi - 0 0 seema@iasri.res.in. Introduction The concept of probability
More informationLecture 6: Discrete & Continuous Probability and Random Variables
Lecture 6: Discrete & Continuous Probability and Random Variables D. Alex Hughes Math Camp September 17, 2015 D. Alex Hughes (Math Camp) Lecture 6: Discrete & Continuous Probability and Random September
More informationWHERE DOES THE 10% CONDITION COME FROM?
1 WHERE DOES THE 10% CONDITION COME FROM? The text has mentioned The 10% Condition (at least) twice so far: p. 407 Bernoulli trials must be independent. If that assumption is violated, it is still okay
More informationChapter 3 RANDOM VARIATE GENERATION
Chapter 3 RANDOM VARIATE GENERATION In order to do a Monte Carlo simulation either by hand or by computer, techniques must be developed for generating values of random variables having known distributions.
More informationST 371 (IV): Discrete Random Variables
ST 371 (IV): Discrete Random Variables 1 Random Variables A random variable (rv) is a function that is defined on the sample space of the experiment and that assigns a numerical variable to each possible
More informationDefinition: Suppose that two random variables, either continuous or discrete, X and Y have joint density
HW MATH 461/561 Lecture Notes 15 1 Definition: Suppose that two random variables, either continuous or discrete, X and Y have joint density and marginal densities f(x, y), (x, y) Λ X,Y f X (x), x Λ X,
More informationAggregate Loss Models
Aggregate Loss Models Chapter 9 Stat 477 - Loss Models Chapter 9 (Stat 477) Aggregate Loss Models Brian Hartman - BYU 1 / 22 Objectives Objectives Individual risk model Collective risk model Computing
More informationThe normal approximation to the binomial
The normal approximation to the binomial In order for a continuous distribution (like the normal) to be used to approximate a discrete one (like the binomial), a continuity correction should be used. There
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More information6.4 Normal Distribution
Contents 6.4 Normal Distribution....................... 381 6.4.1 Characteristics of the Normal Distribution....... 381 6.4.2 The Standardized Normal Distribution......... 385 6.4.3 Meaning of Areas under
More information1.1 Introduction, and Review of Probability Theory... 3. 1.1.1 Random Variable, Range, Types of Random Variables... 3. 1.1.2 CDF, PDF, Quantiles...
MATH4427 Notebook 1 Spring 2016 prepared by Professor Jenny Baglivo c Copyright 2009-2016 by Jenny A. Baglivo. All Rights Reserved. Contents 1 MATH4427 Notebook 1 3 1.1 Introduction, and Review of Probability
More informationPractice Problems #4
Practice Problems #4 PRACTICE PROBLEMS FOR HOMEWORK 4 (1) Read section 2.5 of the text. (2) Solve the practice problems below. (3) Open Homework Assignment #4, solve the problems, and submit multiple-choice
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationPrinciple of Data Reduction
Chapter 6 Principle of Data Reduction 6.1 Introduction An experimenter uses the information in a sample X 1,..., X n to make inferences about an unknown parameter θ. If the sample size n is large, then
More informationHow To Find Out How Much Money You Get From A Car Insurance Claim
Chapter 11. Poisson processes. Section 11.4. Superposition and decomposition of a Poisson process. Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ 1/18 Superposition
More informationChapter 4. Probability and Probability Distributions
Chapter 4. robability and robability Distributions Importance of Knowing robability To know whether a sample is not identical to the population from which it was selected, it is necessary to assess the
More informationSTRUTS: Statistical Rules of Thumb. Seattle, WA
STRUTS: Statistical Rules of Thumb Gerald van Belle Departments of Environmental Health and Biostatistics University ofwashington Seattle, WA 98195-4691 Steven P. Millard Probability, Statistics and Information
More informationYou flip a fair coin four times, what is the probability that you obtain three heads.
Handout 4: Binomial Distribution Reading Assignment: Chapter 5 In the previous handout, we looked at continuous random variables and calculating probabilities and percentiles for those type of variables.
More informationLecture 10: Depicting Sampling Distributions of a Sample Proportion
Lecture 10: Depicting Sampling Distributions of a Sample Proportion Chapter 5: Probability and Sampling Distributions 2/10/12 Lecture 10 1 Sample Proportion 1 is assigned to population members having a
More informationChapter 4 Lecture Notes
Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,
More informationLecture 2: Discrete Distributions, Normal Distributions. Chapter 1
Lecture 2: Discrete Distributions, Normal Distributions Chapter 1 Reminders Course website: www. stat.purdue.edu/~xuanyaoh/stat350 Office Hour: Mon 3:30-4:30, Wed 4-5 Bring a calculator, and copy Tables
More informationReview of Random Variables
Chapter 1 Review of Random Variables Updated: January 16, 2015 This chapter reviews basic probability concepts that are necessary for the modeling and statistical analysis of financial data. 1.1 Random
More information6.2. Discrete Probability Distributions
6.2. Discrete Probability Distributions Discrete Uniform distribution (diskreetti tasajakauma) A random variable X follows the dicrete uniform distribution on the interval [a, a+1,..., b], if it may attain
More informationMath 461 Fall 2006 Test 2 Solutions
Math 461 Fall 2006 Test 2 Solutions Total points: 100. Do all questions. Explain all answers. No notes, books, or electronic devices. 1. [105+5 points] Assume X Exponential(λ). Justify the following two
More informationE3: PROBABILITY AND STATISTICS lecture notes
E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................
More informationPeople have thought about, and defined, probability in different ways. important to note the consequences of the definition:
PROBABILITY AND LIKELIHOOD, A BRIEF INTRODUCTION IN SUPPORT OF A COURSE ON MOLECULAR EVOLUTION (BIOL 3046) Probability The subject of PROBABILITY is a branch of mathematics dedicated to building models
More information26 Integers: Multiplication, Division, and Order
26 Integers: Multiplication, Division, and Order Integer multiplication and division are extensions of whole number multiplication and division. In multiplying and dividing integers, the one new issue
More informationDETERMINE whether the conditions for a binomial setting are met. COMPUTE and INTERPRET probabilities involving binomial random variables
1 Section 7.B Learning Objectives After this section, you should be able to DETERMINE whether the conditions for a binomial setting are met COMPUTE and INTERPRET probabilities involving binomial random
More informationQuestion: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?
ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the
More informationManual for SOA Exam MLC.
Chapter 5. Life annuities. Extract from: Arcones Manual for the SOA Exam MLC. Spring 2010 Edition. available at http://www.actexmadriver.com/ 1/114 Whole life annuity A whole life annuity is a series of
More informationRandom Variables. Chapter 2. Random Variables 1
Random Variables Chapter 2 Random Variables 1 Roulette and Random Variables A Roulette wheel has 38 pockets. 18 of them are red and 18 are black; these are numbered from 1 to 36. The two remaining pockets
More informationProbability Distributions
Learning Objectives Probability Distributions Section 1: How Can We Summarize Possible Outcomes and Their Probabilities? 1. Random variable 2. Probability distributions for discrete random variables 3.
More informationMath/Stats 342: Solutions to Homework
Math/Stats 342: Solutions to Homework Steven Miller (sjm1@williams.edu) November 17, 2011 Abstract Below are solutions / sketches of solutions to the homework problems from Math/Stats 342: Probability
More informationBinomial lattice model for stock prices
Copyright c 2007 by Karl Sigman Binomial lattice model for stock prices Here we model the price of a stock in discrete time by a Markov chain of the recursive form S n+ S n Y n+, n 0, where the {Y i }
More information2 Binomial, Poisson, Normal Distribution
2 Binomial, Poisson, Normal Distribution Binomial Distribution ): We are interested in the number of times an event A occurs in n independent trials. In each trial the event A has the same probability
More informationManual for SOA Exam MLC.
Chapter 4. Life Insurance. c 29. Miguel A. Arcones. All rights reserved. Extract from: Arcones Manual for the SOA Exam MLC. Fall 29 Edition. available at http://www.actexmadriver.com/ c 29. Miguel A. Arcones.
More information8. THE NORMAL DISTRIBUTION
8. THE NORMAL DISTRIBUTION The normal distribution with mean μ and variance σ 2 has the following density function: The normal distribution is sometimes called a Gaussian Distribution, after its inventor,
More information1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let
Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as
More informationThe Exponential Distribution
21 The Exponential Distribution From Discrete-Time to Continuous-Time: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding
More informationAachen Summer Simulation Seminar 2014
Aachen Summer Simulation Seminar 2014 Lecture 07 Input Modelling + Experimentation + Output Analysis Peer-Olaf Siebers pos@cs.nott.ac.uk Motivation 1. Input modelling Improve the understanding about how
More informationApplied Reliability ------------------------------------------------------------------------------------------------------------ Applied Reliability
Applied Reliability Techniques for Reliability Analysis with Applied Reliability Tools (ART) (an EXCEL Add-In) and JMP Software AM216 Class 6 Notes Santa Clara University Copyright David C. Trindade, Ph.
More informationPart 2: One-parameter models
Part 2: One-parameter models Bernoilli/binomial models Return to iid Y 1,...,Y n Bin(1, θ). The sampling model/likelihood is p(y 1,...,y n θ) =θ P y i (1 θ) n P y i When combined with a prior p(θ), Bayes
More informationChapter 4 - Lecture 1 Probability Density Functions and Cumul. Distribution Functions
Chapter 4 - Lecture 1 Probability Density Functions and Cumulative Distribution Functions October 21st, 2009 Review Probability distribution function Useful results Relationship between the pdf and the
More informationSection 5 Part 2. Probability Distributions for Discrete Random Variables
Section 5 Part 2 Probability Distributions for Discrete Random Variables Review and Overview So far we ve covered the following probability and probability distribution topics Probability rules Probability
More informationPractice Problems for Homework #6. Normal distribution and Central Limit Theorem.
Practice Problems for Homework #6. Normal distribution and Central Limit Theorem. 1. Read Section 3.4.6 about the Normal distribution and Section 4.7 about the Central Limit Theorem. 2. Solve the practice
More informationLecture 5 : The Poisson Distribution
Lecture 5 : The Poisson Distribution Jonathan Marchini November 10, 2008 1 Introduction Many experimental situations occur in which we observe the counts of events within a set unit of time, area, volume,
More informationStat 704 Data Analysis I Probability Review
1 / 30 Stat 704 Data Analysis I Probability Review Timothy Hanson Department of Statistics, University of South Carolina Course information 2 / 30 Logistics: Tuesday/Thursday 11:40am to 12:55pm in LeConte
More information2WB05 Simulation Lecture 8: Generating random variables
2WB05 Simulation Lecture 8: Generating random variables Marko Boon http://www.win.tue.nl/courses/2wb05 January 7, 2013 Outline 2/36 1. How do we generate random variables? 2. Fitting distributions Generating
More informationChapter 9 Monté Carlo Simulation
MGS 3100 Business Analysis Chapter 9 Monté Carlo What Is? A model/process used to duplicate or mimic the real system Types of Models Physical simulation Computer simulation When to Use (Computer) Models?
More informationExample: 1. You have observed that the number of hits to your web site follow a Poisson distribution at a rate of 2 per day.
16 The Exponential Distribution Example: 1. You have observed that the number of hits to your web site follow a Poisson distribution at a rate of 2 per day. Let T be the time (in days) between hits. 2.
More informationThe Binomial Probability Distribution
The Binomial Probability Distribution MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2015 Objectives After this lesson we will be able to: determine whether a probability
More informationMath 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 5 Solutions
Math 370/408, Spring 2008 Prof. A.J. Hildebrand Actuarial Exam Practice Problem Set 5 Solutions About this problem set: These are problems from Course 1/P actuarial exams that I have collected over the
More information