# Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab

Save this PDF as:

Size: px
Start display at page:

Download "Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab"

## Transcription

1 Lecture 2 Probability BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab Sample Spaces and Events Random Experiment and Sample Space Definition 1 (Random Experiment). An experiment that can result in different outcomes, even though it is repeated in the same manner every time, is called a random experiment. Definition 2 (Sample Space). The set of all possible outcomes of a random experiment is called the sample space of the experiment. The sample space is denoted as S (or Ω). 2.2 Sample Spaces: Tossing Coin Example 3 (Coin Tossing Once). A coin is tossed once. Then S = {H,T }, where H stands for head and T for tail. Example 4 (Coin Tossing Twice). If the same coin is tossed twice, then S = {HH,HT,T H,T T }. Example 5 (Coin Tossing Twice). If we are interested in the number of heads occurring, then S = {0, 1, 2}. 2.3 Sample Space: Drawing Cards Example 6 (Drawing cards from a Bridge Deck). A card is drawn from a well shuffled bridge deck. The possible sample spaces are as follows: the set of suit S 1 = {C,D,H,S} the set of denomination S 2 = {A,2,3,...,J,Q,K} the set of 52 points S 3 = {AC,2C,...,KC,...,AS,...,KS} Note: Club (C), Diamond (D), Heart (H) and Spade (S)

2 Probability and Statistics 2/10 Fall, 2014 Sample Spaces: Discrete and Continuous Definition 7 (Discrete Sample Space). A sample space S is said to be discrete if it contains at most countable number of elements. Definition 8 (Continuous Sample Space). A sample space S is said to be continuous if its elements constitute a continuum: all points in an interval, or all points in the plane, or all points in the k-dimensional space, and so on. 2.5 Continuous Sample Spaces: Choosing a Point Example 9 (From an Interval). A point is chosen form the interval [0,1]. The sample space is S = {x : 0 x 1} and contains an uncountable number of points. Example 10 (From a Region). If a point is chosen form the square bounded by points (0,0),(1,0),(0,1) and (1,1), then the sample space S = {(x,y) : 0 x 1,0 y 1}. Note that this space is also uncountable. 2.6 Sample Spaces: Life Length of a Light Bulb Example 11 (Continuous Sample Space). The time until failure of a light bulb manufactured at certain plant is recorded. One can simply takes which is a continuous sample space. S = {t : t 0}, Example 12 (Discrete Sample Space). If the time is recorded to the nearest hour, then S = {0,1,2,...}, which is a discrete sample space. Note that the type of a sample space is subject to how the measurement is interpreted. 2.7 Events Definition 13 (Event). An event is a set of outcomes and hence a subset of the sample space of a random experiment. The empty set, denoted by /0, and S are also subsets (i.e. events). Events are denoted by the capital letters, like A,B,C,... Definition 14 (Mutually Exclusion). Two events, denoted as A and B, such that A B = /0 are said to be mutually exclusive (or disjoint). 2.8

3 (A B) = A B 2.11 Probability and Statistics 3/10 Fall, 2014 Events: Birth Month Example 15. Which month does a person s birthday fall? An obvious choice for the sample space is S = {Jan,Feb,Mar,Apr,May,Jun,Jul,Aug,Sep,Oct,Nov,Dec} Example 16. The outcomes correspond to a long month, i.e., a month with 31 days. This is the event L = {Jan,Mar,May,Jul,Aug,Oct,Dec}. 2.9 Events: Birth Month (Cont d) Example 17. For example, R is the event that corresponds to the months that have the letter r in their (full) name R = {Jan,Feb,Mar,Apr,Sep,Oct,Nov,Dec}. Example 18. The long months that contain the letter r are L R = {Jan,Mar,Oct,Dec}. The set L R is called the intersection of L and R and occurs if both L and R occur. This is also an event!! 2.10 Intersection, Union, Complement Some of the basic set operations are summarized below in terms of events: The union of two events is the event that consists of all outcomes that are contained in either of the two events, denoted by A B. The intersection of two events is the event that consists of all outcomes that are contained in both of the two events, denoted by A B. The complement of an event E in a sample space is the set of outcomes in the sample space that are not in the event, denoted by E or E c. Theorem 19 (DeMorgan s laws). For any two events A and B we have (A B) = A B 2 Probability Axioms of Probability Definition 20 (Axioms of Probability). Probability is a number that is assigned to each member of a collection of events from a random experiment that satisfies the following properties: If S is the sample space and E is any event in a random experiment, 1. P(S) = P(E) 1 3. For two events E 1 and E 2 with E 1 E 2 = /0 P(E 1 E 2 ) = P(E 1 ) + P(E 2 ) 2.12

4 Probability and Statistics 4/10 Fall, 2014 Probability and Set Operations P(A B) = P(A) + P(B) P(A B) P(A B) P(A) + P(B) P( n i=1 A i) = P( n i=1 A i) n i=1 n + i< j<k 3 + P(A i ) n i< j 2 P(A i A j ) P(A i A j A k ) +( 1) n 1 P(A 1 A 2 A n ) n i=1 P(A i ) Review the textbook for more details about set operations Advanced and Optional Topic Definition 21 (Sigma Field). A class (or collection) ξ of subsets of S is said to be a sigma field (σ-field), if it satisfies the following properties: 1. S ξ, 2. if E ξ, then E c ξ (or E ξ ), 3. (closure under countable union) if E 1,E 2,... ξ, then i=1 E i ξ, 4. (closure under countable intersection) if E 1,E 2,... ξ, then i=1 E i ξ, Ex. (Coin Tossing Once) A coin is tossed once with sample space S = {H,T }. A σ-field associated with S can be defined as follows: ξ = {S, /0,{H},{T }} 2.14 Advanced and Optional Topic Definition 22 (Axioms of Probability). Let S be a set of outcomes and ξ be the associated collection of events. A set function P defined on ξ is called a probability if the following axioms are satisfied: Axiom I. 0 P(E) 1, E ξ, Axiom II. P(S) = 1, Axiom III. if {E i } is a sequence of mutually exclusive events (E i E j = /0 for i j), then P( i=1e i ) = i=1 P(E i ). Note that this is a formal definition of probability Example: Coin Tossing Example 23. A coin is tossed and the up face is record. Sol. The sample sample S = {H,T }, The σ-field ξ = {S, /0,{H},{T }}. The probability is defined as P(H) = p = 1 P(T ),0 p 1. If the coin is fair, p =

5 Probability and Statistics 5/10 Fall, 2014 Example: Rolling a Pair of Dice Example 24. Suppose that a pair of fair dice is rolled. The random experiment has 36 outcomes. The sample space is S = {(i, j), i = 1,...,6, j = 1,...,6} Since the dice are fair, all pairs are equally likely and P(i, j) = 1, i, j. 36 What is the probability that the sum of face values is at least 5? 2.17 Example: Rolling a Pair of Dice (Cont d) Axioms of Probability P{(i, j) : i + j 5, i, j [1,2,3,4,5,6]} = 1 P{(i, j) : i + j 4, i, j [1,2,3,4,5,6]} = 1 P{(1,1),(1,2),(1,3),(2,1),(2,2),(3,1)} = = 1 6 Proposition 1. For the empty set /0, P(/0) = 0. Proof. If S is the sample space and E is any event in a random experiment, since /0 /0 = /0 and /0 /0 = /0, it follows from the Axiom III that Hence, P(/0) = 0. Axioms of Probability P(/0) = P(/0 /0) = P(/0) + P(/0) = 2P(/0). Proposition 2. For any event, P(E ) = 1 P(E). Proof. Since E E = /0 and E E = S, it follows from the Axiom II and III that Hence, P(E ) = 1 P(E). P(S) = 1 = P(E E = S) = P(E) + P(E ) Conditional and Total Probability Conditional Probability Definition 25. The conditional probability of an event B given an event A, denoted as P(B A), is P(B A) = P(A B)/P(A), A > 0 (1) Theorem 26 (Multiplication Rule). P(A B) = P(A B)P(B) = P(B A)P(A) (2) 2.21

6 Probability and Statistics 6/10 Fall, 2014 Example: Conditional Probability Example 27 (Coin Tossing). Consider three independent tossings of a fair coin. Let X be the number of heads and Y be the number of tails before the first head. Y \X htt hth, hht hhh 1 0 tht thh tth ttt Y \X P(Y = y) 0 0 1/8 2/8 1/8 4/ /8 1/8 0 2/ / /8 3 1/ /8 P(X = x) 1/8 3/8 3/8 1/ Example: Conditional Probability Let us compute the conditional distribution of X given Y = y, y = 0, 1, 2, 3. 1/4, x = 1,3 P(X = x Y = 0) = 1/2, x = 2 0, otherwise { P(X = x Y = 1) = 0, { 1/2, x = 1,2 otherwise P(X = x Y = 2) = 0, { 1, x = 1 otherwise P(X = x Y = 3) = 1, x = 0 0, otherwise 2.23 Example: Conditional Probability Example 28. A day s production of 850 parts contains 50 parts that do not meet customer requirements. Two parts are selected randomly without replacement from the batch. What is the probability that the second part is defective given that the first part is defective? Let A denote the event that the first part selected is defective, P(A) = Let B denote the event that the second part selected is defective, P(B A) = What is the probability that first and second selected parts are both defective, P(A B) = P(B A)P(A) =

7 Probability and Statistics 7/10 Fall, 2014 Example: Multiplication Rule Example 29. The probability that the first stage of machining operation meets specification is Failures are due to metal vibrations, fixture alignment, blade condition, etc. Given that the first stage meets specifications, the second stage of machining meets specification is What is the probability that both stages meet specifications? Let A and B denote the events that the first and second stages meet specifications, respectively. P(A) = 0.90 and P(B A) = The probability that both stages meet specifications: P(A B) = P(B A)P(A) = = Total Probability Theorem 30 (Total Probability). For any events A and B, P(B) = P(B A) + P(B A ) = P(B A)P(A) + P(B A )P(A ) (3) Theorem 31 (Total Probability). Assume A 1,A 2,...,A k are k mutually exclusive and exhaustive sets (i.e., k i=1 A i = S). Then P(B) = P(B A 1 ) + P(B A 2 ) + + P(B A k ) = P(B A 1 )P(A 1 ) + + P(B A k )P(A k ) (4) 2.26 Example: Total Probability Rule Example 32. In semiconductor manufacturing, the probability is 0.1 that a chip subject to high levels of contamination causes a product failure. The probability is that a chip subject to low (not high) levels of contamination causes a product failure. In a particular production run, 20% of the chips are subject to high levels of contamination. What is the probability that a product using one of these chips fails? Prob. of Failure Level of Contam. Prob. of Level 0.1 High Low (not High) 0.8 Example: Total Probability Rule Let F denote the event that the product fails, and H denote the event that the chip is exposed to high level of contamination. Then Prob. of Failure Prob. of Level P(F H) = 0.1 P(H) = 0.2 P(F H ) = P(H ) = 0.8 The probability that a product using one of these chips fails is P(F) = P(F H)P(H) + P(F H )P(H ) = =

8 Probability and Statistics 8/10 Fall, Independence Independence Definition 33 (Independence). Two events are independent if any one of the following equivalent statements is true: (1) P(A B) = P(A) (2) P(B A) = P(B) (3) P(A B) = P(A)P(B) (5) Definition 34 (Independence of Multiple Events). The events E 1,E 2,...,E n are independent if and only if for any subset of these events E i1,e i2,...,e ik, P(E i1 E i2...e ik ) = P(E i1 ) P(E i2 ) P(E ik ) (6) 2.29 Example: Independence Example 35. A day s production of 850 parts contains 50 parts that do not meet customer requirements. Two parts are selected randomly with replacement from the batch. What is the probability that the second part is defective (event B) given that the first part is defective (event A)? The probability that the first part is defective, is P(A) = The probability of B does not depend on whether or not the part was defective, P(B A) = P(B) = What is the probability that first and second selected parts are both defective, P(A B) = P(B A)P(A) = = Bayes Theorem Bayes Theorem Theorem 36 (Bayes Theorem). P(A B) = P(B A)P(A), P(B) > 0 (7) P(B) Theorem 37 (Bayes Theorem). If E 1,E 2,...,E k are k mutually exclusive and exhaustive events and B is any event, P(E 1 B) = P(B E 1)P(E 1 ) k i=1 P(B E i)p(e i ), P(B) > 0 (8) 2.31

9 Probability and Statistics 9/10 Fall, 2014 Medical Diagnostic Example 38. The probability that the test correctly identifies someone with the illness as positive is The probability that the test correctly identifies someone without the illness as negative is The incidence of the illness in the general population is You take the test, and the result is positive. What is the probability that you have the illness? Let D denote the event that you have illness, and P(D) = The probability that you are healthy (no illness) is P(D ) = 1 P(D). Let S denote the event that the test signal positive, P(S D) = The probability that the test correctly identifies someone without the illness as negative is P(S D ) = Medical Diagnostic The probability that the test falsely identifies someone without the illness as positive is P(S D ) = 1 P(S D ) = When the test result is positive, the probability that you have the illness is P(D S): P(D S) = P(D S)/P(S) = P(D S)/ [ P(S D) + P(S D ) ] = P(S D)P(D)/ [ P(S D)P(D) + P(S D )P(D ) ] = /[ ] = The probability of having the illness given a positive result from the test is only Reliability Analysis Example 39. A system contains two components, A and B, connected in series as shown in the following diagram. The system will function only if both components function. The probability that A functions is given by P(A) = 0.98, and the probability that B functions is given by P(B) = Assume that A and B function independently. Find the probability that the system functions. Since the system will function only if both components function, it follows that P(system functions) = P(A B) = P(A) P(B) = =

10 Probability and Statistics 10/10 Fall, 2014 Reliability Analysis Example 40. A system contains two components, C and D, connected in parallel as shown in the following diagram. The system will function if either C or D functions. The probability that C functions is 0.90, and the probability that D functions is Assume C and D function independently. Find the probability that the system functions. Since the system will function so long as either of the two components functions, it follows that P(system functions) = P(C D) = P(C) + P(D) P(C D) = P(C) + P(D) P(C) P(D) = =

### Definition and Calculus of Probability

In experiments with multivariate outcome variable, knowledge of the value of one variable may help predict another. For now, the word prediction will mean update the probabilities of events regarding the

### Lesson 1. Basics of Probability. Principles of Mathematics 12: Explained! www.math12.com 314

Lesson 1 Basics of Probability www.math12.com 314 Sample Spaces: Probability Lesson 1 Part I: Basic Elements of Probability Consider the following situation: A six sided die is rolled The sample space

### Math/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability

Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock

### I. WHAT IS PROBABILITY?

C HAPTER 3 PROBABILITY Random Experiments I. WHAT IS PROBABILITY? The weatherman on 0 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

### Lecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett

Lecture Note 1 Set and Probability Theory MIT 14.30 Spring 2006 Herman Bennett 1 Set Theory 1.1 Definitions and Theorems 1. Experiment: any action or process whose outcome is subject to uncertainty. 2.

### PROBABILITY. The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE

PROBABILITY 53 Chapter 3 PROBABILITY The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE 3. Introduction In earlier Classes, we have studied the probability as

### Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments

### V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPETED VALUE A game of chance featured at an amusement park is played as follows: You pay \$ to play. A penny and a nickel are flipped. You win \$ if either

### ECE302 Spring 2006 HW1 Solutions January 16, 2006 1

ECE302 Spring 2006 HW1 Solutions January 16, 2006 1 Solutions to HW1 Note: These solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics

### Probability OPRE 6301

Probability OPRE 6301 Random Experiment... Recall that our eventual goal in this course is to go from the random sample to the population. The theory that allows for this transition is the theory of probability.

### Worked examples Basic Concepts of Probability Theory

Worked examples Basic Concepts of Probability Theory Example 1 A regular tetrahedron is a body that has four faces and, if is tossed, the probability that it lands on any face is 1/4. Suppose that one

### + Section 6.2 and 6.3

Section 6.2 and 6.3 Learning Objectives After this section, you should be able to DEFINE and APPLY basic rules of probability CONSTRUCT Venn diagrams and DETERMINE probabilities DETERMINE probabilities

### Chapter 4 Probability

The Big Picture of Statistics Chapter 4 Probability Section 4-2: Fundamentals Section 4-3: Addition Rule Sections 4-4, 4-5: Multiplication Rule Section 4-7: Counting (next time) 2 What is probability?

### Chapter 4 & 5 practice set. The actual exam is not multiple choice nor does it contain like questions.

Chapter 4 & 5 practice set. The actual exam is not multiple choice nor does it contain like questions. MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

### Chapter 4 - Practice Problems 1

Chapter 4 - Practice Problems SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Provide an appropriate response. ) Compare the relative frequency formula

### Chapter 3: The basic concepts of probability

Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording

### Chapter 6. 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? Ans: 4/52.

Chapter 6 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? 4/52. 2. What is the probability that a randomly selected integer chosen from the first 100 positive

### Probability. A random sample is selected in such a way that every different sample of size n has an equal chance of selection.

1 3.1 Sample Spaces and Tree Diagrams Probability This section introduces terminology and some techniques which will eventually lead us to the basic concept of the probability of an event. The Rare Event

### Bayesian Tutorial (Sheet Updated 20 March)

Bayesian Tutorial (Sheet Updated 20 March) Practice Questions (for discussing in Class) Week starting 21 March 2016 1. What is the probability that the total of two dice will be greater than 8, given that

### Probability distributions

Probability distributions (Notes are heavily adapted from Harnett, Ch. 3; Hayes, sections 2.14-2.19; see also Hayes, Appendix B.) I. Random variables (in general) A. So far we have focused on single events,

### Statistics in Geophysics: Introduction and Probability Theory

Statistics in Geophysics: Introduction and Steffen Unkel Department of Statistics Ludwig-Maximilians-University Munich, Germany Winter Term 2013/14 1/32 What is Statistics? Introduction Statistics is the

### Probability for Estimation (review)

Probability for Estimation (review) In general, we want to develop an estimator for systems of the form: x = f x, u + η(t); y = h x + ω(t); ggggg y, ffff x We will primarily focus on discrete time linear

### Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom

Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of sample space, event and probability function. 2. Be able to

### IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION 1 WHAT IS STATISTICS? Statistics is a science of collecting data, organizing and describing it and drawing conclusions from it. That is, statistics

### Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?

ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the

### Random variables, probability distributions, binomial random variable

Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that

### Math 141. Lecture 2: More Probability! Albyn Jones 1. jones@reed.edu www.people.reed.edu/ jones/courses/141. 1 Library 304. Albyn Jones Math 141

Math 141 Lecture 2: More Probability! Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Outline Law of total probability Bayes Theorem the Multiplication Rule, again Recall

### Basic Probability Theory (I)

Basic Probability Theory (I) Intro to Bayesian Data Analysis & Cognitive Modeling Adrian Brasoveanu [partly based on slides by Sharon Goldwater & Frank Keller and John K. Kruschke] Fall 2012 UCSC Linguistics

### Sample Space and Probability

1 Sample Space and Probability Contents 1.1. Sets........................... p. 3 1.2. Probabilistic Models.................... p. 6 1.3. Conditional Probability................. p. 18 1.4. Total Probability

### The Calculus of Probability

The Calculus of Probability Let A and B be events in a sample space S. Partition rule: P(A) = P(A B) + P(A B ) Example: Roll a pair of fair dice P(Total of 10) = P(Total of 10 and double) + P(Total of

### Probability Theory on Coin Toss Space

Probability Theory on Coin Toss Space 1 Finite Probability Spaces 2 Random Variables, Distributions, and Expectations 3 Conditional Expectations Probability Theory on Coin Toss Space 1 Finite Probability

### Homework 8 Solutions

CSE 21 - Winter 2014 Homework Homework 8 Solutions 1 Of 330 male and 270 female employees at the Flagstaff Mall, 210 of the men and 180 of the women are on flex-time (flexible working hours). Given that

### Probability & Probability Distributions

Probability & Probability Distributions Carolyn J. Anderson EdPsych 580 Fall 2005 Probability & Probability Distributions p. 1/61 Probability & Probability Distributions Elementary Probability Theory Definitions

### STATISTICS HIGHER SECONDARY - SECOND YEAR. Untouchability is a sin Untouchability is a crime Untouchability is inhuman

STATISTICS HIGHER SECONDARY - SECOND YEAR Untouchability is a sin Untouchability is a crime Untouchability is inhuman TAMILNADU TEXTBOOK CORPORATION College Road, Chennai- 600 006 i Government of Tamilnadu

### Statistical Inference. Prof. Kate Calder. If the coin is fair (chance of heads = chance of tails) then

Probability Statistical Inference Question: How often would this method give the correct answer if I used it many times? Answer: Use laws of probability. 1 Example: Tossing a coin If the coin is fair (chance

### The Central Limit Theorem Part 1

The Central Limit Theorem Part. Introduction: Let s pose the following question. Imagine you were to flip 400 coins. To each coin flip assign if the outcome is heads and 0 if the outcome is tails. Question:

### STAT 319 Probability and Statistics For Engineers PROBABILITY. Engineering College, Hail University, Saudi Arabia

STAT 319 robability and Statistics For Engineers LECTURE 03 ROAILITY Engineering College, Hail University, Saudi Arabia Overview robability is the study of random events. The probability, or chance, that

### Chapter 4 - Practice Problems 2

Chapter - Practice Problems 2 MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Find the indicated probability. 1) If you flip a coin three times, the

### Probability --QUESTIONS-- Principles of Math 12 - Probability Practice Exam 1 www.math12.com

Probability --QUESTIONS-- Principles of Math - Probability Practice Exam www.math.com Principles of Math : Probability Practice Exam Use this sheet to record your answers:... 4... 4... 4.. 6. 4.. 6. 7..

### 6. Jointly Distributed Random Variables

6. Jointly Distributed Random Variables We are often interested in the relationship between two or more random variables. Example: A randomly chosen person may be a smoker and/or may get cancer. Definition.

### Introduction to Probability

3 Introduction to Probability Given a fair coin, what can we expect to be the frequency of tails in a sequence of 10 coin tosses? Tossing a coin is an example of a chance experiment, namely a process which

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

### Basic Probability. Probability: The part of Mathematics devoted to quantify uncertainty

AMS 5 PROBABILITY Basic Probability Probability: The part of Mathematics devoted to quantify uncertainty Frequency Theory Bayesian Theory Game: Playing Backgammon. The chance of getting (6,6) is 1/36.

### Math 141. Lecture 3: The Binomial Distribution. Albyn Jones 1. 1 Library 304. jones/courses/141

Math 141 Lecture 3: The Binomial Distribution Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Outline Coin Tossing Coin Tosses Independent Coin Tosses Crucial Features

### Summary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)

Summary of Formulas and Concepts Descriptive Statistics (Ch. 1-4) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume

### Introduction to probability theory in the Discrete Mathematics course

Introduction to probability theory in the Discrete Mathematics course Jiří Matoušek (KAM MFF UK) Version: Oct/18/2013 Introduction This detailed syllabus contains definitions, statements of the main results

### Chapter 4 Lecture Notes

Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,

### Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber 2011 1

Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2011 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields

### MCA SEMESTER - II PROBABILITY & STATISTICS

MCA SEMESTER - II PROBABILITY & STATISTICS mca-5 230 PROBABILITY 1 INTRODUCTION TO PROBABILITY Managers need to cope with uncertainty in many decision making situations. For example, you as a manager may

### 4.1 4.2 Probability Distribution for Discrete Random Variables

4.1 4.2 Probability Distribution for Discrete Random Variables Key concepts: discrete random variable, probability distribution, expected value, variance, and standard deviation of a discrete random variable.

### E3: PROBABILITY AND STATISTICS lecture notes

E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................

### Basic concepts in probability. Sue Gordon

Mathematics Learning Centre Basic concepts in probability Sue Gordon c 2005 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Set Notation You may omit this section if you are

### Probability definitions

Probability definitions 1. Probability of an event = chance that the event will occur. 2. Experiment = any action or process that generates observations. In some contexts, we speak of a data-generating

### Probabilities. Probability of a event. From Random Variables to Events. From Random Variables to Events. Probability Theory I

Victor Adamchi Danny Sleator Great Theoretical Ideas In Computer Science Probability Theory I CS 5-25 Spring 200 Lecture Feb. 6, 200 Carnegie Mellon University We will consider chance experiments with

### The study of probability has increased in popularity over the years because of its wide range of practical applications.

6.7. Probability. The study of probability has increased in popularity over the years because of its wide range of practical applications. In probability, each repetition of an experiment is called a trial,

### Notes on Probability. Peter J. Cameron

Notes on Probability Peter J. Cameron ii Preface Here are the course lecture notes for the course MAS108, Probability I, at Queen Mary, University of London, taken by most Mathematics students and some

### A Few Basics of Probability

A Few Basics of Probability Philosophy 57 Spring, 2004 1 Introduction This handout distinguishes between inductive and deductive logic, and then introduces probability, a concept essential to the study

### 3. Discrete Probability. CSE 312 Autumn 2011 W.L. Ruzzo

3. Discrete Probability CSE 312 Autumn 2011 W.L. Ruzzo sample spaces Sample space: S is the set of all possible outcomes of an experiment (Ω in your text book Greek uppercase omega) Coin flip: S = {Heads,

### Math 3C Homework 3 Solutions

Math 3C Homework 3 s Ilhwan Jo and Akemi Kashiwada ilhwanjo@math.ucla.edu, akashiwada@ucla.edu Assignment: Section 2.3 Problems 2, 7, 8, 9,, 3, 5, 8, 2, 22, 29, 3, 32 2. You draw three cards from a standard

### Random variables P(X = 3) = P(X = 3) = 1 8, P(X = 1) = P(X = 1) = 3 8.

Random variables Remark on Notations 1. When X is a number chosen uniformly from a data set, What I call P(X = k) is called Freq[k, X] in the courseware. 2. When X is a random variable, what I call F ()

### Examination 110 Probability and Statistics Examination

Examination 0 Probability and Statistics Examination Sample Examination Questions The Probability and Statistics Examination consists of 5 multiple-choice test questions. The test is a three-hour examination

### CONTINGENCY (CROSS- TABULATION) TABLES

CONTINGENCY (CROSS- TABULATION) TABLES Presents counts of two or more variables A 1 A 2 Total B 1 a b a+b B 2 c d c+d Total a+c b+d n = a+b+c+d 1 Joint, Marginal, and Conditional Probability We study methods

### Basic Probability Concepts

page 1 Chapter 1 Basic Probability Concepts 1.1 Sample and Event Spaces 1.1.1 Sample Space A probabilistic (or statistical) experiment has the following characteristics: (a) the set of all possible outcomes

### SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question.

Math 1342 (Elementary Statistics) Test 2 Review SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Find the indicated probability. 1) If you flip a coin

### Probability. a number between 0 and 1 that indicates how likely it is that a specific event or set of events will occur.

Probability Probability Simple experiment Sample space Sample point, or elementary event Event, or event class Mutually exclusive outcomes Independent events a number between 0 and 1 that indicates how

### Probability. Sample space: all the possible outcomes of a probability experiment, i.e., the population of outcomes

Probability Basic Concepts: Probability experiment: process that leads to welldefined results, called outcomes Outcome: result of a single trial of a probability experiment (a datum) Sample space: all

Probability Worksheet 2 NAME: Remember to leave your answers as unreduced fractions. We will work with the example of picking poker cards out of a deck. A poker deck contains four suits: diamonds, hearts,

### Probability and Hypothesis Testing

B. Weaver (3-Oct-25) Probability & Hypothesis Testing. PROBABILITY AND INFERENCE Probability and Hypothesis Testing The area of descriptive statistics is concerned with meaningful and efficient ways of

### 6.3 Conditional Probability and Independence

222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

### Elements of probability theory

2 Elements of probability theory Probability theory provides mathematical models for random phenomena, that is, phenomena which under repeated observations yield di erent outcomes that cannot be predicted

### Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22

CS 70 Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette

### Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

### SCHOOL OF ENGINEERING & BUILT ENVIRONMENT. Mathematics

SCHOOL OF ENGINEERING & BUILT ENVIRONMENT Mathematics Probability and Probability Distributions 1. Introduction 2. Probability 3. Basic rules of probability 4. Complementary events 5. Addition Law for

### Welcome to Stochastic Processes 1. Welcome to Aalborg University No. 1 of 31

Welcome to Stochastic Processes 1 Welcome to Aalborg University No. 1 of 31 Welcome to Aalborg University No. 2 of 31 Course Plan Part 1: Probability concepts, random variables and random processes Lecturer:

### 4. Joint Distributions

Virtual Laboratories > 2. Distributions > 1 2 3 4 5 6 7 8 4. Joint Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an underlying sample space. Suppose

### Pattern matching probabilities and paradoxes A new variation on Penney s coin game

Osaka Keidai Ronshu, Vol. 63 No. 4 November 2012 Pattern matching probabilities and paradoxes A new variation on Penney s coin game Yutaka Nishiyama Abstract This paper gives an outline of an interesting

### Homework 3 Solution, due July 16

Homework 3 Solution, due July 16 Problems from old actuarial exams are marked by a star. Problem 1*. Upon arrival at a hospital emergency room, patients are categorized according to their condition as

### Introduction to Probability

LECTURE NOTES Course 6.041-6.431 M.I.T. FALL 2000 Introduction to Probability Dimitri P. Bertsekas and John N. Tsitsiklis Professors of Electrical Engineering and Computer Science Massachusetts Institute

### Chapter 4. Probability and Probability Distributions

Chapter 4. robability and robability Distributions Importance of Knowing robability To know whether a sample is not identical to the population from which it was selected, it is necessary to assess the

### https://assessment.casa.uh.edu/assessment/printtest.htm PRINTABLE VERSION Quiz 10

1 of 8 4/9/2013 8:17 AM PRINTABLE VERSION Quiz 10 Question 1 Let A and B be events in a sample space S such that P(A) = 0.34, P(B) = 0.39 and P(A B) = 0.19. Find P(A B). a) 0.4872 b) 0.5588 c) 0.0256 d)

### Reliability Applications (Independence and Bayes Rule)

Reliability Applications (Independence and Bayes Rule ECE 313 Probability with Engineering Applications Lecture 5 Professor Ravi K. Iyer University of Illinois Today s Topics Review of Physical vs. Stochastic

### Decision Making Under Uncertainty. Professor Peter Cramton Economics 300

Decision Making Under Uncertainty Professor Peter Cramton Economics 300 Uncertainty Consumers and firms are usually uncertain about the payoffs from their choices Example 1: A farmer chooses to cultivate

### Probability: The Study of Randomness Randomness and Probability Models. IPS Chapters 4 Sections 4.1 4.2

Probability: The Study of Randomness Randomness and Probability Models IPS Chapters 4 Sections 4.1 4.2 Chapter 4 Overview Key Concepts Random Experiment/Process Sample Space Events Probability Models Probability

### STA 256: Statistics and Probability I

Al Nosedal. University of Toronto. Fall 2014 1 2 3 4 5 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. Experiment, outcome, sample space, and

### Statistics 100A Homework 2 Solutions

Statistics Homework Solutions Ryan Rosario Chapter 9. retail establishment accepts either the merican Express or the VIS credit card. total of percent of its customers carry an merican Express card, 6

### Section 6.2 Definition of Probability

Section 6.2 Definition of Probability Probability is a measure of the likelihood that an event occurs. For example, if there is a 20% chance of rain tomorrow, that means that the probability that it will

### ST 371 (IV): Discrete Random Variables

ST 371 (IV): Discrete Random Variables 1 Random Variables A random variable (rv) is a function that is defined on the sample space of the experiment and that assigns a numerical variable to each possible

### For two disjoint subsets A and B of Ω, say that A and B are disjoint events. For disjoint events A and B we take an axiom P(A B) = P(A) + P(B)

Basic probability A probability space or event space is a set Ω together with a probability measure P on it. This means that to each subset A Ω we associate the probability P(A) = probability of A with

### m (t) = e nt m Y ( t) = e nt (pe t + q) n = (pe t e t + qe t ) n = (qe t + p) n

1. For a discrete random variable Y, prove that E[aY + b] = ae[y] + b and V(aY + b) = a 2 V(Y). Solution: E[aY + b] = E[aY] + E[b] = ae[y] + b where each step follows from a theorem on expected value from

### Chapter 13 & 14 - Probability PART

Chapter 13 & 14 - Probability PART IV : PROBABILITY Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Chapter 13 & 14 - Probability 1 / 91 Why Should We Learn Probability Theory? Dr. Joseph

### Discrete Structures for Computer Science

Discrete Structures for Computer Science Adam J. Lee adamlee@cs.pitt.edu 6111 Sennott Square Lecture #20: Bayes Theorem November 5, 2013 How can we incorporate prior knowledge? Sometimes we want to know

### PROBABILITY. Chapter. 0009T_c04_133-192.qxd 06/03/03 19:53 Page 133

0009T_c04_133-192.qxd 06/03/03 19:53 Page 133 Chapter 4 PROBABILITY Please stand up in front of the class and give your oral report on describing data using statistical methods. Does this request to speak

### BRIEF SOLUTIONS. Basic Probability WEEK THREE. This worksheet relates to chapter four of the text book (Statistics for Managers 4 th Edition).

BRIEF SOLUTIONS Basic Probability WEEK THREE This worksheet relates to chapter four of the text book (Statistics for Managers 4 th Edition). This topic is the one many students find the most difficult.

### 1. Prove that the empty set is a subset of every set.

1. Prove that the empty set is a subset of every set. Basic Topology Written by Men-Gen Tsai email: b89902089@ntu.edu.tw Proof: For any element x of the empty set, x is also an element of every set since

### MATHEMATICS 154, SPRING 2010 PROBABILITY THEORY Outline #3 (Combinatorics, bridge, poker)

Last modified: February, 00 References: MATHEMATICS 5, SPRING 00 PROBABILITY THEORY Outline # (Combinatorics, bridge, poker) PRP(Probability and Random Processes, by Grimmett and Stirzaker), Section.7.

### L10: Probability, statistics, and estimation theory

L10: Probability, statistics, and estimation theory Review of probability theory Bayes theorem Statistics and the Normal distribution Least Squares Error estimation Maximum Likelihood estimation Bayesian

### Section 6-5 Sample Spaces and Probability

492 6 SEQUENCES, SERIES, AND PROBABILITY 52. How many committees of 4 people are possible from a group of 9 people if (A) There are no restrictions? (B) Both Juan and Mary must be on the committee? (C)

### The Story. Probability - I. Plan. Example. A Probability Tree. Draw a probability tree.

Great Theoretical Ideas In Computer Science Victor Adamchi CS 5-5 Carnegie Mellon University Probability - I The Story The theory of probability was originally developed by a French mathematician Blaise