Bayesian Tutorial (Sheet Updated 20 March)


 Buddy Cooper
 2 years ago
 Views:
Transcription
1 Bayesian Tutorial (Sheet Updated 20 March) Practice Questions (for discussing in Class) Week starting 21 March What is the probability that the total of two dice will be greater than 8, given that the first die is a 6? 2. A patient s probability to have a liver disease increases if he is an alcoholic. Given that, 10% of the patients entering the clinic have liver disease, 5% of the clinic s patients are alcoholic and that, 7% of the patients diagnosed with liver disease are alcoholics, find the probability that an alcoholic patient is diagnosed with liver disease. 3. After tossing a fair coin three times: i. What is the probability of at least two tails? ii. What is the probability of exactly one tail? iii. Given that at least one tail is observed, what is the probability of observing at least two tails? 4. Given that 13% of patients who have lung cancer, and smoke; 3% of patients smoke and do not have lung cancer. 5% of patients have lung cancer and do not smoke. 79% of patients neither have lung cancer nor do they smoke. Draw an appropriate probability table and find the probability that a patient, picked at random, has lung cancer, given that he smokes. Also find the probability that a patient is a smoker given that he has lung cancer. From this, derive your inference. 5. Consider that 0.9% of the people have a genetic defect, 92% of the tests for gene are true positives, 9.8% of the tests are false positives. If a person gets a positive test result, what are the odds that they actually have the faulty gene? 6. The probability that it is Wednesday and that a student is absent is What is the probability that a student is absent given that today is Wednesday? 7. You go to see the doctor about an ingrowing toenail. The doctor selects you at random to have a blood test for swine flu, which for the purposes of this exercise we will say is currently suspected to affect 1 in 10,000 people in Australia. The test is 99% accurate, in the sense that the probability of a false positive is 1%. The probability of a false negative is zero. You test positive. What is the new probability that you have swine flu? Now imagine that you went to a friend s wedding in Mexico recently, and (for the purposes of this exercise) it is known that 1 in 200 people who visited Mexico recently come back with swine flu. Given the same test result as above, what should your revised estimate be for the probability you have the disease?
2 Poker Tournament Question Play this game in Groups, in YOUR OWN TIME! We are going to play a game of poker. Unlike usual games, we will discuss our cards and our bets as we play. The rules of the game Texas Hold em The aim of the game is to win the chips that are bet on each hand You do this by either o Having the best hand o Or forcing all the other players to throw in their hands instead of calling your bet i.e. they fold You will be dealt two cards that only you can see Once everyone has their cards, the person to the left of the dealer makes a bet based on their cards Everybody has the choice of: o Calling betting the same amount o Folding betting nothing and throwing in their cards o Raising Making the bet bigger, which means that the following players must bet the new higher amount if they want to call and that the players who have already bet have to make up the difference to stay in When everybody has bet the same amount or folded, three cards are dealt face up on the table. These cards are shared by all players There is another round of betting, as above, followed by one more shared card, another round of betting, and a final shared card. After a final round of betting, if more than one player is left in, the players show their hands and the player who can make the best hand using the middle cards plus 1 or 2 of his own cards wins. The order of the hands is as follows, with the best first: 1. Straight flush all cards the same suit and in unbroken order, e.g. 5,6,7,8,9 of spades 2. Four of a kind all cards have the same value, e.g. 5,5,5,5 one of each suit 3. Full house Three cards with one shared value plus two of another, e.g K,K,K,5,5 4. Flush All cards the same suit, e.g. 5 hearts. 5. Straight 5 cards in unbroken order, but of a mix of suits, e.g. 3,4 of spades, 5 of diamonds, 6 and 7 of hearts. 6. Three of a kind three cards of the same value 7. Two pairs e.g. 5,5,K,K 8. One pair e.g.7,7 9. No hand none of the above are made When two players have a hand of the same rank, the one that contains the highest valued card wins, except in the case of a full house, where the one with the highest ranking 3 of a kind wins. Round 1 Make sure you can answer these questions before you start the game! Supposing there s just me playing poker, no other players Let s say that I will bet whenever I get two fancy cards, but never any other time (fancy cards ace, Jack, Queen, King).
3 1. What is the probability of me making a bet, given that you don t know what cards I have? I need to play more hands than that, so I will bluff (bet on rubbish cards) exactly 20% of the time that I have rubbish cards. 2. Now what is the probability of me making a bet, given that you don t know what cards I have? Clue it is the conditional probability of me betting given that I do not have two fancy cards plus the answer to question 1. Now let s work out something more useful. I have made a bet and you want to know whether or not I am bluffing. 3. Use Bayes rule to work out the probability that I am bluffing. Then use the same rule to work out the probability that I have two fancy cards. Check that they sum to one to make sure you have it right. 4. Finally, if I also bet when I have any pair in my hand (5,5 for example), how does that affect the values calculated in 1,2 and 3 above? Once we ve answered these questions, we will try them out in a few hands. Round 2 Each player will say what cards they have and calculate the probability of being dealt those two cards. Hopefully a pattern will be quickly discovered! Players will be forced to bet a minimum amount at this point. We will then deal the three cards to the middle the so called Flop. Now each player will calculate the probability of them making a good hand from the last two unknown cards. Those with a low probability can fold. The others can bet. Again, another card will be dealt and probabilities will be calculated. People can bet or fold. The winner gets the chips. We will play a few more rounds, without people showing their cards until the end. Then we will look at the cards and calculate the probabilities that people were playing with.
4 Quick Review of Bayes Theorem and Bayesian Network Conditional Probability & Bayes Theorem: The conditional probability of an event B is the probability that the event will occur given the knowledge that an event A has already occurred. This probability is written P(B A), notation for the probability of B given A. P(B A) = P(A B) P(B) / P(A) Deriving Bayes theorem using conditional probability. P(A B) = P(A) * P(B A) P(B A) = P(B) * P(A B) Equating two of them, P(A) P(B A) = P(B) P(A B) This implies, P(B A) = P(A B) P(B) / P(A) Bayesian networks A Bayesian Network (BN) is a way of describing the relationships between causes & effects BNs used to support decision making and to find strategies to solve tasks under uncertainty BNs use Bayesian probability theory How are they different from others? Uncertainty is handled in a mathematically rigorous yet simple and efficient way. Network representation of problems. Most other methods do not include statistical information to make inferences. Combination of statistics and Bayesian network is powerful  Bayesian nets are a networkbased framework for representing and analysing models involving uncertainty. Recall example Nodes: Random Variables Arcs: Casual or influential relationships Collection of nodes & arcs is termed graph or topology of BN (For each node, an associated Node Probability Table (NPT) give the the conditional probability of each possible outcome, given combinations of outcomes from parent nodes) BN present causal chains (i.e causeeffect relationships between parent and child nodes) Given evidence of past events, run the BN to see what the most likely future outcomes will be they are also robust to missing info.! Bayesian classification can help to predict information we do not know using information we do know and the likelihood of certain patterns in the data occurring (cf. learning!)
5 Example Solutions 1. What is the probability that the total of two dice will be greater than 8, given that the first die is a 6? Let A = first die is 6 Let B = total of two dice is greater than 8 We need to determine the conditional probability, P(B/A) i.e. the probability of an event (B) given that another event (A) has occurred. This can be computed by considering only outcomes for which the first die is a 6. Then, determine the proportion of these outcomes that total more than 8. All the possible outcomes for two dice can be calculated as below: There are 36 possible outcomes when a pair of dice is thrown. Consider that if one of the dice rolled is a 1, there are six possibilities for the other die. If one of the dice rolled a 2, the same is still true. And the same is true if one of the dice is a 3,4,5, or 6. If this is still confusing, look at the following (abbreviated) list of outcomes: [(1,1),(1,2),(1,3),(1,4),(1,5),(1,6); (2,1),(2,2),(2,3) (3,1),(3,2),3,3) (4,1) (5,1) (6,1). The total number of outcomes is 6 6 = 36 (or 6^2) Now, there are 6 outcomes for which the first die is a 6: (6,1),(6,2),(6,3),(6,4),(6,5),(6,6), and of these, there are four that total more than 8. The probability of a total greater than 8 given that the first die is 6, i.e. P(B/A) is therefore = 4/6 = 2/3. Alternatively, using Bayes Theorem: P (A) = 1/6 Favourable outcomes for A and B: (6, 3), (6, 4), (6, 5), (6, 6) P (A and B) = 4/ 36 P (B A) = P (A and B) / P (A) = 4/36 * 6/1 = 2/3 2. A patient s probability to have a liver disease increases if he is an alcoholic. Given that, 10% of the patients entering the clinic have liver disease, 5% of the clinic s patients are alcoholic and that, 7% of the patients diagnosed with liver disease are alcoholics, find the probability that an alcoholic patient is diagnosed with liver disease. Given: Probability of patients with Liver disease: P(A) = 0.10 Probability of patients who are alcoholic: P(B) = (7% patients diagnosed with liver disease (A) are alcoholics (B)) i.e. P(B A) = (Probability that alcoholic patient (B) is diagnosed with liver disease (A)), i.e. P(A B) = P(B A) P(A) / P(B) = 0.14
6 3. After tossing a fair coin three times: i. What is the probability of at least two tails? Let H represent an outcome of heads and T represent an outcome of Tails For three tosses of the coin all the possible outcomes are HHH THH HTH HHT THT TTH HTT TTT (or, 2^3 since, each toss leads to two outcomes) The above eight possible outcomes are the sample space. The outcomes that have at least two tails in them are THT, TTH, HTT, and TTT. Therefore, there are four of the eight outcomes that have two or more tails in them. This means that the probability of throwing at least two tails in three tosses is 4 out of 8, which reduces to: 50 percent. OR: P (HTT U THT U TTH U TTT) = 1/8 + 1/8 + 1/8 + 1/8 = 4/8 (since events are mutually exclusive) ii. What is the probability of exactly one tail? P (HHT U HTH U THH) = 1/8 + 1/8 + 1/8 = 3/8 iii. Given that at least one tail is observed, what is the probability of observing at least two tails? A1 = event that at least one tail is observed (T 1) A2 = event of observing at least two tails (T 2) Intuitive Answer: It would be pretty quick to just list all possible outcomes. There are 8 ways you can flip 3 coins. Only one of them is eliminated by the condition (HHH). How many of the remaining results have at least two tails? (4/7) Using Bayes Theorem: P (A1 ) = 7/8 P (A2) = 4/8 P (A2 A1) = P(A1 A2) / P(A1) = (4/8) / (7/8) = 4/7 (To find P(T 1 T 2), we should just list the possible sequences of coin tosses that would allow this (4 out of the 8 tosses, as the required conditions eliminate four remaining sequences: HHH,THH, HTH, HHT)
7 4. Given that 13% of patients who have lung cancer, and smoke; 3% of patients smoke and do not have lung cancer. 5% of patients have lung cancer and do not smoke. 79% of patients neither have lung cancer nor do they smoke. Draw an appropriate probability table and find the probability that a patient, picked at random, has lung cancer, given that he smokes. Also find the probability that a patient is a smoker given that he has lung cancer. From this, derive your inference. S A B 0.79 Disease Status (Jointprobabilities Table!) Smoker (B) Nonsmoker (~B) Lung No Lung Cancer (A) Cancer (~A) A = lung cancer B = smoker P(A B) = 0.13/0.16 = which is 81.25% P(B A) = 0.13/0.18 = which is 72.22% Inference is P(A B) and P(B A) are not equal. Q5. Consider that 0.9% of the people have a genetic defect, 92% of the tests for gene are true positives, 9.8% of the tests are false positives. If a person gets a positive test result, what are the odds that they actually have the faulty gene? Let P(A) = probability of having the faulty gene = (Hence, P(~A) = 0.991) B = positive test result P(A B) = Probability of having the gene given a positive test result. P(B A) = Probability of a positive test result given that the person has the gene = 0.92 P(B ~A) = Probability of a positive test if the person does not have the gene = P(B) = P(B A) + P(B ~A) = P(B A) * P(A) + P(B ~A)*P(~A) = 0.92 * * 0.991= P(A B) = P(B A) * P(A) / P(B) = (0.92 * 0.009) / ( ) = , which is 7.86% probability of having the faulty gene. Q6. The probability that it is Wednesday and that a student is absent is What is the probability that a student is absent given that today is Wednesday? P(Absent Wednesday) = P(Wednesday and Absent) / P(Wednesday) = 0.04/0.2 = 0.2 which is 20%. (assuming there are five working days in a student s week!)
8 Q7 You go to see the doctor about an ingrowing toenail. The doctor selects you at random to have a blood test for swine flu, which for the purposes of this exercise we will say is currently suspected to affect 1 in 10,000 people in Australia. The test is 99% accurate, in the sense that the probability of a false positive is 1%. The probability of a false negative is zero. You test positive. What is the new probability that you have swine flu? Now imagine that you went to a friend s wedding in Mexico recently, and (for the purposes of this exercise) it is known that 1 in 200 people who visited Mexico recently come back with swine flu. Given the same test result as above, what should your revised estimate be for the probability you have the disease? Let P(D) be the probability one has swine flu. Let P(T) be the probability of a positive test. We wish to know P(D T). Bayes theorem says: P T D P(D) P D T = P T which in this case can be rewritten as: P T D P(D) P D T = P T D P D + P T ~ D P(~ D) where P(~ D) means the probability of not having swine flu. We have P(D) = (the a priori probability one has swine flu). P(~ D) = P(T D) = 1 (if one has swine flu the test is always positive). P(T ~ D) = 0.01 (1% chance of a false positive, i.e. test wrongly indicates the condition is present). Plugging these numbers in we get: P D T = That is, even though the test was positive one s chance of having swine flu is only 1%. However, if one went to Mexico recently then his starting P(D) is In this case P D T = and you should be a lot more worried! Aside: Recap definitions of True/False Positives/Negatives (Confusion Matrix) There is quite a bit of terminological confusion in this area. Many people find it useful to come back to a confusion matrix to think about this. In a classification / screening test, you can have four different situations: Condition: A Not A Test says A True positive False positive Test says Not A False negative True negative
9 In this table, true positive, false negative, false positive and true negative are events (or their probability). What you have is therefore probably a true positive rate and a false negative rate. The distinction matters because it emphasizes that both numbers have a numerator and a denominator. Where things get a bit confusing is that you can find several definitions of false positive rate and false negative rate, with different denominators. For example, Wikipedia provides the following definitions (they seem pretty standard): True positive rate (or sensitivity): TPR=TP/(TP+FN) False positive rate: FPR=FP/(FP+TN) True negative rate (or specificity): TNR=TN/(FP+TN) In all cases, the denominator is the column total. This also gives a cue to their interpretation: The true positive rate is the probability that the test says A when the real value is indeed A (i.e., it is a conditional probability, conditioned on A being true). This does not tell you how likely you are to be correct when calling A (i.e., the probability of a true positive, conditioned on the test result being A ). Assuming the false negative rate is defined in the same way, we then have we then have FNR=1 TPR We cannot however directly derive the false positive rate from either the true positive or false negative rates because they provide no information on the specificity, i.e., how the test behaves when not A is the correct answer. There are however other definitions in the literature! NOTE: 1) True +ve and false ve make 100% 2) False +ve and true ve make 100% 3) There is no relation between true positives and false positives.
Lesson 1. Basics of Probability. Principles of Mathematics 12: Explained! www.math12.com 314
Lesson 1 Basics of Probability www.math12.com 314 Sample Spaces: Probability Lesson 1 Part I: Basic Elements of Probability Consider the following situation: A six sided die is rolled The sample space
More informationGrade 7/8 Math Circles Fall 2012 Probability
1 University of Waterloo Faculty of Mathematics Centre for Education in Mathematics and Computing Grade 7/8 Math Circles Fall 2012 Probability Probability is one of the most prominent uses of mathematics
More informationTopic 6: Conditional Probability and Independence
Topic 6: September 1520, 2011 One of the most important concepts in the theory of probability is based on the question: How do we modify the probability of an event in light of the fact that something
More informationPROBABILITY. Chapter Overview Conditional Probability
PROBABILITY Chapter. Overview.. Conditional Probability If E and F are two events associated with the same sample space of a random experiment, then the conditional probability of the event E under the
More informationProbability QUESTIONS Principles of Math 12  Probability Practice Exam 1 www.math12.com
Probability QUESTIONS Principles of Math  Probability Practice Exam www.math.com Principles of Math : Probability Practice Exam Use this sheet to record your answers:... 4... 4... 4.. 6. 4.. 6. 7..
More informationLecture 2: Probability
Lecture 2: Probability Assist. Prof. Dr. Emel YAVUZ DUMAN MCB1007 Introduction to Probability and Statistics İstanbul Kültür University Outline 1 Introduction 2 Sample Spaces 3 Event 4 The Probability
More informationProbability. A random sample is selected in such a way that every different sample of size n has an equal chance of selection.
1 3.1 Sample Spaces and Tree Diagrams Probability This section introduces terminology and some techniques which will eventually lead us to the basic concept of the probability of an event. The Rare Event
More information33 Probability: Some Basic Terms
33 Probability: Some Basic Terms In this and the coming sections we discuss the fundamental concepts of probability at a level at which no previous exposure to the topic is assumed. Probability has been
More informationTexas Hold em. From highest to lowest, the possible five card hands in poker are ranked as follows:
Texas Hold em Poker is one of the most popular card games, especially among betting games. While poker is played in a multitude of variations, Texas Hold em is the version played most often at casinos
More informationChapter 4 & 5 practice set. The actual exam is not multiple choice nor does it contain like questions.
Chapter 4 & 5 practice set. The actual exam is not multiple choice nor does it contain like questions. MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.
More informationChapter 4 Probability
The Big Picture of Statistics Chapter 4 Probability Section 42: Fundamentals Section 43: Addition Rule Sections 44, 45: Multiplication Rule Section 47: Counting (next time) 2 What is probability?
More informationP (A B) = P (AB)/P (B).
1 Lecture 8 Conditional Probability Define the conditional probability of A given B by P (A B) = P (AB) P (B. If we roll two dice in a row the probability that the sum is 9 is 1/9 as there are four combinations
More informationChapter 6. 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? Ans: 4/52.
Chapter 6 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? 4/52. 2. What is the probability that a randomly selected integer chosen from the first 100 positive
More informationMath 140 Introductory Statistics
The Big Picture of Statistics Math 140 Introductory Statistics Lecture 10 Introducing Probability Chapter 10 2 Example Suppose that we are interested in estimating the percentage of U.S. adults who favor
More informationBasics of Probability
Basics of Probability August 27 and September 1, 2009 1 Introduction A phenomena is called random if the exact outcome is uncertain. The mathematical study of randomness is called the theory of probability.
More informationProbability of Repeated Independent Events
Math Objectives Students will identify the sample space of an experiment involving repeated independent trials. Students will calculate the probability of multiple independent events occurring. Students
More informationV. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE
V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPETED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny and a nickel are flipped. You win $ if either
More informationChingHan Hsu, BMES, National Tsing Hua University c 2014 by ChingHan Hsu, Ph.D., BMIR Lab
Lecture 2 Probability BMIR Lecture Series in Probability and Statistics ChingHan Hsu, BMES, National Tsing Hua University c 2014 by ChingHan Hsu, Ph.D., BMIR Lab 2.1 1 Sample Spaces and Events Random
More informationProbability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of sample space, event and probability function. 2. Be able to
More informationBasic Probability. Probability: The part of Mathematics devoted to quantify uncertainty
AMS 5 PROBABILITY Basic Probability Probability: The part of Mathematics devoted to quantify uncertainty Frequency Theory Bayesian Theory Game: Playing Backgammon. The chance of getting (6,6) is 1/36.
More informationDistributions. and Probability. Find the sample space of an experiment. Find the probability of an event. Sample Space of an Experiment
C Probability and Probability Distributions APPENDIX C.1 Probability A1 C.1 Probability Find the sample space of an experiment. Find the probability of an event. Sample Space of an Experiment When assigning
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11
CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According
More informationExpected Value 10/11/2005
Expected Value 10/11/2005 Definition Let X be a numericallyvalued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω xm(x), provided
More informationI. WHAT IS PROBABILITY?
C HAPTER 3 PROBABILITY Random Experiments I. WHAT IS PROBABILITY? The weatherman on 0 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and
More informationPattern matching probabilities and paradoxes A new variation on Penney s coin game
Osaka Keidai Ronshu, Vol. 63 No. 4 November 2012 Pattern matching probabilities and paradoxes A new variation on Penney s coin game Yutaka Nishiyama Abstract This paper gives an outline of an interesting
More informationAP Stats  Probability Review
AP Stats  Probability Review Multiple Choice Identify the choice that best completes the statement or answers the question. 1. I toss a penny and observe whether it lands heads up or tails up. Suppose
More informationnumber of favorable outcomes total number of outcomes number of times event E occurred number of times the experiment was performed.
12 Probability 12.1 Basic Concepts Start with some Definitions: Experiment: Any observation of measurement of a random phenomenon is an experiment. Outcomes: Any result of an experiment is called an outcome.
More informationRemember to leave your answers as unreduced fractions.
Probability Worksheet 2 NAME: Remember to leave your answers as unreduced fractions. We will work with the example of picking poker cards out of a deck. A poker deck contains four suits: diamonds, hearts,
More information7.1 Sample space, events, probability
7.1 Sample space, events, probability In this chapter, we will study the topic of probability which is used in many different areas including insurance, science, marketing, government and many other areas.
More informationMATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables
MATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you
More informationMath 30530: Introduction to Probability, Spring 2012
Name: Math 30530: Introduction to Probability, Spring 01 Midterm Exam I Monday, February 0, 01 This exam contains problems on 7 pages (including the front cover). Calculators may be used. Show all your
More informationA (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes.
Chapter 7 Probability 7.1 Experiments, Sample Spaces, and Events A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes. Each outcome
More informationUsing Laws of Probability. Sloan Fellows/Management of Technology Summer 2003
Using Laws of Probability Sloan Fellows/Management of Technology Summer 2003 Uncertain events Outline The laws of probability Random variables (discrete and continuous) Probability distribution Histogram
More informationPROBABILITY. The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE
PROBABILITY 53 Chapter 3 PROBABILITY The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE 3. Introduction In earlier Classes, we have studied the probability as
More informationThe Central Limit Theorem Part 1
The Central Limit Theorem Part. Introduction: Let s pose the following question. Imagine you were to flip 400 coins. To each coin flip assign if the outcome is heads and 0 if the outcome is tails. Question:
More informationMath 421: Probability and Statistics I Note Set 2
Math 421: Probability and Statistics I Note Set 2 Marcus Pendergrass September 13, 2013 4 Discrete Probability Discrete probability is concerned with situations in which you can essentially list all the
More informationContemporary Mathematics MAT 130. Probability. a) What is the probability of obtaining a number less than 4?
Contemporary Mathematics MAT 30 Solve the following problems:. A fair die is tossed. What is the probability of obtaining a number less than 4? What is the probability of obtaining a number less than
More informationLesson 1: Experimental and Theoretical Probability
Lesson 1: Experimental and Theoretical Probability Probability is the study of randomness. For instance, weather is random. In probability, the goal is to determine the chances of certain events happening.
More information7 Probability. Copyright Cengage Learning. All rights reserved.
7 Probability Copyright Cengage Learning. All rights reserved. 7.1 Sample Spaces and Events Copyright Cengage Learning. All rights reserved. Sample Spaces 3 Sample Spaces At the beginning of a football
More informationNotes for Math 1020 by Gerald Beer and Silvia Heubach, July The leastsquares regression line
Notes for Math 1020 by Gerald Beer and Silvia Heubach, July 2016 1. The leastsquares regression line Often a finite set of data points {(x 1, y 1 ), (x 2, y 2 ),..., (x n, y n )} exhibits a linear pattern
More informationProbability and Expected Value
Probability and Expected Value This handout provides an introduction to probability and expected value. Some of you may already be familiar with some of these topics. Probability and expected value are
More informationConditional Probability, Independence and Bayes Theorem Class 3, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Conditional Probability, Independence and Bayes Theorem Class 3, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of conditional probability and independence
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10
CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice,
More informationLecture 11: Probability models
Lecture 11: Probability models Probability is the mathematical toolbox to describe phenomena or experiments where randomness occur. To have a probability model we need the following ingredients A sample
More informationChapter 4  Practice Problems 1
Chapter 4  Practice Problems SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Provide an appropriate response. ) Compare the relative frequency formula
More informationOdds: Odds compares the number of favorable outcomes to the number of unfavorable outcomes.
MATH 11008: Odds and Expected Value Odds: Odds compares the number of favorable outcomes to the number of unfavorable outcomes. Suppose all outcomes in a sample space are equally likely where a of them
More informationProbability definitions
Probability definitions 1. Probability of an event = chance that the event will occur. 2. Experiment = any action or process that generates observations. In some contexts, we speak of a datagenerating
More informationUnit 19: Probability Models
Unit 19: Probability Models Summary of Video Probability is the language of uncertainty. Using statistics, we can better predict the outcomes of random phenomena over the long term from the very complex,
More informationDiscrete probability and the laws of chance
Chapter 8 Discrete probability and the laws of chance 8.1 Introduction In this chapter we lay the groundwork for calculations and rules governing simple discrete probabilities. These steps will be essential
More informationA Few Basics of Probability
A Few Basics of Probability Philosophy 57 Spring, 2004 1 Introduction This handout distinguishes between inductive and deductive logic, and then introduces probability, a concept essential to the study
More informationLaws of probability. Information sheet. Mutually exclusive events
Laws of probability In this activity you will use the laws of probability to solve problems involving mutually exclusive and independent events. You will also use probability tree diagrams to help you
More informationThursday, October 18, 2001 Page: 1 STAT 305. Solutions
Thursday, October 18, 2001 Page: 1 1. Page 226 numbers 2 3. STAT 305 Solutions S has eight states Notice that the first two letters in state n +1 must match the last two letters in state n because they
More informationChapter 3: The basic concepts of probability
Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording
More informationP (A) = 0.60, P (B) = 0.55, P (A B c ) = 0.30
Probability Math 42 Test October, 20 Dr. Pendergrass On my honor, I have neither given nor received any aid on this work, nor am I aware of any breach of the Honor Code that I shall not immediately report.
More informationProbability distributions
Probability distributions (Notes are heavily adapted from Harnett, Ch. 3; Hayes, sections 2.142.19; see also Hayes, Appendix B.) I. Random variables (in general) A. So far we have focused on single events,
More information15 Chances, Probabilities, and Odds
15 Chances, Probabilities, and Odds 15.1 Random Experiments and Sample Spaces 15.2 Counting Outcomes in Sample Spaces 15.3 Permutations and Combinations 15.4 Probability Spaces 15.5 Equiprobable Spaces
More informationSession 8 Probability
Key Terms for This Session Session 8 Probability Previously Introduced frequency New in This Session binomial experiment binomial probability model experimental probability mathematical probability outcome
More information6.3 Conditional Probability and Independence
222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted
More informationMath 1320 Chapter Seven Pack. Section 7.1 Sample Spaces and Events. Experiments, Outcomes, and Sample Spaces. Events. Complement of an Event
Math 1320 Chapter Seven Pack Section 7.1 Sample Spaces and Events Experiments, Outcomes, and Sample Spaces An experiment is an occurrence with a result, or outcome, that is uncertain before the experiment
More informationRussell Thomas
From Actuarial Science to Poker Russell Thomas 11.14.2013 1 Agenda Playing poker vs. Being an Actuary Rules of No Limit Texas Hold em Poker skills Conclusions 2 How does Poker relate to being an Actuary?
More informationJan 17 Homework Solutions Math 151, Winter 2012. Chapter 2 Problems (pages 5054)
Jan 17 Homework Solutions Math 11, Winter 01 Chapter Problems (pages 0 Problem In an experiment, a die is rolled continually until a 6 appears, at which point the experiment stops. What is the sample
More informationDiscrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22
CS 70 Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette
More informationBasic Probability Theory (I)
Basic Probability Theory (I) Intro to Bayesian Data Analysis & Cognitive Modeling Adrian Brasoveanu [partly based on slides by Sharon Goldwater & Frank Keller and John K. Kruschke] Fall 2012 UCSC Linguistics
More informationBayesian Updating with Discrete Priors Class 11, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
1 Learning Goals Bayesian Updating with Discrete Priors Class 11, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1. Be able to apply Bayes theorem to compute probabilities. 2. Be able to identify
More informationSection 8.1 Properties of Probability
Section 8. Properties of Probability Section 8. Properties of Probability A probability is a function that assigns a value between 0 and to an event, describing the likelihood of that event happening.
More informationSection 6.2 ~ Basics of Probability. Introduction to Probability and Statistics SPRING 2016
Section 6.2 ~ Basics of Probability Introduction to Probability and Statistics SPRING 2016 Objective After this section you will know how to find probabilities using theoretical and relative frequency
More informationChapter 5  Probability
Chapter 5  Probability 5.1 Basic Ideas An experiment is a process that, when performed, results in exactly one of many observations. These observations are called the outcomes of the experiment. The set
More informationMATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics
MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you should
More informationMTH 110 Chapter 6 Practice Test Problems
MTH 0 Chapter 6 Practice Test Problems Name ) Probability A) assigns realistic numbers to random events. is the branch of mathematics that studies longterm patterns of random events by repeated observations.
More informationAll You Ever Wanted to Know About Probability Theory, but Were Afraid to Ask
All You Ever Wanted to Know About Probability Theory, but Were Afraid to Ask 1 Theoretical Exercises 1. Let p be a uniform probability on a sample space S. If S has n elements, what is the probability
More informationReady, Set, Go! Math Games for Serious Minds
Math Games with Cards and Dice presented at NAGC November, 2013 Ready, Set, Go! Math Games for Serious Minds Rande McCreight Lincoln Public Schools Lincoln, Nebraska Math Games with Cards Close to 20 
More informationProbabilities of Poker Hands with Variations
Probabilities of Poker Hands with Variations Jeff Duda Acknowledgements: Brian Alspach and Yiu Poon for providing a means to check my numbers Poker is one of the many games involving the use of a 52card
More informationExample: If we roll a dice and flip a coin, how many outcomes are possible?
12.5 Tree Diagrams Sample space Sample point Counting principle Example: If we roll a dice and flip a coin, how many outcomes are possible? TREE DIAGRAM EXAMPLE: Use a tree diagram to show all the possible
More informationMULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.
Ch.  Problems to look at Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Provide an appropriate response. 1) A coin is tossed. Find the probability
More informationCombinatorics 3 poker hands and Some general probability
Combinatorics 3 poker hands and Some general probability Play cards 13 ranks Heart 4 Suits Spade Diamond Club Total: 4X13=52 cards You pick one card from a shuffled deck. What is the probability that it
More informationWeek 2: Conditional Probability and Bayes formula
Week 2: Conditional Probability and Bayes formula We ask the following question: suppose we know that a certain event B has occurred. How does this impact the probability of some other A. This question
More informationExamples of infinite sample spaces. Math 425 Introduction to Probability Lecture 12. Example of coin tosses. Axiom 3 Strong form
Infinite Discrete Sample Spaces s of infinite sample spaces Math 425 Introduction to Probability Lecture 2 Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan February 4,
More informationBasic Probability Theory II
RECAP Basic Probability heory II Dr. om Ilvento FREC 408 We said the approach to establishing probabilities for events is to Define the experiment List the sample points Assign probabilities to the sample
More informationChapter 13 & 14  Probability PART
Chapter 13 & 14  Probability PART IV : PROBABILITY Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Chapter 13 & 14  Probability 1 / 91 Why Should We Learn Probability Theory? Dr. Joseph
More informationPROBABILITY 14.3. section. The Probability of an Event
4.3 Probability (43) 727 4.3 PROBABILITY In this section In the two preceding sections we were concerned with counting the number of different outcomes to an experiment. We now use those counting techniques
More informationBetting systems: how not to lose your money gambling
Betting systems: how not to lose your money gambling G. Berkolaiko Department of Mathematics Texas A&M University 28 April 2007 / Mini Fair, Math Awareness Month 2007 Gambling and Games of Chance Simple
More informationDefinition of Random Variable A random variable is a function from a sample space S into the real numbers.
.4 Random Variable Motivation example In an opinion poll, we might decide to ask 50 people whether they agree or disagree with a certain issue. If we record a for agree and 0 for disagree, the sample space
More information6.3 Probabilities with Large Numbers
6.3 Probabilities with Large Numbers In general, we can t perfectly predict any single outcome when there are numerous things that could happen. But, when we repeatedly observe many observations, we expect
More informationDecision Making Under Uncertainty. Professor Peter Cramton Economics 300
Decision Making Under Uncertainty Professor Peter Cramton Economics 300 Uncertainty Consumers and firms are usually uncertain about the payoffs from their choices Example 1: A farmer chooses to cultivate
More informationIn the situations that we will encounter, we may generally calculate the probability of an event
What does it mean for something to be random? An event is called random if the process which produces the outcome is sufficiently complicated that we are unable to predict the precise result and are instead
More informationMost of us would probably believe they are the same, it would not make a difference. But, in fact, they are different. Let s see how.
PROBABILITY If someone told you the odds of an event A occurring are 3 to 5 and the probability of another event B occurring was 3/5, which do you think is a better bet? Most of us would probably believe
More informationQuestion: What is the probability that a fivecard poker hand contains a flush, that is, five cards of the same suit?
ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the
More informationSection I.2: Expected Values and Applications to Algorithms
Section I.: Expected Values and Applications to Algorithms Definition I..: A finite random variable X is a function from a finite sample space S to the real numbers. Example I..: Let S be the set of students
More informationIntroduction to Random Variables (RVs)
ECE270: Handout 5 Introduction to Random Variables (RVs) Outline: 1. informal definition of a RV, 2. three types of a RV: a discrete RV, a continuous RV, and a mixed RV, 3. a general rule to find probability
More informationMath 141. Lecture 2: More Probability! Albyn Jones 1. jones@reed.edu www.people.reed.edu/ jones/courses/141. 1 Library 304. Albyn Jones Math 141
Math 141 Lecture 2: More Probability! Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Outline Law of total probability Bayes Theorem the Multiplication Rule, again Recall
More informationDefinition and Calculus of Probability
In experiments with multivariate outcome variable, knowledge of the value of one variable may help predict another. For now, the word prediction will mean update the probabilities of events regarding the
More informationMassachusetts Institute of Technology
n (i) m m (ii) n m ( (iii) n n n n (iv) m m Massachusetts Institute of Technology 6.0/6.: Probabilistic Systems Analysis (Quiz Solutions Spring 009) Question Multiple Choice Questions: CLEARLY circle the
More informationThis is Basic Concepts of Probability, chapter 3 from the book Beginning Statistics (index.html) (v. 1.0).
This is Basic Concepts of Probability, chapter 3 from the book Beginning Statistics (index.html) (v. 1.0). This book is licensed under a Creative Commons byncsa 3.0 (http://creativecommons.org/licenses/byncsa/
More informationCurriculum Design for Mathematic Lesson Probability
Curriculum Design for Mathematic Lesson Probability This curriculum design is for the 8th grade students who are going to learn Probability and trying to show the easiest way for them to go into this class.
More informationProbabilistic Strategies: Solutions
Probability Victor Xu Probabilistic Strategies: Solutions Western PA ARML Practice April 3, 2016 1 Problems 1. You roll two 6sided dice. What s the probability of rolling at least one 6? There is a 1
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science Adam J. Lee adamlee@cs.pitt.edu 6111 Sennott Square Lecture #20: Bayes Theorem November 5, 2013 How can we incorporate prior knowledge? Sometimes we want to know
More information2. How many ways can the letters in PHOENIX be rearranged? 7! = 5,040 ways.
Math 142 September 27, 2011 1. How many ways can 9 people be arranged in order? 9! = 362,880 ways 2. How many ways can the letters in PHOENIX be rearranged? 7! = 5,040 ways. 3. The letters in MATH are
More informationWhat is the probability of throwing a fair die and receiving a six? Introduction to Probability. Basic Concepts
Basic Concepts Introduction to Probability A probability experiment is any experiment whose outcomes relies purely on chance (e.g. throwing a die). It has several possible outcomes, collectively called
More informationBasic Probability Theory I
A Probability puzzler!! Basic Probability Theory I Dr. Tom Ilvento FREC 408 Our Strategy with Probability Generally, we want to get to an inference from a sample to a population. In this case the population
More informationSTAT 270 Probability Basics
STAT 270 Probability Basics Richard Lockhart Simon Fraser University Spring 2015 Surrey 1/28 Purposes of These Notes Jargon: experiment, sample space, outcome, event. Set theory ideas and notation: intersection,
More information