Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10

Save this PDF as:

Size: px
Start display at page:

Download "Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10"

Transcription

1 CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette wheels. Today it is an essential tool in engineering and the sciences. No less so in computer science, where its use is widespread in algorithms, systems, learning theory and artificial intelligence. Here are some typical statements that you might see concerning probability: 1. The chance of getting a flush in a 5-card poker hand is about 2 in The chance that a particular implementation of the primality testing algorithm outputs prime when the input is composite is at most one in a trillion. 3. The average time between system failures is about 3 days. 4. In this load-balancing scheme, the probability that any processor has to deal with more than 12 requests is negligible. 5. There is a 30% chance of a magnitude 8.0 earthquake in Northern California before Implicit in all such statements is the notion of an underlying probability space. This may be the result of a random experiment that we have ourselves constructed (as in 1, 2 and 3 above), or some model we build of the real world (as in 4 and 5 above). None of these statements makes sense unless we specify the probability space we are talking about: for this reason, statements like 5 (which are typically made without this context) are almost content-free. Let us try to understand all this more clearly. The first important notion here is one of a random experiment. An example of such an experiment is tossing a coin 4 times, or dealing a poker hand. In the first case an outcome of the experiment might be HT HT or it might be HHHT. The question we are interested in might be what is the chance that there are 2 H s? Well, the number of outcomes that meet this condition is ( ) 4 2 = 4! 2!2! = 6 (corresponding to choosing the positions of the two H s in the sequence of four tosses); these outcomes are HHT T,HT HT,HT T H,T HHT,T HT H,T T HH. On the other hand, the total number of distinct outcomes for this experiment is 2 4 = 16. If the coin is fair then all these 16 outcomes are equally likely, so the chance that there are exactly 2 H s is 6/16 = 3/8. Now some terminology. The outcome of a random experiment is called a sample point. Thus HT HT is an example of a sample point. The sample space, often denoted by Ω, is the set of all possible outcomes. In our example the sample space has 16 elements: CS 70, Fall 2009, Note 10 1

2 A probability space is a sample space Ω, together with a probability Pr[ω] for each sample point ω, such that 0 Pr[ω] 1 for all ω Ω. Pr[ω] = 1, i.e., the sum of the probabilities of all outcomes is 1. ω Ω The easiest way to assign probabilities to sample points is uniformly (as we saw earlier in the coin tossing example): if Ω = N, then Pr[x] = 1 N x Ω. We will see examples of non-uniform probability distributions soon. Here s another example: dealing a poker hand. In this case, our sample space Ω = {all possible poker hands}, which corresponds to choosing k = 5 objects without replacement from a set of size n = 52 where order does not matter. Hence, as we saw in the previous Note, Ω = ( ) 52 5 = = 2, 598, 960. Since the probability of each outcome is equally likely, this implies that the probability of any particular 1 hand, such as, Pr[{5, 3, 7, 8, K }] = 2,598,960. As we saw in the coin tossing example above, what we are often interested in knowing after performing an experiment is whether a certain event occurred. Thus we considered the event that there were exactly two H s in the four tosses of the coin. Here are some more examples of events we might be interested in: Sum of the rolls of 2 dice is 10. Poker hand is a flush (i.e., all 5 cards have the same suit). In n coin tosses, at least n 3 of the tosses land on tails. Let us now formalize the notion of an event. Formally, an event A is just a subset of the sample space, A Ω. As we saw above, the event exactly 2 H s in four tosses of the coin is the subset: {HHT T,HT HT,HT T H,T HHT,T HT H,T T HH} Ω. How should we define the probability of an event A? Naturally, we should just add up the probabilities of the sample points in A. For any event A Ω, we define the probability of A to be Pr[A] = Pr[ω]. ω A Thus the probability of getting exactly two H s in four coin tosses can be calculated using this definition as follows. A consists of all sequences that have exactly two H s, and so A = 6. For this example, there are CS 70, Fall 2009, Note 10 2

3 2 4 = 16 possible outcomes for flipping four coins. Thus, each sample point ω A has probability 1 16 ; and, as we saw above, there are six sample points in A, giving us Pr[A] = = 3 8. We will now look at examples of probability spaces and typical events that may occur in such experiments. 1. Flip a fair coin. Here Ω = {H,T }, and Pr[H] = Pr[T ] = Flip a fair coin three times. Here Ω = {(t 1,t 2,t 3 ) : t i {H,T }}, where t i gives the outcome of the ith toss. Thus Ω consists of 2 3 = 8 points, each with equal probability 1 8. More generally, if we flip the coin n times, we get a sample space of size 2 n (corresponding to all words of length n over the alphabet {H,T }), each point having probability 1 2. We can look, e.g., at the event A that all three coin n tosses are the same. Then A = {HHH,T T T }, with each sample point having probability 1 8. Thus, Pr[A] = Pr[HHH] + Pr[T T T ] = = Flip a biased coin three times. Suppose the bias is two-to-one in favor of Heads, i.e., it comes up Heads with probability 2 3 and Tails with probability 1 3. The sample space here is exactly the same as in the previous example. However, the probabilities are different. For example, Pr[HHH] = = 8 27, while Pr[T HH] = = [Note: We have cheerfully multiplied probabilities here; we ll explain why this is OK later. It is not always OK!] More generally, if we flip a biased coin with Heads probability p (and Tails probability 1 p) n times, the probability of a given sequence is p r (1 p) n r, where r is the number of H s in the sequence. Let A be the same event as in the previous example. Then Pr[A] = Pr[HHH] + Pr[T T T ] = = 9 27 = 1 3. As a second example, let B be the event that there are exactly two Heads. We know that the probability of any outcome with two Heads (and therefore one Tail) is ( 2 3 )2 ( 1 3 ) = How many such outcomes are there? Well, there are ( 3 2) = 3 ways of choosing the positions of the Heads, and these choices completely specify the sequence. So Pr[B] = = 4 9. More generally, the probability of getting exactly r Heads from n tosses of a biased coin with Heads probability p is ( n r) p r (1 p) n r. Biased coin-tossing sequences show up in many contexts: for example, they might model the behavior of n trials of a faulty system, which fails each time with probability p Roll two dice. Then Ω = {(i, j) : 1 i, j 6}. Each of the 36 outcomes has equal probability, 36. We can look at the event A that the sum of the dice is at least 10, and B the event that there is at least one 6. In this example (and in 1 and 2 above), our probability space is uniform, i.e., all the sample points have the same probability (which must be 1 Ω, where Ω denotes the size of Ω). In such circumstances, the probability of any event A is clearly just Pr[A] = # of sample points in A # of sample points in Ω = A Ω. So for uniform spaces, computing probabilities reduces to counting sample points! Using this observation, it is now easy to compute the probabilities of the two events A and B above: Pr[A] = 6 36 = 1 6, and Pr[B] = Card Shuffling. Shuffle a deck of cards. Here Ω consists of the 52! permutations of the deck, each with equal probability 1 52!. [Note that we re really talking about an idealized mathematical model of shuffling here; in real life, there will always be a bit of bias in our shuffling. However, the mathematical model is close enough to be useful.] 6. Poker Hands. Shuffle a deck of cards, and then deal a poker hand. Here Ω consists of all possible five-card hands, each with equal probability (because the deck is assumed to be randomly shuffled). As we saw above, the number of such hands is ( 52 5 ). What is the probability that our poker hand is a CS 70, Fall 2009, Note 10 3

4 flush? [For those who are not addicted to gambling, a flush is a hand in which all cards have the same suit, say Hearts.] To compute this probability, we just need to figure out how many poker hands are flushes. Well, there are 13 cards in each suit, so the number of flushes in each suit is ( ) The total number of flushes is therefore 4 (13 ) 5. So we have Pr[hand is a flush] = 4 (13 ) 5 ) = ( ! 5! 47! 5! 8! 52! = Balls and Bins. Throw 20 (labeled) balls into 10 (labeled) bins, so that each ball is equally likely to land in any bin, regardless of what happens to the other balls. (Thus, in the terminology of the previous Note, we are in the situation of sampling with replacement and order does matter.) Here Ω = {(b 1,b 2,...,b 20 ) : 1 b i 10}; the component b i denotes the bin in which ball i lands. There are possible outcomes (why?), each with probability 1. More generally, if we throw m balls into n bins, we have a sample space of size n m. [Note that example 2 above is the special case with m = 3 and n = 2, and example 4 is the special case m = 2, n = 6.] Let A be the event that bin 1 is empty. Again, we just need to count how many outcomes have this property. And this is exactly the number of ways all 20 balls can fall into the remaining nine bins, which is Hence Pr[A] = 920 = ( ) What is the probability that bin 1 contains at least one ball? This is easy: this event, call it Ā, is the complement of A, i.e., it consists of precisely those sample points that are not in A. So Pr[Ā] = 1 Pr[A] More generally, if we throw m balls into n bins, we have ( ) n 1 m ( Pr[bin 1 is empty] = = 1 1 m. n n) As we shall see, balls and bins is another probability space that shows up very often in Computer Science: for example, we can think of it as modeling a load balancing scheme, in which each job is sent to a random processor. Birthday Paradox The birthday paradox is a remarkable phenomenon that examines the chances that two people in a group have the same birthday. It is a paradox not because of a logical contradiction, but because it goes against intuition. For ease of calculation, we take the number of days in a year to be 365. If we consider the case where there are n people in a room, then Ω = 365 n. Let A = At least two people have the same birthday, and let Ā = No two people have the same birthday. It is clear that Pr[A] = 1 Pr[Ā]. We will calculate Pr[Ā], since it is easier, and then find out Pr[A]. How many ways are there for no two people to have the same birthday? Well, there are 365 choices for the first person, 364 for the second,..., 365 n+1 choices for the n th person, for a total of (365 n+1). (Note that this is just sampling without replacement with 365 bins and n balls; as we saw in the previous Note, the number of outcomes is 365! n!, which is what we just got.) Thus we have Pr[Ā] = Ā Ω = (365 n+1) 365. Then Pr[A] = (365 n+1) n 365. n This allows us to compute Pr[A] as a function of the number of people, n. Of course, as n increases Pr[A] increases. In fact, with n = 23 people you should be willing to bet that at least two people do have the same birthday, since then Pr[A] is larger than 50%! For n = 60 people, Pr[A] is over 99%. The Monty Hall Problem In an (in)famous 1970s game show hosted by one Monty Hall, a contestant was shown three doors; behind one of the doors was a prize, and behind the other two were goats. The contestant picks a door (but doesn t CS 70, Fall 2009, Note 10 4

5 open it). Then Hall s assistant (Carol), opens one of the other two doors, revealing a goat (since Carol knows where the prize is, she can always do this). The contestant is then given the option of sticking with his current door, or switching to the other unopened one. He wins the prize if and only if his chosen door is the correct one. The question, of course, is: Does the contestant have a better chance of winning if he switches doors? Intuitively, it seems obvious that since there are only two remaining doors after the host opens one, they must have equal probability. So you may be tempted to jump to the conclusion that it should not matter whether or not the contestant stays or switches. We will see that actually, the contestant has a better chance of picking the car if he or she uses the switching strategy. We will first give an intuitive pictorial argument, and then take a more rigorous probability approach to the problem. To see why it is in the contestant s best interests to switch, consider the following. Initially when the contestant chooses the door, he or she has a 1 3 chance of picking the car. This must mean that the other doors combined have a 2 3 chance of winning. But after Carol opens a door with a goat behind it, how do the probabilities change? Well, the door the contestant originally chose still has a 1 3 chance of winning, and the door that Carol opened has no chance of winning. What about the last door? It must have a 2 3 chance of containing the car, and so the contestant has a higher chance of winning if he or she switches doors. This argument can be summed up nicely in the following picture: What is the sample space here? Well, we can describe the outcome of the game (up to the point where the contestant makes his final decision) using a triple of the form (i, j,k), where i, j,k {1,2,3}. The values i, j, k respectively specify the location of the prize, the initial door chosen by the contestant, and the door opened by Carol. Note that some triples are not possible: e.g., (1,2,1) is not, because Carol never opens the prize door. Thinking of the sample space as a tree structure, in which first i is chosen, then j, and finally k (depending on i and j), we see that there are exactly 12 sample points. Assigning probabilities to the sample points here requires pinning down some assumptions: The prize is equally likely to be behind any of the three doors. Initially, the contestant is equally likely to pick any of the three doors. If the contestant happens to pick the prize door (so there are two possible doors for Carol to open), Carol is equally likely to pick either one. From this, we can assign a probability to every sample point. For example, the point (1, 2, 3) corresponds to the prize being placed behind door 1 (with probability 1 3 ), the contestant picking door 2 (with probability 1 3 ), and Carol opening door 3 (with probability 1, because she has no choice). So Pr[(1,2,3)] = = 1 9. CS 70, Fall 2009, Note 10 5

6 [Note: Again we are multiplying probabilities here, without proper justification!] Note that there are six outcomes of this type, characterized by having i j (and hence k must be different from both). On the other hand, we have Pr[(1,1,2)] = = And there are six outcomes of this type, having i = j. These are the only possible outcomes, so we have completely defined our probability space. Just to check our arithmetic, we note that the sum of the probabilities of all outcomes is (6 1 9 ) + ( ) = 1. Let s return to the Monty Hall problem. Recall that we want to investigate the relative merits of the sticking strategy and the switching strategy. Let s suppose the contestant decides to switch doors. The event A we are interested in is the event that the contestant wins. Which sample points (i, j, k) are in A? Well, since the contestant is switching doors, his initial choice j cannot be equal to the prize door, which is i. And all outcomes of this type correspond to a win for the contestant, because Carol must open the second non-prize door, leaving the contestant to switch to the prize door. So A consists of all outcomes of the first type in our earlier analysis; recall that there are six of these, each with probability 1 9. So Pr[A] = 6 9 = 2 3. That is, using the switching strategy, the contestant wins with probability 2 3! It should be intuitively clear (and easy to check formally try it!) that under the sticking strategy his probability of winning is 1 3. (In this case, he is really just picking a single random door.) So by switching, the contestant actually improves his odds by a huge amount! This is one of many examples that illustrate the importance of doing probability calculations systematically, rather than intuitively. Recall the key steps in all our calculations: What is the sample space (i.e., the experiment and its set of possible outcomes)? What is the probability of each outcome (sample point)? What is the event we are interested in (i.e., which subset of the sample space)? Finally, compute the probability of the event by adding up the probabilities of the sample points inside it. Whenever you meet a probability problem, you should always go back to these basics to avoid potential pitfalls. Even experienced researchers make mistakes when they forget to do this witness many erroneous proofs, submitted by mathematicians to newspapers at the time, of the fact that the switching strategy in the Monty Hall problem does not improve the odds. CS 70, Fall 2009, Note 10 6

Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22

CS 70 Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 13. Random Variables: Distribution and Expectation

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 3 Random Variables: Distribution and Expectation Random Variables Question: The homeworks of 20 students are collected

Topic 1 Probability spaces

CSE 103: Probability and statistics Fall 2010 Topic 1 Probability spaces 1.1 Definition In order to properly understand a statement like the chance of getting a flush in five-card poker is about 0.2%,

Math 421: Probability and Statistics I Note Set 2

Math 421: Probability and Statistics I Note Set 2 Marcus Pendergrass September 13, 2013 4 Discrete Probability Discrete probability is concerned with situations in which you can essentially list all the

Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?

ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the

The Story. Probability - I. Plan. Example. A Probability Tree. Draw a probability tree.

Great Theoretical Ideas In Computer Science Victor Adamchi CS 5-5 Carnegie Mellon University Probability - I The Story The theory of probability was originally developed by a French mathematician Blaise

Introductory Probability. MATH 107: Finite Mathematics University of Louisville. March 5, 2014

Introductory Probability MATH 07: Finite Mathematics University of Louisville March 5, 204 What is probability? Counting and probability 2 / 3 Probability in our daily lives We see chances, odds, and probabilities

Events. Independence. Coin Tossing. Random Phenomena

Random Phenomena Events A random phenomenon is a situation in which we know what outcomes could happen, but we don t know which particular outcome did or will happen For any random phenomenon, each attempt,

Lecture 11: Probability models

Lecture 11: Probability models Probability is the mathematical toolbox to describe phenomena or experiments where randomness occur. To have a probability model we need the following ingredients A sample

Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80)

Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80) CS 30, Winter 2016 by Prasad Jayanti 1. (10 points) Here is the famous Monty Hall Puzzle. Suppose you are on a game show, and you

Reasoning with Probabilities. Critical Thinking

Reasoning with Probabilities Critical Thinking Working with Probabilities is Hard What makes it hard? The underlying mathematics: probability theory We don t do well with probability theory, especially

The Casino Lab STATION 1: CRAPS

The Casino Lab Casinos rely on the laws of probability and expected values of random variables to guarantee them profits on a daily basis. Some individuals will walk away very wealthy, while others will

3. Examples of discrete probability spaces.. Here α ( j)

3. EXAMPLES OF DISCRETE PROBABILITY SPACES 13 3. Examples of discrete probability spaces Example 17. Toss n coins. We saw this before, but assumed that the coins are fair. Now we do not. The sample space

Introduction to Discrete Probability. Terminology. Probability definition. 22c:19, section 6.x Hantao Zhang

Introduction to Discrete Probability 22c:19, section 6.x Hantao Zhang 1 Terminology Experiment A repeatable procedure that yields one of a given set of outcomes Rolling a die, for example Sample space

Grade 7/8 Math Circles Fall 2012 Probability

1 University of Waterloo Faculty of Mathematics Centre for Education in Mathematics and Computing Grade 7/8 Math Circles Fall 2012 Probability Probability is one of the most prominent uses of mathematics

Lecture 2: Probability

Lecture 2: Probability Assist. Prof. Dr. Emel YAVUZ DUMAN MCB1007 Introduction to Probability and Statistics İstanbul Kültür University Outline 1 Introduction 2 Sample Spaces 3 Event 4 The Probability

MATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables

MATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you

PROBABILITY NOTIONS. Summary. 1. Random experiment

PROBABILITY NOTIONS Summary 1. Random experiment... 1 2. Sample space... 2 3. Event... 2 4. Probability calculation... 3 4.1. Fundamental sample space... 3 4.2. Calculation of probability... 3 4.3. Non

Introduction to Probability

3 Introduction to Probability Given a fair coin, what can we expect to be the frequency of tails in a sequence of 10 coin tosses? Tossing a coin is an example of a chance experiment, namely a process which

MATH 3070 Introduction to Probability and Statistics Lecture notes Probability

Objectives: MATH 3070 Introduction to Probability and Statistics Lecture notes Probability 1. Learn the basic concepts of probability 2. Learn the basic vocabulary for probability 3. Identify the sample

Practical Probability:

Practical Probability: Casino Odds and Sucker Bets Tom Davis tomrdavis@earthlink.net April 2, 2011 Abstract Gambling casinos are there to make money, so in almost every instance, the games you can bet

The Binomial Distribution

The Binomial Distribution James H. Steiger November 10, 00 1 Topics for this Module 1. The Binomial Process. The Binomial Random Variable. The Binomial Distribution (a) Computing the Binomial pdf (b) Computing

Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

Section 2.1. Tree Diagrams

Section 2.1 Tree Diagrams Example 2.1 Problem For the resistors of Example 1.16, we used A to denote the event that a randomly chosen resistor is within 50 Ω of the nominal value. This could mean acceptable.

Introduction to Probability

Massachusetts Institute of Technology Course Notes 0 6.04J/8.06J, Fall 0: Mathematics for Computer Science November 4 Professor Albert Meyer and Dr. Radhika Nagpal revised November 6, 00, 57 minutes Introduction

PROBABILITY C A S I N O L A B

A P S T A T S A Fabulous PROBABILITY C A S I N O L A B AP Statistics Casino Lab 1 AP STATISTICS CASINO LAB: INSTRUCTIONS The purpose of this lab is to allow you to explore the rules of probability in the

Chapter 15. Definitions: experiment: is the act of making an observation or taking a measurement.

MATH 11008: Probability Chapter 15 Definitions: experiment: is the act of making an observation or taking a measurement. outcome: one of the possible things that can occur as a result of an experiment.

Probability. Experiment - any happening for which the result is uncertain. Outcome the possible result of the experiment

Probability Definitions: Experiment - any happening for which the result is uncertain Outcome the possible result of the experiment Sample space the set of all possible outcomes of the experiment Event

6.3 Conditional Probability and Independence

222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

Chapter 6. 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? Ans: 4/52.

Chapter 6 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? 4/52. 2. What is the probability that a randomly selected integer chosen from the first 100 positive

7.5 Conditional Probability; Independent Events

7.5 Conditional Probability; Independent Events Conditional Probability Example 1. Suppose there are two boxes, A and B containing some red and blue stones. The following table gives the number of stones

Introduction and Overview

Introduction and Overview Probability and Statistics is a topic that is quickly growing, has become a major part of our educational program, and has a substantial role in the NCTM Standards. While covering

Chapter 16: law of averages

Chapter 16: law of averages Context................................................................... 2 Law of averages 3 Coin tossing experiment......................................................

33 Probability: Some Basic Terms

33 Probability: Some Basic Terms In this and the coming sections we discuss the fundamental concepts of probability at a level at which no previous exposure to the topic is assumed. Probability has been

Basic Probability Theory I

A Probability puzzler!! Basic Probability Theory I Dr. Tom Ilvento FREC 408 Our Strategy with Probability Generally, we want to get to an inference from a sample to a population. In this case the population

Most of us would probably believe they are the same, it would not make a difference. But, in fact, they are different. Let s see how.

PROBABILITY If someone told you the odds of an event A occurring are 3 to 5 and the probability of another event B occurring was 3/5, which do you think is a better bet? Most of us would probably believe

LET S MAKE A DEAL! ACTIVITY

LET S MAKE A DEAL! ACTIVITY NAME: DATE: SCENARIO: Suppose you are on the game show Let s Make A Deal where Monty Hall (the host) gives you a choice of three doors. Behind one door is a valuable prize.

Probabilistic Strategies: Solutions

Probability Victor Xu Probabilistic Strategies: Solutions Western PA ARML Practice April 3, 2016 1 Problems 1. You roll two 6-sided dice. What s the probability of rolling at least one 6? There is a 1

Bayesian Tutorial (Sheet Updated 20 March)

Bayesian Tutorial (Sheet Updated 20 March) Practice Questions (for discussing in Class) Week starting 21 March 2016 1. What is the probability that the total of two dice will be greater than 8, given that

Probabilities. Probability of a event. From Random Variables to Events. From Random Variables to Events. Probability Theory I

Victor Adamchi Danny Sleator Great Theoretical Ideas In Computer Science Probability Theory I CS 5-25 Spring 200 Lecture Feb. 6, 200 Carnegie Mellon University We will consider chance experiments with

MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics

MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you should

Math 55: Discrete Mathematics

Math 55: Discrete Mathematics UC Berkeley, Fall 2011 Homework # 7, due Wedneday, March 14 Happy Pi Day! (If any errors are spotted, please email them to morrison at math dot berkeley dot edu..5.10 A croissant

Lesson 1. Basics of Probability. Principles of Mathematics 12: Explained! www.math12.com 314

Lesson 1 Basics of Probability www.math12.com 314 Sample Spaces: Probability Lesson 1 Part I: Basic Elements of Probability Consider the following situation: A six sided die is rolled The sample space

Section 8.1 Properties of Probability

Section 8. Properties of Probability Section 8. Properties of Probability A probability is a function that assigns a value between 0 and to an event, describing the likelihood of that event happening.

Lecture 13. Understanding Probability and Long-Term Expectations

Lecture 13 Understanding Probability and Long-Term Expectations Thinking Challenge What s the probability of getting a head on the toss of a single fair coin? Use a scale from 0 (no way) to 1 (sure thing).

The Monty Hall Problem

Gateway to Exploring Mathematical Sciences (GEMS) 9 November, 2013 Lecture Notes The Monty Hall Problem Mark Huber Fletcher Jones Foundation Associate Professor of Mathematics and Statistics and George

Section 6-5 Sample Spaces and Probability

492 6 SEQUENCES, SERIES, AND PROBABILITY 52. How many committees of 4 people are possible from a group of 9 people if (A) There are no restrictions? (B) Both Juan and Mary must be on the committee? (C)

MAT 1000. Mathematics in Today's World

MAT 1000 Mathematics in Today's World We talked about Cryptography Last Time We will talk about probability. Today There are four rules that govern probabilities. One good way to analyze simple probabilities

Week 2: Conditional Probability and Bayes formula

Week 2: Conditional Probability and Bayes formula We ask the following question: suppose we know that a certain event B has occurred. How does this impact the probability of some other A. This question

36 Odds, Expected Value, and Conditional Probability

36 Odds, Expected Value, and Conditional Probability What s the difference between probabilities and odds? To answer this question, let s consider a game that involves rolling a die. If one gets the face

Expected Value 10/11/2005

Expected Value 10/11/2005 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω xm(x), provided

I. WHAT IS PROBABILITY?

C HAPTER 3 PROBABILITY Random Experiments I. WHAT IS PROBABILITY? The weatherman on 0 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

I. WHAT IS PROBABILITY?

C HAPTER 3 PROAILITY Random Experiments I. WHAT IS PROAILITY? The weatherman on 10 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

Stat 110. Unit 3: Random Variables Chapter 3 in the Text

Stat 110 Unit 3: Random Variables Chapter 3 in the Text 1 Unit 3 Outline Random Variables (RVs) and Distributions Discrete RVs and Probability Mass Functions (PMFs) Bernoulli and Binomial Distributions

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 20

CS 70 Discrete Mathematics and Probability Theory Fall 009 Satish Rao, David Tse Note 0 Infinity and Countability Consider a function (or mapping) f that maps elements of a set A (called the domain of

MATH 140 Lab 4: Probability and the Standard Normal Distribution

MATH 140 Lab 4: Probability and the Standard Normal Distribution Problem 1. Flipping a Coin Problem In this problem, we want to simualte the process of flipping a fair coin 1000 times. Note that the outcomes

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPETED VALUE A game of chance featured at an amusement park is played as follows: You pay \$ to play. A penny and a nickel are flipped. You win \$ if either

Conditional Probability, Independence and Bayes Theorem Class 3, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom

Conditional Probability, Independence and Bayes Theorem Class 3, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of conditional probability and independence

15 Chances, Probabilities, and Odds

15 Chances, Probabilities, and Odds 15.1 Random Experiments and Sample Spaces 15.2 Counting Outcomes in Sample Spaces 15.3 Permutations and Combinations 15.4 Probability Spaces 15.5 Equiprobable Spaces

Probability Life is full of uncertainty. Probability is the best way we currently have to quantify it.

Probability Life is full of uncertainty. Probability is the best way we currently have to quantify it. Probability Life is full of uncertainty. Probability is the best way we currently have to quantify

Statistics 100A Homework 3 Solutions

Chapter Statistics 00A Homework Solutions Ryan Rosario. Two balls are chosen randomly from an urn containing 8 white, black, and orange balls. Suppose that we win \$ for each black ball selected and we

Basics of Probability

Basics of Probability August 27 and September 1, 2009 1 Introduction A phenomena is called random if the exact outcome is uncertain. The mathematical study of randomness is called the theory of probability.

Session 8 Probability

Key Terms for This Session Session 8 Probability Previously Introduced frequency New in This Session binomial experiment binomial probability model experimental probability mathematical probability outcome

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 2

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 2 Proofs Intuitively, the concept of proof should already be familiar We all like to assert things, and few of us

Chapter 3: The basic concepts of probability

Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording

8.5 Probability Distributions; Expected Value

Math 07 - Finite Math.5 Probability Distributions; Expected Value In this section, we shall see that the expected value of a probability distribution is a type of average. A probability distribution depends

JANUARY TERM 2012 FUN and GAMES WITH DISCRETE MATHEMATICS Module #9 (Geometric Series and Probability)

JANUARY TERM 2012 FUN and GAMES WITH DISCRETE MATHEMATICS Module #9 (Geometric Series and Probability) Author: Daniel Cooney Reviewer: Rachel Zax Last modified: January 4, 2012 Reading from Meyer, Mathematics

Probability. A random sample is selected in such a way that every different sample of size n has an equal chance of selection.

1 3.1 Sample Spaces and Tree Diagrams Probability This section introduces terminology and some techniques which will eventually lead us to the basic concept of the probability of an event. The Rare Event

Discrete Mathematics Lecture 5. Harper Langston New York University

Discrete Mathematics Lecture 5 Harper Langston New York University Empty Set S = {x R, x 2 = -1} X = {1, 3}, Y = {2, 4}, C = X Y (X and Y are disjoint) Empty set has no elements Empty set is a subset of

Massachusetts Institute of Technology

n (i) m m (ii) n m ( (iii) n n n n (iv) m m Massachusetts Institute of Technology 6.0/6.: Probabilistic Systems Analysis (Quiz Solutions Spring 009) Question Multiple Choice Questions: CLEARLY circle the

Gaming the Law of Large Numbers

Gaming the Law of Large Numbers Thomas Hoffman and Bart Snapp July 3, 2012 Many of us view mathematics as a rich and wonderfully elaborate game. In turn, games can be used to illustrate mathematical ideas.

Contemporary Mathematics- MAT 130. Probability. a) What is the probability of obtaining a number less than 4?

Contemporary Mathematics- MAT 30 Solve the following problems:. A fair die is tossed. What is the probability of obtaining a number less than 4? What is the probability of obtaining a number less than

Lesson 1: Experimental and Theoretical Probability

Lesson 1: Experimental and Theoretical Probability Probability is the study of randomness. For instance, weather is random. In probability, the goal is to determine the chances of certain events happening.

1. De Morgan s Law. Let U be a set and consider the following logical statement depending on an integer n. We will call this statement P (n):

Math 309 Fall 0 Homework 5 Drew Armstrong. De Morgan s Law. Let U be a set and consider the following logical statement depending on an integer n. We will call this statement P (n): For any n sets A, A,...,

3. Conditional probability & independence

3. Conditional probability & independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Derivation: Suppose we repeat the experiment n times. Let

AP Stats - Probability Review

AP Stats - Probability Review Multiple Choice Identify the choice that best completes the statement or answers the question. 1. I toss a penny and observe whether it lands heads up or tails up. Suppose

MATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS

MATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS CONTENTS Sample Space Accumulative Probability Probability Distributions Binomial Distribution Normal Distribution Poisson Distribution

Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom

Probability: Terminology and Examples Class 2, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of sample space, event and probability function. 2. Be able to

Lab 11. Simulations. The Concept

Lab 11 Simulations In this lab you ll learn how to create simulations to provide approximate answers to probability questions. We ll make use of a particular kind of structure, called a box model, that

Probability and Expected Value

Probability and Expected Value This handout provides an introduction to probability and expected value. Some of you may already be familiar with some of these topics. Probability and expected value are

In the situations that we will encounter, we may generally calculate the probability of an event

What does it mean for something to be random? An event is called random if the process which produces the outcome is sufficiently complicated that we are unable to predict the precise result and are instead

Avoiding the Consolation Prize: The Mathematics of Game Shows

Avoiding the Consolation Prize: The Mathematics of Game Shows STUART GLUCK, Ph.D. CENTER FOR TALENTED YOUTH JOHNS HOPKINS UNIVERSITY STU@JHU.EDU CARLOS RODRIGUEZ CENTER FOR TALENTED YOUTH JOHNS HOPKINS

PROBABILITY. Chapter Overview

Chapter 6 PROBABILITY 6. Overview Probability is defined as a quantitative measure of uncertainty a numerical value that conveys the strength of our belief in the occurrence of an event. The probability

Finite and discrete probability distributions

8 Finite and discrete probability distributions To understand the algorithmic aspects of number theory and algebra, and applications such as cryptography, a firm grasp of the basics of probability theory

5544 = 2 2772 = 2 2 1386 = 2 2 2 693. Now we have to find a divisor of 693. We can try 3, and 693 = 3 231,and we keep dividing by 3 to get: 1

MATH 13150: Freshman Seminar Unit 8 1. Prime numbers 1.1. Primes. A number bigger than 1 is called prime if its only divisors are 1 and itself. For example, 3 is prime because the only numbers dividing

8. You have three six-sided dice (one red, one green, and one blue.) The numbers of the dice are

Probability Warm up problem. Alice and Bob each pick, at random, a real number between 0 and 10. Call Alice s number A and Bob s number B. The is the probability that A B? What is the probability that

1 Combinations, Permutations, and Elementary Probability

1 Combinations, Permutations, and Elementary Probability Roughly speaking, Permutations are ways of grouping things where the order is important. Combinations are ways of grouping things where the order

number of favorable outcomes total number of outcomes number of times event E occurred number of times the experiment was performed.

12 Probability 12.1 Basic Concepts Start with some Definitions: Experiment: Any observation of measurement of a random phenomenon is an experiment. Outcomes: Any result of an experiment is called an outcome.

Probability and Random Variables (Rees: )

Probability and Random Variables (Rees:. -.) Earlier in this course, we looked at methods of describing the data in a sample. Next we would like to have models for the ways in which data can arise. Before

Worksheet for Teaching Module Probability (Lesson 1)

Worksheet for Teaching Module Probability (Lesson 1) Topic: Basic Concepts and Definitions Equipment needed for each student 1 computer with internet connection Introduction In the regular lectures in

The Central Limit Theorem Part 1

The Central Limit Theorem Part. Introduction: Let s pose the following question. Imagine you were to flip 400 coins. To each coin flip assign if the outcome is heads and 0 if the outcome is tails. Question:

An event is any set of outcomes of a random experiment; that is, any subset of the sample space of the experiment. The probability of a given event

An event is any set of outcomes of a random experiment; that is, any subset of the sample space of the experiment. The probability of a given event is the sum of the probabilities of the outcomes in the

We rst consider the game from the player's point of view: Suppose you have picked a number and placed your bet. The probability of winning is

Roulette: On an American roulette wheel here are 38 compartments where the ball can land. They are numbered 1-36, and there are two compartments labeled 0 and 00. Half of the compartments numbered 1-36

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments

That s Not Fair! ASSESSMENT #HSMA20. Benchmark Grades: 9-12

That s Not Fair! ASSESSMENT # Benchmark Grades: 9-12 Summary: Students consider the difference between fair and unfair games, using probability to analyze games. The probability will be used to find ways

A Simple Example. Sample Space and Event. Tree Diagram. Tree Diagram. Probability. Probability - 1. Probability and Counting Rules

Probability and Counting Rules researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people in this random sample