# Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 CS 70 Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette wheels. Today it is an essential tool in engineering and the sciences. No less so in computer science, where its use is widespread in algorithms, systems, learning theory and artificial intelligence. Here are some typical statements that you might see concerning probability: The chance of getting a flush in a 5-card poker hand is about 2 in The chance that a particular implementation of the primality testing algorithm outputs prime when the input is composite is at most one in a trillion. The average time between system failures is about 3 days. In this load-balancing scheme, the probability that any processor has to deal with more than 12 requests is negligible. There is a 30% chance of a magnitude 8.0 earthquake in Northern California before Implicit in all such statements is the notion of an underlying probability space. This may be the result of a random experiment that we have ourselves constructed (as in 1, 2 and 3 above), or some model we build of the real world (as in 4 and 5 above). None of these statements makes sense unless we specify the probability space we are talking about: for this reason, statements like 5 (which are typically made without this context) are almost content-free. Let us try to understand all this more clearly. The first important notion here is one of a random experiment. An example of such an experiment is tossing a coin 4 times, or dealing a poker hand. In the first case an outcome of the experiment might be HTHT or it might be HHHT. The question we are interested in might be what is the chance that there are 2 H s. Well, there are several outcomes that would meet that condition: HHTT,HTHT,HTT H,THHT,THTH,TTHH. The total number of distinct outcomes to this experiment is 2 4 = 16. If the coin is fair then all these 16 outcomes are equally likely, so the chance that there are exactly 2 H s is 3/8. As we saw with counting, there is a common framework in which we can view random experiments about flipping coins, dealing cards, rolling dice, etc. A finite process is the following: We are given a finite population U, of cardinality n. In the case of coin tossing, U = {H,T }, and in card dealing, U is the set of 52 cards. An experiment consists of drawing a sample of k elements from U. As before we will consider two cases: sampling with replacement and sampling without replacement. Thus in our coin flipping example, n = 2 and the sample size is k = 4. The outcome of the experiment is called a sample point. Thus HTHT is an example of a sample point. The sample space, often denoted by Ω, is the set of all possible outcomes. In our example the sample space has 16 elements. CS 70, Fall 2006, Lecture 22 1

2 A probability space is a sample space Ω, together with a probability Pr[ω] for each sample point ω, such that 0 Pr[ω] 1 for all ω Ω. Pr[ω] = 1, i.e., the sum of the probabilities of all outcomes is 1. ω Ω The easiest way to assign probabilities to sample points is uniformly (as we saw earlier in the coin tossing example): if Ω = N, then P[x] = 1 N x Ω. We will see examples of non-uniform probability distributions soon. Here s another example: dealing a poker hand. In this case, our sample space Ω = {all possible poker hands}. Thus, Ω = ( 52) 5 = = 2, 598, 960. Since the probability of each outcome is equally 1 like, this implies that the probability of any particular hand, such as, P[{5h, 3c, 7s, 8c, Kh}] = 2,598,960. As we saw in the coin tossing example above, what we are often interested in knowing after performing an experiment is whether a certain event occurred. Thus we considered the event that there were exactly two H s in the four tosses of the coin. Here are some more examples of events we might be interested in: Sum of the rolls of 2 dice is 10. Poker hand is a flush (i.e., all 5 cards have the same suit). n coin tosses where n 3 landed on tails. Let us now formalize this notion of an event. Formally, an event E is just a subset of the sample space, E Ω. As we saw above, the event exactly 2 H s in four tosses of the coin is the subset: {HHTT,HTHT,HTT H,THHT,THTH,T T HH} Ω. How should we define the probability of an event A? Naturally, we should just add up the probabilities of the sample points in A. For any event A Ω, we define the probability of A to be Pr[A] = Pr[ω]. ω A Thus the probability of getting exactly two H s in four coin tosses can be calculated using this definition as follows. A consists of all sequences that have exactly two H s, and so A = 6. For this example, there are CS 70, Fall 2006, Lecture 22 2

4 since it is a subset of all possible poker hands)? [For those who are not addicted to gambling, a flush is a hand in which all cards have the same suit, say Hearts.] To compute this probability, we just need to figure out how many poker hands are flushes. Well, there are 13 cards in each suit, so the number of flushes in each suit is ( 13) 5. The total number of flushes is therefore 4 ( 13 ) 5. So we have Pr[hand is a flush] = 4 (13 ) 5 ) = ( ! 5! 47! 5! 8! 52! = Balls and Bins. Throw 20 balls into 10 bins, so that each ball is equally likely to land in any bin, regardless of what happens to the other balls. Here Ω = {(b 1,b 2,...,b 20 ) : 1 b i 10}; the component b i denotes the bin in which ball i lands. There are possible outcomes (why?), each with probability 1. More generally, if we throw m balls into n bins, we have a sample space of size n m [Note that example 2 above is a special case of balls and bins, with m = 3 and n = 2.] Let A be the event that bin 1 is empty. Again, we just need to count how many outcomes have this property. And this is exactly the number of ways all 20 balls can fall into the remaining nine boxes, which is Hence Pr[A] = 920 = ( ) What is the probability that bin 1 contains at least one ball? This is easy: this event, call it Ā, is the complement of A, i.e., it consists of precisely those sample points that are not in A. So Pr[Ā] = 1 Pr[A] More generally, if we throw m balls into n bins, we have ( ) n 1 m ( Pr[bin 1 is empty] = = 1 1 m. n n) As we shall see, balls and bins is another probability space that shows up very often in Computer Science: for example, we can think of it as modeling a load balancing scheme, in which each job is sent to a random processor. Birthday Paradox The birthday paradox is a remarkable phenomenon that examines the chances that two people in a group have the same birthday. It is a paradox not because of a logical contradiction, but because it goes against intuition. For ease of calculation, we take the number of days in a year to be 365. If we consider the case where there are n people in a room, then Ω = 365 n. Let A = At least two people have the same birthday, and let B = No two people have the same birthday. It is clear that P[A] = 1 P[B]. We will calculate P[B], since it is easier, and then find out P[A]. How many ways are there for no two people to have the same birthday? Well, there are 365 choices for the first person, 364 for the second,..., 365 n+1 choices for the n th person. Thus, P[B] = B Ω = (365 n+1) 365. Then P[A] = (365 n+1) n 365. In fact, at n n = 23 people, you should be willing to bet that at least two people do have the same birthday, since the chances of you winning are over 50%! The chances increase dramatically, and at n = 60 people the chances are over 99%. The Monty Hall Problem In an (in)famous 1970s game show hosted by one Monty Hall, a contestant was shown three doors; behind one of the doors was a prize, and behind the other two were goats. The contestant picks a door (but doesn t open it). Then Hall s assistant (Carol), opens one of the other two doors, revealing a goat (since Carol knows where the prize is, she can always do this). The contestant is then given the option of sticking with his current door, or switching to the other unopened one. He wins the prize if and only if his chosen door CS 70, Fall 2006, Lecture 22 4

5 is the correct one. The question, of course, is: Does the contestant have a better chance of winning if he switches doors? Intuitively, it seems obvious that since there are only two remaining doors after the host opens one, they must have equal probability. So you may be tempted to jump to the conclusion that it should not matter whether or not the contestant stays or switches. We will see that actually, the contestant has a better chance of picking the car if he or she uses the switching strategy. We will first give an intuitive pictorial argument, and then take a more rigorous probability approach to the problem. To see why it is in the contestant s best interests to switch, consider the following. Initially when the contestant chooses the door, he or she has a 1 3 chance of picking the car. This must mean that the other doors combined have a 2 3 chance of winning. But after Carol opens a door with a goat behind it, how do the probabilities change? Well, the door the contestant originally chose still has a 1 3 chance of winning, and the door that Carol opened has no chance of winning. What about the last door? It must have a 2 3 chance of containing the car, and so the contestant has a higher chance of winning if he or she switches doors. This argument can be summed up nicely in the following picture: What is the sample space here? Well, we can describe the outcome of the game (up to the point where the contestant makes his final decision) using a triple of the form (i, j,k), where i, j,k {1,2,3}. The values i, j,k respectively specify the location of the prize, the initial door chosen by the contestant, and the door opened by Carol. Note that some triples are not possible: e.g., (1,2,1) is not, because Carol never opens the prize door. Thinking of the sample space as a tree structure, in which first i is chosen, then j, and finally k (depending on i and j), we see that there are exactly 12 sample points. Assigning probabilities to the sample points here requires pinning down some assumptions: The prize is equally likely to be behind any of the three doors. Initially, the contestant is equally likely to pick any of the three doors. If the contestant happens to pick the prize door (so there are two possible doors for Carol to open), Carol is equally likely to pick either one. From this, we can assign a probability to every sample point. For example, the point (1,2,3) corresponds to the prize being placed behind door 1 (with probability 1 3 ), the contestant picking door 2 (with probability 1 3 ), and Carol opening door 3 (with probability 1, because she has no choice). So Pr[(1,2,3)] = = 1 9. [Note: Again we are multiplying probabilities here, without proper justification!] Note that there are six outcomes of this type, characterized by having i j (and hence k must be different from both). On the other CS 70, Fall 2006, Lecture 22 5

6 hand, we have Pr[(1,1,2)] = = And there are six outcomes of this type, having i = j. These are the only possible outcomes, so we have completely defined our probability space. Just to check our arithmetic, we note that the sum of the probabilities of all outcomes is (6 1 9 )+( ) = 1. Let s return to the Monty Hall problem. Recall that we want to investigate the relative merits of the sticking strategy and the switching strategy. Let s suppose the contestant decides to switch doors. The event A we are interested in is the event that the contestant wins. Which sample points (i, j, k) are in A? Well, since the contestant is switching doors, his initial choice j cannot be equal to the prize door, which is i. And all outcomes of this type correspond to a win for the contestant, because Carol must open the second non-prize door, leaving the contestant to switch to the prize door. So A consists of all outcomes of the first type in our earlier analysis; recall that there are six of these, each with probability 1 9. So Pr[A] = 6 9 = 2 3. That is, using the switching strategy, the contestant wins with probability 2 3! It should be intuitively clear (and easy to check formally try it!) that under the sticking strategy his probability of winning is 1 3. (In this case, he is really just picking a single random door.) So by switching, the contestant actually improves his odds by a huge amount! This is one of many examples that illustrate the importance of doing probability calculations systematically, rather than intuitively. Recall the key steps in all our calculations: What is the sample space (i.e., the experiment and its set of possible outcomes)? What is the probability of each outcome (sample point)? What is the event we are interested in (i.e., which subset of the sample space)? Finally, compute the probability of the event by adding up the probabilities of the sample points inside it. Whenever you meet a probability problem, you should always go back to these basics to avoid potential pitfalls. Even experienced researchers make mistakes when they forget to do this witness many erroneous proofs, submitted by mathematicians to newspapers at the time, of the fact that the switching strategy in the Monty Hall problem does not improve the odds. CS 70, Fall 2006, Lecture 22 6

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 10 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice,

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

### Topic 1 Probability spaces

CSE 103: Probability and statistics Fall 2010 Topic 1 Probability spaces 1.1 Definition In order to properly understand a statement like the chance of getting a flush in five-card poker is about 0.2%,

### Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?

ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 13. Random Variables: Distribution and Expectation

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 3 Random Variables: Distribution and Expectation Random Variables Question: The homeworks of 20 students are collected

### Introductory Probability. MATH 107: Finite Mathematics University of Louisville. March 5, 2014

Introductory Probability MATH 07: Finite Mathematics University of Louisville March 5, 204 What is probability? Counting and probability 2 / 3 Probability in our daily lives We see chances, odds, and probabilities

### The Story. Probability - I. Plan. Example. A Probability Tree. Draw a probability tree.

Great Theoretical Ideas In Computer Science Victor Adamchi CS 5-5 Carnegie Mellon University Probability - I The Story The theory of probability was originally developed by a French mathematician Blaise

### 3. Examples of discrete probability spaces.. Here α ( j)

3. EXAMPLES OF DISCRETE PROBABILITY SPACES 13 3. Examples of discrete probability spaces Example 17. Toss n coins. We saw this before, but assumed that the coins are fair. Now we do not. The sample space

### Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80)

Discrete Math in Computer Science Homework 7 Solutions (Max Points: 80) CS 30, Winter 2016 by Prasad Jayanti 1. (10 points) Here is the famous Monty Hall Puzzle. Suppose you are on a game show, and you

### The Casino Lab STATION 1: CRAPS

The Casino Lab Casinos rely on the laws of probability and expected values of random variables to guarantee them profits on a daily basis. Some individuals will walk away very wealthy, while others will

### Lecture 2: Probability

Lecture 2: Probability Assist. Prof. Dr. Emel YAVUZ DUMAN MCB1007 Introduction to Probability and Statistics İstanbul Kültür University Outline 1 Introduction 2 Sample Spaces 3 Event 4 The Probability

### Probabilities. Probability of a event. From Random Variables to Events. From Random Variables to Events. Probability Theory I

Victor Adamchi Danny Sleator Great Theoretical Ideas In Computer Science Probability Theory I CS 5-25 Spring 200 Lecture Feb. 6, 200 Carnegie Mellon University We will consider chance experiments with

### Events. Independence. Coin Tossing. Random Phenomena

Random Phenomena Events A random phenomenon is a situation in which we know what outcomes could happen, but we don t know which particular outcome did or will happen For any random phenomenon, each attempt,

### Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

### PROBABILITY NOTIONS. Summary. 1. Random experiment

PROBABILITY NOTIONS Summary 1. Random experiment... 1 2. Sample space... 2 3. Event... 2 4. Probability calculation... 3 4.1. Fundamental sample space... 3 4.2. Calculation of probability... 3 4.3. Non

### Introduction to Discrete Probability. Terminology. Probability definition. 22c:19, section 6.x Hantao Zhang

Introduction to Discrete Probability 22c:19, section 6.x Hantao Zhang 1 Terminology Experiment A repeatable procedure that yields one of a given set of outcomes Rolling a die, for example Sample space

### Probabilistic Strategies: Solutions

Probability Victor Xu Probabilistic Strategies: Solutions Western PA ARML Practice April 3, 2016 1 Problems 1. You roll two 6-sided dice. What s the probability of rolling at least one 6? There is a 1

### Reasoning with Probabilities. Critical Thinking

Reasoning with Probabilities Critical Thinking Working with Probabilities is Hard What makes it hard? The underlying mathematics: probability theory We don t do well with probability theory, especially

### Basic Probability Theory I

A Probability puzzler!! Basic Probability Theory I Dr. Tom Ilvento FREC 408 Our Strategy with Probability Generally, we want to get to an inference from a sample to a population. In this case the population

### MATH 140 Lab 4: Probability and the Standard Normal Distribution

MATH 140 Lab 4: Probability and the Standard Normal Distribution Problem 1. Flipping a Coin Problem In this problem, we want to simualte the process of flipping a fair coin 1000 times. Note that the outcomes

### Section 2.1. Tree Diagrams

Section 2.1 Tree Diagrams Example 2.1 Problem For the resistors of Example 1.16, we used A to denote the event that a randomly chosen resistor is within 50 Ω of the nominal value. This could mean acceptable.

### Discrete Mathematics Lecture 5. Harper Langston New York University

Discrete Mathematics Lecture 5 Harper Langston New York University Empty Set S = {x R, x 2 = -1} X = {1, 3}, Y = {2, 4}, C = X Y (X and Y are disjoint) Empty set has no elements Empty set is a subset of

### Math 55: Discrete Mathematics

Math 55: Discrete Mathematics UC Berkeley, Fall 2011 Homework # 7, due Wedneday, March 14 Happy Pi Day! (If any errors are spotted, please email them to morrison at math dot berkeley dot edu..5.10 A croissant

### Introduction to Probability

Massachusetts Institute of Technology Course Notes 0 6.04J/8.06J, Fall 0: Mathematics for Computer Science November 4 Professor Albert Meyer and Dr. Radhika Nagpal revised November 6, 00, 57 minutes Introduction

### 6.3 Conditional Probability and Independence

222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

### PROBABILITY C A S I N O L A B

A P S T A T S A Fabulous PROBABILITY C A S I N O L A B AP Statistics Casino Lab 1 AP STATISTICS CASINO LAB: INSTRUCTIONS The purpose of this lab is to allow you to explore the rules of probability in the

### MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics

MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you should

### Practical Probability:

Practical Probability: Casino Odds and Sucker Bets Tom Davis tomrdavis@earthlink.net April 2, 2011 Abstract Gambling casinos are there to make money, so in almost every instance, the games you can bet

### I. WHAT IS PROBABILITY?

C HAPTER 3 PROAILITY Random Experiments I. WHAT IS PROAILITY? The weatherman on 10 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

### MATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables

MATH 10: Elementary Statistics and Probability Chapter 4: Discrete Random Variables Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you

### Introduction and Overview

Introduction and Overview Probability and Statistics is a topic that is quickly growing, has become a major part of our educational program, and has a substantial role in the NCTM Standards. While covering

### I. WHAT IS PROBABILITY?

C HAPTER 3 PROBABILITY Random Experiments I. WHAT IS PROBABILITY? The weatherman on 0 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

### Section 6-5 Sample Spaces and Probability

492 6 SEQUENCES, SERIES, AND PROBABILITY 52. How many committees of 4 people are possible from a group of 9 people if (A) There are no restrictions? (B) Both Juan and Mary must be on the committee? (C)

### Chapter 3: The basic concepts of probability

Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording

### Lecture 13. Understanding Probability and Long-Term Expectations

Lecture 13 Understanding Probability and Long-Term Expectations Thinking Challenge What s the probability of getting a head on the toss of a single fair coin? Use a scale from 0 (no way) to 1 (sure thing).

### Chapter 15. Definitions: experiment: is the act of making an observation or taking a measurement.

MATH 11008: Probability Chapter 15 Definitions: experiment: is the act of making an observation or taking a measurement. outcome: one of the possible things that can occur as a result of an experiment.

### A Few Basics of Probability

A Few Basics of Probability Philosophy 57 Spring, 2004 1 Introduction This handout distinguishes between inductive and deductive logic, and then introduces probability, a concept essential to the study

### Conditional Probability, Hypothesis Testing, and the Monty Hall Problem

Conditional Probability, Hypothesis Testing, and the Monty Hall Problem Ernie Croot September 17, 2008 On more than one occasion I have heard the comment Probability does not exist in the real world, and

### The Binomial Distribution

The Binomial Distribution James H. Steiger November 10, 00 1 Topics for this Module 1. The Binomial Process. The Binomial Random Variable. The Binomial Distribution (a) Computing the Binomial pdf (b) Computing

### Finite and discrete probability distributions

8 Finite and discrete probability distributions To understand the algorithmic aspects of number theory and algebra, and applications such as cryptography, a firm grasp of the basics of probability theory

### MAT 1000. Mathematics in Today's World

MAT 1000 Mathematics in Today's World We talked about Cryptography Last Time We will talk about probability. Today There are four rules that govern probabilities. One good way to analyze simple probabilities

### 33 Probability: Some Basic Terms

33 Probability: Some Basic Terms In this and the coming sections we discuss the fundamental concepts of probability at a level at which no previous exposure to the topic is assumed. Probability has been

### The Monty Hall Problem

Gateway to Exploring Mathematical Sciences (GEMS) 9 November, 2013 Lecture Notes The Monty Hall Problem Mark Huber Fletcher Jones Foundation Associate Professor of Mathematics and Statistics and George

### Grade 7/8 Math Circles Fall 2012 Probability

1 University of Waterloo Faculty of Mathematics Centre for Education in Mathematics and Computing Grade 7/8 Math Circles Fall 2012 Probability Probability is one of the most prominent uses of mathematics

### 5544 = 2 2772 = 2 2 1386 = 2 2 2 693. Now we have to find a divisor of 693. We can try 3, and 693 = 3 231,and we keep dividing by 3 to get: 1

MATH 13150: Freshman Seminar Unit 8 1. Prime numbers 1.1. Primes. A number bigger than 1 is called prime if its only divisors are 1 and itself. For example, 3 is prime because the only numbers dividing

### Introduction to Probability

3 Introduction to Probability Given a fair coin, what can we expect to be the frequency of tails in a sequence of 10 coin tosses? Tossing a coin is an example of a chance experiment, namely a process which

### JANUARY TERM 2012 FUN and GAMES WITH DISCRETE MATHEMATICS Module #9 (Geometric Series and Probability)

JANUARY TERM 2012 FUN and GAMES WITH DISCRETE MATHEMATICS Module #9 (Geometric Series and Probability) Author: Daniel Cooney Reviewer: Rachel Zax Last modified: January 4, 2012 Reading from Meyer, Mathematics

### V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPETED VALUE A game of chance featured at an amusement park is played as follows: You pay \$ to play. A penny and a nickel are flipped. You win \$ if either

### AP Stats - Probability Review

AP Stats - Probability Review Multiple Choice Identify the choice that best completes the statement or answers the question. 1. I toss a penny and observe whether it lands heads up or tails up. Suppose

### Massachusetts Institute of Technology

n (i) m m (ii) n m ( (iii) n n n n (iv) m m Massachusetts Institute of Technology 6.0/6.: Probabilistic Systems Analysis (Quiz Solutions Spring 009) Question Multiple Choice Questions: CLEARLY circle the

### Statistics 100A Homework 3 Solutions

Chapter Statistics 00A Homework Solutions Ryan Rosario. Two balls are chosen randomly from an urn containing 8 white, black, and orange balls. Suppose that we win \$ for each black ball selected and we

### LET S MAKE A DEAL! ACTIVITY

LET S MAKE A DEAL! ACTIVITY NAME: DATE: SCENARIO: Suppose you are on the game show Let s Make A Deal where Monty Hall (the host) gives you a choice of three doors. Behind one door is a valuable prize.

### Worksheet for Teaching Module Probability (Lesson 1)

Worksheet for Teaching Module Probability (Lesson 1) Topic: Basic Concepts and Definitions Equipment needed for each student 1 computer with internet connection Introduction In the regular lectures in

### Avoiding the Consolation Prize: The Mathematics of Game Shows

Avoiding the Consolation Prize: The Mathematics of Game Shows STUART GLUCK, Ph.D. CENTER FOR TALENTED YOUTH JOHNS HOPKINS UNIVERSITY STU@JHU.EDU CARLOS RODRIGUEZ CENTER FOR TALENTED YOUTH JOHNS HOPKINS

### Week 2: Conditional Probability and Bayes formula

Week 2: Conditional Probability and Bayes formula We ask the following question: suppose we know that a certain event B has occurred. How does this impact the probability of some other A. This question

### Bayesian Tutorial (Sheet Updated 20 March)

Bayesian Tutorial (Sheet Updated 20 March) Practice Questions (for discussing in Class) Week starting 21 March 2016 1. What is the probability that the total of two dice will be greater than 8, given that

### Chapter 16: law of averages

Chapter 16: law of averages Context................................................................... 2 Law of averages 3 Coin tossing experiment......................................................

### Most of us would probably believe they are the same, it would not make a difference. But, in fact, they are different. Let s see how.

PROBABILITY If someone told you the odds of an event A occurring are 3 to 5 and the probability of another event B occurring was 3/5, which do you think is a better bet? Most of us would probably believe

### Lesson 1. Basics of Probability. Principles of Mathematics 12: Explained! www.math12.com 314

Lesson 1 Basics of Probability www.math12.com 314 Sample Spaces: Probability Lesson 1 Part I: Basic Elements of Probability Consider the following situation: A six sided die is rolled The sample space

### Probability Review. ICPSR Applied Bayesian Modeling

Probability Review ICPSR Applied Bayesian Modeling Random Variables Flip a coin. Will it be heads or tails? The outcome of a single event is random, or unpredictable What if we flip a coin 10 times? How

### Probability definitions

Probability definitions 1. Probability of an event = chance that the event will occur. 2. Experiment = any action or process that generates observations. In some contexts, we speak of a data-generating

### Basic concepts in probability. Sue Gordon

Mathematics Learning Centre Basic concepts in probability Sue Gordon c 2005 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Set Notation You may omit this section if you are

### Statistics and Random Variables. Math 425 Introduction to Probability Lecture 14. Finite valued Random Variables. Expectation defined

Expectation Statistics and Random Variables Math 425 Introduction to Probability Lecture 4 Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan February 9, 2009 When a large

### Math/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability

Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock

### Probability Life is full of uncertainty. Probability is the best way we currently have to quantify it.

Probability Life is full of uncertainty. Probability is the best way we currently have to quantify it. Probability Life is full of uncertainty. Probability is the best way we currently have to quantify

### To formulate more complex mathematical statements, we use the quantifiers there exists, written, and for all, written. If P(x) is a predicate, then

Discrete Math in CS CS 280 Fall 2005 (Kleinberg) Quantifiers 1 Quantifiers To formulate more complex mathematical statements, we use the quantifiers there exists, written, and for all, written. If P(x)

### In the situations that we will encounter, we may generally calculate the probability of an event

What does it mean for something to be random? An event is called random if the process which produces the outcome is sufficiently complicated that we are unable to predict the precise result and are instead

### Introduction to probability theory in the Discrete Mathematics course

Introduction to probability theory in the Discrete Mathematics course Jiří Matoušek (KAM MFF UK) Version: Oct/18/2013 Introduction This detailed syllabus contains definitions, statements of the main results

### A1. Basic Reviews PERMUTATIONS and COMBINATIONS... or HOW TO COUNT

A1. Basic Reviews Appendix / A1. Basic Reviews / Perms & Combos-1 PERMUTATIONS and COMBINATIONS... or HOW TO COUNT Question 1: Suppose we wish to arrange n 5 people {a, b, c, d, e}, standing side by side,

### Probability. a number between 0 and 1 that indicates how likely it is that a specific event or set of events will occur.

Probability Probability Simple experiment Sample space Sample point, or elementary event Event, or event class Mutually exclusive outcomes Independent events a number between 0 and 1 that indicates how

### HMMT February Saturday 21 February Combinatorics

HMMT February 015 Saturday 1 February 015 1. Evan s analog clock displays the time 1:13; the number of seconds is not shown. After 10 seconds elapse, it is still 1:13. What is the expected number of seconds

### Examples of infinite sample spaces. Math 425 Introduction to Probability Lecture 12. Example of coin tosses. Axiom 3 Strong form

Infinite Discrete Sample Spaces s of infinite sample spaces Math 425 Introduction to Probability Lecture 2 Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan February 4,

### Gaming the Law of Large Numbers

Gaming the Law of Large Numbers Thomas Hoffman and Bart Snapp July 3, 2012 Many of us view mathematics as a rich and wonderfully elaborate game. In turn, games can be used to illustrate mathematical ideas.

### Chapter 17: Thinking About Chance

Chapter 17: Thinking About Chance Thought Question Flip a coin 20 times and record the results of each flip (H or T). Do we know what will come up before we flip the coin? If we flip a coin many, many

### Ch. 13.3: More about Probability

Ch. 13.3: More about Probability Complementary Probabilities Given any event, E, of some sample space, U, of a random experiment, we can always talk about the complement, E, of that event: this is the

### Chapter 10: Introducing Probability

Chapter 10: Introducing Probability Randomness and Probability So far, in the first half of the course, we have learned how to examine and obtain data. Now we turn to another very important aspect of Statistics

### Notes 3 Autumn Independence. Two events A and B are said to be independent if

MAS 108 Probability I Notes 3 Autumn 2005 Independence Two events A and B are said to be independent if P(A B) = P(A) P(B). This is the definition of independence of events. If you are asked in an exam

### Jan 17 Homework Solutions Math 151, Winter 2012. Chapter 2 Problems (pages 50-54)

Jan 17 Homework Solutions Math 11, Winter 01 Chapter Problems (pages 0- Problem In an experiment, a die is rolled continually until a 6 appears, at which point the experiment stops. What is the sample

### Lab 11. Simulations. The Concept

Lab 11 Simulations In this lab you ll learn how to create simulations to provide approximate answers to probability questions. We ll make use of a particular kind of structure, called a box model, that

### Chapter 4 Lecture Notes

Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,

### Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab

Lecture 2 Probability BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab 2.1 1 Sample Spaces and Events Random

### PROBABILITY. Chapter Overview

Chapter 6 PROBABILITY 6. Overview Probability is defined as a quantitative measure of uncertainty a numerical value that conveys the strength of our belief in the occurrence of an event. The probability

### PROBABILITY 14.3. section. The Probability of an Event

4.3 Probability (4-3) 727 4.3 PROBABILITY In this section In the two preceding sections we were concerned with counting the number of different outcomes to an experiment. We now use those counting techniques

### Basic Probability. Probability: The part of Mathematics devoted to quantify uncertainty

AMS 5 PROBABILITY Basic Probability Probability: The part of Mathematics devoted to quantify uncertainty Frequency Theory Bayesian Theory Game: Playing Backgammon. The chance of getting (6,6) is 1/36.

### Formal Languages and Automata Theory - Regular Expressions and Finite Automata -

Formal Languages and Automata Theory - Regular Expressions and Finite Automata - Samarjit Chakraborty Computer Engineering and Networks Laboratory Swiss Federal Institute of Technology (ETH) Zürich March

### 14 Events and Probability Spaces

mcs-ftl 200/9/8 0:40 page 39 #397 4 Events and Probability Spaces 4. Let s Make a Deal In the September 9, 990 issue of Parade magazine, columnist Marilyn vos Savant responded to this letter: Suppose you

### 36 Odds, Expected Value, and Conditional Probability

36 Odds, Expected Value, and Conditional Probability What s the difference between probabilities and odds? To answer this question, let s consider a game that involves rolling a die. If one gets the face

### Lecture 4: Probability Spaces

EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 4: Probability Spaces Lecturer: Dr. Krishna Jagannathan Scribe: Jainam Doshi, Arjun Nadh and Ajay M 4.1 Introduction

### Probability. A random sample is selected in such a way that every different sample of size n has an equal chance of selection.

1 3.1 Sample Spaces and Tree Diagrams Probability This section introduces terminology and some techniques which will eventually lead us to the basic concept of the probability of an event. The Rare Event

### That s Not Fair! ASSESSMENT #HSMA20. Benchmark Grades: 9-12

That s Not Fair! ASSESSMENT # Benchmark Grades: 9-12 Summary: Students consider the difference between fair and unfair games, using probability to analyze games. The probability will be used to find ways

### Worked examples Basic Concepts of Probability Theory

Worked examples Basic Concepts of Probability Theory Example 1 A regular tetrahedron is a body that has four faces and, if is tossed, the probability that it lands on any face is 1/4. Suppose that one

### Chapter 13 & 14 - Probability PART

Chapter 13 & 14 - Probability PART IV : PROBABILITY Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Chapter 13 & 14 - Probability 1 / 91 Why Should We Learn Probability Theory? Dr. Joseph

### A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes.

Chapter 7 Probability 7.1 Experiments, Sample Spaces, and Events A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes. Each outcome

### 15 Chances, Probabilities, and Odds

15 Chances, Probabilities, and Odds 15.1 Random Experiments and Sample Spaces 15.2 Counting Outcomes in Sample Spaces 15.3 Permutations and Combinations 15.4 Probability Spaces 15.5 Equiprobable Spaces

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 2

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 2 Proofs Intuitively, the concept of proof should already be familiar We all like to assert things, and few of us

### Chapter 6. 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? Ans: 4/52.

Chapter 6 1. What is the probability that a card chosen from an ordinary deck of 52 cards is an ace? 4/52. 2. What is the probability that a randomly selected integer chosen from the first 100 positive

### number of favorable outcomes total number of outcomes number of times event E occurred number of times the experiment was performed.

12 Probability 12.1 Basic Concepts Start with some Definitions: Experiment: Any observation of measurement of a random phenomenon is an experiment. Outcomes: Any result of an experiment is called an outcome.

### Math 141. Lecture 2: More Probability! Albyn Jones 1. jones@reed.edu www.people.reed.edu/ jones/courses/141. 1 Library 304. Albyn Jones Math 141

Math 141 Lecture 2: More Probability! Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Outline Law of total probability Bayes Theorem the Multiplication Rule, again Recall