Lecture 1. Basics of probability theory

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Lecture 1. Basics of probability theory"

Transcription

1 Lecture 1. Basics of probability theory Mathematical Statistics and Discrete Mathematics November 2nd, / 21

2 Sample space A sample space S is the set of all possible outcomes ω of an experiment.! toss a coin, S = {heads, tails}.! toss a die, S = {1, 2, 3, 4, 5, 6}.! pick a card from a deck, S = {all possible cards}.! lottery: choose six numbers from 1 to 49, S = {all six-element subsets of {1, 2,..., 49}}. 2 / 21

3 Events An event A S is any subset of the sample space, that is, any collection of possible outcomes. The full set S is called the certain event. The empty set is called the impossible event. An event containing exactly one outcome is called an elementary event. Pick a card, we can have! A 1 = {hearts}.! A 2 = {even numbers}.! A 3 = {queen of hearts}, elementary event. Usually, an event will take the general form A = {all outcomes (not) satisfying a specific condition}. 3 / 21

4 Event operations (Boolean operations) The intersection of events A and B is A B = {all outcomes that are both in A and B} = {ω : ω A & ω B}. If A B =, then we say that A and B are disjoint. S S A A B B A B Figure: left: events with a non-empty intersection on the left-hand side, right: disjoint events.! Let A = {1, 2, 3, 4}, B = {2, 4, 5, 6}. Then, A B = {2, 4}.! Let A = {1, 2, 3}, B = {4, 5, 6}. Then, A B =.! Let A = [0, 7), B = [5, 10). Then, A B = [5, 7). 4 / 21

5 Event operations (Boolean operations) The union of events A and B is A B = {all outcomes that are in A or B} = {ω : ω A or ω B}. A B S! Let A = {1, 2, 3, 4}, B = {2, 4, 5, 6}. Then, A B = {1, 2, 3, 4, 5, 6}.! Let A = {1, 2, 3}, B = {4, 5, 6}. Then, A B = {1, 2, 3, 4, 5, 6}.! Let A = [0, 7), B = [5, 10). Then, A B = [0, 10). 5 / 21

6 Event operations The difference between events A and B is A \ B = {all outcomes that are in A but not in B} = {ω : ω A & ω / B}. S A \ B B! Let A = {1, 2, 3, 4}, B = {2, 4, 5, 6}. Then, A \ B = {1, 3}.! Let A = {1, 2, 3}, B = {4, 5, 6}. Then, A \ B = A = {1, 2, 3}.! Let A = [0, 7), B = [5, 10). Then, A \ B = [0, 5), B \ A = [7, 10). 6 / 21

7 Event operations (Boolean operations) The complement of event A is A c = S \ A = {all outcomes that are not in A} = {ω : ω / A}. A c S A Note that to know the complement, we have to know the sample space S.! Let A = {1, 2, 3, 4}, S = {1, 2, 3, 4, 5, 6}. Then, A c = {5, 6}.! Let A = [0, 7), B = [0, 10). Then, A c = [7, 10). 7 / 21

8 Classical definition of probability We say that an event A occurs if ω A. By P(A) we denote the probability that A occurs. By P(ω) we denote the probability that the elementary event {ω} occurs, or in other words, that the outcome of the experiment is equal to ω. Main motivating question: How to compute probabilities of events? We can agree that The certain event occurs with probability 1, and we write P(S) = 1 The impossible event occurs with probability 0, and we write P( ) = 0. But what about other events? 8 / 21

9 Classical definition of probability The classical probability is defined by P(A) = A number of outcomes in A = S number of all outcomes. In particular, for any outcome ω, P(ω) = 1/ S. This is also called the uniform probability since the probability does not depend on the particular outcome ω. Pick a random card from a deck. Let A 1 = {hearts}, A 2 = {even numbers}, A 3 = {queen of hearts}. We have A 1 = 13, A 2 = 20, A 3 = 1, and S = 52. Then, P(A 1 ) = = 1 4, P(A 2) = = 5 13, P(A 3) = / 21

10 Choose two letters out of a, b, c. The combined sample space S of all configuraions is! S = {aa, ab, ac, ba, bb, bc, ca, cb, cc}, S = 9, if we care about the order and allow repetitions,! S = {ab, ac, ba, bc, ca, cb}, S = 6, if we care about the order and don t allow repetitions,! S = {{aa}, {ab}, {ac}, {bb}, {bc}, {cc}}, S = 6, if we don t care about the order and allow repetitions,! S = {{ab}, {ac}, {bc}}, S = 3, if we don t care about the order and don t allow repetitions. 10 / 21 Counting configurations Suppose we run n experiments and we record all the outcomes. If we care about the order of the experiments, we record the combined outcome as an ordered sequence of n outcomes. If we do note care about the order of the experiments, we record the combined outcome as an unordered collection of n outcomes. Depending on the type of the experiments, we may or may not get repeated outcomes. Combined outcomes are called configurations.

11 Counting configurations Configurations where the order matters and there are no repetitions are called permutations, where the order does not matter and there are no repetitions are called combinations. What is the size of the combined sample space? The multiplication rule says that if we run k experiments, and we know that the sample space of the ith experiment contains n i outcomes. Then, the combined sample space contains k n i = n 1 n 2... n k configurations. i=1 11 / 21

12 Counting configurations Recall that n factorial is n! = n = n (n 1) (n 2) We have an urn with n balls of different colours. We choose one ball in each of the total of k turns! If n k and we do not put back the ball into the urn, then the first time we have n balls to choose from, the second time we have n 1 balls, and so on, until we are left with n k balls. Hence, the number of all possible configurations is n (n 1)... (n k + 1) = n! (n k)!. If n = k, we get n! configurations.! If we put the ball back into the urn, then each time we have n balls to choose from. Hence, the number of all possible configurations is } n n {{... n } = n k. k times 12 / 21

13 Counting configurations We have an urn with k balls of different colours. We choose one ball in each of the total of n turns! If n k, and we do not put back the ball into the urn, and we do not care about the order, the number of all possible configurations is ( ) n k := n!, (You read this notation: n choose k) k!(n k)!! The above number is just the number of all k-element subsets of an n-element set. Hence, the probability of winning the lottery is 1/ ( 49 6 ) 1/( ).! If we put back the ball into the urn, and we do not care about the order, the number of all possible configurations is ( n + k 1 k Exercise for the willing: prove the last formula. ). 13 / 21

14 Axioms of general probability Toss a coin. In classical probability P(heads) = 1 2. But what about asymmetric coins? Axioms of a probability (measure): A probability (measure) P is an assignment of numbers to events such that (i) P(A) 0 for all events A (probablities are non-negative), (ii) P(S) = 1 (probability of the certain event is 1), (iii) P(A B) = P(A) + P(B) for disjoint events A and B (probabilities add up on disjoint events).! Classical probability satisfies all the axioms of a probability measure.! For a toss of a coin, let P(heads) = 2/3, P(tails) = 1/3, P( ) = 0, and P({heads, tails}) = 1. Then P satisfies the axioms above. 14 / 21

15 Axioms of general probability Important consequences of the axioms: (a) 0 P(A) 1 for any event A. (b) P( ) = 0. (c) P(A) = 1 P(A c ) for any event A. (d) P(A) P(B) if A B. (e) If A 1, A 2,..., A n are pairwise disjoint, that is A i A j = for i j, then P(A 1 A 2... A n ) = P(A 1 ) + P(A 2 ) P(A n ) = n P(A i ). i=1 (f) P(A B) = P(A) + P(B) P(A B) for all events A and B. (g) P(A B) P(A) + P(B) for all events A and B. 15 / 21

16 Axioms of general probability Proof of: (a) The lower bound P(A) 0 is axiom (i). It follows from axiom (iii) by taking B = A c, that P(A) + P(A c ) = 1. The upper bound P(A) 1 follows from this equality since by axiom (i), P(A c ) 0. (b) By axiom (iii), P( ) = P( ) + P( ) since the empty event is disjoint with itself. (c) It follows from axiom (iii) by taking B = A c. (d) By axiom (iii) and (i), and since A B, P(B) = P(A) + P(B \ A) P(A). (e) Apply axiom (iii) n times. (f) By equation (c), P(A B) = P(A \ B) + P(B \ A) + P(A B), and P(A \ B) = P(A) P(A B) and P(B \ A) = P(B) P(A B). (g) It follows from equation (e) and the fact that P(A B) / 21

17 Conditional probability Main motivating question: Suppose that we know that an event occurs. What information does that give us about other events? Suppose B has positive probability of occurrence, that is P(B) > 0. For any event A, the probability of A conditioned on B (or probability of A given B) is P(A B) := P(A B). P(B) Throw a die. Let A = {1, 2, 3}. Then P(A) = 1/2 in classical probability, and! P(A {even}) = P(A {even})/p({even}) = 1/6 1/2 = 1/3. Since P(A {even}) < P(A), the occurrence of event {even} has a negative influence on the probability of occurrence of A.! P(A {odd}) = P(A {odd})/p({odd}) = 2/6 1/2 = 2/3. Since P(A {odd}) > P(A), the occurrence of event {odd} has a positive influence on the probability of occurrence of A. P(A B) and P(B A) have different interpretations and usually take different values. 17 / 21

18 Independent events Two events A and B are called independent if and only if P(A B) = P(A)P(B). If A and B are independent, and P(B) > 0 then P(A B) = P(A B) P(B) = P(A)P(B) P(B) = P(A). Hence, the occurrence of B does not influence the (probability of) occurrence of A.! and S are always independent of all other events,! Throw a die twice and call the outcomes ω 1 and ω 2. The events A 1 = {ω 1 = 1} and A 2 = {ω 2 = 6} are independent.! The events A = {it is raining somewhere in New Zealand} and B = {it is raining in Gothenburg} are independent. 18 / 21

19 Total probability formula Let B be any event, and A 1, A 2,..., A n be pairwise disjoint events, that is A i A j = for i j, and such that A 1 A 2... A n = S. B S A 1 A 2... A n Then, P(B) = n P(B A i )P(A i ). i=1 19 / 21

20 Total probability formula Proof. P(B) = P(B S) = P(B (A 1 A 2... A n )) = P((B A 1 ) (B A 2 )... (B A 2 )) n = P(B A i ) = i=1 n P(B A i )P(A i ). i=1 20 / 21

21 Bayes theorem With B such that P(B) > 0, and A 1, A 2,..., A n as before, we have for any i {1, 2,..., n}, P(B A i )P(A i ) P(A i B) = n i=1 P(B A i)p(a i ). The probability of having a certain disease is 10%. Patients with the disease test positive with probability 95%. Patients without the disease test positive with probability 2%. Given a positive test result, what is the probability that the patient has the disease? Let We have A 1 = {patient has the disease} A 2 = A c 1 = {patient does not have the disease} B = {patient tests positive}. P(A 1 B) = P(B A 1 )P(A 1 ) P(B A 1 )P(A 1 ) + P(B A 2 )P(A 2 ) = 0, 95 0, 10 0, 95 0, , 02(1 0, 10) = / 21

Lecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett

Lecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett Lecture Note 1 Set and Probability Theory MIT 14.30 Spring 2006 Herman Bennett 1 Set Theory 1.1 Definitions and Theorems 1. Experiment: any action or process whose outcome is subject to uncertainty. 2.

More information

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11 CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

More information

Lecture 4: Probability Spaces

Lecture 4: Probability Spaces EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 4: Probability Spaces Lecturer: Dr. Krishna Jagannathan Scribe: Jainam Doshi, Arjun Nadh and Ajay M 4.1 Introduction

More information

E3: PROBABILITY AND STATISTICS lecture notes

E3: PROBABILITY AND STATISTICS lecture notes E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................

More information

STAT 270 Probability Basics

STAT 270 Probability Basics STAT 270 Probability Basics Richard Lockhart Simon Fraser University Spring 2015 Surrey 1/28 Purposes of These Notes Jargon: experiment, sample space, outcome, event. Set theory ideas and notation: intersection,

More information

33 Probability: Some Basic Terms

33 Probability: Some Basic Terms 33 Probability: Some Basic Terms In this and the coming sections we discuss the fundamental concepts of probability at a level at which no previous exposure to the topic is assumed. Probability has been

More information

Assigning Probabilities

Assigning Probabilities What is a Probability? Probabilities are numbers between 0 and 1 that indicate the likelihood of an event. Generally, the statement that the probability of hitting a target- that is being fired at- is

More information

Introduction to Probability. Experiments. Sample Space. Event. Basic Requirements for Assigning Probabilities. Experiments

Introduction to Probability. Experiments. Sample Space. Event. Basic Requirements for Assigning Probabilities. Experiments Introduction to Probability Experiments These are processes that generate welldefined outcomes Experiments Counting Rules Combinations Permutations Assigning Probabilities Experiment Experimental Outcomes

More information

Lecture 2 : Basics of Probability Theory

Lecture 2 : Basics of Probability Theory Lecture 2 : Basics of Probability Theory When an experiment is performed, the realization of the experiment is an outcome in the sample space. If the experiment is performed a number of times, different

More information

Chapter 15. Definitions: experiment: is the act of making an observation or taking a measurement.

Chapter 15. Definitions: experiment: is the act of making an observation or taking a measurement. MATH 11008: Probability Chapter 15 Definitions: experiment: is the act of making an observation or taking a measurement. outcome: one of the possible things that can occur as a result of an experiment.

More information

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments

More information

PROBABILITY NOTIONS. Summary. 1. Random experiment

PROBABILITY NOTIONS. Summary. 1. Random experiment PROBABILITY NOTIONS Summary 1. Random experiment... 1 2. Sample space... 2 3. Event... 2 4. Probability calculation... 3 4.1. Fundamental sample space... 3 4.2. Calculation of probability... 3 4.3. Non

More information

Definition and Calculus of Probability

Definition and Calculus of Probability In experiments with multivariate outcome variable, knowledge of the value of one variable may help predict another. For now, the word prediction will mean update the probabilities of events regarding the

More information

Probability OPRE 6301

Probability OPRE 6301 Probability OPRE 6301 Random Experiment... Recall that our eventual goal in this course is to go from the random sample to the population. The theory that allows for this transition is the theory of probability.

More information

Basics of Probability

Basics of Probability Basics of Probability August 27 and September 1, 2009 1 Introduction A phenomena is called random if the exact outcome is uncertain. The mathematical study of randomness is called the theory of probability.

More information

The concept of probability is fundamental in statistical analysis. Theory of probability underpins most of the methods used in statistics.

The concept of probability is fundamental in statistical analysis. Theory of probability underpins most of the methods used in statistics. Elementary probability theory The concept of probability is fundamental in statistical analysis. Theory of probability underpins most of the methods used in statistics. 1.1 Experiments, outcomes and sample

More information

Elements of probability theory

Elements of probability theory 2 Elements of probability theory Probability theory provides mathematical models for random phenomena, that is, phenomena which under repeated observations yield di erent outcomes that cannot be predicted

More information

A natural introduction to probability theory. Ronald Meester

A natural introduction to probability theory. Ronald Meester A natural introduction to probability theory Ronald Meester ii Contents Preface v 1 Experiments 1 1.1 Definitions and examples........................ 1 1.2 Counting and combinatorics......................

More information

The study of probability has increased in popularity over the years because of its wide range of practical applications.

The study of probability has increased in popularity over the years because of its wide range of practical applications. 6.7. Probability. The study of probability has increased in popularity over the years because of its wide range of practical applications. In probability, each repetition of an experiment is called a trial,

More information

Topic 6: Conditional Probability and Independence

Topic 6: Conditional Probability and Independence Topic 6: September 15-20, 2011 One of the most important concepts in the theory of probability is based on the question: How do we modify the probability of an event in light of the fact that something

More information

Events. Independence. Coin Tossing. Random Phenomena

Events. Independence. Coin Tossing. Random Phenomena Random Phenomena Events A random phenomenon is a situation in which we know what outcomes could happen, but we don t know which particular outcome did or will happen For any random phenomenon, each attempt,

More information

Probability - Part I. Definition : A random experiment is an experiment or a process for which the outcome cannot be predicted with certainty.

Probability - Part I. Definition : A random experiment is an experiment or a process for which the outcome cannot be predicted with certainty. Probability - Part I Definition : A random experiment is an experiment or a process for which the outcome cannot be predicted with certainty. Definition : The sample space (denoted S) of a random experiment

More information

Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab

Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab Lecture 2 Probability BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab 2.1 1 Sample Spaces and Events Random

More information

Lecture 2: Probability

Lecture 2: Probability Lecture 2: Probability Assist. Prof. Dr. Emel YAVUZ DUMAN MCB1007 Introduction to Probability and Statistics İstanbul Kültür University Outline 1 Introduction 2 Sample Spaces 3 Event 4 The Probability

More information

Probability Review. ICPSR Applied Bayesian Modeling

Probability Review. ICPSR Applied Bayesian Modeling Probability Review ICPSR Applied Bayesian Modeling Random Variables Flip a coin. Will it be heads or tails? The outcome of a single event is random, or unpredictable What if we flip a coin 10 times? How

More information

Probability and Counting

Probability and Counting Probability and Counting Basic Counting Principles Permutations and Combinations Sample Spaces, Events, Probability Union, Intersection, Complements; Odds Conditional Probability, Independence Bayes Formula

More information

Probabilities and Random Variables

Probabilities and Random Variables Probabilities and Random Variables This is an elementary overview of the basic concepts of probability theory. 1 The Probability Space The purpose of probability theory is to model random experiments so

More information

A Simple Example. Sample Space and Event. Tree Diagram. Tree Diagram. Probability. Probability - 1. Probability and Counting Rules

A Simple Example. Sample Space and Event. Tree Diagram. Tree Diagram. Probability. Probability - 1. Probability and Counting Rules Probability and Counting Rules researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people in this random sample

More information

Chapter 5 - Probability

Chapter 5 - Probability Chapter 5 - Probability 5.1 Basic Ideas An experiment is a process that, when performed, results in exactly one of many observations. These observations are called the outcomes of the experiment. The set

More information

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION 1 WHAT IS STATISTICS? Statistics is a science of collecting data, organizing and describing it and drawing conclusions from it. That is, statistics

More information

PROBABILITY. Chapter Overview

PROBABILITY. Chapter Overview Chapter 6 PROBABILITY 6. Overview Probability is defined as a quantitative measure of uncertainty a numerical value that conveys the strength of our belief in the occurrence of an event. The probability

More information

6.3 Conditional Probability and Independence

6.3 Conditional Probability and Independence 222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

More information

P (A) = lim P (A) = N(A)/N,

P (A) = lim P (A) = N(A)/N, 1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or non-deterministic experiments. Suppose an experiment can be repeated any number of times, so that we

More information

Section 2.1. Tree Diagrams

Section 2.1. Tree Diagrams Section 2.1 Tree Diagrams Example 2.1 Problem For the resistors of Example 1.16, we used A to denote the event that a randomly chosen resistor is within 50 Ω of the nominal value. This could mean acceptable.

More information

Math 141. Lecture 2: More Probability! Albyn Jones 1. jones@reed.edu www.people.reed.edu/ jones/courses/141. 1 Library 304. Albyn Jones Math 141

Math 141. Lecture 2: More Probability! Albyn Jones 1. jones@reed.edu www.people.reed.edu/ jones/courses/141. 1 Library 304. Albyn Jones Math 141 Math 141 Lecture 2: More Probability! Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Outline Law of total probability Bayes Theorem the Multiplication Rule, again Recall

More information

Basic concepts in probability. Sue Gordon

Basic concepts in probability. Sue Gordon Mathematics Learning Centre Basic concepts in probability Sue Gordon c 2005 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Set Notation You may omit this section if you are

More information

Statistical Inference. Prof. Kate Calder. If the coin is fair (chance of heads = chance of tails) then

Statistical Inference. Prof. Kate Calder. If the coin is fair (chance of heads = chance of tails) then Probability Statistical Inference Question: How often would this method give the correct answer if I used it many times? Answer: Use laws of probability. 1 Example: Tossing a coin If the coin is fair (chance

More information

Basic Probability Concepts

Basic Probability Concepts page 1 Chapter 1 Basic Probability Concepts 1.1 Sample and Event Spaces 1.1.1 Sample Space A probabilistic (or statistical) experiment has the following characteristics: (a) the set of all possible outcomes

More information

+ Section 6.2 and 6.3

+ Section 6.2 and 6.3 Section 6.2 and 6.3 Learning Objectives After this section, you should be able to DEFINE and APPLY basic rules of probability CONSTRUCT Venn diagrams and DETERMINE probabilities DETERMINE probabilities

More information

I. WHAT IS PROBABILITY?

I. WHAT IS PROBABILITY? C HAPTER 3 PROAILITY Random Experiments I. WHAT IS PROAILITY? The weatherman on 10 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

More information

Lectures 2 and 3 : Probability

Lectures 2 and 3 : Probability Lectures 2 and 3 : Probability Jonathan L. Marchini October 15, 2004 In this lecture we will learn about why we need to learn about probability what probability is how to assign probabilities how to manipulate

More information

Chapter 4: Probabilities and Proportions

Chapter 4: Probabilities and Proportions Stats 11 (Fall 2004) Lecture Note Introduction to Statistical Methods for Business and Economics Instructor: Hongquan Xu Chapter 4: Probabilities and Proportions Section 4.1 Introduction In the real world,

More information

Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?

Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit? ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the

More information

5 Week Modular Course in Statistics & Probability Strand 1. Module 3

5 Week Modular Course in Statistics & Probability Strand 1. Module 3 5 Week Modular Course in Statistics & Probability Strand Module JUNIOR CERTIFICATE LEAVING CERTIFICATE. Probability Scale. Relative Frequency. Fundamental Principle of Counting. Outcomes of simple random

More information

Discrete Mathematics Lecture 5. Harper Langston New York University

Discrete Mathematics Lecture 5. Harper Langston New York University Discrete Mathematics Lecture 5 Harper Langston New York University Empty Set S = {x R, x 2 = -1} X = {1, 3}, Y = {2, 4}, C = X Y (X and Y are disjoint) Empty set has no elements Empty set is a subset of

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology n (i) m m (ii) n m ( (iii) n n n n (iv) m m Massachusetts Institute of Technology 6.0/6.: Probabilistic Systems Analysis (Quiz Solutions Spring 009) Question Multiple Choice Questions: CLEARLY circle the

More information

Chapter 3: The basic concepts of probability

Chapter 3: The basic concepts of probability Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording

More information

3. Examples of discrete probability spaces.. Here α ( j)

3. Examples of discrete probability spaces.. Here α ( j) 3. EXAMPLES OF DISCRETE PROBABILITY SPACES 13 3. Examples of discrete probability spaces Example 17. Toss n coins. We saw this before, but assumed that the coins are fair. Now we do not. The sample space

More information

The basics of probability theory. Distribution of variables, some important distributions

The basics of probability theory. Distribution of variables, some important distributions The basics of probability theory. Distribution of variables, some important distributions 1 Random experiment The outcome is not determined uniquely by the considered conditions. For example, tossing a

More information

MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics

MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics MATH 10: Elementary Statistics and Probability Chapter 3: Probability Topics Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides, you should

More information

I. WHAT IS PROBABILITY?

I. WHAT IS PROBABILITY? C HAPTER 3 PROBABILITY Random Experiments I. WHAT IS PROBABILITY? The weatherman on 0 o clock news program states that there is a 20% chance that it will snow tomorrow, a 65% chance that it will rain and

More information

Statistics in Geophysics: Introduction and Probability Theory

Statistics in Geophysics: Introduction and Probability Theory Statistics in Geophysics: Introduction and Steffen Unkel Department of Statistics Ludwig-Maximilians-University Munich, Germany Winter Term 2013/14 1/32 What is Statistics? Introduction Statistics is the

More information

Some Definitions about Sets

Some Definitions about Sets Some Definitions about Sets Definition: Two sets are equal if they contain the same elements. I.e., sets A and B are equal if x[x A x B]. Notation: A = B. Recall: Sets are unordered and we do not distinguish

More information

Jan 17 Homework Solutions Math 151, Winter 2012. Chapter 2 Problems (pages 50-54)

Jan 17 Homework Solutions Math 151, Winter 2012. Chapter 2 Problems (pages 50-54) Jan 17 Homework Solutions Math 11, Winter 01 Chapter Problems (pages 0- Problem In an experiment, a die is rolled continually until a 6 appears, at which point the experiment stops. What is the sample

More information

Worked examples Basic Concepts of Probability Theory

Worked examples Basic Concepts of Probability Theory Worked examples Basic Concepts of Probability Theory Example 1 A regular tetrahedron is a body that has four faces and, if is tossed, the probability that it lands on any face is 1/4. Suppose that one

More information

Unit 4 The Bernoulli and Binomial Distributions

Unit 4 The Bernoulli and Binomial Distributions PubHlth 540 4. Bernoulli and Binomial Page 1 of 19 Unit 4 The Bernoulli and Binomial Distributions Topic 1. Review What is a Discrete Probability Distribution... 2. Statistical Expectation.. 3. The Population

More information

Remember to leave your answers as unreduced fractions.

Remember to leave your answers as unreduced fractions. Probability Worksheet 2 NAME: Remember to leave your answers as unreduced fractions. We will work with the example of picking poker cards out of a deck. A poker deck contains four suits: diamonds, hearts,

More information

Probability. a number between 0 and 1 that indicates how likely it is that a specific event or set of events will occur.

Probability. a number between 0 and 1 that indicates how likely it is that a specific event or set of events will occur. Probability Probability Simple experiment Sample space Sample point, or elementary event Event, or event class Mutually exclusive outcomes Independent events a number between 0 and 1 that indicates how

More information

Sections 2.1, 2.2 and 2.4

Sections 2.1, 2.2 and 2.4 SETS Sections 2.1, 2.2 and 2.4 Chapter Summary Sets The Language of Sets Set Operations Set Identities Introduction Sets are one of the basic building blocks for the types of objects considered in discrete

More information

A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes.

A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes. Chapter 7 Probability 7.1 Experiments, Sample Spaces, and Events A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes. Each outcome

More information

What is the probability of throwing a fair die and receiving a six? Introduction to Probability. Basic Concepts

What is the probability of throwing a fair die and receiving a six? Introduction to Probability. Basic Concepts Basic Concepts Introduction to Probability A probability experiment is any experiment whose outcomes relies purely on chance (e.g. throwing a die). It has several possible outcomes, collectively called

More information

Math/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability

Math/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock

More information

Chapter 4 Probability

Chapter 4 Probability The Big Picture of Statistics Chapter 4 Probability Section 4-2: Fundamentals Section 4-3: Addition Rule Sections 4-4, 4-5: Multiplication Rule Section 4-7: Counting (next time) 2 What is probability?

More information

PROBABILITY. The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE

PROBABILITY. The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE PROBABILITY 53 Chapter 3 PROBABILITY The theory of probabilities is simply the Science of logic quantitatively treated. C.S. PEIRCE 3. Introduction In earlier Classes, we have studied the probability as

More information

Introduction to Probability

Introduction to Probability 3 Introduction to Probability Given a fair coin, what can we expect to be the frequency of tails in a sequence of 10 coin tosses? Tossing a coin is an example of a chance experiment, namely a process which

More information

Study Manual for Exam P/Exam 1. Probability

Study Manual for Exam P/Exam 1. Probability Study Manual for Exam P/Exam 1 Probability Eleventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com

More information

Example: If we roll a dice and flip a coin, how many outcomes are possible?

Example: If we roll a dice and flip a coin, how many outcomes are possible? 12.5 Tree Diagrams Sample space- Sample point- Counting principle- Example: If we roll a dice and flip a coin, how many outcomes are possible? TREE DIAGRAM EXAMPLE: Use a tree diagram to show all the possible

More information

4 BASICS OF PROBABILITY. Experiment is a process of observation that leads to a single outcome that cannot be predicted with certainty.

4 BASICS OF PROBABILITY. Experiment is a process of observation that leads to a single outcome that cannot be predicted with certainty. 4 BASICS OF PROBABILITY Experiment is a process of observation that leads to a single outcome that cannot be predicted with certainty. Examples: 1. Pull a card from a deck 2. Toss a coin 3. Response time.

More information

MATHEMATICS 117/E-217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions )

MATHEMATICS 117/E-217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions ) MATHEMATICS 117/E-217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions ) Last modified: May 1, 2012 Reading Dineen, pages 57-67 Proof

More information

5. Probability Calculus

5. Probability Calculus 5. Probability Calculus So far we have concentrated on descriptive statistics (deskriptiivinen eli kuvaileva tilastotiede), that is methods for organizing and summarizing data. As was already indicated

More information

Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22

Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 CS 70 Discrete Mathematics for CS Fall 2006 Papadimitriou & Vazirani Lecture 22 Introduction to Discrete Probability Probability theory has its origins in gambling analyzing card games, dice, roulette

More information

Module 6: Basic Counting

Module 6: Basic Counting Module 6: Basic Counting Theme 1: Basic Counting Principle We start with two basic counting principles, namely, the sum rule and the multiplication rule. The Sum Rule: If there are n 1 different objects

More information

Basic Probability Theory II

Basic Probability Theory II RECAP Basic Probability heory II Dr. om Ilvento FREC 408 We said the approach to establishing probabilities for events is to Define the experiment List the sample points Assign probabilities to the sample

More information

36 Odds, Expected Value, and Conditional Probability

36 Odds, Expected Value, and Conditional Probability 36 Odds, Expected Value, and Conditional Probability What s the difference between probabilities and odds? To answer this question, let s consider a game that involves rolling a die. If one gets the face

More information

Lesson 3 Chapter 2: Introduction to Probability

Lesson 3 Chapter 2: Introduction to Probability Lesson 3 Chapter 2: Introduction to Probability Department of Statistics The Pennsylvania State University 1 2 The Probability Mass Function and Probability Sampling Counting Techniques 3 4 The Law of

More information

Probability. Section 9. Probability. Probability of A = Number of outcomes for which A happens Total number of outcomes (sample space)

Probability. Section 9. Probability. Probability of A = Number of outcomes for which A happens Total number of outcomes (sample space) Probability Section 9 Probability Probability of A = Number of outcomes for which A happens Total number of outcomes (sample space) In this section we summarise the key issues in the basic probability

More information

Study Manual for Exam P/Exam 1. Probability

Study Manual for Exam P/Exam 1. Probability Study Manual for Exam P/Exam 1 Probability Seventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com

More information

An approach to Calculus of Probabilities through real situations

An approach to Calculus of Probabilities through real situations MaMaEuSch Management Mathematics for European Schools http://www.mathematik.unikl.de/ mamaeusch An approach to Calculus of Probabilities through real situations Paula Lagares Barreiro Federico Perea Rojas-Marcos

More information

STAB47S:2003 Midterm Name: Student Number: Tutorial Time: Tutor:

STAB47S:2003 Midterm Name: Student Number: Tutorial Time: Tutor: STAB47S:200 Midterm Name: Student Number: Tutorial Time: Tutor: Time: 2hours Aids: The exam is open book Students may use any notes, books and calculators in writing this exam Instructions: Show your reasoning

More information

Finite and discrete probability distributions

Finite and discrete probability distributions 8 Finite and discrete probability distributions To understand the algorithmic aspects of number theory and algebra, and applications such as cryptography, a firm grasp of the basics of probability theory

More information

Notes on Probability. Peter J. Cameron

Notes on Probability. Peter J. Cameron Notes on Probability Peter J. Cameron ii Preface Here are the course lecture notes for the course MAS108, Probability I, at Queen Mary, University of London, taken by most Mathematics students and some

More information

STAT 319 Probability and Statistics For Engineers PROBABILITY. Engineering College, Hail University, Saudi Arabia

STAT 319 Probability and Statistics For Engineers PROBABILITY. Engineering College, Hail University, Saudi Arabia STAT 319 robability and Statistics For Engineers LECTURE 03 ROAILITY Engineering College, Hail University, Saudi Arabia Overview robability is the study of random events. The probability, or chance, that

More information

Fundamentals of Probability

Fundamentals of Probability Fundamentals of Probability Introduction Probability is the likelihood that an event will occur under a set of given conditions. The probability of an event occurring has a value between 0 and 1. An impossible

More information

Sets and set operations

Sets and set operations CS 441 Discrete Mathematics for CS Lecture 7 Sets and set operations Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square asic discrete structures Discrete math = study of the discrete structures used

More information

A set is a Many that allows itself to be thought of as a One. (Georg Cantor)

A set is a Many that allows itself to be thought of as a One. (Georg Cantor) Chapter 4 Set Theory A set is a Many that allows itself to be thought of as a One. (Georg Cantor) In the previous chapters, we have often encountered sets, for example, prime numbers form a set, domains

More information

Probability is concerned with quantifying the likelihoods of various events in situations involving elements of randomness or uncertainty.

Probability is concerned with quantifying the likelihoods of various events in situations involving elements of randomness or uncertainty. Chapter 1 Probability Spaces 11 What is Probability? Probability is concerned with quantifying the likelihoods of various events in situations involving elements of randomness or uncertainty Example 111

More information

MAS113 Introduction to Probability and Statistics

MAS113 Introduction to Probability and Statistics MAS113 Introduction to Probability and Statistics 1 Introduction 1.1 Studying probability theory There are (at least) two ways to think about the study of probability theory: 1. Probability theory is a

More information

Math 3C Homework 3 Solutions

Math 3C Homework 3 Solutions Math 3C Homework 3 s Ilhwan Jo and Akemi Kashiwada ilhwanjo@math.ucla.edu, akashiwada@ucla.edu Assignment: Section 2.3 Problems 2, 7, 8, 9,, 3, 5, 8, 2, 22, 29, 3, 32 2. You draw three cards from a standard

More information

AP Stats - Probability Review

AP Stats - Probability Review AP Stats - Probability Review Multiple Choice Identify the choice that best completes the statement or answers the question. 1. I toss a penny and observe whether it lands heads up or tails up. Suppose

More information

Probability definitions

Probability definitions Probability definitions 1. Probability of an event = chance that the event will occur. 2. Experiment = any action or process that generates observations. In some contexts, we speak of a data-generating

More information

Applications of Methods of Proof

Applications of Methods of Proof CHAPTER 4 Applications of Methods of Proof 1. Set Operations 1.1. Set Operations. The set-theoretic operations, intersection, union, and complementation, defined in Chapter 1.1 Introduction to Sets are

More information

4.3. Addition and Multiplication Laws of Probability. Introduction. Prerequisites. Learning Outcomes. Learning Style

4.3. Addition and Multiplication Laws of Probability. Introduction. Prerequisites. Learning Outcomes. Learning Style Addition and Multiplication Laws of Probability 4.3 Introduction When we require the probability of two events occurring simultaneously or the probability of one or the other or both of two events occurring

More information

number of favorable outcomes total number of outcomes number of times event E occurred number of times the experiment was performed.

number of favorable outcomes total number of outcomes number of times event E occurred number of times the experiment was performed. 12 Probability 12.1 Basic Concepts Start with some Definitions: Experiment: Any observation of measurement of a random phenomenon is an experiment. Outcomes: Any result of an experiment is called an outcome.

More information

Introduction to probability theory in the Discrete Mathematics course

Introduction to probability theory in the Discrete Mathematics course Introduction to probability theory in the Discrete Mathematics course Jiří Matoušek (KAM MFF UK) Version: Oct/18/2013 Introduction This detailed syllabus contains definitions, statements of the main results

More information

Section 6.2 Definition of Probability

Section 6.2 Definition of Probability Section 6.2 Definition of Probability Probability is a measure of the likelihood that an event occurs. For example, if there is a 20% chance of rain tomorrow, that means that the probability that it will

More information

Homework 3 Solution, due July 16

Homework 3 Solution, due July 16 Homework 3 Solution, due July 16 Problems from old actuarial exams are marked by a star. Problem 1*. Upon arrival at a hospital emergency room, patients are categorized according to their condition as

More information

A1. Basic Reviews PERMUTATIONS and COMBINATIONS... or HOW TO COUNT

A1. Basic Reviews PERMUTATIONS and COMBINATIONS... or HOW TO COUNT A1. Basic Reviews Appendix / A1. Basic Reviews / Perms & Combos-1 PERMUTATIONS and COMBINATIONS... or HOW TO COUNT Question 1: Suppose we wish to arrange n 5 people {a, b, c, d, e}, standing side by side,

More information

ECE302 Spring 2006 HW1 Solutions January 16, 2006 1

ECE302 Spring 2006 HW1 Solutions January 16, 2006 1 ECE302 Spring 2006 HW1 Solutions January 16, 2006 1 Solutions to HW1 Note: These solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics

More information

EXAM. Exam #3. Math 1430, Spring 2002. April 21, 2001 ANSWERS

EXAM. Exam #3. Math 1430, Spring 2002. April 21, 2001 ANSWERS EXAM Exam #3 Math 1430, Spring 2002 April 21, 2001 ANSWERS i 60 pts. Problem 1. A city has two newspapers, the Gazette and the Journal. In a survey of 1, 200 residents, 500 read the Journal, 700 read the

More information

Chapter 13 & 14 - Probability PART

Chapter 13 & 14 - Probability PART Chapter 13 & 14 - Probability PART IV : PROBABILITY Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Chapter 13 & 14 - Probability 1 / 91 Why Should We Learn Probability Theory? Dr. Joseph

More information