# Basic Probability Concepts

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 page 1 Chapter 1 Basic Probability Concepts 1.1 Sample and Event Spaces Sample Space A probabilistic (or statistical) experiment has the following characteristics: (a) the set of all possible outcomes of the experiment can be described; (b) the outcome of the experiment cannot be predicted with certainty prior to the performance of the experiment. The set of all possible outcomes (or sample points) of the experiment is called the sample space and is denoted by S. For a given experiment it may be possible to define several sample spaces. Example For the experiment of tossing a coin three times, we could define (a) S = {HHH,HHT,HTH,THH,HTT,THT,TTH,TTT}, each outcome being an ordered sequence of results; or (b) S = {0, 1, 2, 3}, each outcome being a possible value for the number of heads obtained. If S consists of a list of outcomes (finite or infinite in number), S is a discrete sample space. Examples (i) Tossing a die: S = {1, 2, 3, 4, 5, 6} (ii) Tossing a coin until the first head appears: S = {H,TH,TTH,TTTH,...}. Otherwise S is an uncountable sample space. In particular, if S belongs to a Euclidean space (e.g. real line, plane), S is a continuous sample space. Example Lifetime of an electronic device: S = {t : 0 t < }.

2 page Event Space Events A specified collection of outcomes in S is called an event: i.e., any subset of S (including S itself) is an event. When the experiment is performed, an event A occurs if the outcome is a member of A. Example In tossing a die once, let the event A be the occurrence of an even number: i.e., A = {2, 4, 6}. If a 2 or 4 or 6 is obtained when the die is tossed, event A occurs. The event S is called the certain event, since some member of S must occur. A single outcome is called an elementary event. If an event contains no outcomes, it is called the impossible or null event and is denoted by. Combination of events Since events are sets, they may be combined using the notation of set theory: Venn diagrams are useful for exhibiting definitions and results, and you should draw such a diagram for each operation and identity introduced below. [In the following, A, B, C, A 1,..., A n are events in the event space F (discussed below), and are therefore subsets of the sample space S.] The union of A and B, denoted by A B, is the event either A or B, or both. The intersection of A and B, denoted by A B, is the event both A and B. The union and intersection operations are commutative, i.e. A B = B A, A B = B A, (1.1) associative, i.e. A (B C) = (A B) C = A B C, A (B C) = (A B) C = A B C, (1.2) and distributive: A (B C) = (A B) (A C), A (B C) = (A B) (A C). (1.3) If A is a subset of B, denoted by A B, then A B = B and A B = A. The difference of A and B, denoted by A\B, is the event A but not B. The complement of A, denoted by A, is the event not A. The complement operation has the properties: A A = S, A A =, (A) = A, (1.4) and A B = A B, A B = A B. (1.5) Note also that A\B = A B. Hence use of the difference symbol can be avoided if desired (and will be in our discussion).

3 page 3 Two events A and B are termed mutually exclusive if A B =. Two events A and B are termed exhaustive if A B = S. The above results may be generalised to combinations of n events: thus A 1 A 2... A n is the event at least one of A 1, A 2,..., A n A 1 A 2... A n is the event all of A 1, A 2,..., A n A 1 (A 2 A 3... A n ) = (A 1 A 2 ) (A 1 A 3 )... (A 1 A n ) (1.6) A 1 (A 2 A 3... A n ) = (A 1 A 2 ) (A 1 A 3 )... (A 1 A n ) (1.7) A 1 A 2... A n = A 1 A 2... A n or n A i = n A i (1.8) A 1 A 2... A n = A 1 A 2... A n or n A i = n A i (1.9) (The last two results are known as de Morgan s Laws - see e.g. Ross for proofs.) The events A 1, A 2,..., A n are termed mutually exclusive if A i A j = for all i j. The events A 1, A 2,..., A n are termed exhaustive if A 1 A 2... A n = S. If the events A 1, A 2,..., A n are both mutually exclusive and exhaustive, they are called a partition of S. Event space The collection of all subsets of S may be too large for probabilities to be assigned reasonably to all its members. This suggests the concept of event space. A collection F of subsets of the sample space is called an event space (or σ-field) if (a) the certain event S and the impossible event belong to F; (b) if A F, then A F; (c) if A 1, A 2,... F, then A 1 A 2... F, i.e. F is closed under the operation of taking countable unions. (Note that one of the statements in (a) is redundant, in view of (b).)

4 page 4 It is readily shown that, if A 1, A 2,... F, then A i F. For A i = (A i ) F (invoking i properties (b) and (c) of F, and the result follows from property (b). For a finite sample space, we normally use the collection of all subsets of S (the power set of S) as the event space. For S = {, } (or a subset of the real line), the collection of sets containing all one-point sets and all well-defined intervals is an event space. 1.2 Probability Spaces Probability Axioms Consideration of the more familiar relative frequency interpretation of probability suggests the following formal definition: A function P defined on F is called a probability function (or probability measure) on (S, F) if (a) 0 P(A) 1 for all A F; (b) P( ) = 0 and P(S) = 1; (c) if A 1, A 2,... is a collection of mutually exclusive events F, then Note: P(A 1 A 2...) = P(A 1 ) + P(A 2 ) + (1.10) (i) There is redundancy in both axioms (a) and (b) - see Corollaries to the Complementarity Rule (overleaf). (ii) Axiom (c) states that P is countably additive. This is a more extensive property than being finitely additive, i.e. the property that, if A 1, A 2,...A n is a collection of n mutually exclusive events, then P(A 1 A 2... A n ) = P(A i ). (1.11) This is derived from axiom (c) by defining A n+1, A n+2,... to be : only (1.11) is required in the case of finite S and F. It can be shown that the property of being countably additive is equivalent to the assertion that P is a continuous set function, i.e. given an increasing sequence of events A 1 A 2... and writing A = A i = lim A i, then P(A) = lim P(A i ) i i (with a similar result for a decreasing sequence) - see e.g. Grimmett & Welsh 1.9 The triple (S, F, P) is called a probability space. The function P(.) assigns a numerical value to each A F; however, the above axioms (a)-(c) do not tell us how to assign the numerical value this will depend on the description of, and assumptions concerning, the experiment in question. If P(A) = a/(a + b), the odds for A occurring are a to b and the odds against A occurring are b to a.

5 page Derived Properties From the probability axioms (a)-(c), many results follow. For example: (i) Complementarity rule If A F, then P(A) + P(A) = 1. (1.12) Proof S = A A - the union of two disjoint (or mutually exclusive) events. So P(S) = 1 = P(A) + P(A) by probability axiom (c). Corollaries (a) Let A = S. Then P(S) + P( ) = 1, so P(S) = 1 P( ) = 0 so axiom (b) can be simplified to P(S) = 1. (b) If A S, then P(A) 0 P(A) 1, so in axiom (a) only P(A) 0 is needed. (ii) If A B, then P(A) P(B). (1.13) Proof P(B) = P(A (B A)) = P(A) + P(B A) using axiom (c). The result follows from the fact that P(B A) 0 (axiom (a)). (iii) Addition Law (for two events) If A, B F, then Proof We have that P(A B) = P(A) + P(B) P(A B). (1.14) A B = A (B A) and B = (A B) (B A). In each case, the r.h.s. is the union of two mutually exclusive events F. So by axiom (c) P(A B) = P(A) + P(B A) and P(B) = P(A B) + P(B A). Eliminating P(B A), the result follows. Corollaries Boole s Inequalities If A, B F, then it follows from (1.14) and axiom (a) that (a) P(A B) P(A) + P(B); (b) P(A B) P(A) + P(B) 1. (1.15a) (1.15b) (iv) Generalized Addition Law (for n events) that at least one of these events occurs is P(A 1 A 2... A n ) = If A 1, A 2,..., A n F, then the probability P(A i ) P(A i A j ) 1 i<j n + P(A i A j A k )... 1 i<j<k n +( 1) n+1 P(A 1 A 2... A n ). This is sometimes termed the inclusion-exclusion principle. One proof is by induction on n: this is left as an exercise. For a non-inductive proof, see Ross. (1.16)

6 page 6 (v) Bonferroni s Inequalities If A 1, A 2,..., A n F, then (a) P(A i ) P(A i A j ) P(A 1... A n ) P(A i ); i<j (1.17a) (b) P(A 1 A 2... A n ) P(A i ) (n 1) = 1 P(A i ). (1.17b) Again, proofs are by induction on n (see Examples Sheet 1). [(1.17a) can be generalized.] 1.3 Solving Probability Problems The axioms and derived properties of P provide a probability calculus, but they do not help in setting up a probability model for an experiment or in assigning actual numerical values to the probabilities of specific events. However, the properties of P may prove very useful in solving a problem once these two steps have been completed. An important special case (the classical situation) is where S is finite and consists of N equally likely outcomes E 1, E 2,..., E N : thus, E 1,..., E N are mutually exclusive and exhaustive, and P(E 1 ) =... P(E N ). Then, since 1 = P(S) = P(E 1... E N ) = P(E 1 ) + + P(E N ), we have P(E i ) = 1, i = 1,..., N. (1.18) N Often there is more than one way of tackling a probability problem: on the other hand, an approach which solves one problem may be inapplicable to another problem (or only solve it with considerable difficulty). There are five general methods which are widely used: (i) Listing the elements of the sample space S = {E 1,..., E N }, where N is finite (and fairly small), and identifying the favourable ones. Thus, if the event of interest is A = {E i1,..., E in(a) }, then P(A) = P(E i1 ) + + P(E in(a) ). If the outcomes can be assumed to be equally likely, this reduces to i.e. P(A) = P(A) = N(A) N ; (1.19) number of outcomes in A total number of outcomes. In such calculations, symmetry arguments may play an important role. (ii) Enumeration, when S is a finite sample space of equally likely outcomes. To avoid listing, we calculate the numbers N(A) and N by combinatorial arguments, then again use P(A) = N(A)/N. (iii) Sequential (or Historical) method. Here we follow the history of the system (actual or conceptual) and use the multiplication rules for probabilities (see later).

7 page 7 (iv) Recursion. Here we express the problem in some recursive form, and solve it by recursion or induction (see later). (v) Define suitable random variables e.g. indicator random variables (see later). In serious applications, we should also investigate the robustness (or sensitivity of the results) with respect to small changes in the initially assumed probabilities and assumptions in the model (e.g. assumed independence of successive trials). 1.4 Some Results in Combinatorial Analysis As already observed, in many problems involving finite sample spaces with equally likely outcomes, the calculation of a probability reduces to problems of combinatorial counting. Also, it is common for problems which at first appear to be quite different to actually have identical solutions: e.g. (see below) (i) calculate the probability that all students in a class of 30 have different birthdays; (ii) calculate the probability that in a random sample of size 30, sampling with replacement, from a set of 365 distinct objects, all objects are different. In this course, we will not be doing many such examples, but from time to time combinatorial arguments will be used, and you will be expected to be familiar with the more elementary results in combinatorial analysis. A summary of the different contexts in which these can arise is provided below. All the following results follow from simple counting principles, and it is worth checking that you can derive them. Sampling Suppose that a sample of size r is taken from a population of n distinct elements. Then (i) If sampling is with replacement, there are n r different ordered samples. (ii) If sampling is without replacement, there are n!/(n r)! different ordered samples and ( n ) r = n!/{r!(n r)!} different non-ordered samples. (A random sample of size r from a finite population is one which has been drawn in such a way that all possible samples of size r have the same probability of being chosen. If a sample is drawn by successively selecting elements from the population (with or without replacement) in such a way that each element remaining has the same chance of being chosen at the next selection, then the sample is a random sample.) Arrangements (i) The number of different arrangements of r objects chosen from n distinct objects is n!/(n r)!. In particular, the number of arrangements of n distinct objects is n!. (ii) The number of different arrangements of n objects of which n 1 are of one kind, n 2 of a second kind,...,n k of a kth kind is n!/{n 1!n 2!...n k!}, where k n i = n (known as the multinomial coefficient). In particular, when k = 2, this reduces to ( n ) n 1, the binomial coefficient.

8 page 8 Sub-populations (i) The number of ways in which a population of n distinct elements can be partitioned into k sub-populations with n 1 elements in the first, n 2 elements in the second,..., n k elements in the kth, so that k n i = n, is the multinomial coefficient n!/{n 1!n 2!...n k!}. (ii) Consider a population of n distinct elements which is partitioned into k sub-populations, where the ith sub-population contains n i elements. Then the number of different nonordered samples of size r, sampling without replacement, such that the sample contains r 1 elements from the first sub-population, r 2 elements from the second,..., r k elements from the kth, is n1 n2 nk k k, n i = n, r i = r r 1 r 2 r k 1.5 Matching and Collection Problems Matching Problems Example 1.1 Suppose n cards numbered 1, 2,...n are laid out at random in a row. Define the event A i : card i appears in the ith position of the row. This is termed a match (or coincidence or rencontre) in the ith position. What is the probability of obtaining at least one match? Solution First, some preliminary results: (a) How many arrangements are there in all? n!. with a match in position 1? (n 1)! (by ignoring position 1). with a match in position i? (n 1)! (by symmetry). with matches in positions 1 and 2? (n 2)! with matches in positions i and j? (n 2)! with matches in positions i, j, k? (n 3)! etc. (b) How many terms are there in the summations 1 i<j n b ij, 1 i<j<k n c ijk,...? The easiest argument is as follows. In the case of the first summation, take a sample of size 2, {r,s} say, from the population {1, 2,..., n}, sampling ( without ) replacement: let n i = min(r, s), j = max(r, s). The number of such samples is, so this is the number 2 of terms in the first summation. n Similarly, the number of terms in the second summation is and so on. 3

9 page 9 Now for the main problem. We have that P(at least one match) = P(A i A 2... A n ) = P(A i ) P(A i A j ) + + ( 1) n+1 P(A 1 A n ) i<j by the generalized addition law (1.16). From (a) above, and more generally P(A i ) = P(A i A j ) = P(A i1 A i2 A ir ) = (n 1)!, i = 1,..., n n! (n 2)!, 1 i < j n n! (n r)!, 1 i 1 < i 2 < < i r n. n! From preliminary result (b) above, the number of terms in the summations are n n n n n,,,...,,..., = r n respectively. Hence (n 1)! P(A 1 A n ) = n. n! n (n 2)!. + 2 n! n (n 3)! n 0!. + ( 1) n+1 3 n! n n! = 1 1 2! + 1 3! + ( 1)n+1. 1 n!. (1.20) Now So and therefore e x = r=0 x r r! = 1 + x 1! + x2 2! + x3 + for all real x. 3! e 1 ( 1) r = = r! 2! 1 3! + 1 4!, r=0 P(A 1... A n ) 1 e 1 = when n is large. (1.21) (The approximation may be regarded as adequate for n 6: for n = 6, the exact result is ) We deduce also that P(no match) e 1 = (1.22) An outcome in which there is no match is termed a derangement. We shall return to this problem from time to time. The problem can be extended to finding the probability of exactly k matches (0 k n) see Examples Sheet 1. This matching problem is typical of many probability problems in that it can appear in a variety of guises: e.g. matching of two packs of playing cards (consider one pack to be in a fixed order); envelopes and letters are mixed up by accident and then paired randomly; n drivers put their car keys into a basket, then each driver draws a key at random. It is important to be able to recognize the essential equivalence of such problems.

10 page Collecting Problems Example 1.2 A Token-Collecting Problem (or Adding Spice to Breakfast) In a promotional campaign, a company making a breakfast cereal places one of a set of 4 cards in each packet of cereal. Anyone who collects a complete set of cards can claim a prize. Assuming that the cards are distributed at random into the packets, calculate the probability that a family which purchases 10 packets will be able to claim at least one prize. Solution Define A i : family does not find card i (i = 1,..., 4) in its purchase of 10 packets. Then the required probability is P(A 1 A 2 A 3 A 4 ) = 1 P(A 1 A 2 A 3 A 4 ) = 1 P(A 1 A 2 A 3 A 4 ). Again invoking the generalized addition law (1.16), we have 4 P(A 1 A 2 A 3 A 4 ) = P(A i ) P(A i A j )+ i<j Now i<j<k P(A 1 ) = P(no card 1 in 10 packets) = P(A i A j A k ) P(A 1 A 2 A 3 A 4 ) (by combinatorial argument or multiplication law or binomial distribution (see later)). By symmetry 3 10 P(A i ) =, i = 1,..., 4. 4 Similarly, we have that P(A i A j ) = P(A i A j A k ) = P(A 1 A 2 A 3 A 4 ) = , i j, ( 4) 1 10, i j k, 4 So P(A 1 A 2 A 3 A 4 ) = = Hence the required probability is

11 page Further Examples Example 1.3 A Sampling Problem A bag contains 12 balls numbered 1 to 12. replacement). What is the probability that A random sample of 5 balls is drawn (without (a) the largest number chosen is 8; (b) the median number in the sample is 8? Solution There are 12 points in the sample space. Then: 5 (a) If the largest number chosen is 8, the( other ) 4 are chosen from the numbers 1 to 7 and the 7 number of ways this can be done is ; so the required probability is (b) If the median is 8, two of the chosen numbers come from {1, 2, 3, 4, 5, 6, 7} and 2 from {9, 10, 11, 12}; so the required probability is Example 1.4 The Birthday Problem If there are n people in a room, what is the probability that at least two of them have the same birthday? Solution Recording the n birthdays is equivalent to taking a sample of size n with replacement from a population of size 365 (leap-years will be ignored). The number of samples is (365) n and we assume that each is equally likely (corresponds to the assumption that birth rates are constant throughout the year). The number of samples in which there are no common birthdays is clearly (365 (n 1)). So the probability that there are no common birthdays is ( (365)(364)...(365 (n 1)) 365 n = 1 1 ) ( 1 2 ) ( n ). (1.23) The required probability is 1 - this expression: it increases rapidly with n, first exceeding 1 2 at n = 23 (value ).

12 page 12 [Some people may find this result surprising, thinking that the critical value of n should be much larger; but this is perhaps because they are confusing this problem with another one - what is the probability that at least one person in a group of n people has a specific birthday e.g. 1st January. The answer to this is clearly 1 ( )n : this rises more slowly with n and does not exceed 1 2 until n = 253.] Example 1.5 A Seating Problem If n married couples are seated at random at a round table, find the probability that no wife sits next to her husband. Solution Let A i : couple i sit next to each other. Then the required probability is 1 P(A 1 A 2... A n ) = 1 P(A i ) ( 1) r+1 ( 1) n+1 P(A 1 A n ). 1 i 1 <i 2 <...<i r n P(A i1 A i2 A ir ) To compute the generic term P(A i1 A i2 A ir ) we proceed as follows. There are (2n 1)! ways of seating 2n people at a round table (put the first person on some seat, then arrange the other (2n 1) around them). The number of arrangements in which a specified set of r men, i 1, i 2,..., i r, sit next to their wives is (2n r 1)! (regard each specified couple as a single entity - then we have to arrange (2n 2r+r) = (2n r) entities (the r specified couples and the other people) around the table). Also, each of the r specified couples can be seated together in two ways. So the number of arrangements in which a specified set of r men sit next to their wives is 2 r (2n r 1)!. Hence P(A i1 A i2 A ir ) = 2r (2n r 1)!. (2n 1)! It follows that the required probability is n 1 ( 1) r+1 2 r (2n r 1)!/(2n 1)!. r r=1 (Note: there is another version of this problem in which one imposes the constraint that men and women must alternate around the table).

### Math/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability

Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock

### P (A) = lim P (A) = N(A)/N,

1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or non-deterministic experiments. Suppose an experiment can be repeated any number of times, so that we

### Lecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett

Lecture Note 1 Set and Probability Theory MIT 14.30 Spring 2006 Herman Bennett 1 Set Theory 1.1 Definitions and Theorems 1. Experiment: any action or process whose outcome is subject to uncertainty. 2.

### Basics of Probability

Basics of Probability August 27 and September 1, 2009 1 Introduction A phenomena is called random if the exact outcome is uncertain. The mathematical study of randomness is called the theory of probability.

### Lecture 2 : Basics of Probability Theory

Lecture 2 : Basics of Probability Theory When an experiment is performed, the realization of the experiment is an outcome in the sample space. If the experiment is performed a number of times, different

### Elements of probability theory

2 Elements of probability theory Probability theory provides mathematical models for random phenomena, that is, phenomena which under repeated observations yield di erent outcomes that cannot be predicted

### E3: PROBABILITY AND STATISTICS lecture notes

E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................

### Probability - Part I. Definition : A random experiment is an experiment or a process for which the outcome cannot be predicted with certainty.

Probability - Part I Definition : A random experiment is an experiment or a process for which the outcome cannot be predicted with certainty. Definition : The sample space (denoted S) of a random experiment

### Chapter 3: The basic concepts of probability

Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11

CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According

### Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments

### IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION 1 WHAT IS STATISTICS? Statistics is a science of collecting data, organizing and describing it and drawing conclusions from it. That is, statistics

### + Section 6.2 and 6.3

Section 6.2 and 6.3 Learning Objectives After this section, you should be able to DEFINE and APPLY basic rules of probability CONSTRUCT Venn diagrams and DETERMINE probabilities DETERMINE probabilities

### Finite Sets. Theorem 5.1. Two non-empty finite sets have the same cardinality if and only if they are equivalent.

MATH 337 Cardinality Dr. Neal, WKU We now shall prove that the rational numbers are a countable set while R is uncountable. This result shows that there are two different magnitudes of infinity. But we

### Probabilities and Random Variables

Probabilities and Random Variables This is an elementary overview of the basic concepts of probability theory. 1 The Probability Space The purpose of probability theory is to model random experiments so

### Events. Independence. Coin Tossing. Random Phenomena

Random Phenomena Events A random phenomenon is a situation in which we know what outcomes could happen, but we don t know which particular outcome did or will happen For any random phenomenon, each attempt,

### A set is a Many that allows itself to be thought of as a One. (Georg Cantor)

Chapter 4 Set Theory A set is a Many that allows itself to be thought of as a One. (Georg Cantor) In the previous chapters, we have often encountered sets, for example, prime numbers form a set, domains

### 33 Probability: Some Basic Terms

33 Probability: Some Basic Terms In this and the coming sections we discuss the fundamental concepts of probability at a level at which no previous exposure to the topic is assumed. Probability has been

### Chapter 15. Definitions: experiment: is the act of making an observation or taking a measurement.

MATH 11008: Probability Chapter 15 Definitions: experiment: is the act of making an observation or taking a measurement. outcome: one of the possible things that can occur as a result of an experiment.

### STAT 270 Probability Basics

STAT 270 Probability Basics Richard Lockhart Simon Fraser University Spring 2015 Surrey 1/28 Purposes of These Notes Jargon: experiment, sample space, outcome, event. Set theory ideas and notation: intersection,

### Sets and Subsets. Countable and Uncountable

Sets and Subsets Countable and Uncountable Reading Appendix A Section A.6.8 Pages 788-792 BIG IDEAS Themes 1. There exist functions that cannot be computed in Java or any other computer language. 2. There

### Assigning Probabilities

What is a Probability? Probabilities are numbers between 0 and 1 that indicate the likelihood of an event. Generally, the statement that the probability of hitting a target- that is being fired at- is

### Chapter 4: Probabilities and Proportions

Stats 11 (Fall 2004) Lecture Note Introduction to Statistical Methods for Business and Economics Instructor: Hongquan Xu Chapter 4: Probabilities and Proportions Section 4.1 Introduction In the real world,

### Sections 2.1, 2.2 and 2.4

SETS Sections 2.1, 2.2 and 2.4 Chapter Summary Sets The Language of Sets Set Operations Set Identities Introduction Sets are one of the basic building blocks for the types of objects considered in discrete

### Discrete Mathematics Lecture 5. Harper Langston New York University

Discrete Mathematics Lecture 5 Harper Langston New York University Empty Set S = {x R, x 2 = -1} X = {1, 3}, Y = {2, 4}, C = X Y (X and Y are disjoint) Empty set has no elements Empty set is a subset of

### MAT2400 Analysis I. A brief introduction to proofs, sets, and functions

MAT2400 Analysis I A brief introduction to proofs, sets, and functions In Analysis I there is a lot of manipulations with sets and functions. It is probably also the first course where you have to take

### Study Manual for Exam P/Exam 1. Probability

Study Manual for Exam P/Exam 1 Probability Eleventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com

### Lecture 4: Probability Spaces

EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 4: Probability Spaces Lecturer: Dr. Krishna Jagannathan Scribe: Jainam Doshi, Arjun Nadh and Ajay M 4.1 Introduction

### Introduction to Probability

3 Introduction to Probability Given a fair coin, what can we expect to be the frequency of tails in a sequence of 10 coin tosses? Tossing a coin is an example of a chance experiment, namely a process which

### Probability. A random sample is selected in such a way that every different sample of size n has an equal chance of selection.

1 3.1 Sample Spaces and Tree Diagrams Probability This section introduces terminology and some techniques which will eventually lead us to the basic concept of the probability of an event. The Rare Event

### Probability distributions

Probability distributions (Notes are heavily adapted from Harnett, Ch. 3; Hayes, sections 2.14-2.19; see also Hayes, Appendix B.) I. Random variables (in general) A. So far we have focused on single events,

### Study Manual for Exam P/Exam 1. Probability

Study Manual for Exam P/Exam 1 Probability Seventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com

### Basic concepts in probability. Sue Gordon

Mathematics Learning Centre Basic concepts in probability Sue Gordon c 2005 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Set Notation You may omit this section if you are

### A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes.

Chapter 7 Probability 7.1 Experiments, Sample Spaces, and Events A (random) experiment is an activity with observable results. The sample space S of an experiment is the set of all outcomes. Each outcome

### Lecture 2: Probability

Lecture 2: Probability Assist. Prof. Dr. Emel YAVUZ DUMAN MCB1007 Introduction to Probability and Statistics İstanbul Kültür University Outline 1 Introduction 2 Sample Spaces 3 Event 4 The Probability

### Sets. A set is a collection of (mathematical) objects, with the collection treated as a single mathematical object.

Sets 1 Sets Informally: A set is a collection of (mathematical) objects, with the collection treated as a single mathematical object. Examples: real numbers, complex numbers, C integers, All students in

### WHERE DOES THE 10% CONDITION COME FROM?

1 WHERE DOES THE 10% CONDITION COME FROM? The text has mentioned The 10% Condition (at least) twice so far: p. 407 Bernoulli trials must be independent. If that assumption is violated, it is still okay

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete

### Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

### Introduction to Probability. Experiments. Sample Space. Event. Basic Requirements for Assigning Probabilities. Experiments

Introduction to Probability Experiments These are processes that generate welldefined outcomes Experiments Counting Rules Combinations Permutations Assigning Probabilities Experiment Experimental Outcomes

### PROBABILITY. Chapter Overview

Chapter 6 PROBABILITY 6. Overview Probability is defined as a quantitative measure of uncertainty a numerical value that conveys the strength of our belief in the occurrence of an event. The probability

### 6.2 Unions and Intersections

22 CHAPTER 6. PROBABILITY 6.2 Unions and Intersections The probability of a union of events Exercise 6.2- If you roll two dice, what is the probability of an even sum or a sum of 8 or more? Exercise 6.2-2

### Sets and Cardinality Notes for C. F. Miller

Sets and Cardinality Notes for 620-111 C. F. Miller Semester 1, 2000 Abstract These lecture notes were compiled in the Department of Mathematics and Statistics in the University of Melbourne for the use

### A Few Basics of Probability

A Few Basics of Probability Philosophy 57 Spring, 2004 1 Introduction This handout distinguishes between inductive and deductive logic, and then introduces probability, a concept essential to the study

### Finite and discrete probability distributions

8 Finite and discrete probability distributions To understand the algorithmic aspects of number theory and algebra, and applications such as cryptography, a firm grasp of the basics of probability theory

### M2S1 Lecture Notes. G. A. Young http://www2.imperial.ac.uk/ ayoung

M2S1 Lecture Notes G. A. Young http://www2.imperial.ac.uk/ ayoung September 2011 ii Contents 1 DEFINITIONS, TERMINOLOGY, NOTATION 1 1.1 EVENTS AND THE SAMPLE SPACE......................... 1 1.1.1 OPERATIONS

### Section 2.1. Tree Diagrams

Section 2.1 Tree Diagrams Example 2.1 Problem For the resistors of Example 1.16, we used A to denote the event that a randomly chosen resistor is within 50 Ω of the nominal value. This could mean acceptable.

### Applications of Methods of Proof

CHAPTER 4 Applications of Methods of Proof 1. Set Operations 1.1. Set Operations. The set-theoretic operations, intersection, union, and complementation, defined in Chapter 1.1 Introduction to Sets are

### If f is a 1-1 correspondence between A and B then it has an inverse, and f 1 isa 1-1 correspondence between B and A.

Chapter 5 Cardinality of sets 51 1-1 Correspondences A 1-1 correspondence between sets A and B is another name for a function f : A B that is 1-1 and onto If f is a 1-1 correspondence between A and B,

### Question: What is the probability that a five-card poker hand contains a flush, that is, five cards of the same suit?

ECS20 Discrete Mathematics Quarter: Spring 2007 Instructor: John Steinberger Assistant: Sophie Engle (prepared by Sophie Engle) Homework 8 Hints Due Wednesday June 6 th 2007 Section 6.1 #16 What is the

### Elementary Number Theory We begin with a bit of elementary number theory, which is concerned

CONSTRUCTION OF THE FINITE FIELDS Z p S. R. DOTY Elementary Number Theory We begin with a bit of elementary number theory, which is concerned solely with questions about the set of integers Z = {0, ±1,

### MATHEMATICS 117/E-217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions )

MATHEMATICS 117/E-217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions ) Last modified: May 1, 2012 Reading Dineen, pages 57-67 Proof

### Random variables, probability distributions, binomial random variable

Week 4 lecture notes. WEEK 4 page 1 Random variables, probability distributions, binomial random variable Eample 1 : Consider the eperiment of flipping a fair coin three times. The number of tails that

### This chapter describes set theory, a mathematical theory that underlies all of modern mathematics.

Appendix A Set Theory This chapter describes set theory, a mathematical theory that underlies all of modern mathematics. A.1 Basic Definitions Definition A.1.1. A set is an unordered collection of elements.

### 4.3. Addition and Multiplication Laws of Probability. Introduction. Prerequisites. Learning Outcomes. Learning Style

Addition and Multiplication Laws of Probability 4.3 Introduction When we require the probability of two events occurring simultaneously or the probability of one or the other or both of two events occurring

### The concept of probability is fundamental in statistical analysis. Theory of probability underpins most of the methods used in statistics.

Elementary probability theory The concept of probability is fundamental in statistical analysis. Theory of probability underpins most of the methods used in statistics. 1.1 Experiments, outcomes and sample

### Toss a coin twice. Let Y denote the number of heads.

! Let S be a discrete sample space with the set of elementary events denoted by E = {e i, i = 1, 2, 3 }. A random variable is a function Y(e i ) that assigns a real value to each elementary event, e i.

### Chapter 3. Cartesian Products and Relations. 3.1 Cartesian Products

Chapter 3 Cartesian Products and Relations The material in this chapter is the first real encounter with abstraction. Relations are very general thing they are a special type of subset. After introducing

### Probability OPRE 6301

Probability OPRE 6301 Random Experiment... Recall that our eventual goal in this course is to go from the random sample to the population. The theory that allows for this transition is the theory of probability.

### NOTES ON MEASURE THEORY. M. Papadimitrakis Department of Mathematics University of Crete. Autumn of 2004

NOTES ON MEASURE THEORY M. Papadimitrakis Department of Mathematics University of Crete Autumn of 2004 2 Contents 1 σ-algebras 7 1.1 σ-algebras............................... 7 1.2 Generated σ-algebras.........................

### STAT 319 Probability and Statistics For Engineers PROBABILITY. Engineering College, Hail University, Saudi Arabia

STAT 319 robability and Statistics For Engineers LECTURE 03 ROAILITY Engineering College, Hail University, Saudi Arabia Overview robability is the study of random events. The probability, or chance, that

### Notes on counting finite sets

Notes on counting finite sets Murray Eisenberg February 26, 2009 Contents 0 Introduction 2 1 What is a finite set? 2 2 Counting unions and cartesian products 4 2.1 Sum rules......................................

### M2L1. Random Events and Probability Concept

M2L1 Random Events and Probability Concept 1. Introduction In this lecture, discussion on various basic properties of random variables and definitions of different terms used in probability theory and

### The Language of Mathematics

CHPTER 2 The Language of Mathematics 2.1. Set Theory 2.1.1. Sets. set is a collection of objects, called elements of the set. set can be represented by listing its elements between braces: = {1, 2, 3,

### Chapter 4 Introduction to Probability

Chapter 4 Introduction to Probability Experiments, Counting Rules, and Assigning Probabilities Events and Their Probability Some Basic Relationships of Probability Conditional Probability Probability as

### Probability Review. ICPSR Applied Bayesian Modeling

Probability Review ICPSR Applied Bayesian Modeling Random Variables Flip a coin. Will it be heads or tails? The outcome of a single event is random, or unpredictable What if we flip a coin 10 times? How

### Chapter 4. Probability and Probability Distributions

Chapter 4. robability and robability Distributions Importance of Knowing robability To know whether a sample is not identical to the population from which it was selected, it is necessary to assess the

### 3. Examples of discrete probability spaces.. Here α ( j)

3. EXAMPLES OF DISCRETE PROBABILITY SPACES 13 3. Examples of discrete probability spaces Example 17. Toss n coins. We saw this before, but assumed that the coins are fair. Now we do not. The sample space

### Math/CSE 1019: Discrete Mathematics for Computer Science Fall Suprakash Datta

Math/CSE 1019: Discrete Mathematics for Computer Science Fall 2011 Suprakash Datta datta@cse.yorku.ca Office: CSEB 3043 Phone: 416-736-2100 ext 77875 Course page: http://www.cse.yorku.ca/course/1019 1

### Lectures 2 and 3 : Probability

Lectures 2 and 3 : Probability Jonathan L. Marchini October 15, 2004 In this lecture we will learn about why we need to learn about probability what probability is how to assign probabilities how to manipulate

### Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab

Lecture 2 Probability BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 2014 by Ching-Han Hsu, Ph.D., BMIR Lab 2.1 1 Sample Spaces and Events Random

### Section 6-5 Sample Spaces and Probability

492 6 SEQUENCES, SERIES, AND PROBABILITY 52. How many committees of 4 people are possible from a group of 9 people if (A) There are no restrictions? (B) Both Juan and Mary must be on the committee? (C)

### 6.3 Conditional Probability and Independence

222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted

### Extension of measure

1 Extension of measure Sayan Mukherjee Dynkin s π λ theorem We will soon need to define probability measures on infinite and possible uncountable sets, like the power set of the naturals. This is hard.

### Chap2: The Real Number System (See Royden pp40)

Chap2: The Real Number System (See Royden pp40) 1 Open and Closed Sets of Real Numbers The simplest sets of real numbers are the intervals. We define the open interval (a, b) to be the set (a, b) = {x

### (Refer Slide Time: 1:41)

Discrete Mathematical Structures Dr. Kamala Krithivasan Department of Computer Science and Engineering Indian Institute of Technology, Madras Lecture # 10 Sets Today we shall learn about sets. You must

### Statistical Inference. Prof. Kate Calder. If the coin is fair (chance of heads = chance of tails) then

Probability Statistical Inference Question: How often would this method give the correct answer if I used it many times? Answer: Use laws of probability. 1 Example: Tossing a coin If the coin is fair (chance

### An approach to Calculus of Probabilities through real situations

MaMaEuSch Management Mathematics for European Schools http://www.mathematik.unikl.de/ mamaeusch An approach to Calculus of Probabilities through real situations Paula Lagares Barreiro Federico Perea Rojas-Marcos

### Probability II (MATH 2647)

Probability II (MATH 2647) Lecturer Dr. O. Hryniv email Ostap.Hryniv@durham.ac.uk office CM309 http://maths.dur.ac.uk/stats/courses/probmc2h/probability2h.html or via DUO This term we shall consider: Review

### The study of probability has increased in popularity over the years because of its wide range of practical applications.

6.7. Probability. The study of probability has increased in popularity over the years because of its wide range of practical applications. In probability, each repetition of an experiment is called a trial,

### Discrete Structures for Computer Science: Counting, Recursion, and Probability

Discrete Structures for Computer Science: Counting, Recursion, and Probability Michiel Smid School of Computer Science Carleton University Ottawa, Ontario Canada michiel@scs.carleton.ca December 15, 2016

### Spring 2007 Math 510 Hints for practice problems

Spring 2007 Math 510 Hints for practice problems Section 1 Imagine a prison consisting of 4 cells arranged like the squares of an -chessboard There are doors between all adjacent cells A prisoner in one

### Probability and Statistics Vocabulary List (Definitions for Middle School Teachers)

Probability and Statistics Vocabulary List (Definitions for Middle School Teachers) B Bar graph a diagram representing the frequency distribution for nominal or discrete data. It consists of a sequence

### MATH 289 PROBLEM SET 1: INDUCTION. 1. The induction Principle The following property of the natural numbers is intuitively clear:

MATH 89 PROBLEM SET : INDUCTION The induction Principle The following property of the natural numbers is intuitively clear: Axiom Every nonempty subset of the set of nonnegative integers Z 0 = {0,,, 3,

### Some Definitions about Sets

Some Definitions about Sets Definition: Two sets are equal if they contain the same elements. I.e., sets A and B are equal if x[x A x B]. Notation: A = B. Recall: Sets are unordered and we do not distinguish

### Math 117 Chapter 7 Sets and Probability

Math 117 Chapter 7 and Probability Flathead Valley Community College Page 1 of 15 1. A set is a well-defined collection of specific objects. Each item in the set is called an element or a member. Curly

### SETS. Chapter Overview

Chapter 1 SETS 1.1 Overview This chapter deals with the concept of a set, operations on sets.concept of sets will be useful in studying the relations and functions. 1.1.1 Set and their representations

### 2 Elementary probability

2 Elementary probability This first chapter devoted to probability theory contains the basic definitions and concepts in this field, without the formalism of measure theory. However, the range of problems

### Statistics in Geophysics: Introduction and Probability Theory

Statistics in Geophysics: Introduction and Steffen Unkel Department of Statistics Ludwig-Maximilians-University Munich, Germany Winter Term 2013/14 1/32 What is Statistics? Introduction Statistics is the

### Lesson 3 Chapter 2: Introduction to Probability

Lesson 3 Chapter 2: Introduction to Probability Department of Statistics The Pennsylvania State University 1 2 The Probability Mass Function and Probability Sampling Counting Techniques 3 4 The Law of

### MATHEMATICS 154, SPRING 2010 PROBABILITY THEORY Outline #3 (Combinatorics, bridge, poker)

Last modified: February, 00 References: MATHEMATICS 5, SPRING 00 PROBABILITY THEORY Outline # (Combinatorics, bridge, poker) PRP(Probability and Random Processes, by Grimmett and Stirzaker), Section.7.

### A Simple Example. Sample Space and Event. Tree Diagram. Tree Diagram. Probability. Probability - 1. Probability and Counting Rules

Probability and Counting Rules researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people in this random sample

### Welcome to Stochastic Processes 1. Welcome to Aalborg University No. 1 of 31

Welcome to Stochastic Processes 1 Welcome to Aalborg University No. 1 of 31 Welcome to Aalborg University No. 2 of 31 Course Plan Part 1: Probability concepts, random variables and random processes Lecturer:

### CmSc 175 Discrete Mathematics Lesson 10: SETS A B, A B

CmSc 175 Discrete Mathematics Lesson 10: SETS Sets: finite, infinite, : empty set, U : universal set Describing a set: Enumeration = {a, b, c} Predicates = {x P(x)} Recursive definition, e.g. sequences

### Worked examples Basic Concepts of Probability Theory

Worked examples Basic Concepts of Probability Theory Example 1 A regular tetrahedron is a body that has four faces and, if is tossed, the probability that it lands on any face is 1/4. Suppose that one

### CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE

CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE With the notion of bijection at hand, it is easy to formalize the idea that two finite sets have the same number of elements: we just need to verify

### 1.3 Induction and Other Proof Techniques

4CHAPTER 1. INTRODUCTORY MATERIAL: SETS, FUNCTIONS AND MATHEMATICAL INDU 1.3 Induction and Other Proof Techniques The purpose of this section is to study the proof technique known as mathematical induction.

### Jan 17 Homework Solutions Math 151, Winter 2012. Chapter 2 Problems (pages 50-54)

Jan 17 Homework Solutions Math 11, Winter 01 Chapter Problems (pages 0- Problem In an experiment, a die is rolled continually until a 6 appears, at which point the experiment stops. What is the sample