Complement If A is an event, then the complement of A, written A c, means all the possible outcomes that are not in A. For example, if A is the event UNC wins at least 5 football games, then A c is the event UNC wins less than 5 football games. 1
We can represent this by a Venn diagram, as follows: S A c A Figure 1. Venn diagram for a single event A and its complement A c. 2
The Law of Complementary Events states that P (A c ) = 1 P (A). Example. In the game involving two throws of a die, if A is the event the total is 10 or greater, then A c is the event the total is 9 or smaller. We know P (A) = 1 6, so P (Ac ) = 5 6. 3
Disjoint events, Intersection and Union Two events A and B are said to be disjoint if they cannot both occur. This is represented by the following Venn diagram: S A B Figure 2. Venn diagram for two disjoint events A and B. 4
For example, in two throws of a die, if A is the event the total is 10 or larger and B is the event the total is 3 or smaller, it is clear that A and B cannot both be true, so they are disjoint events. With any two events A and B, we define the intersection of A and B, also written A and B, to be the event that A and B both occur. With any two events A and B, we define the union of A and B, also written A or B, to be the event that at least one of A and B occurs. Note that in common English, if we say A or B, that s often taken as excluding the possibility of both A and B occurring. In the language of probability, A or B always includes the possibility that both A and B might occur unless they are disjoint, in which case it is impossible. 5
So another definition of disjoint events is: two events A and B are disjoint if the intersection A and B is an impossible event. The law of addition for disjoint events states that: If two events A and B are disjoint, then P (A or B) = P (A) + P (B). Example. Consider the toss of two dice where A is the event the total is 10 or larger and B is the event the total is 3 or smaller. We have already seen that P (A) = 6 1 and it is easy to see by similar reasoning that P (B) = 12 1. Therefore P (A or B) = P (A) + P (B) = 1 6 + 1 12 = 1 4. We could also figure this out directly, by noting that the event A or B consists of 9 outcomes of the sample space ((1,1),(1,2),(2,1) plus the 6 outcomes that comprise B) so the probability is 9 36 = 1 4. 6
The Law of Addition for Non-disjoint Events S A B Figure 3. Venn diagram for two disjoint events A and B. 7
In this case the Law of Addition reads P (A or B) = P (A) + P (B) P (A and B). Example. In a certain university, 52% of all students take a statistics class, 23% take a computing course, and 7% take both. What percentage of students take at least one of computing or statistics? 8
For a randomly chosen student let A be the event the student takes statistics, and let B be the event the student takes computing. The Venn diagram to represent this situation is: S A B Figure 4. Venn diagram for this problem. 9
Applying the Law of Addition, P (A or B) = 0.52 + 0.23 0.07 = 0.68. In other words, 68% of students take at least one of Statistics or Computing. 10
Independent Events Two events are said to be independent if the outcome of one of them does not influence the other. For example, in sporting events, the outcomes of different games are usually considered independent even though that may not be true in a completely strict and literal sense. The multiplication rule for independent events says that if A and B are independent, P (A and B) = P (A) P (B). 11
Example: A football pundit states that the probability that UNC will beat NC State is 0.4, while the probability that UNC will beat Duke is 0.8. What is the probability that 1. UNC wins both games? 2. UNC wins at least one game? 3. UNC loses both games? 12
Solution: 1. If A is the event UNC beats State and B is the event UNC beats Duke, and if we assume these are independent events, then the probability of A and B is 0.4 0.8 = 0.32. 2. Apply the Law of Addition: P (A or B) = P (A)+P (B) P (A and B) = 0.4+0.8 0.32 = 0.88. 3. Apply the Law of Complementary Events: UNC loses both games is the complement of UNC wins at least one game, so its probability is 1 0.88 = 0.12. 13
Warning: Don t confuse the notions of independent events and disjoint events. Independence means that the outcome of one event does not influence the outcome of the other. Disjoint means that if one event occurs then the other cannot occur the very opposite of independence! 14
Conditional Probabilities Consider the example (page 218 of text, referring to the Wimbledon tennis tournament), A: Federer misses his first serve B: Federer misses his second serve We are told that Federer misses his first serve 36% of the time, and that of all the times he misses his first serve, he also misses his second serve 6% of the time. What, then, is the probability he has a double fault? Logically, the answer is 6% of 36%, or 0.06 0.36, which is about 0.02. 15
Now let us rephrase this in the language of conditional probability. We are told that the event A occurs 36% of the time, or in other words P (A) = 0.36. We are also told that, given that A has occurred, the event B occurs 6% of the time. This is written in probability notation as P (B A) = 0.06. The left hand side is read as the probability of B given A. In this particular context, it would not make sense to talk about the probability of B given A c, though in other contexts, that would make sense (e.g. free throws in basketball). 16
The law of multiplication for conditional probabilities says P (A and B) = P (A) P (B A). Note that if we just interchange the role of A and B, we also get P (A and B) = P (B) P (A B). Finally, if A and B are independent, we get P (A B) = P (A) and P (B A) = P (B) that formalizes what is meant by saying that the outcome of one event does not influence the outcome of the other. But in that case, either of the last two formulas reduces to P (A and B) = P (A) P (B) as in our earlier formulation of the multiplication rule for independent events. 17
Here is another (more complicated) example. Consider the game in which a player tosses a die twice, and we want to calculate the probability that the total of the two tosses is at least 10. Define the events A: The first throw is a 6. B: The first throw is a 5. C: The first throw is a 4. D: The total of the two throws is at least 10. Note that if the first throw is less than 4, it s impossible for the total to be 10 or higher. So P (D) = P (A and D) + P (B and D) + P (C and D). (1) 18
Now P (A) = 6 1. Given that A has occurred, D will occur if the second throw produces any of 4, 5 or 6, and the probability of one of those outcomes is 3 6 or 1 2. So we have P (A) = 1 6, P (D A) = 1 2, P (A and D) = 1 6 1 2 = 1 12. Similarly P (B) = 1 6, P (D B) = 1 3, P (B and D) = 1 6 1 3 = 1 18, P (C) = 1 6, P (D C) = 1 6, P (C and D) = 1 6 1 6 = 1 36. Therefore, (1) leads us to P (D) = 1 12 + 1 18 + 1 36 = 1 6 giving the same answer as in our earlier calculation. 19