chapter 2 probability -...
Post on 25-Jul-2018
239 Views
Preview:
TRANSCRIPT
Chapter 2 Probability
Part 3: Probability Introduction
Section 2.6 IndependenceSection 2.7 Bayes’ Theorem
1 / 16
Independence
Consider the RANK and SEX variables in the STEM faculty example.In that case, knowing RANK (i.e. conditioning on it) changed theprobability that a randomly chosen member was female.
What if the extra information you get (like conditioning on RANK)didn’t change the probability?
Example (Independence)
Joleb Inc. is a sales company with 350 employees. The frequency table ofSalary Category (high/low) and Color of car (red/not red) are shown inthe table:
CAR COLORred not red total
SALARY low 28 252 280high 7 63 70total 35 315 350
2 / 16
Independence
Example (Independence, continued)
Does the chance of being in ahigh salary category depend onwhether or not they person has ared car?
CAR COLORred not red total
SALARY low 28 252 280high 7 63 70total 35 315 350
Suppose we randomly choose anemployee.
Let H be the event of high salary.
P (H) = 70350=0.20
We know that P (H) = 0.20, butwhat about P (H|R)?
The probability that the employeehas high salary given they have a redcar.
3 / 16
Independence
Example (Independence, continued)
P (H|R) = P (H∩R)P (R) = 7/350
35/350=0.20 and P (H) = 70350=0.20
It looks like knowing that the employee has a red car doesn’t change thechance of them having a high salary. → H and R are independent.
Independent Events
7
Not Red Red!
1.00!
0.75!
0.50!
0.25!
0.00!
P(R)=0.10 P(R)=0.90
Complement of R, which means ‘not R’.
low
high P(H)=0.20 P(H|R)=0.20
Regardless of whether a person has a red car (R) or not (R), thereʼs still a 0.20 probability that they have a high salary. This says they’re
independent.
(mosaic plot)
4 / 16
Independence
Example (Independence, continued)
In this special case, events H and R are said to be independent.Knowledge that the outcome is in event R does not affect the probabilitythat the outcome is in event H.
Compare the above example to the below example with DependentEvents B and H:
Dependent Events
9
B Not B!
1.00!
0.75!
0.50!
0.25!
0.00!
P(B)=0.30 P(B)=0.70
low
high P(H|B)=0.80 P(H)=0.40
The probability of having a high salary depends on whether a person has a B.S. degree (B) or not (B).
This says they’re NOT independent. P(H|B)≠P(H)
B: Person has B.S. degree!H: Person has a high salary
5 / 16
Independence
For independent events A and B, P (B|A) = P (B).
How does this affect the Multiplication Rule for probability?
For independent events A and B,P (A ∩B) = P (B|A) · P (A) (always applicable)
= P (B) · P (A) (because independent)
Definition (Independence (two events))
Two events are independent if any one of the following equivalentstatements is true:
1 P (B|A) = P (B)
2 P (A|B) = P (A)
3 P (A ∩B) = P (B) · P (A)
6 / 16
Independence
Example (Sequential tosses of a coin are independent)
Let H1 be the event that the first toss is a head.Let H2 be the event that the second toss is a head.
P (H2|H1) = P (H2) Because H1 & H1 are independent= 1
2
What you flipped in the first toss doesn’t affect what you’ll get in thesecond, H1 & H1 are independent.
P (H1 ∩H2) = P (H2|H1) · P (H1)= P (H2) · P (H1) Because H1 & H1 are independent= 1
2 ·12 = 1
4
7 / 16
Independence
Example (Series Circuits)
The circuit below will function only if both devices work properly. Theprobability that a device functions properly is written on the device in thegraphic.
The chance of a failure in a single device is independent of the otherdevice (it’s a matter of the integrity of the device itself). Find theprobability that the circuit functions.
Let D1 be the event that the 1st device works.Let D2 be the event that the 2nd device works.
ANS:
8 / 16
Independence
Example (Parallel Circuits)
For the circuit below to function, only one of the two devices must workproperly. The devices fail independently. The probability that a devicefunctions properly is written on the device in the graphic.
Let T be the event that the top device works.Let B be the event that the bottom device works.
What is the probability that the circuit functions?
We want to find P (T ∪B).
9 / 16
Independence
Example (Parallel Circuits, continued)
ANS:P (circuit functions) = P (top or bottom or both works) = P (T ∪B)
P (T ∪B) = 1− P [(T ∪B)′] {utilize the complement}= 1− P (neither works)= 1− P (T ′ ∩B′)= 1− (0.05)(0.05) = 1− (0.05)2 = 0.9975
This can also be seen by the addition rule:P (T ∪B) = P (T ) + P (B)− P (T ∩B)
= 0.95 + 0.95− (0.95)(0.95) = 0.997510 / 16
Independence
Example (Three independent radars)
Three radar sets, operating independently, are set to detect any aircraftflying through a certain area. Each set has a probability of 0.02 of failingto detect a plane. If an aircraft enters the area, what is the probabilitythat it goes undetected?
(a) (0.02)3
(b) 1− (0.98)3
(c) (0.98)3
(d) 1− (0.02)3
{Also, what detection scenario goes with each probability above...}
11 / 16
Independence
Definition (Independence (multiple events))
The events E1, E2, . . . , En are independent if and only if for any subset ofthese events
P (Ei1 ∩ Ei2 ∩ Ei3 ∩ · · · ∩ Eik) = P (Ei1)× P (Ei2)× · · ·P (Eik).
The knowledge that the events are independent usually comes from afundamental understanding of the random experiment.
12 / 16
Bayes’ Rule (lead-in to Bayes’ Theorem)
Definition (Bayes Rule)
P (A|B) = P (B|A)·P (A)P (B) for P (B) > 0
This is a useful results that lets us compute P (A|B) in terms of P (B|A).
Example (Disease diagnosis, Bayes Rule)
Suppose we’re trying to determine whether someone has meningitis, aninfection of the central nervous system that can be fatal. It causessymptoms like a high fever and a stiff neck.
Let M be the event that a person has Meningitis.
Let S be the event that a person has a stiff neck.
13 / 16
Bayes’ Rule (lead-in to Bayes’ Theorem)
Example (Disease diagnosis, Bayes Rule cont.)
Suppose the following facts:
P (M) = 150000 = 0.00002
P (S) = 120
P (S|M) = 12
If a patient complains of a stiff neck, we can calculate:
P (M |S) = P (S|M)P (M)P (S) = (1/2)(1/50000)
1/20 = 15000 = 0.0002
Because the patient is complaining of a stiff neck, the probability that theperson has meningitis is 0.0002. Without any symptom information, theprobability of having meningitis is 0.00002.
The probability has gone up by a factor of ten given the symptominformation, but it’s still quite unlikely. 14 / 16
Bayes’ Theorem
Definition (Bayes’ Theorem)
If we rewrite the denominator in Bayes’ Rule or P (B) using the TotalProbability Rule and the partition A ∪A′ = S, we have Bayes’ Theorem...
P (A|B) = P (B|A)·P (A)P (B) for P (B) > 0
= P (B|A)·P (A)P (B|A)P (A)+P (B|A′)P (A′)
And this can be extended to any set of k mutually exclusive eventsE1, E2, . . . , Ek such that E1 ∪ E2 ∪ . . . ∪ Ek = S.
P (E1|B) = P (B|E1)·P (E1)P (B) for P (B) > 0
= P (B|E1)·P (E1)P (B|E1)P (E1)+P (B|E2)P (E2)+...+P (B|Ek)P (Ek)
NOTICE: The numerator always equals one of the terms in the sum in the denominator.15 / 16
Bayes’ Theorem
Example (American Lung Association)
According to the Arizona Chapter of the American Lung Association, 7.0%of the population has lung disease. Of those having lung disease, 90% aresmokers; of those not having lung disease, 25.3% are smokers.
Determine the probability that a randomly selected smoker has lungdisease.
ANS:
16 / 16
top related