Statistics 303Chapter 4 and 1.3Probability

ProbabilityThe probability of an outcome is the proportion of times the outcome would occur if we repeated the procedure many times.ExamplesCoin: What is the probability of obtaining heads when flipping a coin?A single die: What is the probability I will roll a four?Two dice: What is the probability I will roll a four?A jar of 30 red and 40 green jelly beans: What is the probability I will randomly select a red jelly bean?Computer: In the past 20 times I used my computer, it crashed 4 times and didnt crash 16 times. What is the probability my computer will crash next time I use it?

ProbabilityIndependence: Two events are independent if the outcome of one does not affect or give an indication of the outcome of the other.

EventsIndependentDependentFlipping a coin twiceTemperature on consecutive days3 jelly beans: red, green, orange. Eat one. Eat another.

ProbabilityIndependence: Two events are independent if the outcome of one does not affect or give an indication of the outcome of the other.

EventsIndependentDependentRandomly polling two individualsComparing fertilizer yield for two adjacent field plotsRolling two dice

ProbabilityDefinition: A sample space is a set of all the possible outcomes of a process.Example: CoinWhat is the sample space for flipping a coin 3 times?

ProbabilityDefinition: An event is an outcome or set of outcomes of a process.Example: CoinWhat is one of the possible events for flipping a coin 3 times?

Probability RulesRule 1: The probability of any event is between 0 and 1 inclusive.Pr(HTH) = 1/8 which is between 0 and 1.Rule 2: The probability of the whole sample space is 1.Pr(rolling a 1 or 2 or 3 or 4 or 5 or 6) = 1Rule 3: The probability of an event not occurring is 1 minus the probability of the event. This is known as the complement rule.Pr(not rolling a 5) = 1 1/6 = 5/6

Probability RulesRule 4: If two events A and B have no outcomes in common (they are disjoint), then Pr(A or B) = Pr(A) + Pr(B)Pr(rolling a 1 or a 6) = Pr(rolling a 1) + Pr(rolling a 6) = 1/6 + 1/6 = 2/6 or 1/3Rule 5: If two events A and B are independent, then Pr(A and B) = Pr(A)Pr(B)Pr(rolling a 1 and then a 6) = Pr(rolling a 1) * Pr(rolling a 6) = (1/6)(1/6) = 1/36

Rules of ProbabilityRule 1: 0 P(A) 1Rule 2: P(S) = 1Rule 3: Complement Rule: For any event, A,P(Ac) = 1 P(A)Rule 4: Addition Rule: If A and B are disjoint events, thenP(A or B) = P(A) + P(B)Rule 5: Multiplication Rule: If A and B are independent events, thenP(A and B) = P(A)P(B)

Random VariablesA random variable is a variable whose value is a numerical outcome of a random phenomenon.A discrete random variable, X, has a finite number of possible values. The probability distribution of X lists the values and their probabilities.

Discrete Probability ExampleThe table above represents the distribution of a discrete random variable, X. How likely are you to get an X more than 2? How likely are you to get TWO 3s if you take a random sample of 2 from this population?

Discrete Probability ExampleTo find the mean of a discrete distribution, multiply each possible value by its probability, then add all the products.To find the variance of a discrete distribution, subtract the mean from each of the Xs, square it, multiply it by the corresponding probability, then add up all the products.

Random VariablesA continuous random variable, X, takes all values in an interval of numbers. The probability distribution is described by a density curve. The probability of any event is the area under the density curve and above the values of X that make up the event. Examples are uniform, normal, left-skewed distributions, and right-skewed distributions.

Uniform Distribution ExampleThis is a Uniform Distribution from 0 to 1. Since the area under the curve is 1, the height is also 1. To find the probability for a given interval, you find the areas under the curve.

The Normal DistributionThe mean for a normal distribution is called (pronounced myu), the Greek letter for m (for mean). The standard deviation for a normal distribution is called s (pronounced sigma), the Greek letter for s (for std. dev.)ms

The Normal DistributionWe often write that a variable (call it X) has normal distribution with mean m and variance s2 in the following way:

msNote that the std. dev. is still s.

The Normal DistributionThe normal distribution we have already seen is the standard normal distribution, which has mean = 0 and standard deviation = 1 (the variance = 12 = 1). This is also called the Z-distribution.01

The Normal DistributionThe distribution of any variable which is normally distributed can be converted to a standard normal (Z) distribution in the following way:

This is known as a Z-score.

The Normal DistributionThe distribution of any variable which is normally distributed can be converted to a standard normal (Z) distribution in the following way:

X

The Normal DistributionFor the Standard Normal Distribution (or Z-Distribution) we can find probabilities associated with different values of Z using Z-tables.Z

The Normal DistributionFirst we look at some general characteristics of the Z-distribution.The area under the entire curve is 1.The area under the curve to the left of 0 is 0.5.We say, The probability that Z is to the left of 0 is 0.5.This can be written as Prob ( Z < 0) = 0.5.

Z010.5

The Normal DistributionWe can find the probability that Z is to the left of any number using the Z-table.Z-tables can be found at http://stat.tamu.edu/stat30x/zttables.htmlZ-tables can also be found on the inside front cover of the bookNotice first if we go in the table to the value z = 0.00 we see the probability is 0.5.Z00.5

The Normal DistributionWe can find the probability that Z is to the left of any number using the Z-table.See explanation at http://stat.tamu.edu/stat30x/notes.html called How To Use Z TablesLets look at some examples:Pr ( Z < 1.25) = ?AnswerPr ( Z < 0.50) = ?Answer

The Normal DistributionMore examples of probabilities to the left or less than a numberPr ( Z < -2.01) = ?Pr ( Z < -3.75) = ?Answer Answer

The Normal DistributionThe Z-table only gives probabilities to the left of the value. If we want to get probabilities to the right we use 1 Pr (Z < z).Pr ( Z > 1.25) = ?Answer:Pr ( Z > 0.50) = ?Answer:

The Normal DistributionMore examples of finding probabilities to the right of a number using 1 Pr (Z < z).Pr ( Z > -2.01) = ?Pr ( Z > -3.75) = ?Answer: >Answer:

The Normal DistributionTo find probabilities between two numbers,find the less than (of to the left) probability for each number and then subtract.Pr (-2.01< Z < 2.01) = ?ANSWER:

The Normal DistributionNow suppose we know X ~ N (m, s2) and we want to know the probability that X is less than some value. We must first convert the X to a Z and then use the probabilities from the Z-table. Recall that if X ~ N (m, s2) , thenSo Pr (X < x) = Pr (Z < (x m)/s)

The Normal DistributionHeres an example. Suppose X ~ N ( 3, 22). Find the probability that X is less than 4.Pr ( X < 4 ) = ?Pr (Z < 0.5) =Pr ( X < 4 ) =

The Normal DistributionWe will look at some more difficult examples by hand:Suppose X ~ N (2, 32),Given a value z, find the corresponding x that it came from.How many standard deviations is x from m?Find Pr (X > 5).Find Pr (X < 4 or X > 8).Find Pr ( 4 < X < 8 ).Find the x* such that Pr ( X < x* ) = 0.8485, where 0.8485 is some probability.

Normal Distribution ExampleSuppose the sample proportion of 100 students who think that there is insufficient parking is normally distributed with a mean of 0.8 and a standard deviation of 0.04 ie. p ~ N(0.8, 0.042).How often would we get a sample proportion of 0.75 or less?

Law of Large NumbersDraw independent observations at random from any population with finite mean, . Decide how accurately you would like to estimate . As the number of observations drawn increases, the sample mean ( ) of the observed values eventually approaches the mean of the population as closely as you specified and then stays that close.

Rules for meansRule 1: If X is a random variable and a and b are fixed numbers, thenRule 2: If X and Y are random variables, then

Rules for VariancesRule 1: If X is a random variable and a and b are fixed numbers, thenRule 2: If X and Y are independent random variables, thenNote: variances, NOT std. devs. always add. If X and Y are not independent, then there is a correlation factor added or subtracted from their sum.

Variance when X and Y are CorrelatedRule 2b: If X and Y are NOT independent random variables, then

where is the correlation factor between X and Y.

General Addition RulesThe union of any collection of events is the event that at least one of the collection occurs.Addition Rule for Disjoint Events If events A, B, and C are disjoint in the sense that no two have any outcomes in common, thenP(one or more of A, B, C) = P(A)+P(B)+P(C)General Addition Rule for the Unions of Two Events For any two events A and B,P(A or B) = P(A) + P(B) P(A and B)