366 5. sampling defined / the idea – making inference about a larger population what is the...
TRANSCRIPT
![Page 1: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/1.jpg)
366
5
![Page 2: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/2.jpg)
Sampling
• Defined / The idea– Making inference about a larger population• What is the population
– Some particular value in the population• estimating a parameter
![Page 3: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/3.jpg)
Sampling
![Page 4: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/4.jpg)
Sampling
• Population must be defined– If interested in opinions of...• All adults• Registered voters• Likely voters• Actual voters
• These are all distinct populations
![Page 5: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/5.jpg)
Sampling
• Population must be defined– If interested in opinions of...• People in Whatcom County• Voters in Whatcom County• People in Bellingham• Voters in Bellingham• Likely voters in Bellingham
• These are all distinct populations
![Page 6: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/6.jpg)
Sampling
• Population must be defined– If interested in opinions of...• Students at WWU• Seniors at WWU (xxx # of credits & up)• Students in College of Arts & Sciences• etc.
• These are all distinct populations; who should be included, excluded
![Page 7: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/7.jpg)
Sampling
• Sampling unit– A single member of the population• a case
– If population = conflicts (wars)• sampling unit = nations of a certain size
![Page 8: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/8.jpg)
Sampling
• Sampling Frame
• Once clear about what population & units are, how do we find them?– Frame = complete list of population• Registered voters; Students at WWU
– In reality this may not exist• e.g., all people living in the US
![Page 9: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/9.jpg)
Sampling
• Sampling Frame• US Census
– How get ‘the list?’– $3billion; 500,000 workers...
![Page 10: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/10.jpg)
Sampling
• Sampling Frame
• Registered voters; Students at WWU
– Piece of cake?
– Accuracy of sample depends on comprehensiveness of frame
![Page 11: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/11.jpg)
Sampling
• Sampling Frame
• Ahead of time, evaluate for problems– Missing elements• New residents, newly registered voters, ?
– Clusters• Census tracts, city blocks, Zip code, Area code, prefix
– Take random draw of clusters, then random draw of households in cluster
![Page 12: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/12.jpg)
Sampling
• Sampling Frame
• Ahead of time, evaluate for problems– Blank elements• Phone directories (address w/o #)• Phone #s (unassigned prefixes; fax machine; pager)• List of all residents when population = voters
![Page 13: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/13.jpg)
Classic Sample Failure
• 1936 Literary Digest Survey– Survey of 2.4 million Americans– Predicted Alf Landon 57%, FDR 43%– Actual resultFDR 62%, Landon 38%
– Frame = 10 million people• subscribers to Digest; phone directories; club
memberships
![Page 14: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/14.jpg)
Classic Sample Failure
• 1936 Literary Digest Survey
– What went wrong?
![Page 15: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/15.jpg)
Classic Sample Failure
• 2000 & 2004 & 2012 (WI) US Exit polls– Surveys of tens of thousands– 2000 initially predicted Gore win FL• Actually, Bush won
– 2004 initially predicted Kerry win OH• Actually, Bush won
• Frame:– Key precincts, people voting at polling places
![Page 16: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/16.jpg)
2004 VNS Exit Polls, Ohio
![Page 17: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/17.jpg)
“This can’t happen in America. Maybe in Ohio...”
![Page 18: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/18.jpg)
• http://www.youtube.com/watch?v=ArC7XarwnWI
• 2008
• http://www.youtube.com/watch?v=IoWJkrlptNs
![Page 19: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/19.jpg)
Classic Sample Failure
• 2000 & 2004 US Exit polls– What went (goes) wrong?
– also response bias that favors Democrats
![Page 20: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/20.jpg)
Sample Designs
• Probability vs. Non probability sampling– Probability sample• We know the probability that each unit in the
population has of being in the sample
– Non probability sample• We don’t know if every unit has a fixed chance of being
in sample
![Page 21: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/21.jpg)
Sample Design
• Probability sample– If 22% of population are white, males over 21
years of age...– a .22 probability that a white, male over 21 would
end up in sample
![Page 22: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/22.jpg)
Sample Design
• Probability sample– If study repeated w/ different samples, high
likelihood that results similar
– We can estimate likelihood that things observed in the sample are representative of the population
![Page 23: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/23.jpg)
Sample Design
• Real world probability sample problems– Population = likely voters– Good sample frame?
• Voters yes, likely voters no
– Proper randomization • You try it
– Missing elements• Land line vs. cell phones
![Page 24: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/24.jpg)
Probability Samples
• Simple random sampling• Systematic samples• Stratified samples• Cluster samples
![Page 25: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/25.jpg)
Probability Samples
• Simple random sampling– List each unit (person) in population– Give each a number (List from 1 to n)– Use random # generator– If 1207 comes up, select #1207 from list– Repeat
![Page 26: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/26.jpg)
Probability Samples
• Systematic sample– Have list of population, 1 – nth– Find random #, start there on list– Pick each kth unit (person) on list– Hope there is no structure to list• Starting point random, increment random
– Easier• Kind of how exit polls work at polling place
![Page 27: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/27.jpg)
Probability Sample
• Stratified sample– Use available information from the population– Dived so elements w/ in groups (strata) are more
alike than population– A series of homogeneous groups
• Race/ethnicity; income
– Combine samples into one
• Cheaper
![Page 28: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/28.jpg)
Probability Samples
• Cluster sample– Identify clusters (groups)– Select large groups by random• Cities, congressional districts, states, neighborhoods
– Randomly sample within cluster
– Cheaper, no list of national US voters; consider face to face interviews
![Page 29: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/29.jpg)
Probability Samples
• Simple random sampling• Systematic samples• Stratified samples• Cluster samples
• Other types, some of these used together
![Page 30: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/30.jpg)
Non-probability Samples
• Convenience sample– All students in this class• Population = WWU students
– First 200 people walking down Railroad Ave.• Population = Whatcom County voters
– No way to know representativeness of sample
![Page 31: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/31.jpg)
Non-probability samples
• Purposive sample– Units selected subjectively– Chance of being selected depends on researcher’s
judgment
– “Critical elections”• Population = all US Presidential elections
– “Major wars”• Population = all wars
![Page 32: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/32.jpg)
Non-probability sample
• Quota sample– Purposively select sample as representative as
possible– Use know characteristics of population– Target quota based on know characteristics
![Page 33: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/33.jpg)
Non-probability sample
• Quota sample– WWU (Fake example)• 57% female, 43% male• 45% A&S; 25% CST; 10% CBE; 10% Huxley; 10% other• Age• Ethnicity
![Page 34: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/34.jpg)
Non-probability sample
• Quota sample– Whatcom Co. (Fake example)• Gender• Age• Partisanship• City resident vs. County resident
• Monitor demographics of respondents as you go
![Page 35: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/35.jpg)
Non-probability sample
• Quota sample– Poor person’s random
sampling– Can fail to predict
– 1948 3 surveys predicted Dewey to win
– None targeted partisanship
![Page 36: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/36.jpg)
Internet Samples
• Opt-in
• Provide people computers
• Huge samples asked to do interviews
• “Weight” data after responses to represent population
![Page 37: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/37.jpg)
Sample size
• If sample random (ish), precision of estimates depend on size
• Larger = more precise estimate, all else equal
• Very large doesn’t add much precision
![Page 38: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/38.jpg)
Sample size
• Diminishing returns on size
• Depends on scale of population, subgroups– Whatcom Co.– State of WA– USA
![Page 39: 366 5. Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating](https://reader036.vdocuments.site/reader036/viewer/2022062421/56649e5f5503460f94b59bd0/html5/thumbnails/39.jpg)
Sample size
• Diminishing returns on size
• Depends on scale of population, subgroups– Whatcom Co.– State of WA– USA