name that tune
DESCRIPTION
Name that tune. . Song title? Performer(s)?. Scientific Method. “Finding New Information” 3/22/2010. First . . . Reaction to a mid-course class evaluation . Just 8 respondents. Mostly positive. One answer that troubled me: Course objectives and assignments are clearly stated. - PowerPoint PPT PresentationTRANSCRIPT
![Page 3: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/3.jpg)
R.G. Bias | [email protected] |
First . . . Reaction to a mid-course class
evaluation.– Just 8 respondents.– Mostly positive.– One answer that troubled me:
Course objectives and assignments are clearly stated.
25% (2) 50% (4) 12.5% (1) 12.5% (1) 0% (0) Level-setting. Where are we and
where are we headed?3
![Page 4: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/4.jpg)
R.G. Bias | [email protected] |
ObjectivesAfter this class (or these 3 weeks of classes) you
will (it is my hope!): know something about how scientists
(information scientists) gather new information. AND you’ll be good at evaluating information
others offer you. I want to arm you with a scientist’s skepticism,
and a scientist’s tools to conduct research and evaluate others’ research.
- Randolph – remember to take roll.
![Page 5: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/5.jpg)
R.G. Bias | [email protected] |5
There are three kinds of lies: lies, damned lies, and statistics.– Benjamin Disraeli (1804 – 1881), British
politician
![Page 6: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/6.jpg)
R.G. Bias | [email protected] |6
Statistics are like a bikini. What they
reveal is suggestive, but what they conceal is vital. – Aaron Levenstein, U.S. politician
![Page 7: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/7.jpg)
R.G. Bias | [email protected] |7
The statistics on sanity are that one out of every four Americans is suffering from some form of mental illness. Think of your three best friends. If they're okay, then it's you. – Rita Mae Brown, U.S. author
![Page 8: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/8.jpg)
R.G. Bias | [email protected] |8
First . . . There are two components of this
and any class: Instruction and Evaluation.
Let’s get the evaluation out of the way, early.
Need one volunteer.
![Page 9: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/9.jpg)
R.G. Bias | [email protected] |9
“Research shows . . .” Finger length is a good (and quick!)
indicator of intelligence. One volunteer – measure your finger
length in cm. However.
![Page 10: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/10.jpg)
R.G. Bias | [email protected] |10
Hmmmm . . . Everyone in the class will get a
grade of “C”
But still, we can continue with the “instruction” part of the course.
![Page 11: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/11.jpg)
R.G. Bias | [email protected] |11
Oh, so maybe . . . Just THIS person isn’t too smart. Or maybe finger length is NOT a
good indicator of intelligence.
![Page 12: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/12.jpg)
R.G. Bias | [email protected] |12
Now, an experiment I will hand you each a slip of paper.
Please read it an do NOT let anyone else read it.– Women receive a white slip of paper.– Men receive a green slip of paper.
After everyone has read his/her slip of paper and refolded it, I’ll show some letters of the alphabet, one at a time, for one second each.
After the last one, I’ll say “Go,” and ask you to write down the letters, in order.
Any questions?
![Page 17: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/17.jpg)
R.G. Bias | [email protected] |17
Exp. 1 -- DataAll correct Not all
correctTotal
Men 7 (47%) 8 15
Women 3 (13%) 20 23
Total
![Page 18: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/18.jpg)
R.G. Bias | [email protected] |18
Who among you . . . . . . is a statistical wizard? . . . has experience conducting
research?
![Page 19: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/19.jpg)
R.G. Bias | [email protected] |19
Many ways to learn new things Method of Authority
– trusted authority tells you something Method of Reason
– follow basic logical laws from philosophy Modeling Trial-and-error Intuition Scientific Method
– belief on the basis of experience
![Page 20: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/20.jpg)
R.G. Bias | [email protected] |20
Three Paths to “Belief”1 – Naïve acceptance.2 – Cynicism.3 – Critical skepticism.
![Page 22: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/22.jpg)
R.G. Bias | [email protected] |22
What you’ll learn the next 3 weeks
Reliability. (“Oh, just measure it however.”)
Validity. (Finger length a good indicator of intelligence?)
Sampling – picking a representative sample and then generalizing to a larger population
Why larger samples are better
![Page 23: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/23.jpg)
R.G. Bias | [email protected] |23
What you’ll learn (cont’d.): How to represent a group of numbers,
meaningfully. – Frequency distributions– Measures of central tendency– Measures of dispersion (spread)– Graphs/Tables
Operationalizing variables (“intelligence”) Probability Correlation
![Page 24: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/24.jpg)
R.G. Bias | [email protected] |24
What you’ll learn (cont’d.): Different measurement scales What makes a good research
question? Experimental design
– Independent and dependent variables– Controls, counterbalancing, and
confounds– Hypothesis testing– Inferential statistics (is THAT number
really bigger than THIS number?)
![Page 25: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/25.jpg)
R.G. Bias | [email protected] |25
More than anything else . . . . . . scientists are skeptical. “Scientific skepticism is a gullible
public’s defense against charlatans and others who would sell them ineffective medicines and cures, impossible schemes to get rich, and supernatural explanations for natural phenomena.”
![Page 26: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/26.jpg)
R.G. Bias | [email protected] |26
Research MethodsResearchers are . . .- like detectives – gather evidence,
develop a theory.- like judges – decide if evidence meets
scientific standards.- like juries – decide if evidence is
“beyond a reasonable doubt.”
![Page 27: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/27.jpg)
R.G. Bias | [email protected] |27
Science . . . . . . Is a cumulative affair. Current
research builds on previous research.
The Scientific Method:– is empirical (acquires new knowledge
via direct observation and experimentation)
– entails systematic, controlled observations.
– is unbiased, objective.– entails operational definitions.– is valid, reliable, testable, critical,
skeptical.
![Page 28: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/28.jpg)
R.G. Bias | [email protected] |28
CONTROL . . . is the essential ingredient of
science, distinguishing it from nonscientific procedures.
The scientist, the experimenter, manipulates the Independent Variable (IV – “treatment – at least two levels – “experimental and control conditions”) and controls other variables.
![Page 29: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/29.jpg)
R.G. Bias | [email protected] |29
More control After manipulating the IV (because
the experimenter is independent – he/she decides what to do) . . .
He/she measures the effect on the Dependent Variable (what is measured – it depends on the IV).
![Page 30: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/30.jpg)
R.G. Bias | [email protected] |30
Key Distinction IV vs. Individual Differences variable The scientist MANIPULATES an IV,
but SELECTS an Individual Differences variable (or “subject” variable).
Can’t manipulate a subject variable. – “Select a sample. Have half of ‘em get
a divorce.” Consider an Individual Difference, or
Subject Variable, as a TYPE of IV.
![Page 31: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/31.jpg)
R.G. Bias | [email protected] |31
Operational Definitions Explains a concept solely in terms of the
operations used to produce and measure it.– Bad: “Smart people.”– Good: “People with an IQ over 120.”– Bad: “People with long index fingers.”– Good: “People with index fingers at least 7.2
cm.”– Bad: Ugly guys.– Good: “Guys rated as ‘ugly’ by at least 50% of
the respondents.”
![Page 32: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/32.jpg)
R.G. Bias | [email protected] |32
Validity and Reliability Validity: the “truthfulness” of a measure.
Are you really measuring what you claim to measure? “The validity of a measure . . . the extent that people do as well on it as they do on independent measures that are presumed to measure the same concept.”
Reliability: a measure’s consistency. A measure can be reliable without being
valid, but not vice versa.
![Page 33: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/33.jpg)
R.G. Bias | [email protected] |33
Theory and Hypothesis Theory: a logically organized set of
propositions (claims, statements, assertions) that serves to define events (concepts), describe relationships among these events, and explain their occurrence.– Theories organize our knowledge and guide
our research
Hypothesis: A tentative explanation.– A scientific hypothesis is TESTABLE.
![Page 34: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/34.jpg)
R.G. Bias | [email protected] |34
Goals of Scientific Method Description
– Nomothetic approach – establish broad generalizations and general laws that apply to a diverse population
– Versus idiographic approach – interested in the individual, their uniqueness (e.g., case studies)
Prediction– Correlational study – when scores on one variable can
be used to predict scores on a second variable. (Doesn’t necessarily tell you “why.”)
Understanding – con’t. on next page Creating change
– Applied research
![Page 35: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/35.jpg)
R.G. Bias | [email protected] |35
Understanding Three important conditions for
making a causal inference:– Covariation of events. (IV changes, and
the DV changes.)– A time-order relationship. (First the
scientist changes the IV – then there’s a change in the DV.)
– The elimination of plausible alternative causes.
![Page 36: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/36.jpg)
R.G. Bias | [email protected] |36
Confounding When two potentially effective IVs are allowed to
covary simultaneously.
– Poor control!
Men, overall, did a better job of remembering the 12 “random” letters. But the men had received a different “clue.”
So GENDER (what type of IV? A SUBJECT variable, or indiv. differences variable) was CONFOUNDED with “type of clue” (an IV).
![Page 38: Name that tune](https://reader033.vdocuments.site/reader033/viewer/2022051219/568161c5550346895dd1ac8d/html5/thumbnails/38.jpg)
R.G. Bias | [email protected] |
Going forward . . . Annotated bibliography due 3/24
(this Wednesday – same drill, hard-copy in class, digital copy to your TA).
Read those two books that are on reserve in the library – To know a fly and How to lie with statistics.
See you Wednesday.
38