experiment design 4: theoretical + operational def’ns
DESCRIPTION
Experiment Design 4: Theoretical + Operational Def’ns. Martin Ch. 7. Operational Definitions. Select an operational definition that is: Reliable Valid Likely to produce an effect But also representative Cost and time effective. Valid, reliable Valid, not reliable. Not valid, reliable - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/1.jpg)
Experiment Design 4:Theoretical + Operational Def’ns
Martin Ch. 7
![Page 2: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/2.jpg)
Operational Definitions
Select an operational definition that is:– Reliable– Valid– Likely to produce an effect– But also representative– Cost and time effective
![Page 3: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/3.jpg)
Measure Reliability vs. Validity
Valid, reliable
Valid, not reliable
Not valid, reliable
Not valid, not reliable
![Page 4: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/4.jpg)
Reliability Test-retest
– Same score again? Alternative-form
– Same score on similar test? Split-half
– Same score on even and odd items? Inter-rater
– Same score assigned by different raters?
![Page 5: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/5.jpg)
Construct (measure) validity
Face– Sounds plausible on the face of it?
Content– Content details seem appropriate?
Predictive– Predicts things that it should predict?
Concurrent– Correlated with things that should be
related? (but not too highly!)
![Page 6: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/6.jpg)
Example experiments
Intelligence & age Classroom size & learning
![Page 7: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/7.jpg)
Indirect measures:Behavioral measures Reaction time
– More time = more processing or less automatic
– Need large N to get reliable data Choice & errors
– Harder = more processing or less automatic
Speed-accuracy tradeoffs
![Page 8: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/8.jpg)
Even more indirect measures: Physiological measures Examples:
– GSR, EEG, PET, fMRI, MEG Timing:
– Timing of activation = timing of processing Activity:
– More activation = more processing
![Page 9: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/9.jpg)
Direct stimulation
Apply small electrical charge to brain area
Ask patient what happens– See lights or hear sounds, etc?
![Page 10: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/10.jpg)
Computerized tomography (CT scan)– See brain regions (no timing info)
Positron Emission Tomography (PET)– Track heightened brain flow activity using
radioactive isotope (slow timing info) Functional Magnetic Resonance
Imaging (fMRI)– Track magnetic changes due to changes
in blood oxygen levels (good timing info) EEG & ERP
– Track brain waves (best timing info)
Imaging
![Page 11: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/11.jpg)
PET
Images are taken at many different slices across the brain
![Page 12: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/12.jpg)
An example PET study
![Page 13: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/13.jpg)
An fMRI scanner
Very loud and produces claustrophobia– Therefore, also some questions of poor
external validity
![Page 14: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/14.jpg)
An example fMRI study
Subjects viewed a face on a computer monitor for 3 seconds, held the face in memory (with no visual stimuli) for an 8 second pause, and then viewed a second face for 3 seconds. They pressed a button to indicate whether or not the faces matched.
![Page 15: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/15.jpg)
• Impose fMRI on top of MRI structural• Use subtractive logic
![Page 16: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/16.jpg)
EEG & ERP
![Page 17: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/17.jpg)
Data gathered from EEG
ALPHA WAVES, brought on by unfocusing one's attention, have relatively large amplitude and moderate frequencies.
BETA WAVES, the result of heightened mental activity, typically show rapid oscillations with small amplitudes.
![Page 18: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/18.jpg)
Event-Related Potentials (ERP) Fast changes in EEG in response to a
stimulus
![Page 19: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/19.jpg)
Hot off the presses: rTMS Repetitive transcranial magnetic
stimulation– Produce a repeating magnetic disruption in
one area of the brain to temporally disrupt its function
– Allows for causal inference– But can cause epileptic seizures– Also, don’t know if have perfect targeting
ability yet– Also, because it is repetitive, don’t have
timing information
![Page 20: Experiment Design 4: Theoretical + Operational Def’ns](https://reader035.vdocuments.site/reader035/viewer/2022070419/56815bc6550346895dc9bf40/html5/thumbnails/20.jpg)
Pro Lesions
– Can establish causality
Direct stimulation– Can establish causality– Excellent localization
Imaging– Study normal functions– Good localization and/or
timing info
rTMS– Can establish causality– Damage temporary
Con Lesions
– Normal patients?– Poor localization
Direct stimulation– Damage cells?– Bigger patterns?
Imaging– Causal?– Subtractive logic?
rTMS– Seizures?– Poor timing information– Localization not clear