Download - The Embodied Cognition Literature
![Page 1: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/1.jpg)
The Embodied Cognition Literature
Michael J. SpiveyDepartment of Cognitive ScienceUniversity of California, Merced
16th International Summer School in Cognitive Science, New Bulgarian University, Sofia, Bulgaria, 2009
…cont’d
![Page 2: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/2.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 3: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/3.jpg)
Sensorimotor Influences in Cognition
QuickTime™ and a decompressor
are needed to see this picture.
Scheerer & Lyons (1957)
![Page 4: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/4.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 5: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/5.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 6: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/6.jpg)
Barsalou, Solomon, & Wu (1999)
List the featuresof a watermelon
LargeGreen Sweet
List the featuresof half a watermelon
Red SweetSeeds
![Page 7: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/7.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 8: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/8.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 9: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/9.jpg)
Stimulus-Response CompatibilityTucker & Ellis (1998)
![Page 10: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/10.jpg)
Stimulus-Response CompatibilityTucker & Ellis (1998)
![Page 11: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/11.jpg)
Stimulus-Response CompatibilityTucker & Ellis (1998)
![Page 12: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/12.jpg)
Stimulus-Response CompatibilityTucker & Ellis (1998)
![Page 13: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/13.jpg)
The Importance of BeingSomatosensory Input
Bosbach, Cole, Prinz, Knoblich (2005)
![Page 14: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/14.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 15: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/15.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 16: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/16.jpg)
Mental SimulationsStanfield & Zwaan (2001)
John put the pencil in the cup.John put the pencil in the drawer.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
![Page 17: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/17.jpg)
Mental SimulationsZwaan, Stanfield & Yaxley (2001)
The ranger saw the eagle in the sky.The ranger saw the eagle in the nest.
QuickTime™ and a decompressor
are needed to see this picture.QuickTime™ and a decompressor
are needed to see this picture.
![Page 18: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/18.jpg)
Mental SimulationsZwaan, Madden, Yaxley, & Aveyard (2004)
The pitcher hurled the softball at you.You hurled the softball at the pitcher.
QuickTime™ and a decompressor
are needed to see this picture.QuickTime™ and a decompressor
are needed to see this picture.QuickTime™ and a decompressor
are needed to see this picture.QuickTime™ and a decompressor
are needed to see this picture.
![Page 19: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/19.jpg)
Mental SimulationsMeteyard, Bahrami, & Vigliocco (2007)
QuickTime™ and aVideo decompressor
are needed to see this picture.“bomb, drop, fall…”
“climb, rise, fly…”
“cook, sew, write…”Upward:
Control:
Downward:
QuickTime™ and aVideo decompressor
are needed to see this picture.
![Page 20: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/20.jpg)
Mental SimulationsMeteyard, Bahrami, & Vigliocco (2007)
“bomb, drop, fall…”
“climb, rise, fly…”
“cook, sew, write…”Upward:
Control:
Downward:
QuickTime™ and aVideo decompressor
are needed to see this picture.
QuickTime™ and aVideo decompressor
are needed to see this picture.
![Page 21: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/21.jpg)
Mental SimulationsMeteyard, Bahrami, & Vigliocco (2007)
QuickTime™ and aVideo decompressor
are needed to see this picture.“bomb, drop, fall…”
“climb, rise, fly…”
“cook, sew, write…”Upward:
Control:
Downward:
QuickTime™ and aVideo decompressor
are needed to see this picture.
![Page 22: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/22.jpg)
Verb Image Schemas
• An intimate relationship between language and space– Language is embodied and metaphorical (Gibbs, 2006;
Lakoff, 1999)– Spatial registration hypothesis (Chatterjee, 2001;
Coslett, 1999)– Language is not describable without reference to
cognitive processes such as attentional mechanisms (Langacker, 1991; Talmy, 1983)
– Perceptual symbol systems: cognitive representations are schematics, or simulations of perceptual experiences (Barsalou, 1999)
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 23: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/23.jpg)
Verb Image Schemas - Offline Data• Forced Choice Norming Study
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 24: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/24.jpg)
Verb Image Schemas• Free Drawing Norming Study
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 25: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/25.jpg)
argued with
![Page 26: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/26.jpg)
respected
![Page 27: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/27.jpg)
![Page 28: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/28.jpg)
![Page 29: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/29.jpg)
Verb Image Schemas• Did subjects agree with each other?
– 70% agreement in forced choice; Std errors about 10˚ in freeform.
• Did the tasks tap the same representation?– Axis/aspect angle correlation, R = 0.71
• Did they agree with linguistic intuitions?– Significant effect of expected axis in both studies
![Page 30: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/30.jpg)
Verb Image Schemas - Online Data• Experiment 1 - Visual discrimination
– Hypothesis: comprehending a verb will activate a form of spatial representation that will be extended along either a horizontal or vertical axis, as shown by norming data.
– Non-compatible mental imagery will interfere with the detection or discrimination of overlapping visual stimuli (Perky, 1910; Craver & Arterberry, 2001)
– Participants presented with a spoken sentence containing a horizontal or vertical verb, and identified a rapidly flashed visual stimulus.
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 31: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/31.jpg)
Verb Image Schemas - Online Data
• Performance on the visual task was impaired when the visual stimulus appeared along the axis of the verb’s image schema
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 32: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/32.jpg)
Verb Image Schemas - Online Data• Experiment 2 - Memory• Hypothesis: the spatial structure associated with a verb will influence
the encoding of visual stimuli• Imagery improves memory (Paivio, 1969), and visual stimuli are
remembered better when they are presented in the same spatial locations at presentation and test (Santa, 1977; Zimmer 1998)
• Participants heard a sentence and saw pictures of the agent and patient of the sentence, presented centrally. At a later test stage, they were shown pairs of pictures and asked if they had been previously been presented together. At test, the pictures were presented in a horizontal or vertical alignment.
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 33: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/33.jpg)
Verb Image Schemas - Online DataRichardson, Spivey, Barsalou, & McRae (2003)
![Page 34: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/34.jpg)
Verb Image Schemas - Online DataRichardson, Spivey, Barsalou, & McRae (2003)
![Page 35: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/35.jpg)
Verb Image Schemas - Online Data
• At test, picture pairs were recognized faster if they were presented in the same orientation as the associated verb’s image schema
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 36: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/36.jpg)
Verb Image Schemas • In two offline tasks, naïve participants categorized verbs as having a
horizontal or vertical image schema• There was a good degree of consistency between tasks and between
participants• The offline tasks provided norms for experiments involving online
verb comprehension• In both a visual discrimination and a memory task, reaction times
showed an interaction between the horizontal/vertical nature of the verb’s image schema, and the horizontal/vertical position of the visual stimuli
• Such spatial effects of verb comprehension provide evidence for the perceptual-motor character of linguistic representations (see also Bergen, Lindsay, Matlock & Narayanan, 2007).
Richardson, Spivey, Barsalou, & McRae (2003)
![Page 37: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/37.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 38: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/38.jpg)
attic
basement
Iconicity Affects Semantic Relatedness Judgments (Zwaan & Yaxley, 2003)
![Page 39: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/39.jpg)
basement
attic
Iconicity Affects Semantic Relatedness Judgments (Zwaan & Yaxley, 2003)
![Page 40: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/40.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 41: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/41.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 42: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/42.jpg)
One-Referent Context Two-Referent Context
(Spivey, Tanenhaus, Eberhard, & Sedivy, 2002)
“Put the apple on the towel in the box”“Put the apple that’s on the towel in the box”
Ambiguous:
Unambiguous:
![Page 43: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/43.jpg)
Motor Constraints During Language
Pour the egg in the bowl onto the flour.Pour the egg that’s in the bowl onto the flour.
Compatible Incompatible
(Chambers, Tanenhaus, & Magnuson, 2004)
![Page 44: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/44.jpg)
Motor Constraints During Language(Chambers, Tanenhaus, & Magnuson, 2004)
![Page 45: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/45.jpg)
Motor Facilitation During Language
The Action-Sentence Compatibility Effect(Glenberg & Kaschak, 2002)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 46: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/46.jpg)
Motor Facilitation During Language
Close the drawer.Open the drawer.
QuickTime™ and a decompressor
are needed to see this picture.
The Action-Sentence Compatibility Effect(Glenberg & Kaschak, 2002)
![Page 47: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/47.jpg)
Motor Facilitation During Language
QuickTime™ and a decompressor
are needed to see this picture.
Andy delivered the pizza to you.You delivered the pizza to Andy.
The Action-Sentence Compatibility Effect(Glenberg & Kaschak, 2002)
![Page 48: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/48.jpg)
Motor Facilitation During Language
Liz told you the story.You told Liz the story.
QuickTime™ and a decompressor
are needed to see this picture.
The Action-Sentence Compatibility Effect(Glenberg & Kaschak, 2002)
![Page 49: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/49.jpg)
Motor Facilitation During Language
(For variation in the temporal dynamics,see Kaschak & Borregine, 2008)
The Action-Sentence Compatibility Effect (Glenberg & Kaschak, 2002)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 50: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/50.jpg)
Motor Activation During Language(Pulvermüller, 1999)
![Page 51: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/51.jpg)
Motor Activation During Language(Pulvermüller, 1999)
Language Networks
![Page 52: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/52.jpg)
Motor Activation During Language(Pulvermüller, 1999)
Language Networks Associated with Visual Objects
![Page 53: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/53.jpg)
Motor Activation During Language(Pulvermüller, 1999)
Language Networks Associated with Actions
![Page 54: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/54.jpg)
Motor Activation During Language(Martin, Wiggs, Ungerleider, & Haxby, 1996)
![Page 55: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/55.jpg)
Motor Activation During Language(Pulvermüller, Härle, & Hummel, 2001)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 56: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/56.jpg)
Motor Activation During Language(Pulvermüller, Härle, & Hummel, 2001)
![Page 57: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/57.jpg)
Motor Activation During Language(Pulvermüller, Härle, & Hummel, 2001)
![Page 58: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/58.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory
![Page 59: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/59.jpg)
Sensorimotor Influences in Cognition
• Motor Properties Influence Vision
• Visual Properties Influence Concepts
• Language Influences Visual Properties
• Language and Motor Influence Each Other
• Your Entire Body Participates in Thought
•
•
•
![Page 60: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/60.jpg)
Your Entire Body Participates in Thought• Subliminal Priming of Old Age (Bargh et al., 1996)
• Associations with Approach or Avoid Gestures(Cacioppo and colleagues)
• A Fleeting Moment of Zen and movement/memory
• Orofacial muscles influence judgments (and IAT)(Cacioppo and colleagues)
• Push/Pull response to pos/neg words (Chen &Bargh)
![Page 61: The Embodied Cognition Literature](https://reader035.vdocuments.site/reader035/viewer/2022062221/568134bc550346895d9bdcde/html5/thumbnails/61.jpg)
Sensorimotor Influences in Cognition
ConceptsHaptic
Oculomotor
Visual
Oro-Facial
Auditory
Linguistic
Skeletalmotor
Memory