morality as kluge
TRANSCRIPT
Based on work by:
Stephen StichJoshua Knobe Daniel Kelly
Debunking Moral IntuitionA Hodgepodge of Multipurpose
Kludges
1
Introduction
• Philosophers – and more recently cognitive scientists – have offered many accounts of the psychological mechanisms & processes underlying intuitive moral judgment
• Moral philosophers have always insisted that sometimes the outputs of those processes – people’s “moral intuitions” – are not to be trusted – though they disagree about when skepticism is
warranted
2
Introduction
• Our goal in this talk is to sketch a newly emerging newly emerging perspectiveperspective on the mechanisms underlying moral intuition …
• and to explore its implicationsimplications for the hotly debated issue of whether and when intuitions whether and when intuitions should be relied onshould be relied on
3
Introduction
• Philosophers have typically assumed that those Philosophers have typically assumed that those mechanisms were mechanisms were well designedwell designed for … for … somethingsomething
• But we now have reasons to think that But we now have reasons to think that many of many of theses mechanismstheses mechanisms are are not well designed for not well designed for ANYTHINGANYTHING
4
Introduction
Moral Psychology is a KludgeMoral Psychology is a Kludge
A hodgepodge of multipurpose A hodgepodge of multipurpose kludges!kludges!
5
Introduction
• Before explaining and defending this claim it will be Before explaining and defending this claim it will be useful to consider some of the useful to consider some of the reasonsreasons that that philosophers – both classic & contemporary – have philosophers – both classic & contemporary – have offered offered for discounting moral intuitionsfor discounting moral intuitions
6
Philosophical Background
• Reflective Equilibrium Reflective Equilibrium
– Rawls’ “Decision Procedure for Ethics” (1951)
– Narrow Reflective EquilibriumNarrow Reflective Equilibrium
• Bring intuitions about
– particular cases
– moral principles
into accord
• To do this, sometimes an intuition about a particular case must be rejectedrejected
7
Philosophical Background
– Wide Reflective EquilibriumWide Reflective Equilibrium
• Bring intuitions about
– particular cases
– moral principles
into accord with the rest of our beliefsthe rest of our beliefs
– including beliefs about scientific matters, history, politics – even metaphysics & semantics
• Even more of our intuitionsEven more of our intuitions about particular cases will have to be rejectedrejected
8
Philosophical Background
– Evolutionary argumentsEvolutionary arguments debunking intuition
• Perhaps the most influential writer in this tradition is Peter Singer
Updated in “Ethics & Intuition (2005)
The
ExpandingCircle
Ethics and Sociobiology
Peter Singer
FARRAR, STRAUS & GIROUXNew York
1981
Philosophical Background
– In The Expanding Circle, Singer focuses on nepotistic nepotistic intuitionsintuitions which maintain that, in various domains, we ought to value the welfare of our kinkin and tribesmentribesmen more than the welfare of people outside these circles
– The psychological processes leading to judgments of this sort were adaptive in ancestral environmentsadaptive in ancestral environments (and perhaps they still are)
– But once we see why we have these nepotistic & tribal why we have these nepotistic & tribal intuitionsintuitions, Singer suggests, we can also see that there is there is no good reason to use themno good reason to use them in a “decision procedure for ethics”
10
Philosophical Background
– In “Ethics and Intuition” (2005) Singer develops the argument by focusing on the sort of “trolley problems” “trolley problems” that have loomed large in recent philosophical and empirical studies
11
Philosophical Background
– Singer (following Greene) maintains that the neuroscientific evidenceneuroscientific evidence suggests that intuitions about the “footbridge” case are the result of our emotional reactionemotional reaction to cases in which harm is caused by the sort of harm is caused by the sort of interaction that would have occurred in interaction that would have occurred in ancestral environmentsancestral environments
12
Philosophical Background
“The salient feature that explains our different intuitive judgments concerning the two cases is that the footbridge case is the kind of situation that was likely to arise during the eons of time over which we were evolving; whereas the standard trolley case describes a way of bringing about someone’s death that has only been possible in the past century or two…. But what is the moral salience of the But what is the moral salience of the fact that I have killed someone in a way that was possible a million fact that I have killed someone in a way that was possible a million years ago, rather than in a way that became possible only two years ago, rather than in a way that became possible only two hundred years ago? I would answer: none….hundred years ago? I would answer: none….
13
Philosophical Background
““At [a] more general level …this … At [a] more general level …this … casts serious doubt on the method casts serious doubt on the method of reflective equilibriumof reflective equilibrium. There is little point in constructing a . There is little point in constructing a moral theory designed to match considered moral judgments that moral theory designed to match considered moral judgments that themselves stem from our evolved responses to the situations in themselves stem from our evolved responses to the situations in which we and our ancestors lived during the period of our evolution which we and our ancestors lived during the period of our evolution as social mammals, primates, and finally, human beings. We should, as social mammals, primates, and finally, human beings. We should, with our current powers of reasoning and our rapidly changing with our current powers of reasoning and our rapidly changing circumstances, be able to do better than that.” (348)”circumstances, be able to do better than that.” (348)”
What I am saying, in brief, is this. Advances in our understanding of ethics … undermine some conceptions of doing ethicsundermine some conceptions of doing ethics …. Those Those conceptions of ethics tend to be too respectful of our intuitions. conceptions of ethics tend to be too respectful of our intuitions. Our better understanding of ethics gives us grounds for being less Our better understanding of ethics gives us grounds for being less respectful of them.respectful of them.” (349)
14
Philosophical Background
• AssumptionsAssumptions that SingerSinger and the friends of intuition the friends of intuition shareshare:
– The psychological system underlying our moral intuitions is well designedwell designed
– Thus there is some point point to – or reason forreason for – the intuitive moral judgments people make when the system is working properly
• Though Singer (unlike the friends of intuition) insists that the function the system is designed for is of dubious moral dubious moral importanceimportance, and thus that the intuitions are not to be taken not to be taken seriouslyseriously
15
Philosophical Background
• We believe that the engine of moral intuition is not well is not well designeddesigned at all
• Far from being the sort of “elegant machine”“elegant machine” celebrated in the writings of some evolutionary psychologists, we think that it is a kludgekludge
– a cluster of mechanisms cobbled together rather cobbled together rather awkwardlyawkwardly from bits of mental machinery most of which were designed for functions that have noting to do with designed for functions that have noting to do with moralitymorality
16
Kelly on Disgust
• KellyKelly has constructed a rich, nuanced, empirically supported account of the psychological mechanisms psychological mechanisms underlying the uniquely underlying the uniquely human disgust systemhuman disgust system and how that system evolvedhow that system evolved
17
Daniel Kelly
Kelly on Disgust
• The Entanglement ThesisThe Entanglement Thesis– Disgust is itself a kludgeDisgust is itself a kludge – a uniquely human
emotion produced by the merger of two distinct systems
• The Co-Optation ThesisThe Co-Optation Thesis– After the merger, disgust was co-optedco-opted by
• the norm systemthe norm system• the ethnic boundary systemthe ethnic boundary system
which were central elements in the emergence of human ultra-socialityhuman ultra-sociality
18
Kelly on Disgust
• Kelly assembles a vast array of evidencevast array of evidence for these theses, drawn from– neuroscience– social psychology– cognitive psychology– developmental psychology– evolutionary psychology– gene-culture co-evolution theory
• As usual, the devil is in the detailsthe devil is in the details– read the work as it appears in print
19
Kelly on Disgust The Entanglement Thesis
• Disgust exhibits a puzzling array of
elicitorselicitors
which evoke an equally puzzling cluster of
responsesresponses
20
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects
21
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects– Substances associated with the bodybody: feces, vomit, spit– Organic decayOrganic decay– People and objects associated with illnessillness: a shirt once
worn by a person with leprosy – Sexual practicesSexual practices: necrophilia, incest– Some moral transgressionsmoral transgressions & transgressors: rape, torture,
child molestation– Members of low status outgroupsoutgroups: untouchables, Jews
22
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects– Substances associated with the bodybody: feces, vomit, spit– Organic decayOrganic decay– People and objects associated with illnessillness: a shirt once
worn by a person with leprosy – Sexual practicesSexual practices: necrophilia, incest– Some moral transgressionsmoral transgressions & transgressors: rape, torture,
child molestation– Members of low status outgroupsoutgroups: untouchables, Jews
23
Some elicitors are pan-cultural
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects– Substances associated with the bodybody: feces, vomit, spit– Organic decayOrganic decay– People and objects associated with illnessillness: a shirt once
worn by a person with leprosy – Sexual practicesSexual practices: necrophilia, incest– Some moral transgressionsmoral transgressions & transgressors: rape, torture,
child molestation– Members of low status outgroupsoutgroups: untouchables, Jews
24
Others are culturally local(or idiosyncratic)
Kelly on Disgust The Entanglement Thesis
• The disgust response includes Gape face (occasionally accompanied by retching) Feeling of nausea Sense oral incorporation
Quick withdrawal A more sustained & cognitive sense of offensiveness A more sustained & cognitive sense of contamination
25
Kelly on Disgust The Entanglement Thesis
• How are all of these connectedconnected?
• The Entanglement ThesisThe Entanglement Thesis maintains that the human emotion of disgust is the result of the fusionfusion of two distinct mechanisms – each of which has homologous counterparts in
other species• though they have combined only in humansonly in humans
26
Kelly on Disgust The Entanglement Thesis
• One mechanism (“the poison avoidance mechanismthe poison avoidance mechanism”) is directly linked to digestiondigestion– It evolved to regulate food intakeregulate food intake and protect the gut
against ingested substances that are poisonous or poisonous or otherwise harmfulotherwise harmful
– It was designed to expel substancesdesigned to expel substances entering the gastro-intestinal system via the mouth
– And to acquire new elicitorsnew elicitors very quickly• As John Garcia famously demonstrated, ingested
substances that induce gut-based distress often generate acquired aversions
27
Kelly on Disgust The Entanglement Thesis
• The other mechanism (“the parasite avoidance the parasite avoidance mechanismmechanism”) – Evolved to protect against infection from pathogens and pathogens and
parasitesparasites, by avoiding them– Not specific to ingestion, but serves to guard against coming
into close physical proximityclose physical proximity with infectious agentsinfectious agents– This involves avoiding not only visible pathogens and visible pathogens and
parasitesparasites, but also places, substances and other organismsplaces, substances and other organisms that might be harboring them
28
Kelly on Disgust The Entanglement Thesis
• The disgust response includes Gape face (occasionally accompanied by retching) Feeling of nausea Sense oral incorporation
Quick withdrawal A more sustained & cognitive sense of offensiveness A more sustained & cognitive sense of contamination
29
These elements of the disgust responseresponse aretraceable to the poison avoidance system
Kelly on Disgust The Entanglement Thesis
• The disgust response includes Gape face (occasionally accompanied by retching) Feeling of nausea Sense oral incorporation
Quick withdrawal A more sustained & cognitive sense of offensiveness A more sustained & cognitive sense of contamination
30
and these are traceable to the parasite avoidance poison system
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects– Substances associated with the bodybody: feces, vomit, spit– Organic decayOrganic decay– People and objects associated with illnessillness: a shirt once
worn by a person with leprosy – Sexual practicesSexual practices: necrophilia, incest– Some moral transgressionsmoral transgressions & transgressors: rape, torture,
child molestation– Members of low status outgroupsoutgroups: untouchables, Jews
31
These elicitorselicitors are traceable to the poison avoidance system
Kelly on Disgust The Entanglement Thesis
• Elicitors include– FoodsFoods: dog meat, grubs, insects– Substances associated with the bodybody: feces, vomit, spit– Organic decayOrganic decay– People and objects associated with illnessillness: a shirt once
worn by a person with leprosy – Sexual practicesSexual practices: necrophilia, incest– Some moral transgressionsmoral transgressions & transgressors: rape, torture,
child molestation– Members of low status outgroupsoutgroups: untouchables, Jews
32
and these are traceable to the parasite avoidance system
Kelly on Disgust The Entanglement Thesis
• One bit of evidence supporting the Entanglement Thesis is that different components of that response are on different developmental schedulesdifferent developmental schedules– Distaste & gape are present within the first year of life– Contamination sensitivity emerges significantly later
• Once the full system in in place, the components of the response are produced together – they form a nomological clusternomological cluster– Any elicitor of disgust will reliably produce all or most of those
clustered components
33
Kelly on Disgust The Entanglement Thesis
• A puzzleA puzzle:– Why should the sight of a festering sore or a person with
leprosy evoke a gape face and a feeling of nausea?
• The solutionThe solution: Disgust is a kludgekludge!
• But it is kludge with features that could be readily co-opted and put to other uses as humans began living in larger groups and human ultrasocialityultrasociality emerged
34
Kelly on Disgust The Co-Optation Thesis
• The Gape Face as a SignalThe Gape Face as a Signal– As group size increased, there was an increasing need for a
perspicuous signalperspicuous signal warning of dangerous foods and risk of dangerous foods and risk of infectious diseaseinfectious disease
– In humans, the face and facial expressions provide a rich source of such social information
– The gape facegape face, which clearly has roots in the facial motions that accompany retching, was co-opted as a signalco-opted as a signal, warning others not just against toxic foodstoxic foods, but also against the presence of parasites and contagious pathogensparasites and contagious pathogens
36
Kelly on Disgust The Co-Optation Thesis
• Co-Optation by the Norm SystemCo-Optation by the Norm System– As group size increased, there was increased need for
complex social social coordinationcoordination
– The norm systemnorm system – whose structure we considered briefly in the 2nd Lecture – played an important role in facilitating this co-ordination
– And the disgust system had features that made it an obvious candidate to be co-opted by the norm system as it evolved
37
Kelly on Disgust The Co-Optation Thesis
– The S&S model suggests that compliance motivation & punitive motivation are linked to “the emotion system”
38
Kelly on Disgust The Co-Optation Thesis
39
Acquisition Mechanism
Execution Mechanism
identi
fy n
orm
im
plic
ati
ng
behavio
r
infe
r co
nte
nts
of
norm
ati
ve r
ule
s
compliance
motivation
punitive motivati
on
emotion
systemRule-related
reasoning capacity
norm data base
r1---------- r2---------- r3---------- …… rn----------
ProximalCues in
Environment
judgment
other emotion triggers
beliefs
explicit reasonin
g
post-hoc justificatio
n
Kelly on Disgust The Co-Optation Thesis
– But psychological & neurological evidence indicates that there are several separate emotion systemsseveral separate emotion systems – the disgust system being one of them
40
Kelly on Disgust The Co-Optation Thesis
41
Acquisition Mechanism
Execution Mechanism
identi
fy n
orm
im
plic
ati
ng
behavio
r
infe
r co
nte
nts
of
norm
ati
ve r
ule
s
compliance
motivation
punitive motivati
on
DISGUST
Rule-related
reasoning capacity
norm data base
r1---------- r2---------- r3---------- …… rn----------
ProximalCues in
Environment
judgment
other emotion triggers
beliefs
explicit reasonin
g
post-hoc justificatio
n
other emotion
s
Kelly on Disgust The Co-Optation Thesis
– Disgust is a natural candidate to provide both compliance & compliance & punitive motivationpunitive motivation for norms that involve intrinsically disgusting matters, like the disposal of corpses & bodily wastes, and other activities that are antecedently salient to the disgust system, like eating practices
• ComplianceCompliance is motivated by making norm violating norm violating behavior disgustingbehavior disgusting & thus aversive
• Punitive motivationPunitive motivation is provided because the violator is violator is considered dirty and contaminatedconsidered dirty and contaminated and is avoided or shunned
42
Kelly on Disgust The Co-Optation Thesis
43
Acquisition Mechanism
Execution Mechanism
identi
fy n
orm
im
plic
ati
ng
behavio
r
infe
r co
nte
nts
of
norm
ati
ve r
ule
s
compliance
motivation
punitive motivati
on
DISGUST
Rule-related
reasoning capacity
norm data base
r1---------- r2---------- r3---------- …… rn----------
ProximalCues in
Environment
judgment
other emotion triggers
beliefs
explicit reasonin
g
post-hoc justificatio
n
other emotion
s
Kelly on Disgust The Co-Optation Thesis
• The norm system is thus a kludge built with kludgy partskludge built with kludgy parts– Not surprisingly, this can lead to some very quirky and quirky and
disturbing behaviordisturbing behavior
– Several recent studies have focused on the fact that the disgust systemdisgust system can be triggeredtriggered by many things that have nothing to do with normsnothing to do with norms
• but even when triggered by these non-moral itemstriggered by these non-moral items, the disgust system can have dramatic and persistent influence dramatic and persistent influence on a person’s judgments about moral issueson a person’s judgments about moral issues
44
Kelly on Disgust The Co-Optation Thesis
45
Acquisition Mechanism
Execution Mechanism
identi
fy n
orm
im
plic
ati
ng
behavio
r
infe
r co
nte
nts
of
norm
ati
ve r
ule
s
compliance
motivation
punitive motivati
on
DISGUST
Rule-related
reasoning capacity
norm data base
r1---------- r2---------- r3---------- …… rn----------
ProximalCues in
Environment
judgment
other emotion triggers
beliefs
explicit reasonin
g
post-hoc justificatio
n
other emotion
s
Kelly on Disgust The Co-Optation Thesis
• Wheatley & HaidtWheatley & Haidt have shown that when participants are hypnotically inducedhypnotically induced to feel a brief pang of disgustdisgust when they encounter the work “often”“often” and then presented with the following scenario “Dan is a student council representative at his school. This
semester he is in charge of scheduling discussions about academic issues. He oftenoften picks topics that appeal to both professors and students in order to stimulate discussion.”
many judge that Dan is doing something wrongsomething wrong!
46
Kelly on Disgust The Co-Optation Thesis
• SchnallSchnall et al. have shown participants make more severe moral judgments when the judgments are made in a disgusting office:
• greasy pizza boxes • sticky chair• a dried up smoothie• a chewed up pen
47
Kelly on Disgust The Co-Optation Thesis
• Other studies have focused on prima facie irrational downstream consequencesdownstream consequences of the disgust system being triggered in moral deliberation
48
Kelly on Disgust The Co-Optation Thesis
49
Acquisition Mechanism
Execution Mechanism
identi
fy n
orm
im
plic
ati
ng
behavio
r
infe
r co
nte
nts
of
norm
ati
ve r
ule
s
compliance
motivation
punitive motivati
on
DISGUST
Rule-related
reasoning capacity
norm data base
r1---------- r2---------- r3---------- …… rn----------
ProximalCues in
Environment
judgment
other emotion triggers
beliefs
explicit reasonin
g
post-hoc justificatio
n
other emotion
s
Downstream consequenc
es
Kelly on Disgust The Co-Optation Thesis
• The Lady Macbeth EffectThe Lady Macbeth Effect
– Zhong & LiljenquistZhong & Liljenquist have shown that recalling an unethical unethical deeddeed increased the desire for products related to cleansing, like antiseptic wipes
– And that cleaning one’s handscleaning one’s hands after describing a past unethical deed reduced moral emotionsreduced moral emotions like guilt & shame
• and also reduced the likelihood that participants would reduced the likelihood that participants would volunteer to helpvolunteer to help a desperate graduate student!
50
Kelly on Disgust The Co-Optation Thesis
• The Lady Macbeth EffectThe Lady Macbeth Effect
– Schnall et al. Schnall et al. (unpublished) compared judgments about moral severity in two groups of participants
• One group had just used an alcohol-based cleansingcleansing gel on their hands
• The other group had just used an ordinary, non-non-cleansingcleansing hand cream
– The moral judgments of those using the cleansing gelcleansing gel were significantly less severe!significantly less severe!
51
Kelly on Disgust The Co-Optation Thesis
• Ethnic Boundary MarkersEthnic Boundary Markers– Boyd & RichersonBoyd & Richerson & their students have argued that
another crucial step in the development of human ultra-sociality was the emergence of mechanisms which allow people to recognize members of their own tribe or “ethnie”
• This is important because in-group members share beliefs & norms norms that facilitate coordinationfacilitate coordination
52
Kelly on Disgust The Co-Optation Thesis
– Since different cuisinescuisines & eating practiceseating practices are one of the more visible correlates of ethnie membership, and since disgust is heavily involved in regulating food intake, disgust was a natural candidate to be co-opted by the emerging system of ethnic identification
– Eating practices of out-groups and other readily detectable signs of out-groupsigns of out-group membership came to evoke disgustcame to evoke disgust
– And disgust came to provided a significant part of the motivation motivation to avoid out-group members
53
Kelly on Disgust The Co-Optation Thesis
– Though the evolutionary function of the ethnic boundary marker system was to facilitate cooperation by keeping groups apart, the kludgy solutionkludgy solution to this problem has some unfortunate consequences
– Out-group members are not simply avoided, they are also considered offensive & contaminatingoffensive & contaminating
– People who embrace different norms are often felt to be disgusting and sub-human! disgusting and sub-human!
54
Kludge Meets Kass
• Leon Kass, M.D., Ph.D.
– Conservative bio-ethicist
– Chairman of the U. S. A. President's Council on Bioethics from 2002 to 2005
56
Kludge Meets Kass
• In his book, Life, Liberty & the Defense of Dignity (2002), there is a chapter called “The Wisdom of Repugnance”“The Wisdom of Repugnance”
• Kass maintains that
– "in crucial cases...repugnance is the emotional expression of deep wisdomdeep wisdom, beyond reason's power fully to articulate it.”
– “In this age in which everything is held to be permissible so long as it is freely done, and in which our bodies are regarded as mere instruments of our autonomous rational will, repugnance may be the only voice left that speaks up to defend the core of our humanity. Shallow are the souls that Shallow are the souls that have forgotten how to shudderhave forgotten how to shudder."
57
Kludge Meets Kass
• The claims play a central role in Kass’ critique of human cloninghuman cloning
• Others have adopted the idea to argue against abortionabortion, pornographypornography & same-sex marriagesame-sex marriage
58
Kludge Meets Kass
• Some philosophers, most notably Martha Nussbaum, have challenged Kass, arguing that disgust should be discounted in moral & legal deliberation because (roughly) it reminds us of our animal origins
59
Kludge Meets Kass
I think Kelly’s work offers a far more
plausibleplausible &
powerfulpowerful critiquecritique
60
Kludge Meets Kass
• There is no reason to think there is
wisdom in repugnancewisdom in repugnance
because
Disgust is a KludgeDisgust is a Kludge
and the psychological system that bases moral judgments on disgust is a
Kludge twice over!Kludge twice over!
61
Kludge Meets Kass
Anti-Jewish Nazi propaganda often invoked the imagery and language of disgust, purity, contamination & dehumanization very flagrantly
62
A poster advertising the film The Eternal Jew
Hitler described “the Jew” as “a maggot in a festering abscess, hidden away inside the clean and healthy body of the nation”
Knobe on Norms and Intentional Action
• My second example draws some elegant and exciting work by Joshua Knobe which demonstrates the way in which unconscious moral judgments – judgments which an agent may explicitly reject – can nonetheless have significant impact on a range of morally relevant intuitions
63
Knobe on Norms and Intentional Action
• In his new book, Kluge, Gary MarcusGary Marcus argues that more recently evolved, computationally slow and consciously accessible mental processes – “System “System 2 Processes”2 Processes” in the currently fashionable jargon – were grafted onto older (System 1) psychological systems designed for quite different purposes
• The resulting kludgy architecturekludgy architecture accounts for many of the quirks and quirks and shortcomingsshortcomings that contemporary cognitive science has discovered
64
Knobe on Norms and Intentional Action
• I think that Knobe’s workKnobe’s work provides an important & disquieting illustration of this phenomenon in the moral domainin the moral domain
65
Knobe on Norms and Intentional Action
• The story begins with “the side effect effect”“the side effect effect” (aka the Knobe effect) – one of best known and most surprising finding in the emerging field of experimental philosophy
• Knobe (2003) reports an experiment in which participants were presented with a pair of almost identical vignettes
66
Knobe on Norms and Intentional Action
67
The vice-president of a company went to the chairman of the board and said, ‘We are thinking of starting a new program. It will help us increase profits, but it will also harmharm [helphelp] the environment.’
The chairman of the board answered, ‘I don’t care at all about harmingharming [helpinghelping] the environment. I just want to make as much profit as I can. Let’s start the new program.’
They started the new program. Sure enough, the environment was harmed harmed [helpedhelped].
Knobe on Norms and Intentional Action
• In the harmharm case, participants were asked how much blameblame the chairman deserved (on a scale from 0 – 6) and whether he intentionallyintentionally harmed the environment
• In the helphelp case, participants were asked how much praisepraise the chairman deserved (on a scale from 0 – 6) and whether he intentionallyintentionally helped the environment
– In the harmharm case, 82% said the chairman brought about the side-effect intentionally
– In the helphelp case, 77% said the chairman did notdid not bring about the side-effect intentionally
68
Knobe on Norms and Intentional Action
• Knobe’s initial hypothesisinitial hypothesis was that people’s moral people’s moral assessment of the side-effectassessment of the side-effect plays a substantial role in determining whether they are willing to say that the side-effect was brought about intentionallyintentionally– A judgment that the side-effect is morally badthe side-effect is morally bad makes it
more likely that it will be judged to be intentionalintentional
– Though this seems incompatible incompatible with the widespread idea that judgments of intentionality are judgments about a a purely factual matterpurely factual matter, it does have an obvious rationalean obvious rationale since judgments about whether an action is intentional play a central role in determining whether an agent deserves praise or blame
69
Knobe on Norms and Intentional Action
• Subsequent research showed that, if the hypothesis is understood as a claim about the effect of moral the effect of moral judgments that people consciously makejudgments that people consciously make, this hypothesis is mistaken mistaken
• The problem emerges clearly in study Knobe ran in collaboration with David Pizarro & Paul Bloom
70
Knobe on Norms and Intentional Action
• Liberal university studentsLiberal university students were given Knobe-style Knobe-style vignettesvignettes in which an advertising executive approves an ad campaign which has the side-effectside-effect of
encouraging interracial sex encouraging interracial sex or placing gardenias in one’s office
71
Knobe on Norms and Intentional Action
• NoneNone of the participants judged that inter-inter-racial sexracial sex (or placing gardenias) is morally morally wrongwrong
• But participants were much more inclined to say that the executive intentionally intentionally encouraged interracial sexencouraged interracial sex
• Explicit moral judgmentsExplicit moral judgments cannot explain the difference in judgments about the intention-ality intention-ality of the side-effects
72
Knobe on Norms and Intentional Action
• However, (following Pizarro & Bloom) Knobe has recently proposed that perhaps participants were making non-non-conscious normative judgmentsconscious normative judgments that the behavior in the behavior in question violates a normquestion violates a norm that is made salient by the question or situation, even if it is a norm that they explicitly rejectexplicitly reject
73
Knobe on Norms and Intentional Action
• The picture Knobe now proposes looks like this:
“In reaching a conscious moral judgmentconscious moral judgment, we can consider a variety of different moral norms, weigh these norms against each other, perhaps even determine that some of the norms are themselves unjustified.”
74
Knobe on Norms and Intentional Action
• Non-conscious moral judgmentsNon-conscious moral judgments are formed through a much simpler (system-1 style) process
– They are formed extremely quicklyextremely quickly and therefore involve involve very shallow processingvery shallow processing
– In generating a non-conscious moral judgment, the only the only norms we consider are the ones that first come to mindnorms we consider are the ones that first come to mind. We do not searchsearch for additional norms; we do not weighweigh norms against each other; we do not ask whether any of the norms might themselves be unjustifiedunjustified.
75
Knobe on Norms and Intentional Action
– Instead, we simply determine whether the behavior in the behavior in question violates any of the norms question violates any of the norms in the very limited set we are considering
– If it does, we classify it as a transgressiontransgression. It is this judgment this judgment as to whether or not the behavior is a transgression that then influences our intuitions about intentionalinfluences our intuitions about intentional action.
76
Knobe on Norms and Intentional Action
• The theory predicts that the most salient norms evoked the most salient norms evoked by a given caseby a given case will be the ones used to in making intentionality judgments, even if subsequent reflection leads the agent to think that there is nothing wrong with violating the norm – or that doing so would be a very good thing.
• Here is a vignette that Knobe has recently used to test this idea
77
Knobe on Norms and Intentional Action
In Nazi Germany, there was a law called the ‘racial identification law.’ The purpose of the law was to help identify people of certain races so that they could be rounded up and sent to concentration camps. Shortly after this law was passed, the CEO of a small corporation decided to make certain organizational changes. The Vice-President of the corporation said: “By making those changes, you’ll definitely be increasing our profits. But you’ll also be violatingviolating [fulfillingfulfilling] the requirements of the racial identification law.” The CEO said: “Look, I know that I’ll be violatingviolating [fulfillingfulfilling] the requirements of the law, but I don’t care one bit about that. All I care about is making as much profit as I can. Let’s make those organizational changes!” As soon as the CEO gave this order, the corporation began making the organizational changes.– 81%81% of subjects in the violateviolate condition said that he violated the
requirements intentionally; 30%30% of subjects in the fulfillfulfill condition said that he fulfilled the requirements intentionally.
78
Knobe on Norms and Intentional Action
• Knobe’s theory is certainly not the last wordnot the last word on how how intentionality judgments are generatedintentionality judgments are generated– His work has inspired dozens of other researchers
• there are many studies I have not mentioned• and many others are underway
79
Knobe on Norms and Intentional Action
• However, IFIF Knobe’s theory is on the right track, then intentionality judgmentsintentionality judgments are a product of a kludgy architecturekludgy architecture which can be influenced by norms and judgments which the agent– is not aware ofis not aware of, and– does not endorsedoes not endorse
• This raises serious questionsraises serious questions about the useuse of those judgments in further moral deliberationmoral deliberation, or in the lawlaw
80
From Kludginess to SkepticismFrom Kludginess to Skepticism
• Both Kelly’s & Knobe’s work support the hypothesis that motivates this talk
The psychological mechanism underlying moral intuition is
A Hodgepodge of Multipurpose KludgesA Hodgepodge of Multipurpose Kludges
81
From Kludginess to SkepticismFrom Kludginess to Skepticism
• Suppose that’s right. What should we conclude about moral What should we conclude about moral intuition?intuition?
– The answer is NOTNOT that all moral intuition should be rejectedall moral intuition should be rejected• nor even that intuitions that are closely tied to kludgy features
of the mind should be rejected
– For, as Shaun Nichols has argued, some of the most admirable admirable featuresfeatures of the cultural evolution of normscultural evolution of norms – including the increased scope and acceptance of norms prohibiting physical increased scope and acceptance of norms prohibiting physical harmharm – are the products of kludgy design
82
From Kludginess to SkepticismFrom Kludginess to Skepticism
• Rather, I suggest, the right conclusion to draw is that ALL ALL moral intuitionsmoral intuitions should be viewed with a healthy dose of skepticismskepticism
– The mechanisms that give rise to them may not have been may not have been well designed to do anythingwell designed to do anything
– So we should be skeptical about moral intuitionsskeptical about moral intuitions for roughly the same reason that we should be skeptical of the output skeptical of the output of a kludgy piece of computer softwareof a kludgy piece of computer software
83
From Kludginess to SkepticismFrom Kludginess to Skepticism
• Compare and ContrastCompare and Contrast
– The friends of intuitionThe friends of intuition (e.g. moral sense theorists) think the system producing them is well designed for morally admirable well designed for morally admirable goalsgoals
• though it can sometimes misfireit can sometimes misfire when conditions are unfavorable– Previous enemies of intuitionPrevious enemies of intuition (e.g. Singer) think the system
producing them has been well designedwell designed for morally problematic morally problematic goalsgoals
– We believe that the system producing them is a kludgekludge – much of it has not been well designed at all!has not been well designed at all!
84
From Kludginess to SkepticismFrom Kludginess to Skepticism
• But if we should be skeptical about all intuition, how can we go about making how can we go about making moral decisions?moral decisions?
• That’s a BIG questionBIG question & a HARD oneHARD one.– Perhaps I’ll be able to suggest an answer …
85