Implicit Measures of Marketing Constructs With the Implicit Association Test
Boston University
School of Management Working Paper #2002-14
Frédéric F. Brunel School of Management, Boston University
595 Commonwealth Avenue Boston, MA 02215
(617) 353-4069 (office) (617) 353-4098 (fax)
Brian C. Tietje College of Business, Cal Poly State University
San Luis Obispo, CA 93407 (805) 756-1757 (office)
(805) 756-5057 (fax) [email protected]
Cathleen M. Collins
School of Management, Boston University 595 Commonwealth Avenue
Boston, MA 02215 (617) 353-7057 (office)
(617) 353-4098 (fax) [email protected]
Anthony G. Greenwald
Department of Psychology, University of Washington Box 351525
Seattle WA 98195-1525 (206) 543-7227 (office)
(206) 685-3157 (fax) [email protected]
Implicit Measures of Marketing Constructs With the Implicit Association Test
Abstract
This paper discusses the need for implicit measurements in marketing research, the
shortcomings of current measures, and uses the Implicit Association Test (IAT) in a marketing
context, specifically in the measurement of brand attitudes, brand relationships, and attitude
toward the ad (Aad). First, Study 1 validates the IAT in a general marketing context and
demonstrates significant correlations between explicit measures of brand attitudes, ownership,
usage behavior, and IAT-based measures of implicit brand attitudes and brand relationship
strength. In Study 2, IAT measures of implicit attitudes towards sportswear advertisements
(implicit Aad) portraying African-American (black) and European-American (white) athlete-
spokespersons revealed a more positive attitude towards ads with white spokespeople versus ads
with black spokespeople, but explicit measures of Aad did not, confirming that when social
desirability might be at play, implicit and explicit measures do not correlate. Together, these
studies demonstrate that the IAT enhances understanding of consumer responses to marketing
stimuli, particularly when consumers are either unable or unwilling to identify the sources of
influence on their behaviors. Implications of this research are both theoretical and practical.
A substantial portion of consumer behavior is shaped by cognitive processes that are
outside the range of conscious awareness (Alba and Hutchinson 2000; Bargh and Chartrand
1999; Seger 1994; Underwood and Bright 1996). Although significant theoretical advances have
been made in the investigation of unconscious processes, methodological and validity limitations
have constrained this progress. For instance, explicit self-report measures may not be accurate
indicators since people may be unable or unwilling to share their attitudes with a researcher
(Dovidio and Fazio 1992; Gaertner and Dovidio 1986; Haire 1950). Also, because implicit
attitudes often differ from explicit attitudes, explicit measures are typically unsuitable. Moreover,
implicit or indirect measures (e.g., projective measures, semantic priming) pose other obstacles
including interpretation difficulty, possible researcher bias, and problems identifying individual
differences. Since “valid measurement is the sine qua non of science” (Peter 1979, p. 6), a lack
of satisfactory measurement tools that can directly assess unconscious cognition leads marketing
and consumer researchers to rely on more valid explicit measures for empirical testing. For
example, research concerning incidental ad exposure (Janiszewski 1988; Janiszewski 1990;
Janiszewski 1993; Shapiro 1999; Shapiro and MacInnis 1992; Shapiro, MacInnis and Heckler
1997) presumes that preferences are “formed independently of conscious processing”
(Janiszewski 1988, p. 200), but at the same time must rely on self-report measures of attitude
toward the ad (Aad), recognition, and familiarity. As a result, one would expect that the
availability of valid and implicit measures of these variables would provide new insights for
research in this area, and would allow the testing of new hypotheses.
By definition, implicit attitudes have an influence on behavior that is unknown to the
actor (Greenwald and Banaji 1995). Direct measures that rely on self-report are unable to capture
implicit processes, and therefore indirect measures have become “theoretically essential”
2
(Greenwald and Banaji 1995, p. 5). To that end, the Implicit Association Test (or IAT,
Greenwald, McGhee and Schwartz 1998) provides a metric for investigating the influential role
of unconscious processes in social behaviors such as marketing and consumer behaviors. The
IAT has proven to be an effective tool to explore implicit constructs in general social psychology
settings (Greenwald et al. 2002) and, recently with respect to food preferences (Maison,
Greenwald and Bruin 2001). This paper further extends the application of the IAT in a marketing
context, specifically in the measurement of implicit brand attitudes, brand relationships, and Aad.
In the first section, we discuss the limitation and shortcomings of current measures. We then
describe the IAT, discuss its validity as a measurement tool, and explain how it can be
operationalized to measure marketing constructs. In the third section, we present a validation
study to compare IAT-based measures of implicit brand attitudes and brand relationship strength
with explicit measures of brand attitude and brand ownership behaviors in a context where the
implicit and explicit constructs would presumably converge (namely consumers’ attitudes
towards Apple or Windows-based computers). In the fourth section, we report an experiment that
obtains a divergence between an IAT-based measure of implicit attitude toward the ad (Implicit
Aad), and explicit measures of Aad in a situation where biases in self-report measures might be
anticipated; namely, when participants were asked to evaluate sportswear advertisements
portraying African-American and European-American athlete-spokespersons. Finally, we
provide a discussion of these results and the methodology with both theoretical and practical
implications.
3
SHORTCOMINGS OF EXISTING MEASURES
Most explicit measures of attitude (e.g., Likert or semantic differential scales) reference a
target object in the subject’s personal history (Jacoby, Lindsay and Toth 1992). Thus, explicit
measures must necessarily assume that the subject has (1) formed an attitude, (2) is aware of
(i.e., has access to) his or her attitude and (3) is willing to accurately share it with the researcher.
For many reasons, it may be a tenuous assumption that all three conditions can be met in a given
situation (Jacoby, Lindsay and Toth 1992).
An individual who has never heard of a topic is unlikely or unable to have formed a prior
attitude. However, to avoid appearing ignorant, many people will still answer the question
(Hawkins and Coney 1981). In other cases, previously formed attitudes may not be easily
accessible to the individual (Fazio 1986; Fazio et al. 1986). Thus, although they have an opinion,
they report a newly created one. In addition, even if subjects can identify the prior experience,
they may be unaware of its influence on attitude and, hence provide inaccurate reports
(Greenwald and Banaji 1995). Finally, while subjects may have access to their attitudes they still
may distort their answers for social-desirability or image management reasons. Distortions are
especially likely when an accurate response is seen as either violating social norms such as
politeness or prejudice (Demo 1985; Dovidio and Fazio 1992), would jeopardize a subject’s self-
image (Dovidio and Fazio 1992; Gaertner and Dovidio 1986; Sirgy 1982) or would go against
the cliché, stereotypical answer (Haire 1950).
Overall, it could be argued that no explicit measures of attitude truly guarantee that
responses are free of response bias. In addition, because these measures are subject to both
conscious and unconscious distortions, it should come as no surprise that explicit and implicit
4
measures do not always converge (Banaji and Hardin 1996; Devine 1989; Greenwald, McGhee
and Schwartz 1998).
Implicit or indirect attitude measures were developed to measure implicit attitudes that
would not necessarily be detected by explicit measures (Greenwald and Banaji 1995). These
measures make no reference to objects in a subject’s personal history. Instead, they focus a
subject’s attention on performing some task that can indirectly reveal the underlying attitude
such that inaccessible and closely held attitudes can be measured. Generally, implicit measures
can be categorized as either disguised-unstructured or disguised-structured (Campbell 1950).
They are disguised because subjects are aware they are participating in a study and yet unaware
of what is truly assessed. Response alternatives can range from open and unstructured to a few
structured alternatives (Lemon 1973).
Unstructured Implicit Measures
Projective measures are unstructured measures that ask subjects to react to a deliberately
ambiguous stimulus. In the process of completing the task, subjects project parts of themselves
(in the form of attitudes, prejudices, fears, etc.) that can then be interpreted. For example, Haire’s
shopping study (1950) was one of the first widely reported projective measures in marketing.
Haire asked females to describe “the woman” who had developed a shopping list that included
either Nescafe instant or Maxwell House drip coffee (otherwise, the lists were identical). Nearly
half of the subjects described the Nescafe purchaser as “lazy” and a “poor planner”- attitudes
they were loathe to admit directly (Haire 1950).
Sentence or word completion and word association tests are also used frequently. They
are more structured than projective techniques because the stimulus is less ambiguous and the
response options more focused. In a word association task, subjects respond to words with the
5
first word that comes to mind. In completion tasks, subjects are provided with the first few words
or letters and, as suggested by the name, they complete the sentence or word. In these measures,
only a few responses are analyzed, since target measures are hidden amongst a much larger set.
Further, it is burdensome to create sentence/word completion or word association measures that
gather the information of interest while truly disguising the study purpose.
In sum, even if an unstructured measure has face validity, the analysis process can create
errors in the conclusion. These errors stem from the typical difficulties in coding and
interpretation of qualitative data (Churchill 1995). Thus, although unstructured measures can be
valuable, their use should be discouraged in causal designs where specific and precise
measurements are needed.
Structured Implicit Measures
By limiting response options, structured measures gain a degree of objectivity and avoid
most interpretation problems. With these measures, a subject’s attention is focused on the
completion of a task with defined or undefined success criteria. For example, grouping pictures,
words or objects based on subjects’ evaluation of the stimuli is a structured task with no right
answer. Although grouping pictures has demonstrated convergent validity with explicit
measures, concealing the research goals is difficult (Lemon 1973).
An information test is another type of structured implicit measure. It determines a
subject’s knowledge of a topic and has clearly defined success criteria – the answers are either
correct or not. Since a subject’s attitude toward a topic should systematically guide the selection
and retention of knowledge, this test provides an implicit measure of that attitude (Campbell
1950; Churchill 1995). Information tests are robust to social desirability if the purpose is
sufficiently disguised (Lemon 1973) but may be confounded by need for cognition (Haugvedt,
6
Petty and Cacioppo 1992). Other measures with defined success criteria and robustness to social
desirability ask subjects to estimate a group’s opinion or identify the social norms of an event.
However, they do not provide any information about the automaticity of attitude activation
(Dovidio and Fazio 1992). This is key because: the stronger the associative network around an
attitude object, the more automatically the attitude will be activated, even if the attitude is weak
(Bargh 1989) or not consciously held (Fazio 1986; Fazio et al. 1986).
Priming, at either a subliminal or conscious level, can implicitly assess both attitude and
strength of the automatic activation effect (Dovidio and Fazio 1992; Fazio et al. 1986;
Greenwald, Klinger and Liu 1989). A priming effect exists if a subject’s ability to process a
stimulus is enhanced by the previous presentation of a related or associated stimulus. “What
matters more than whether one is aware of a stimulus event is whether one is aware of the
potential influence of that event on subsequent experience and judgments” (Bargh 1994, p. 15).
Thus, as long as the relationship between the prime and the target is concealed, the indirect
effects of the primed stimuli can be detected. Semantic priming (where subjects classify the
meaning of target words) measures response latency to assess attitude automatic activation.
Although subjects are instructed to ignore the prime word preceding a target word, when prime
and target are semantically similar, categorization judgments of the target words are faster
(Meyer and Schvaneveldt 1971). Overall, priming is very flexible as it can use verbal or non-
verbal (e.g., pictures, shapes, faces) stimuli (Tulving and Schacter 1990), and is robust to social
desirability, self-image and accessibility problems. However, while response latency data
“provide reliable and valid indications of associative strength in memory” (Fazio 1990, p. 95),
there has been evidence that priming measures may not be sensitive enough to highlight
individual differences (Bargh et al. 1992; Chaiken and Bargh 1993).
7
Summary
Several problems of existing measures have been identified. First, explicit measures can
only identify attitudes that a subject is able and willing to share. Second, projective, completion
and association measures are subject to interpretation errors and could be identified by subjects,
thereby becoming de facto explicit measures. Third, information tests may be confounded by
need for cognition and neither these nor opinion estimation/norm identification can determine the
level of automatic activation. Fourth, even though priming solves the weaknesses of explicit
measures and can gauge the activation level of automatic attitudes, it may not be sensitive
enough in all cases. Overall, this discussion of existing measures of attitude has highlighted that
a desirable measure should be sensitive to individual differences and robust to image
management and attitude accessibility issues.
THE IMPLICIT ASSOCIATION TEST
The IAT measures the strength of association between a target-concept and an attribute
dimension. For example, the first demonstration of the IAT (Greenwald, McGhee and Schwartz
1998) compared the relative strength of the association between flowers versus insects (the
target-concepts) and positive versus negative valence (i.e., valence attribute concepts, Greenwald
et al. 2002). In their explication of a Unified Theory of Implicit Social Cognition, Greenwald et
al. (2002) define an attitude as “the association of a social object or social group concept with a
valence attribute concept” (p. 5). Persons holding a more favorable attitude towards flowers than
insects possess stronger “flower”-“positive” associations than “insect”-“positive” linkages. The
IAT’s usefulness for measuring self-concept has also been demonstrated (Greenwald and
8
Farnham 2000). Females, for example, possess stronger IAT-measured associations between
“me”-“feminine” than “me”-“masculine”.
The IAT measures the strength of associations between target-concepts and attribute
dimensions by comparing the relative ease of categorizing target-concepts that are paired with
one attribute dimension versus another. Assume, for the purposes of illustration, that you were an
enthusiastic New York Yankees fan who had a general distaste for the New York Mets. You are
presented with a series of words and/or pictures that portray each of the following: the Yankees,
the Mets, pleasant concepts (e.g., the word “happy” or a picture of a smiley face) and unpleasant
concepts. As you are presented with these stimuli, you are instructed to verbally assign them to
one of two mixed categories – either “Yankees-good” or “Mets-bad”. For example, if you were
presented with a photo of Derek Jeter (a shortstop for the Yankees), you would assign that item
to the category “Yankees-good”. After completing several of these categorization decisions, you
are then presented with the same stimuli, only this time you are instructed to verbally assign
them to either “Yankees-bad” or “Mets-good”. As an avid Yankees fan, you would complete the
first half of the exercise faster than the second, because it would be easier for you to associate the
concept “Yankees” with “good” than with “bad”.
In the IAT, word, picture, and/or sound stimuli are presented via a computer that
represent target-concepts and attribute-dimensions, and participants are instructed to assign these
stimuli to one of two mixed categories by hitting one of two response keys on the computer
keyboard. During the first half of the exercise in the example above, the participant would hit the
“a” key (i.e., the left key) if the stimulus belonged to the category “Yankees-good” and the “k”
key (i.e., the right key) if the stimulus belonged to the category “Mets-bad”. The pairings are
reversed during the second half of the exercise (i.e., the second mixed-task), and participants are
9
instructed to hit the left key if the stimulus belongs to the category “Yankees-bad” and the right
key if the stimulus belongs to the category “Mets-good”. The IAT effect measures the difference
in average response latencies between the first and second mixed-tasks. When targets and
attributes are easily associated (compatible), mean response latency is shorter (i.e., processing
will be faster) than if the target-concepts and attributes are not strongly associated.
VALIDITY OF THE IMPLICIT ASSOCIATION TEST
In psychology, considerable support for the validity of the Implicit Association Test has
emerged, as detailed in the original paper describing the IAT (Greenwald et al. 1998) and several
reviews of the IAT (Cunningham, Preacher and Banaji 2001; Greenwald and Farnham 2000;
Greenwald and Nosek 2001). In this section, several criteria for evaluating marketing measures
(Netemeyer and Bearden 1998) are applied to the IAT.
Theoretical Foundation
The IAT design is based on the premise that attitudes, stereotypes, self-concept, and self-
esteem can be defined as associations between concepts (Greenwald et al. 2002). This theoretical
approach is consistent with the associative network of memory model (Anderson and Bower
1973; Collins and Loftus 1975) in which emotion functions as a “memory unit” (Bower 1981),
and which operationalizes an attitude as the association between an attitude-object and a valence
concept (Fazio 1995; Fazio et al. 1982). Furthermore, the idea that attitudes, self-esteem, and
stereotypes can be manifest implicitly has been established in the literature (Greenwald and
Banaji 1995), and is the impetus for the development of other implicit measures such as Fazio’s
sequential priming paradigm (Fazio et al. 1986).
10
Content Validity
The content validity of the IAT can be assessed by the appropriateness of the stimuli that
are used to represent each of the target-concepts and attribute dimensions. The primary
consideration for stimuli selection is that they be reasonably familiar (although the IAT effect
appears robust across relatively wide variations in item familiarity, c.f.Greenwald and Nosek
2001) and easily classified into one of two categories (e.g., pleasant vs. unpleasant, Nike vs.
Reebok). The stimuli that are used to represent the various concepts and attributes in the IAT are
either drawn from established category lists that are available in the literature (e.g., Battig and
Montague 1969; Bellezza, Greenwald and Banaji 1986) or are pre-tested for familiarity and
ability to be categorized.
Reliability
The IAT demonstrates test-retest reliabilities averaging r = .6 across numerous studies
(Bosson, Swann and Pennebaker 2000; Dasgupta and Greenwald 2000; Greenwald and Farnham
2000; Greenwald and Nosek 2001). The IAT also demonstrates resistance to several types of
procedural artifacts (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek 2001). The
IAT effect is robust across procedural variations, including which hand is assigned to the
pleasant category, variability in the number of items used to represent categories, the familiarity
of the items used to represent categories (except for items with extremely low levels of
familiarity; Brendl, Markman and Messner 2001; Greenwald and Nosek 2001; Rothermund and
Wentura 2001), and variability in the response-stimulus interval. Performance in the
categorization task that occurs in the first mixed task does tend to be faster versus the second
mixed task, but this order effect has subsequently been addressed by counterbalancing the order
of these two tasks (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek 2001). IAT
11
effects are also robust to differences in how incorrect responses and non-normal response latency
distributions are treated (Greenwald and Nosek 2001).
Construct Validity
Convergent Validity: IAT measures converge with semantic priming measures of
association strength (Cunningham, Preacher and Banaji 2001; Mellott and Greenwald 2000;
Rudman and Kilianski 2000). The IAT has also been shown to correlate with physiological
measures of implicit social cognition. IAT measures of implicit prejudice correlate with fMRI-
assessed activation of the amygdala (a subcortical structure associated with emotional learning
and evaluation) in White subjects exposed to unfamiliar Black faces (Phelps et al. 2000).
Discriminant Validity: Confirmatory factor analysis shows divergent validity of implicit
and explicit self-esteem and gender self-concept (Greenwald and Farnham 2000). Prejudice
against female job applicants has been associated with IAT-assessed gender stereotypes, but not
explicit measures of gender stereotypes (Rudman and Glick 2001), illustrating that the IAT
measures implicit constructs that may diverge from their explicit counterparts.
Nomological Validity: Greenwald and Farnham (2000) review several studies
demonstrating that “IAT measures can be influenced in theoretically expected fashion by
procedures that might be expected to influence automatic attitudes or stereotypes” (p. 1023). For
example, viewing photos of admirable members of stigmatized groups and despised members of
nonstigmatized groups reduced implicit negative attitudes towards the stigmatized groups
(Dasgupta and Greenwald 2000).
Known Group Validity: Not only can the IAT detect valence differences that are
considered universal in the population (e.g., preferences for flowers over insects, Greenwald,
McGhee and Schwartz 1998), but also differences that are expected to vary between subject
12
populations. The IAT reveals differences between Japanese and Korean American preferences
for their own ethnicities (Greenwald, McGhee and Schwartz 1998), differences between East and
West Germans in their implicit attitudes toward their geographical regions (Kuehnen et al. 2001),
differences between men and women in their implicit gender self-concepts (Greenwald and
Farnham 2000), and differences between men and women in their implicit attitudes and implicit
self-concepts relating to mathematics and the arts (Nosek, Banaji and Greenwald 2000).
USING THE IAT IN MARKETING
Besides applications in a broad-spectrum of psychology settings, the IAT has also been
used to show that IAT-based measures of attitudes towards food categories including juices
versus sodas and low versus high calorie foods correlate with explicit measures of attitudes and
behaviors towards these categories (Maison, Greenwald and Bruin 2001). In this article, we use
the IAT to measure marketing-related constructs, including brand attitudes, brand relationships,
and Aad. As previously discussed, attitudes can be represented as the association between an
attitude object and a valence attribute concept (Greenwald et al. 2002). A person’s attitude
toward a brand such as McDonald’s, for example, would be represented as the relative strength
of the association between McDonald’s and positive versus negative valence. In addition to
evaluative assessments of brands, consumers can also have a relationship with a brand when it is
part of a person’s self-concept (Belk 1988; Fournier 1998; Kleine, Kleine and Allen 1995). As
such, the strength of one consumer’s relationship with a specific brand would be represented in
our example as the strength of the association between McDonald’s and the attribute concept
“me”. We demonstrate the usefulness of the IAT for measuring these two constructs in Study 1.
In Study 2, we use the IAT to capture implicit attitude toward the ad (implicit Aad), by
13
measuring the relative strength of the association between advertisements with spokespeople of
different ethnicities and the valence attribute concept (pleasant vs. unpleasant).
Although explicit measures of brand attitudes, brand relationships, and Aad have already
been developed, these measures are unable to capture an implicit construct that is, by definition
an “introspectively unidentified (or inaccurately identified) trace of past experience”
(Greenwald and Banaji 1995, p. 5). Unlike explicit measures, the IAT can be used to capture
implicit constructs by measuring the relative strength of associations between target-concepts
and attribute dimensions at the implicit level.
STUDY 1
Study 1 was designed to establish the effectiveness of the IAT as a measure of brand
attitudes and strength of brand relationships. To do so we chose an uncontroversial topic, where
implicit and explicit attitudes are expected to converge. Computer platforms, more specifically
Macintosh by Apple (Mac) and PC (Microsoft Windows-based) machines, were chosen as the
focal targets for this study of implicit attitudes and implicit brand relationships. We did not
expect significant differences between explicit and implicit attitudes, since consumers should
know their attitudes and lack motivation to disguise them, as computers are not considered a
sensitive topic. This study was also designed to test the IAT as an instrument for measuring
brand relationships, or the degree to which some brands are part of consumers’ self-concept.
Procedure and Design
Fifty-six introductory psychology students participated in the study on a voluntary basis
for extra course credit. For each participant, all data was collected during one experimental
session lasting under one hour. All participants first completed a 3-page survey demographic,
14
vision, and computer proficiency questions, explicit measures of Mac versus PC attitudes,
computer ownership, and usage frequency. Even though prior research has demonstrated that the
order of implicit versus explicit measures has inconsequential effects on the results (Greenwald
and Farnham 2000), we selected the most conservative option and captured the explicit measures
first because the IAT is less likely than explicit measures to be influenced by prior measures.
Then, participants completed two IATs whose order was counterbalanced. One of the IATs
measured implicit attitudes by using stimuli representing Macintosh and PC-based computers
(the target-concepts) and pleasant and unpleasant words (the attribute dimension; see Figure 1).
------------------------------------ FIGURE 1 ABOUT HERE ------------------------------------
The other IAT measured implicit brand relationships by pairing the Mac and PC-related
stimuli with words representing the concepts “self” and “other”. Self-related words included “I”,
“me”, “my”, and “mine”; other-related words included “they”, “them”, “their”, and “other”. The
first IAT consisted of 7 blocks with 32 trials during the practice blocks and 40 trials during the
measured blocks. Each trial consisted of the presentation of a single stimulus item. The second
IAT only required 6 blocks, since the block in Step 1 of Figure 1 was unnecessary for the IAT
that was administered second because the Mac versus PC categorization had already been
practiced and the key assignments remained unchanged for each subject.
Subjects were randomly assigned to one of eight counterbalanced task orders to
accommodate three procedural factors (i.e., a 2×2×2 design): whether the brand attitude or brand
relationship IAT was administered first, whether pleasant or unpleasant were initially assigned to
the left or right key (in other words: presentation order of the favorable versus unfavorable
attitude), and whether self or other were initially assigned to the left or right key.
15
Measures
During the IAT, the computer recorded participants’ response latencies (in milliseconds)
for the two measured blocks during the brand attitude and brand relationship IAT. Trial, block,
and stimuli information and error rates were also recorded. Consistent with prior procedures and
recommended guidelines established for the IAT (Greenwald and Farnham 2000; Greenwald,
McGhee and Schwartz 1998), the first two trials in the measured blocks were dropped because
they are typically longer; latencies longer than 3,000 ms were recoded to 3,000 ms, and latencies
shorter than 300 ms were recoded as 300 ms. After the data transformations, the IAT effect was
calculated as the difference in response latencies between the third and fifth step depicted in
Figure 1. A pro-Mac implicit attitude effect occurred when a subject was quicker to categorize a
stimulus when Mac and pleasant shared the same response key compared to when Mac and
unpleasant shared the same key. A self-Mac implicit brand relationship effect occurred when a
subject was quicker to categorize Mac and self together compared to Mac and other. Higher
scores on the IAT effects described in this study indicate more favorable implicit attitude and
brand relationship towards Macs relative to PCs.
Explicit attitudes toward Macs and PC were measured in the survey with a 5-item
semantic differential scale, anchored by good-bad, pleasant-unpleasant, inferior-superior,
unsatisfactory-satisfactory, and favorable-unfavorable (α = .90 for both Mac and PC scales).
Two ownership measures (Mac and PC) asked subjects to indicate how many computers of each
type they owned. For each brand, usage frequency was measured with semantic differential
scales anchored by not at all–very frequently.
Participants’ scores on the explicit attitude, ownership, and usage measures for PCs were
subtracted from their Macintosh scores to generate a relative measure of Mac versus PC
16
tendencies. Consistent with the IAT effect, higher scores on these measures indicated a greater
preference for Macs versus PCs.
Results
Initial analyses tested the effects of the counterbalancing factors (e.g., order of the two
IATs), and none of these factors had a significant effect on the IAT results. These findings are
consistent with prior studies using the IAT demonstrating the robustness of the IAT across
several procedural variations (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek
2001). Therefore, the analysis that follows is collapsed across the eight procedural conditions.
The focal analysis of this study is the degree to which the explicit measures of brand attitudes,
ownership, and usage correlated with IAT-based measures of implicit brand attitudes and brand
relationship. Table 1 illustrates that all of the explicit difference measures were significantly and
strongly correlated with the IAT-based measures. Further, we show that in this context where we
do not expect subjects to hide their true beliefs, the explicit brand attitudes and the implicit
attitudes are strongly correlated (r=.504, p<.01), thereby validating the IAT for brand evaluation.
-------------------------------- Table 1 ABOUT HERE
--------------------------------
Further analysis of the explicit difference scores was conducted to see how well the IAT-
based measures differentiated between respondents who definitively favored Macs or PCs. To do
this, the explicit difference scores for attitudes, ownership, and usage were dummy-coded.
Participants who had reported more favorable Mac-related explicit attitudes, ownership, or usage
were assigned a 1 while a 0 indicated higher measures for PCs. Participants who were
indifferent; that is, whose scores on the attitude, ownership, and usage measures were the same
for PCs and Macs, were excluded from this analysis. This eliminated 11.4%, 20.3%, and 5.6% of
17
the participants who reported equivalent attitudes, ownership, and usage, respectively, for Macs
versus PCs. It should also be noted that the pattern of results does not change if all respondents
are kept in the analysis.
Participants who reported more favorable explicit attitudes, greater ownership or usage
frequencies for a brand had significantly faster response latencies when the brand was paired
with the attribute pleasant versus unpleasant, thereby yielding consistency between the implicit
and explicit constructs. In all six comparisons the difference is statistically significant (p<.05 or
p<.01, see Figure 2). This confirms that not only the brand IAT is correlated with explicit brand
preferences, but it is also sensitive to individual behavioral differences. Further, a comparison of
implicit attitude effects for PC versus Mac loyalists yielded stronger IAT effects for the Mac
groups than the PC groups. Whether the data were split by prior attitudes, ownerships or usages,
the average IAT effect for the Mac loyalists ranged from 130.28 to 158.8, while ranging only
from 54.78 to 69.46 for the PC group. T-tests confirmed that whatever split we analyzed, we
detected a larger IAT effect for the Mac groups that for the PC groups (t > 4.33, p <.001 for all
three comparisons). These results indicate that for the Mac loyalists attitude strength and
accessibility seem stronger and higher than for the PC loyalists (see Figure 2).
-------------------------------- Figure 2 ABOUT HERE --------------------------------
With respect to the brand relationship IAT, a significant IAT brand relationship effect
was obtained across the three categorization schemes only for the Mac loyalists (M=121.1,
t=2.93, p =.01 for explicit attitude; M=157.3, t=3.10, p <.01 for ownership; M=178.6, t=4.36, p
<.001 for usage; see Figure 2). Subjects who reported more favorable explicit attitudes, greater
ownership or usage frequencies for Macs had significantly faster response latencies when Mac
18
and self were combined as opposed to Mac and other. Conversely, PC loyalists’ response
latencies when PC and other were combined as opposed to PC and self were not different (t
values ranging from .15 to .76). Further, a comparison of implicit brand relationship effects for
PC versus Mac loyalists confirmed stronger IAT effects for the Mac groups than the PC groups.
Whether the data was split by prior attitudes, ownerships or usages, t-tests confirmed that we
could detect higher IAT effect for the Mac groups that for the PC groups (t>3.25, p<.005 for all
three comparisons). Together, these results suggest that being a “Mac person” is more closely
related to one’s identity than owning a PC. Also, it appears that for our respondents there was no
evidence of a connection between the concept of self and the PC concept, the opposite being true
for the Mac group.
Study 1 Results Discussion
This study demonstrates the validity of the IAT as an instrument for measuring implicit
brand attitudes and brand relationships. Firstly, in a situation where implicit and explicit
constructs would be expected to converge, IAT measures of brand attitudes and brand
relationship were strongly correlated with explicit measures of brand attitudes, ownership, and
usage. Furthermore, IAT measures were sensitive to individual differences, and effectively
differentiated consumers who reported more favorable explicit attitudes, ownership, and usage of
one brand versus the other. Second, the measurement benefits of the IAT are particularly
compelling with respect to brand relationships. Using Fournier’s terminology (1998), the IAT
results showed that Mac loyalists have a stronger self-connection to the brand, thereby
suggesting that the Mac’s brand relationship quality is superior to that of the PC. The strong
Mac brand relationship might stem from the resistance/loyalty that Mac users have developed
after years of being a minority in the computing world (currently and in recent past, Macintosh
19
has held a small 5% share of all desktop computer sales, Hamilton 1999; Wong 2001) and the
stronger brand community exhibited by Mac users versus PC users (Muniz and O’Guinn 2001).
Because of this small minority status one would expect that Mac users hold “a socially
embedded and entrenched loyalty, brand commitment… and even hyper loyalty (Muniz and
O’Guinn 2001, p. 427), which in turn becomes a central component on one’s identity. The IAT
results also confirm that brands “serve as powerful repositories of meaning purposively and
differently employed in the substantiation, creation, and (re)production of concepts of self in the
marketing age” (Fournier 1998, p. 365). This validation of the IAT in a marketing or brand
evaluation context was a necessary step in order to firmly establish that the IAT is a valid
marketing measure. This is key if one is to also show that under certain conditions or for certain
topics there can be dissociations (i.e., no significant correlations) between explicit marketing
attitude measures and corresponding IAT measures.
STUDY 2
The previous study showed that IAT-based measures of brand attitudes and brand
relationships are correlated with explicit measures in circumstances when consumers know their
attitudes and presumably lack motivation to disguise them. The goal of Study 2 is to establish
that the IAT also allows uncovering consumers’ attitudes that traditional measures do not detect.
In particular, we wish to demonstrate that social desirability in some explicit tasks can lead to
erroneous marketing conclusions if implicit measures are not considered. In this study, we
investigate the sensitive topic of the race of advertising spokespeople. Past IAT research has
shown that the IAT reveals racial biases that explicit measures do not detect (Dasgupta and
McGhee 2000; Greenwald, McGhee and Schwartz 1998). Also, there has been an extensive
20
body of marketing research dealing with the impact of spokespeople on advertising effectiveness
and persuasion (Caballero, Lumpkin and Madden 1989; Debevec and Iyer 1988; Deshpande and
Stayman 1994; Heath, McCarthy and Mothersbaugh 1994; Kamins 1989; Kamins 1990; Kamins
and Gupta 1994; Lynch and Schuler 1994; Misra and Beatty 1990). Yet, this past research has
only assessed advertising perceptions through explicit measures (see Forehand and Perkins 2002
for an exception). In this second study, we focus on the very well established construct attitude
toward the ad (Aad) (Mitchell and Olson 1981; and see Brown and Stayman 1992 for a meta
analysis of 47 studies on this topic) as a focal variable and intend to show that there can be a
disassociation between explicit Aad and implicit Aad.
Procedure and Design
Ninety-three introductory to business statistics undergraduate students (consisting of 33
men and 60 women, 46 Caucasians, 30 Asians, 6 Hispanics, 3 African-Americans, 8 Multi-
Racial or other ethnicities, median age = 19) participated in the study for course credit. For each
participant, all data were collected during one experimental session lasting under forty-five
minutes. First, participants completed a survey containing demographic, vision, and computer
proficiency questions. Subsequent analysis showed that all subjects could be retained in the
sample. The survey also included measures of the key construct of interest – attitude toward the
ad (5 item scale) – both for ads with white spokespeople and ads with black spokespeople.
Measurement order was counterbalanced, so that half of the subjects reported on their attitude
towards ads that featured white spokespeople first and the other half reported on attitude towards
ads with black spokespersons first. Subjects were randomly assigned to one of the orders. Then
subjects completed a 7 block computer-based IAT. Blocks 4 and 7 were the measurement
blocks. Each block consisted of 32 (practice) and 40 (measured) trials each. In addition to trial
21
number, block number, and stimuli information (see Appendix 1 for example of stimulus),
subjects’ response latencies (in milliseconds) and error rates were recorded.
Stimuli
For this study we developed thirty-two ads. These ads were very simple in layout in
order to allow for quick processing and classification. They consisted of a picture of an athlete
(male or female), as well as a brand identifier (name or logo). Based on brand familiarity pretest
with a similar population, ads were designed for two different athletics footwear brands: a low
familiarity brand (Etonic) and a high familiarity brand (New Balance). Sports were varied, and
included tennis, basketball, track, golf and bodybuilding. Ads were executed in four versions:
one with a white athlete and a matching one with a black athlete, and one for each of the two
brands (in total: 8 sports pictures × 2 races × 2 brands). All efforts were made to insure that the
black and white race versions of the ads matched each other in all dimensions (see Appendix 1
for examples of the advertising stimuli). In order to minimize differences between ads, they
were displayed in black and white mode. This study also used the same list of pleasant and
unpleasant words that were used in Study 1.
Measures
Explicit measures of Aad were collected for ads with white spokespersons, and for ads
with black spokespersons. They were measured using a six item semantic differential scale
(interesting/boring, good/bad, unpleasant/pleasant, dislike/like, favorable/not favorable, not
irritating/irritating). These items (in different combinations) have been used in past research on
attitude toward the ad (see MacKenzie and Lutz 1996; MacKenzie, Lutz and Belch 1986;
Mitchell 1986; Mitchell and Olson 1981). Reliability for each scale was high (alpha (black) =
.93; alpha (white) = .88). Two versions of the written survey were made so as to counterbalance
22
presentation order of the explicit measures. Half of the subjects received the version where Aad
black was first and the others the version where Aad white was first.
Two types of explicit measures of attitudes towards whites and blacks were also included
in the survey booklet. The first type of measure was a feeling thermometer (Greenwald, McGhee
and Schwartz 1998) numerically labeled at 10-degree intervals from 0 to 99, with the words
“cold or unfavorable”, “neutral”, and “warm or favorable” placed next to the anchored points of
0, 50, and 99, respectively. Participants were instructed “Please make a horizontal mark across
the scales below indicating how you feel, in general, about each of the ethnic groups listed
below.” Two thermometers (one for each ethnic group) were displayed side by side on the
survey page. The placement of the thermometers (i.e., whether the thermometer for blacks was
on the left or right) was randomized. Next, participants completed two sets of five 7-point
semantic differential scales (beautiful/ugly, good/bad, pleasant/unpleasant, not
trustworthy/trustworthy, and nice/awful) to measure overall race attitude for each ethnicity. As
with the thermometers, the scales’ presentation order was randomized. For each race an average
of the 5 items was computed in order to provide an overall race attitude measure. Then, for each
respondent, and for each type of explicit measures (thermometers and overall race attitude),
difference scores were calculated by subtracting scores towards blacks from the scores towards
whites. Thus, higher values on the difference scores reflect a relatively more positive attitude
towards whites or ads with whites versus blacks.
Implicit attitude toward the ad was measured using a similar methodology to Study One.
In this study, the IAT effect was measured as the difference in response latencies when the
classification target category (“ad with a black spokesperson” versus “ad with a white
spokesperson”) shared the same response key as the attribute (“unpleasant” versus “pleasant”).
23
Thus, a pro-white spokesperson implicit Aad effect occurred when a subject was quicker to
categorize a stimulus when “ad with white spokesperson” and “pleasant” shared the same
response key compared to when “ad with white spokesperson” and “unpleasant” shared the same
key.
Results
First, and as expected, we found that there were no significant differences between
explicit Aad that was reported for ads with white spokespersons (m=4.67) compared to ads with
black spokespersons (m=4.77) (see Figure 3). Although the means were not significantly
different (t=1.32, p<.20), the small difference favoring ads with black spokespersons suggests
that the participants were trying to avoid the appearance of being racially biased. Within the
implicit measures of Aad, there is a strong effect in favor of the white spokespersons (IAT effect
m=244.53ms, t=11.25, p <.001). Participants were approximately a quarter of a second faster
when classifying ads with white spokespeople with pleasant and black spokespeople with
unpleasant than classifying white with unpleasant and black with pleasant. This appearance of
dissociation between the implicit and explicit results is further confirmed by the correlation
analysis.
--------------------------------- Figure 3 ABOUT HERE
---------------------------------
Table 2 illustrates bivariate correlations between the various implicit and explicit
measures obtained in the study. Of central importance for this study is that the implicit and
explicit measures of Aad are not significantly related to one another. Implicit Aad is not
significantly related to explicit attitudes towards whites versus blacks, as measured by the
24
thermometer scale, but it is related to the explicit ethnic attitude difference score, as measured by
the 5-item scale, thought not strongly (r<.30).
-------------------------------- Table 2 ABOUT HERE
--------------------------------
Discussion of Study 2 Results
While Study One has demonstrated the validity of the IAT as an instrument for
measuring implicit brand attitudes and brand relationships and has shown that this instrument is
sensitive to individual differences, this second study has shown that the IAT is a useful
measurement tool that allows the measurement and uncovering of results and effects that explicit
measures cannot detect. In this case, we showed that explicit measures of Aad may not represent
automatic associations evoked by the ad. In this case involving the race of a spokesperson, it is
plausible that explicit Aad measures reflect views that participants wish to present, whereas the
implicit measure reflects a more uncontrollable automatic association. The implicit responses
should be accurate portrayals of the stereotypes that are held by the respondents, whereas the
explicit measures are more tented by socially desirability.
GENERAL DISCUSSION
In this article we set out to demonstrate that 1) marketing research and marketing theories
can benefit from better implicit measures, 2) that the IAT is a valid and reliable instrument that
can be used to measure a range of marketing constructs, and 3) that under specific situations IAT
measures are uniquely suited to provide information that is not available through explicit
measures. Findings from our two studies provide the following insights.
25
In Study 1, we have shown that explicit measures and IAT measures of attitudes and
other marketing constructs converge and are valid when consumers are willing and able to report
their feelings and beliefs, and understand the influence of prior experiences on the knowledge
structures supporting them. IAT-based measures of brand attitudes converged with explicit
measures of brand attitudes in the Mac versus PC study where social desirability or other biases
were not likely to occur. In addition, IAT-based measures of brand relationship strength
revealed distinctive asymmetries between brands. Finally, we showed that the IAT was sensitive
to individual differences, and the magnitude of the IAT effects provides evidence of attitude
availability and strength. However, there are also conditions where respondents do not have
access to their true attitudes or choose to conceal them.
In Study 2, we showed that the IAT can capture automatic associations between target-
concepts and attribute dimensions. The IAT is useful in these circumstances where explicit
measures of brand constructs diverge from their implicit counterparts. In this second study, IAT-
based measures of Aad revealed an influence of ethnic prejudice on Aad that explicit measures
did not. These findings underscore the importance of the IAT for two main domains 1) the
implications and opportunities for future research aimed at better understanding the impact of
ethnic stereotypes on advertising and brand attitudes, and 2) the general usefulness of the IAT as
a measurement tool in marketing theory testing and practice.
Marketing research that investigates the role of unconscious processes in consumer
learning seems to be the number one candidate to benefit from the IAT in the near term.
Research on Aad formation, mere exposure effects, and classical conditioning (e.g., Janiszewski
1988) could use the IAT to determine if automatic/implicit associations between brands, ads, and
attribute dimensions behave as would be expected by these theories. Instead of relying on a lack
26
of recall or other conscious processes as evidence that preconscious activities are present, the
IAT allows researchers to tap directly into the implicit processes that are presumed to occur.
Other domains of consumer behavior are also affected by unconscious and automatic
processes. In general, the IAT can provide important measures for topics that are controversial or
stigmatized. Past research investigating the impact of stigmas associated with volunteerism
(Snyder, Omoto and Crain 1999) has shown that the public stigmatizes people who engage in
socially-beneficial activities such as volunteering to help someone with AIDS. The IAT can be
used in this context to reveal the associations that drive these perceptions, such as an association
between AIDS and homosexuals, drug users, and other stigmatized groups. Similarly, the IAT
can be used to investigate how negative events that involve spokespeople can impact attitudes
towards the spokespeople and the brands they represent (Louie, Kulik and Jacobson 2001). In
both cases, the IAT can be used to test whether implicit associations have been formed between
attitude objects and stigmatic attributes, and also further understand behaviors that derived from
these associations.
Our IAT results with respect to race biases can be linked to other research on race and
ethnicity in marketing. For example, research on consumer distinctiveness and ethnic self-
awareness (Forehand and Deshpande 2001; Grier and Deshpande 2001) examines the effect of
spokesperson ethnicity and other ethnic primes on brand attitudes and persuasion. IAT-based
measures of implicit ethnic stereotypes, Aad, and brand attitudes can allow researchers to test the
theories that are used to explain these effects, especially when these theories suggest the
presence of “unconscious ethnic processing and categorization” (Forehand and Deshpande 2001,
p. 338). Certainly it is not our intent to suggest that because IAT measures revealed that our
respondents were racially biased that marketers should avoid using minorities in their ads.
27
Rather, we see this as a two sided outlook where 1) more work is needed to better understand the
role of unconscious ethnic processing, and 2) the IAT can provide more evidence for policy and
decision makers that even when explicit measures can suggest that racial or other biases do not
exist, there can still be strong stereotypes being held by consumers, and that these deserve
special attention, educational efforts or other interventions. Outside of race, one could consider
the use of the IAT to better understand implicit attitudes towards risky behaviors like smoking or
drinking, the use or not of condoms etc, since it is often likely that political correctness and
social desirability tend to influence explicit answers on these issues. Similarly, the IAT can be
useful to better understand consumers’ reactions to companies’ social responsibility programs,
and help better predict when and how doing good will also do well for the company (Sen and
Bhattacharya 2001).
Results from Study 1 demonstrate the IAT’s usefulness for measuring the degree to
which brands are a part of a consumer’s self-concept. These findings demonstrate the IAT’s
potential for advancing research concerning both brand relationships (Fournier 1998) and brand
community (McAlexander, Schouten and Koenig 2002; Muniz and O'Guinn 2001) and consumer
identity. The IAT is also applicable to research on organizational identification (Bergami and
Bagozzi, 2000) and would allow for new understandings and measures of the overlap between
self-definition and organizational identity and new insights on its likely impact on other
marketing variables.
The IAT may provide unique and important information on other topics in brand
management as well. Consumers’ associative brand networks may include concepts and
associations that a consumer either cannot or will not report, but which may surface through the
IAT. Further, since a successful brand extension or brand alliance would share at least some of
28
the traits associated with the core brand (Simonin and Ruth 1998), the IAT may expand our
understanding of this transfer process.
Finally, we would like to suggest that the IAT be used not just as a dependent measure,
but also as an independent one or in conjunction with others. It seems that much insight can
come from using the IAT as an explanatory factor for behavior, choice or judgments. For
instance, while traditional explicit measures provides satisfactory subjective and normative
measures to understand the link between attitude and behavior, the IAT might increase the
predictability of behavior by adding an unconscious or implicit component to traditional models.
In general, any contexts where associations between attributes and concepts are presumed to
operate at an implicit level would provide a suitable and necessary setting for the use of the
Implicit Association Test. Our studies offer a demonstration of the IAT’s use in marketing and
its potential contribution in consumer research. It is our hope and opinion that future research
will undoubtedly uncover even greater applicability and value of this measurement tool.
29
TABLE 1
STUDY 1 CORRELATION BETWEEN KEY VARIABLES
Pearson Correlation
Implicit Attitudea
Implicit Brand-
Relationship
Explicit Brand
Attitude
Computer Ownership
Implicit Brand Relationship
.542** (n=63)
Explicit Brand Attitude (difference score)
.504** (n=54)
.307* (n=54)
Computer Ownership (difference score)
.468** (n=54)
.411** (n=54)
.581** (n=79)
Computer Usage (difference score)
.688** (n=50)
.543** (n=50)
.692** (n=72)
.689** (n=72)
* p<.05 ** p<.01
aHigh scores on the IAT and the explicit difference scores indicate preferences for Macintosh relative to PC-type computers.
30
TABLE 2
STUDY 2 CORRELATION BETWEEN KEY VARIABLES
Implicit Aad (positive-white)
Explicit Aad (white vs. black spokespeople)
Explicit attitude towards white vs. blacks (thermometer)
Explicit Aad (white vs. black spokespeople)
.054 n=93
Explicit attitude towards white vs. blacks (thermometer)
.108 n=93
.302** n=93
Explicit attitude towards white vs. blacks (scale)
.284** n=93
.279** n=93
.623** n=93
* p<.05
** p<.01 *** p<.001
31
FIGURE 1
SCHEMATIC DESCRIPTION OF THE ATTITUDE IMPLICIT ASSOCIATION TEST (IAT) Category labels Sample stimuli Category labels Step 1: Apple/Macintosh PC-type\IBM Practice block (32 trials) ● Apple ○ ○
●
Step 2: Pleasant Unpleasant Practice block (32 trials) ● lucky ○ ○ hatred ●
Step 3: Apple/Macintosh or
Pleasant
PC-type\IBM or
Unpleasant Practice block (32 trials) ● lucky ○ Critical block (40 trials) ○
●
○ hatred ● ●
○
Step 4: Unpleasant Pleasant Practice block (32 trials) ○ lucky ● ● hatred ○
Step 5: Apple/Macintosh or
Unpleasant
PC-type\IBM or
Pleasant Practice block (32 trials) ○ lucky ● Critical block (40 trials) ○
●
● hatred ○ ●
○
Categorization tasks for the five steps of the attitude IAT. The correct response for each sample stimulus indicated by the black dots. The IAT effect is calculated as the difference in average response latencies between Steps 3 and 5. (Adapted from Greenwald and Farnham 2000)
32
FIGURE 2 STUDY1: IMPLICIT ATTITUDE AND IMPLICIT BRAND RELATIONSHIP RESULTS
Implicit Attitude Effect by Explicit Attitude
500
600
700
800
Pro PC attitude Pro Mac attitude
Lat
ency
(ms)
IAT EffectM=61.7SD =127.6t = 2.78 p < .01
IAT EffectM=130.28SD = 182.7t = 2.94 p = .01
Implicit Attitude Effect by Computer Ownership
500
600
700
800
Own more PCs Own more Macs
Lat
ency
(ms)
IAT EffectM=54.78SD = 117.8t = 2.63 p < .05
IAT EffectM=141.6SD = 199.3t = 2.66 p < .05
Implicit Attitude Effect by Usage Frequency
500
600
700
800
PC-user Mac-user
Lat
ency
(ms)
IAT EffectM=158.8 SD = 179.1t = 3.66p < .01
IAT EffectM=69.46SD = 133.1t = 2.81p < .01
Implicit Brand-Relationship Effect by Explicit Attitude
500
600
700
800
Pro PC attitude Pro Mac attitude
Lat
ency
(ms)
IAT EffectM=16.2SD = 122.05t = .76N.S.
IAT EffectM=121.1SD = 170.6t = 2.93p = .01
Implicit Brand-Relationship Effect by Computer Ownership
500
600
700
800
Own more PCs Own more Macs
Lat
ency
(ms) IAT Effect
M=157.3SD = 189.6t = 3.10p < .01
IAT EffectM=9.2SD = 145.4t = .36N.S.
Implicit Brand-Relationship Effect by Usage Frequency
500
600
700
800
PC-user Mac-user
Lat
ency
(ms)
IAT EffectM=178.6 SD = 168.8t = 4.36p < .001
IAT EffectM=11.10SD = 120.6t = .15N.S.
Mac & Pleasant words Mac & Self words PC & Self words PC & Pleasant words
33
FIGURE 3 STUDY 2: EXPLICIT AND IMPLICIT ATTITUDE TOWARD THE AD MEASURES
Explicit Aad Measures
(1-7 scale)
Implicit Aad Measures
(in m.s.)
737.41
981.84
0
250
500
750
1000
White Pleasant/Black UnpleasantBlack Pleasant/White Unpleasant
IAT Effect
4.67 4.76
1
2
3
4
5
6
White Spokesperson Black Spokesperson
No Significant Difference
M= 244.43t92=11.25
P<.001
34
APPENDIX 1
EXAMPLES OF ADVERTISING STIMULI USED FOR STUDY TWO
All ads were executed for both brands. This appendix contains a representative set of the ad stimuli used in study two. In total there were 32 versions created.
35
36
REFERENCES Alba, Joseph W. and J. Wesley Hutchinson (2000), "Knowledge Calibration: What Consumers
Know and What They Think They Know," Journal of Consumer Research, 27(2), 123-156.
Anderson, James R. and Gordon H. Bower (1973), Human Associative Memory. Washington,
D.C.: V.H. Winston. Banaji, Mahzarin R. and Curtis D. Hardin (1996), "Automatic Stereotyping," Psychological
Science, 7(May), 136-141. Bargh, John A. (1989), "Conditional Automaticity: Varieties of Automatic Influence in Social
Perception and Cognition," in Unintended Thought, J. S. Uleman and J. S. Bargh, eds. New York, NY: Guilford Press: 3-51.
---- (1994), "The Four Horsemen of Automaticity: Awareness, Intention, Efficiency and Control
in Social Cognition," in Handbook of Social Cognition, R. S. Wyer, Jr. and T. K. Srull, eds. Hillside, NJ: Erlbaum. 1: 1-40.
-----, Shelly Chaiken, Rajen Govender and Felicia Pratto (1992), "The Generality of the
Automatic Attitude Activation Effect," Journal of Personality and Social Psychology, 62(June), 893-912.
-----, and Tanya L. Chartrand (1999), "The Unbearable Automaticity of Being," American
Psychologist, 54(July), 462-479. Battig, W.F. and W.E. Montague (1969), "Category Norms for Verbal Items in 56 Categories: A
Replication and Extension of the Connecticut Category Norms," Journal of Experimental Psychology Monographs, 80(3, Pt. 2), 1-46.
Belk, Russell W. (1988), "Possessions and the Extended Self," Journal of Consumer Research,
15(September), 139-168. Bellezza, F.S., Anthony G. Greenwald and M. R. Banaji (1986), "Words High and Low in
Pleasantness as Rated by Male and Female College Students," Behavior Research Methods, Instruments, & Computers, 18, 299-303.
Bergami, Massimo and Richard Bagozzi (2000), “Self-Categorization, Affective Commitment
and Group Self-Esteem as Distinct Aspects of Social Identity in the Organization,” British Journal of Social Psychology, 39, 555-577.
Bosson, J. K., W. B. Swann and J. W. Pennebaker (2000), "Stalking the Perfect Measure of Self-
Esteem: The Blind Men and the Elephant Revisited?," Journal of Personality and Social Psychology, 79, 631-643.
Bower, Gordon H. (1981), "Mood and Memory," American Psychologist(February), 129-148.
37
Brendl, C. M., A. B. Markman and C. Messner (2001), "How Do Indirect Measures of
Evaluation Work? Evaluating the Inference of Prejudice in the Implicit Association Test," Journal of Personality and Social Psychology, 81(5), 760-772.
Brown, Steven P. and Douglas M. Stayman (1992), "Antecedents and Consequences of Attitude
toward the Ad: A Meta-Analysis," Journal of Consumer Research, 19(1), 34-51. Caballero, Marjorie J., James R. Lumpkin and Charles S. Madden (1989), "Using Physical
Attractiveness as an Advertising Tool: An Empirical Test of the Attraction Phenomenon," Journal of Advertising Research, 29(4), 16-22.
Campbell, Donald T. (1950), "The Indirect Assessment of Social Attitudes," Psychological
Bulletin, 47, 15-38. Chaiken, Shelly and John A. Bargh (1993), "Occurrence Versus Moderation of the Automatic
Attitude Activation Effect: Reply to Fazio," Journal of Personality and Social Psychology, 64(May), 759-765.
Churchill, Gilbert A. (1995), Marketing Research: Methodological Foundations. Fort Worth,
TX: Dryden Press. Collins, A.M. and E.F. Loftus (1975), "A Spreading-Activation Theory of Semantic Processing,"
Psychological Review, 82, 407-428. Cunningham, William A., Kristopher J. Preacher and Mahzarin R. Banaji (2001), "Implicit
Attitude Measures: Consistency, Stability, and Convergent Validity," Psychological Science, 12(2), 163-170.
Dasgupta, Nilanjana and Anthony G. Greenwald (2000), "Exposure to Admired Group Members
Reduces Automatic Intergroup Bias," Journal of Experimental Social Psychology, 36(3), May (2000). 316-328.
----- and Debbie E. McGhee (2000), "Automatic preference for White Americans: Eliminating
the Familiarity Explanation," Journal of Experimental Social Psychology, 36(3), 316-330. Debevec, Kathleen and Easwar Iyer (1988), "Self-Referencing as a Mediator of the Effectiveness
of Sex-Role Portrayals in Advertising," Psychology & Marketing, 5(1), 71-84. Demo, David (1985), "The Measurement of Self-Esteem: Refining Our Methods," Journal of
Personality and Social Psychology, 48(June), 1490-1502. Deshpande, Rohit and Douglas M. Stayman (1994), "A Tale of Two Cities: Distinctiveness
Theory and Advertising Effectiveness," Journal of Marketing Research, 31(1), 57-64.
38
Devine, Patricia G. (1989), "Stereotypes and Prejudice: Their Automatic and Controlled Components," Journal of Personality and Social Psychology, 56(January), 5-18.
Dovidio, John F. and Russell H. Fazio (1992), "New Technologies for the Direct and Indirect
Assessment of Attitudes," in Questions About Questions: Inquiries into the Cognitive Bases of Surveys, J. M. Tanur, ed. New York: Sage: 204-237.
Fazio, Russell H. (1986), "How Do Attitudes Guide Behavior?," in Handbook of Motivation and
Cognition, R. M. Sorrentino and E. T. Higgins, eds. New York: Guilford Press. 1: 204-243.
---- (1990), "A Practical Guide to the Use of Response Latency in Social Psychological
Research," in Research Methods in Personality and Social Psychology, C. Hendrick and M. S. Clark, eds. Newbury Park, CA: Sage. 11: 74-97.
---- (1995), "Attitudes as Object-Evaluation Associations: Determinants, Consequences, and
Correlates of Attitude Accessibility," in Attitude Strength: Antecedents and Consequences, R. E. Petty and J. A. Krosnick, eds. Hillsdale, NJ: Erlbaum: 247-282.
-----, J. Chen, E.C. McDonel and S.J. Sherman (1982), "Attitude Accessibility, Attitude-
Behavior Consistency, and the Strength of the Object-Evaluation Association," Journal of Experimental Social Psychology, 18, 339-357.
-----, D.M. Sanbonmatsu, M.C. Powell and F.R. Kardes (1986), "On the Automatic Activation of
Attitudes," Journal of Personality and Social Psychology, 50(February), 229-238. Forehand, Mark R. and Rohit Deshpande (2001), "What We See Makes Us Who We Are:
Priming Ethnic Self-Awareness and Advertising Response," Journal of Marketing Research, 38(3), 336-348.
----- and Andrew Perkins (2002), "Unconscious Processing of Spokesperson Information: The
Influence of Implicit Cognition," Working Paper, University of Washington. Fournier, Susan (1998), "Consumers and Their Brands: Developing Relationship Theory in
Consumer Research," Journal of Consumer Research, 24(March), 343-373. Gaertner, Samuel L. and John F. Dovidio (1986), "The Aversive Form of Racism," in Prejudice,
Discrimination, and Racism, J. F. Dovidio and S. L. Gaertner, eds. Orlando, FL: Academic Press: 61-89.
Greenwald, Anthony G. and Mahzarin R. Banaji (1995), "Implicit Social Cognition: Attitudes,
Self-Esteem, and Stereotypes," Psychological Review, 102(1), 4-27. -----, -----, Laurie A. Rudman, Shelly D. Farnham, Brian A. Nosek and Deborah S. Mellott
(2002), "A Unified Theory of Implicit Attitudes, Stereotypes, Self-Esteem, and Self-Concept," Psychological Review, 109(1), 3-25.
39
----- and Shelly D. Farnham (2000), "Using the Implicit Association Test to Measure Self-
Esteem and Self-Concept," Journal of Personality and Social Psychology, 79(6), 1022-1038.
-----, Mark R. Klinger and T J. Liu (1989), "Unconscious Processing of Dichoptically Masked
Words," Memory and Cognition, 17(January), 35-47. -----, Debbie E. McGhee and Jordan L. K. Schwartz (1998), "Measuring Individual Differences
in Implicit Cognition: The Implicit Association Test," Journal of Personality and Social Psychology, 74(June), 1464-1480.
----- and Brian A. Nosek (2001), "Health of the Implicit Association Test at Age 3," Zeitschrift
fur Experimentelle Psychologie, 48(2), 85-93. Grier, Sonya A. and Rohit Deshpande (2001), "Social Dimensions of Consumer Distinctiveness:
The Influence of Social Status on Group Identity and Advertising Persuasion," Journal of Marketing Research, 38(2), 216-224.
Haire, Mason (1950), "Projective Techniques in Marketing Research," Journal of Marketing,
14(April), 649-656. Hamilton, David P. (1999), "Apple Computer Releases New Operating System for Web
Servers," The Wall Street Journal(March 17), B8. Haugvedt, Curtis P., Richard E. Petty and John T. Cacioppo (1992), "Need for Cognition and
Advertising: Understanding the Role of Personality Variables in Consumer Behavior," Journal of Consumer Psychology, 1(3), 239-260.
Hawkins, Del I. and Kenneth A. Coney (1981), "Uninformed Response Error in Survey
Research," Journal of Marketing Research, 18(August), 370-374. Heath, Timothy B., Michael S. McCarthy and David L. Mothersbaugh (1994), "Spokesperson
Fame and Vividness Effects in the Context of Issue-Relevant Thinking: The Moderating Role of Competitive Setting," Journal of Consumer Research, 20(4), 520-534.
Jacoby, Larry L., D. Stephen Lindsay and Jeffrey P. Toth (1992), "Unconscious Influences
Revealed," American Psychologist, 47(June), 802-809. Janiszewski, Chris (1988), "Preconscious Processing Effects: The Independence of Attitude
Formation and Conscious Thought," Journal of Consumer Research, 15(September), 199-209.
----- (1990), "The Influence of Print Advertisement Organization on Affect toward a Brand
Name," Journal of Consumer Research, 17(June), 53-65.
40
----- (1993), "Preattentive Mere Exposure Effects," Journal of Consumer Research, 20(December), 376-392.
Kamins, Michael A. (1989), "Celebrity and Noncelebrity Advertising in a Two-Sided Context,"
Journal of Advertising Research, 29(3), 34-42. ----- (1990), "An Investigation into the 'Match-up' Hypothesis in Celebrity Advertising: When
Beauty May Be Only Skin Deep," Journal of Advertising, 19(1), 4-13. ----- and Kamal Gupta (1994), "Congruence between Spokesperson and Product Type: A
Matchup Hypothesis Perspective," Psychology & Marketing, 11(6), 569-586. Kleine, Susan Schultz, Robert E. Kleine, III and Chris T. Allen (1995), "How Is a Possession
'Me' or 'Not Me'? Characterizing Types and an Antecedent of Material Possession Attachment," Journal of Consumer Research, 22(December), 327-343.
Kuehnen, U., M. Schiessl, N. Bauer, N. Paulig, C. Poehlmann and K. Schmidthals (2001), "How
Robust Is the IAT? Measuring and Manipulating Implicit Attitudes of East- and West-Germans," Zeitschrift fur Experimentelle Psychologie, 48(2), 135-144.
Lemon, Nigel (1973), Attitudes and Their Measurement. New York: John Wiley & Sons. Louie, Therese A., Robert L. Kulik and Robert Jacobson (2001), "When Bad Things Happen to
Endorsers of Good Products," Marketing Letters, 12(February), 13-23. Lynch, James and Drue Schuler (1994), "The Matchup Effect of Spokesperson and Product
Congruency: A Schema Theory Interpretation," Psychology & Marketing, 11(5), 417-445.
MacKenzie, Scott B. and Richard J. Lutz (1996), "An Empirical Examination of the Structural
Antecedents of Attitude toward the Ad in Advertising Pretesting Context," Journal of Marketing, 53(2), 48-65.
-----, ----- and George E. Belch (1986), "The Role of Attitude toward the Ad as a Mediator of
Advertising Effectiveness: A Test of Competing Explanations," Journal of Marketing Research, 23(2), 130-143.
Maison, Dominika, Anthony G. Greenwald and Ralph Bruin (2001), "The Implicit Association
Test as a Measure of Implicit Consumer Attitudes," Polish Psychological Bulletin, 32(1), 1-9.
McAlexander, James H., John W. Schouten and Harold F. Koenig (2002), "Building Brand
Community," Journal of Marketing, 66(1), 38-54.
41
Mellott, D.S. and Anthony G. Greenwald (2000). Measuring Implicit Ageism: Do the Implicit Association Test and Semantic Priming Measure the Same Contruct? Midwestern Psychological Association, Chicago, IL.
Meyer, David E. and Roger W. Schvaneveldt (1971), "Facilitation in Recognizing Pairs of
Words: Evidence of Dependence between Retrieval Operations," Journal of Experimental Psychology, 90(October), 227-234.
Misra, Shekhar and Sharon E. Beatty (1990), "Celebrity Spokesperson and Brand Congruence:
An Assessment of Recall and Affect," Journal of Business Research, 21(2), 159-173. Mitchell, Andrew A. (1986), "The Effect of Verbal and Visual Components of Advertisements
on Brand Attitudes and Attitude toward the Advertisement," Journal of Consumer Research, 13(1), 12-24.
----- and Jerry C. Olson (1981), "Are Product Attribute Beliefs the Only Mediator of Advertising
Effects on Brand Attitude?," Journal of Marketing Research, 18(3), 318-332. Muniz, Albert M. Jr. and Thomas C. O'Guinn (2001), "Brand Community," Journal of Consumer
Research, 27(4), 412-432. Netemeyer, Richard G. and William O. Bearden, eds. (1998). Handbook of Marketing Scales.
Thousand Oaks, Sage Publications. Nosek, B., M. R. Banaji and Anthony G. Greenwald (2000). Math = Male, Me = Female,
Therefore Math Doesn't Equal Me. Working Paper, Yale University. Peter, J. Paul (1979), "Reliability: A Review of Psychometric Basics and Recent Marketing
Practices," Journal of Marketing Research, 16(February), 6-17. Phelps, Elizabeth A. , Kevine J. O'Connor, William A. Cunningham, E. Sumie Funayama,
J.Christopher Gatenby, John C. Gore and Mahzarin R. Banaji (2000), "Amygala Activation Predicts Performance on Indirect Measures of Racial Bias," Journal of Cognitive Neuroscience, 12(5), 729-738.
Rothermund, K. and D. Wentura (2001), "Figure-Ground Asymmetries in the Implicit
Association Test," Zeitschrift fur Experimentelle Psychologie, 48(2), 94-106. Rudman, Laurie A. and P. Glick (2001), "Prescriptive Gender Stereotypes and Backlash against
Agentic Women," Journal of Social Issues, 57(4), 743-762. ----- and S.E. Kilianski (2000), "Implicit and Explicit Attitudes Towards Female Authority,"
Personality and Social Psychology Bulletin, 26(11), 1315-1328. Seger, Carol Augart (1994), "Implicit Learning," Psychological Bulletin, 115(March), 163-196.
42
Sen, Sankar and C.B. Bhattacharya (2001), "Does Doing Good Always Lead to Doing Better? Consumer Reactions to Corporate Social Responsibility," Journal of Marketing Research, 38(2), 225-243.
Shapiro, Stewart (1999), "When an Ad's Influence Is Beyond Our Conscious Control: Perceptual
and Conceptual Fluency Effects Caused by Incidental Ad Exposure," Journal of Consumer Research, 26(June), 16-36.
----- and Deborah J. MacInnis (1992), "Mapping the Relationship between Preattentive
Processing and Attitude," in Advances in Consumer Research, J. F. Sherry, Jr. and B. Sternthal, eds. Chicago: Association for Consumer Research. 19: 505-513.
-----, ----- and Susan E. Heckler (1997), "The Effects of Incidental Ad Exposure on the
Formation of Consideration Sets," Journal of Consumer Research, 24(1), 94-104. Simonin, Bernard L. and Julie A. Ruth (1998), "Is a Company Known by the Company It Keeps?
Accessing the Spillover Effects of Brand Alliances on Consumer Brand Attitudes," Journal of Marketing Research, 35(February), 30-42.
Sirgy, M. Joseph (1982), "Self-Concept in Consumer Behavior: A Critical Review," Journal of
Consumer Research, 9(December), 287-300. Snyder, Mark, Allen M. Omoto and A. Lauren Crain (1999), "Punished for Their Good Deeds:
Stigmatization of Aids Volunteers," American Behavioral Scientist, 42(7), 1175-1192. Tulving, Endel and Daniel L. Schacter (1990), "Priming and Human Memory Systems," Science,
247(January), 301-306. Underwood, Geoffrey D.M. and James E.H. Bright (1996), "Cognition with and without
Awareness," in Implicit Cognition, G. D. M. Underwood, ed. New York, NY: Oxford University Press: 1-40.
Wong, Nicole C. (2001). Apple's Time to Grow; Computer Maker Expanding in Downturn. The
Washington Post. Washington, D.C.: E01.