Transcript
Page 1: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

Implicit Measures of Marketing Constructs With the Implicit Association Test

Boston University

School of Management Working Paper #2002-14

Frédéric F. Brunel School of Management, Boston University

595 Commonwealth Avenue Boston, MA 02215

(617) 353-4069 (office) (617) 353-4098 (fax)

[email protected]

Brian C. Tietje College of Business, Cal Poly State University

San Luis Obispo, CA 93407 (805) 756-1757 (office)

(805) 756-5057 (fax) [email protected]

Cathleen M. Collins

School of Management, Boston University 595 Commonwealth Avenue

Boston, MA 02215 (617) 353-7057 (office)

(617) 353-4098 (fax) [email protected]

Anthony G. Greenwald

Department of Psychology, University of Washington Box 351525

Seattle WA 98195-1525 (206) 543-7227 (office)

(206) 685-3157 (fax) [email protected]

Page 2: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

Implicit Measures of Marketing Constructs With the Implicit Association Test

Abstract

This paper discusses the need for implicit measurements in marketing research, the

shortcomings of current measures, and uses the Implicit Association Test (IAT) in a marketing

context, specifically in the measurement of brand attitudes, brand relationships, and attitude

toward the ad (Aad). First, Study 1 validates the IAT in a general marketing context and

demonstrates significant correlations between explicit measures of brand attitudes, ownership,

usage behavior, and IAT-based measures of implicit brand attitudes and brand relationship

strength. In Study 2, IAT measures of implicit attitudes towards sportswear advertisements

(implicit Aad) portraying African-American (black) and European-American (white) athlete-

spokespersons revealed a more positive attitude towards ads with white spokespeople versus ads

with black spokespeople, but explicit measures of Aad did not, confirming that when social

desirability might be at play, implicit and explicit measures do not correlate. Together, these

studies demonstrate that the IAT enhances understanding of consumer responses to marketing

stimuli, particularly when consumers are either unable or unwilling to identify the sources of

influence on their behaviors. Implications of this research are both theoretical and practical.

Page 3: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

A substantial portion of consumer behavior is shaped by cognitive processes that are

outside the range of conscious awareness (Alba and Hutchinson 2000; Bargh and Chartrand

1999; Seger 1994; Underwood and Bright 1996). Although significant theoretical advances have

been made in the investigation of unconscious processes, methodological and validity limitations

have constrained this progress. For instance, explicit self-report measures may not be accurate

indicators since people may be unable or unwilling to share their attitudes with a researcher

(Dovidio and Fazio 1992; Gaertner and Dovidio 1986; Haire 1950). Also, because implicit

attitudes often differ from explicit attitudes, explicit measures are typically unsuitable. Moreover,

implicit or indirect measures (e.g., projective measures, semantic priming) pose other obstacles

including interpretation difficulty, possible researcher bias, and problems identifying individual

differences. Since “valid measurement is the sine qua non of science” (Peter 1979, p. 6), a lack

of satisfactory measurement tools that can directly assess unconscious cognition leads marketing

and consumer researchers to rely on more valid explicit measures for empirical testing. For

example, research concerning incidental ad exposure (Janiszewski 1988; Janiszewski 1990;

Janiszewski 1993; Shapiro 1999; Shapiro and MacInnis 1992; Shapiro, MacInnis and Heckler

1997) presumes that preferences are “formed independently of conscious processing”

(Janiszewski 1988, p. 200), but at the same time must rely on self-report measures of attitude

toward the ad (Aad), recognition, and familiarity. As a result, one would expect that the

availability of valid and implicit measures of these variables would provide new insights for

research in this area, and would allow the testing of new hypotheses.

By definition, implicit attitudes have an influence on behavior that is unknown to the

actor (Greenwald and Banaji 1995). Direct measures that rely on self-report are unable to capture

implicit processes, and therefore indirect measures have become “theoretically essential”

Page 4: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

2

(Greenwald and Banaji 1995, p. 5). To that end, the Implicit Association Test (or IAT,

Greenwald, McGhee and Schwartz 1998) provides a metric for investigating the influential role

of unconscious processes in social behaviors such as marketing and consumer behaviors. The

IAT has proven to be an effective tool to explore implicit constructs in general social psychology

settings (Greenwald et al. 2002) and, recently with respect to food preferences (Maison,

Greenwald and Bruin 2001). This paper further extends the application of the IAT in a marketing

context, specifically in the measurement of implicit brand attitudes, brand relationships, and Aad.

In the first section, we discuss the limitation and shortcomings of current measures. We then

describe the IAT, discuss its validity as a measurement tool, and explain how it can be

operationalized to measure marketing constructs. In the third section, we present a validation

study to compare IAT-based measures of implicit brand attitudes and brand relationship strength

with explicit measures of brand attitude and brand ownership behaviors in a context where the

implicit and explicit constructs would presumably converge (namely consumers’ attitudes

towards Apple or Windows-based computers). In the fourth section, we report an experiment that

obtains a divergence between an IAT-based measure of implicit attitude toward the ad (Implicit

Aad), and explicit measures of Aad in a situation where biases in self-report measures might be

anticipated; namely, when participants were asked to evaluate sportswear advertisements

portraying African-American and European-American athlete-spokespersons. Finally, we

provide a discussion of these results and the methodology with both theoretical and practical

implications.

Page 5: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

3

SHORTCOMINGS OF EXISTING MEASURES

Most explicit measures of attitude (e.g., Likert or semantic differential scales) reference a

target object in the subject’s personal history (Jacoby, Lindsay and Toth 1992). Thus, explicit

measures must necessarily assume that the subject has (1) formed an attitude, (2) is aware of

(i.e., has access to) his or her attitude and (3) is willing to accurately share it with the researcher.

For many reasons, it may be a tenuous assumption that all three conditions can be met in a given

situation (Jacoby, Lindsay and Toth 1992).

An individual who has never heard of a topic is unlikely or unable to have formed a prior

attitude. However, to avoid appearing ignorant, many people will still answer the question

(Hawkins and Coney 1981). In other cases, previously formed attitudes may not be easily

accessible to the individual (Fazio 1986; Fazio et al. 1986). Thus, although they have an opinion,

they report a newly created one. In addition, even if subjects can identify the prior experience,

they may be unaware of its influence on attitude and, hence provide inaccurate reports

(Greenwald and Banaji 1995). Finally, while subjects may have access to their attitudes they still

may distort their answers for social-desirability or image management reasons. Distortions are

especially likely when an accurate response is seen as either violating social norms such as

politeness or prejudice (Demo 1985; Dovidio and Fazio 1992), would jeopardize a subject’s self-

image (Dovidio and Fazio 1992; Gaertner and Dovidio 1986; Sirgy 1982) or would go against

the cliché, stereotypical answer (Haire 1950).

Overall, it could be argued that no explicit measures of attitude truly guarantee that

responses are free of response bias. In addition, because these measures are subject to both

conscious and unconscious distortions, it should come as no surprise that explicit and implicit

Page 6: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

4

measures do not always converge (Banaji and Hardin 1996; Devine 1989; Greenwald, McGhee

and Schwartz 1998).

Implicit or indirect attitude measures were developed to measure implicit attitudes that

would not necessarily be detected by explicit measures (Greenwald and Banaji 1995). These

measures make no reference to objects in a subject’s personal history. Instead, they focus a

subject’s attention on performing some task that can indirectly reveal the underlying attitude

such that inaccessible and closely held attitudes can be measured. Generally, implicit measures

can be categorized as either disguised-unstructured or disguised-structured (Campbell 1950).

They are disguised because subjects are aware they are participating in a study and yet unaware

of what is truly assessed. Response alternatives can range from open and unstructured to a few

structured alternatives (Lemon 1973).

Unstructured Implicit Measures

Projective measures are unstructured measures that ask subjects to react to a deliberately

ambiguous stimulus. In the process of completing the task, subjects project parts of themselves

(in the form of attitudes, prejudices, fears, etc.) that can then be interpreted. For example, Haire’s

shopping study (1950) was one of the first widely reported projective measures in marketing.

Haire asked females to describe “the woman” who had developed a shopping list that included

either Nescafe instant or Maxwell House drip coffee (otherwise, the lists were identical). Nearly

half of the subjects described the Nescafe purchaser as “lazy” and a “poor planner”- attitudes

they were loathe to admit directly (Haire 1950).

Sentence or word completion and word association tests are also used frequently. They

are more structured than projective techniques because the stimulus is less ambiguous and the

response options more focused. In a word association task, subjects respond to words with the

Page 7: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

5

first word that comes to mind. In completion tasks, subjects are provided with the first few words

or letters and, as suggested by the name, they complete the sentence or word. In these measures,

only a few responses are analyzed, since target measures are hidden amongst a much larger set.

Further, it is burdensome to create sentence/word completion or word association measures that

gather the information of interest while truly disguising the study purpose.

In sum, even if an unstructured measure has face validity, the analysis process can create

errors in the conclusion. These errors stem from the typical difficulties in coding and

interpretation of qualitative data (Churchill 1995). Thus, although unstructured measures can be

valuable, their use should be discouraged in causal designs where specific and precise

measurements are needed.

Structured Implicit Measures

By limiting response options, structured measures gain a degree of objectivity and avoid

most interpretation problems. With these measures, a subject’s attention is focused on the

completion of a task with defined or undefined success criteria. For example, grouping pictures,

words or objects based on subjects’ evaluation of the stimuli is a structured task with no right

answer. Although grouping pictures has demonstrated convergent validity with explicit

measures, concealing the research goals is difficult (Lemon 1973).

An information test is another type of structured implicit measure. It determines a

subject’s knowledge of a topic and has clearly defined success criteria – the answers are either

correct or not. Since a subject’s attitude toward a topic should systematically guide the selection

and retention of knowledge, this test provides an implicit measure of that attitude (Campbell

1950; Churchill 1995). Information tests are robust to social desirability if the purpose is

sufficiently disguised (Lemon 1973) but may be confounded by need for cognition (Haugvedt,

Page 8: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

6

Petty and Cacioppo 1992). Other measures with defined success criteria and robustness to social

desirability ask subjects to estimate a group’s opinion or identify the social norms of an event.

However, they do not provide any information about the automaticity of attitude activation

(Dovidio and Fazio 1992). This is key because: the stronger the associative network around an

attitude object, the more automatically the attitude will be activated, even if the attitude is weak

(Bargh 1989) or not consciously held (Fazio 1986; Fazio et al. 1986).

Priming, at either a subliminal or conscious level, can implicitly assess both attitude and

strength of the automatic activation effect (Dovidio and Fazio 1992; Fazio et al. 1986;

Greenwald, Klinger and Liu 1989). A priming effect exists if a subject’s ability to process a

stimulus is enhanced by the previous presentation of a related or associated stimulus. “What

matters more than whether one is aware of a stimulus event is whether one is aware of the

potential influence of that event on subsequent experience and judgments” (Bargh 1994, p. 15).

Thus, as long as the relationship between the prime and the target is concealed, the indirect

effects of the primed stimuli can be detected. Semantic priming (where subjects classify the

meaning of target words) measures response latency to assess attitude automatic activation.

Although subjects are instructed to ignore the prime word preceding a target word, when prime

and target are semantically similar, categorization judgments of the target words are faster

(Meyer and Schvaneveldt 1971). Overall, priming is very flexible as it can use verbal or non-

verbal (e.g., pictures, shapes, faces) stimuli (Tulving and Schacter 1990), and is robust to social

desirability, self-image and accessibility problems. However, while response latency data

“provide reliable and valid indications of associative strength in memory” (Fazio 1990, p. 95),

there has been evidence that priming measures may not be sensitive enough to highlight

individual differences (Bargh et al. 1992; Chaiken and Bargh 1993).

Page 9: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

7

Summary

Several problems of existing measures have been identified. First, explicit measures can

only identify attitudes that a subject is able and willing to share. Second, projective, completion

and association measures are subject to interpretation errors and could be identified by subjects,

thereby becoming de facto explicit measures. Third, information tests may be confounded by

need for cognition and neither these nor opinion estimation/norm identification can determine the

level of automatic activation. Fourth, even though priming solves the weaknesses of explicit

measures and can gauge the activation level of automatic attitudes, it may not be sensitive

enough in all cases. Overall, this discussion of existing measures of attitude has highlighted that

a desirable measure should be sensitive to individual differences and robust to image

management and attitude accessibility issues.

THE IMPLICIT ASSOCIATION TEST

The IAT measures the strength of association between a target-concept and an attribute

dimension. For example, the first demonstration of the IAT (Greenwald, McGhee and Schwartz

1998) compared the relative strength of the association between flowers versus insects (the

target-concepts) and positive versus negative valence (i.e., valence attribute concepts, Greenwald

et al. 2002). In their explication of a Unified Theory of Implicit Social Cognition, Greenwald et

al. (2002) define an attitude as “the association of a social object or social group concept with a

valence attribute concept” (p. 5). Persons holding a more favorable attitude towards flowers than

insects possess stronger “flower”-“positive” associations than “insect”-“positive” linkages. The

IAT’s usefulness for measuring self-concept has also been demonstrated (Greenwald and

Page 10: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

8

Farnham 2000). Females, for example, possess stronger IAT-measured associations between

“me”-“feminine” than “me”-“masculine”.

The IAT measures the strength of associations between target-concepts and attribute

dimensions by comparing the relative ease of categorizing target-concepts that are paired with

one attribute dimension versus another. Assume, for the purposes of illustration, that you were an

enthusiastic New York Yankees fan who had a general distaste for the New York Mets. You are

presented with a series of words and/or pictures that portray each of the following: the Yankees,

the Mets, pleasant concepts (e.g., the word “happy” or a picture of a smiley face) and unpleasant

concepts. As you are presented with these stimuli, you are instructed to verbally assign them to

one of two mixed categories – either “Yankees-good” or “Mets-bad”. For example, if you were

presented with a photo of Derek Jeter (a shortstop for the Yankees), you would assign that item

to the category “Yankees-good”. After completing several of these categorization decisions, you

are then presented with the same stimuli, only this time you are instructed to verbally assign

them to either “Yankees-bad” or “Mets-good”. As an avid Yankees fan, you would complete the

first half of the exercise faster than the second, because it would be easier for you to associate the

concept “Yankees” with “good” than with “bad”.

In the IAT, word, picture, and/or sound stimuli are presented via a computer that

represent target-concepts and attribute-dimensions, and participants are instructed to assign these

stimuli to one of two mixed categories by hitting one of two response keys on the computer

keyboard. During the first half of the exercise in the example above, the participant would hit the

“a” key (i.e., the left key) if the stimulus belonged to the category “Yankees-good” and the “k”

key (i.e., the right key) if the stimulus belonged to the category “Mets-bad”. The pairings are

reversed during the second half of the exercise (i.e., the second mixed-task), and participants are

Page 11: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

9

instructed to hit the left key if the stimulus belongs to the category “Yankees-bad” and the right

key if the stimulus belongs to the category “Mets-good”. The IAT effect measures the difference

in average response latencies between the first and second mixed-tasks. When targets and

attributes are easily associated (compatible), mean response latency is shorter (i.e., processing

will be faster) than if the target-concepts and attributes are not strongly associated.

VALIDITY OF THE IMPLICIT ASSOCIATION TEST

In psychology, considerable support for the validity of the Implicit Association Test has

emerged, as detailed in the original paper describing the IAT (Greenwald et al. 1998) and several

reviews of the IAT (Cunningham, Preacher and Banaji 2001; Greenwald and Farnham 2000;

Greenwald and Nosek 2001). In this section, several criteria for evaluating marketing measures

(Netemeyer and Bearden 1998) are applied to the IAT.

Theoretical Foundation

The IAT design is based on the premise that attitudes, stereotypes, self-concept, and self-

esteem can be defined as associations between concepts (Greenwald et al. 2002). This theoretical

approach is consistent with the associative network of memory model (Anderson and Bower

1973; Collins and Loftus 1975) in which emotion functions as a “memory unit” (Bower 1981),

and which operationalizes an attitude as the association between an attitude-object and a valence

concept (Fazio 1995; Fazio et al. 1982). Furthermore, the idea that attitudes, self-esteem, and

stereotypes can be manifest implicitly has been established in the literature (Greenwald and

Banaji 1995), and is the impetus for the development of other implicit measures such as Fazio’s

sequential priming paradigm (Fazio et al. 1986).

Page 12: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

10

Content Validity

The content validity of the IAT can be assessed by the appropriateness of the stimuli that

are used to represent each of the target-concepts and attribute dimensions. The primary

consideration for stimuli selection is that they be reasonably familiar (although the IAT effect

appears robust across relatively wide variations in item familiarity, c.f.Greenwald and Nosek

2001) and easily classified into one of two categories (e.g., pleasant vs. unpleasant, Nike vs.

Reebok). The stimuli that are used to represent the various concepts and attributes in the IAT are

either drawn from established category lists that are available in the literature (e.g., Battig and

Montague 1969; Bellezza, Greenwald and Banaji 1986) or are pre-tested for familiarity and

ability to be categorized.

Reliability

The IAT demonstrates test-retest reliabilities averaging r = .6 across numerous studies

(Bosson, Swann and Pennebaker 2000; Dasgupta and Greenwald 2000; Greenwald and Farnham

2000; Greenwald and Nosek 2001). The IAT also demonstrates resistance to several types of

procedural artifacts (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek 2001). The

IAT effect is robust across procedural variations, including which hand is assigned to the

pleasant category, variability in the number of items used to represent categories, the familiarity

of the items used to represent categories (except for items with extremely low levels of

familiarity; Brendl, Markman and Messner 2001; Greenwald and Nosek 2001; Rothermund and

Wentura 2001), and variability in the response-stimulus interval. Performance in the

categorization task that occurs in the first mixed task does tend to be faster versus the second

mixed task, but this order effect has subsequently been addressed by counterbalancing the order

of these two tasks (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek 2001). IAT

Page 13: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

11

effects are also robust to differences in how incorrect responses and non-normal response latency

distributions are treated (Greenwald and Nosek 2001).

Construct Validity

Convergent Validity: IAT measures converge with semantic priming measures of

association strength (Cunningham, Preacher and Banaji 2001; Mellott and Greenwald 2000;

Rudman and Kilianski 2000). The IAT has also been shown to correlate with physiological

measures of implicit social cognition. IAT measures of implicit prejudice correlate with fMRI-

assessed activation of the amygdala (a subcortical structure associated with emotional learning

and evaluation) in White subjects exposed to unfamiliar Black faces (Phelps et al. 2000).

Discriminant Validity: Confirmatory factor analysis shows divergent validity of implicit

and explicit self-esteem and gender self-concept (Greenwald and Farnham 2000). Prejudice

against female job applicants has been associated with IAT-assessed gender stereotypes, but not

explicit measures of gender stereotypes (Rudman and Glick 2001), illustrating that the IAT

measures implicit constructs that may diverge from their explicit counterparts.

Nomological Validity: Greenwald and Farnham (2000) review several studies

demonstrating that “IAT measures can be influenced in theoretically expected fashion by

procedures that might be expected to influence automatic attitudes or stereotypes” (p. 1023). For

example, viewing photos of admirable members of stigmatized groups and despised members of

nonstigmatized groups reduced implicit negative attitudes towards the stigmatized groups

(Dasgupta and Greenwald 2000).

Known Group Validity: Not only can the IAT detect valence differences that are

considered universal in the population (e.g., preferences for flowers over insects, Greenwald,

McGhee and Schwartz 1998), but also differences that are expected to vary between subject

Page 14: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

12

populations. The IAT reveals differences between Japanese and Korean American preferences

for their own ethnicities (Greenwald, McGhee and Schwartz 1998), differences between East and

West Germans in their implicit attitudes toward their geographical regions (Kuehnen et al. 2001),

differences between men and women in their implicit gender self-concepts (Greenwald and

Farnham 2000), and differences between men and women in their implicit attitudes and implicit

self-concepts relating to mathematics and the arts (Nosek, Banaji and Greenwald 2000).

USING THE IAT IN MARKETING

Besides applications in a broad-spectrum of psychology settings, the IAT has also been

used to show that IAT-based measures of attitudes towards food categories including juices

versus sodas and low versus high calorie foods correlate with explicit measures of attitudes and

behaviors towards these categories (Maison, Greenwald and Bruin 2001). In this article, we use

the IAT to measure marketing-related constructs, including brand attitudes, brand relationships,

and Aad. As previously discussed, attitudes can be represented as the association between an

attitude object and a valence attribute concept (Greenwald et al. 2002). A person’s attitude

toward a brand such as McDonald’s, for example, would be represented as the relative strength

of the association between McDonald’s and positive versus negative valence. In addition to

evaluative assessments of brands, consumers can also have a relationship with a brand when it is

part of a person’s self-concept (Belk 1988; Fournier 1998; Kleine, Kleine and Allen 1995). As

such, the strength of one consumer’s relationship with a specific brand would be represented in

our example as the strength of the association between McDonald’s and the attribute concept

“me”. We demonstrate the usefulness of the IAT for measuring these two constructs in Study 1.

In Study 2, we use the IAT to capture implicit attitude toward the ad (implicit Aad), by

Page 15: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

13

measuring the relative strength of the association between advertisements with spokespeople of

different ethnicities and the valence attribute concept (pleasant vs. unpleasant).

Although explicit measures of brand attitudes, brand relationships, and Aad have already

been developed, these measures are unable to capture an implicit construct that is, by definition

an “introspectively unidentified (or inaccurately identified) trace of past experience”

(Greenwald and Banaji 1995, p. 5). Unlike explicit measures, the IAT can be used to capture

implicit constructs by measuring the relative strength of associations between target-concepts

and attribute dimensions at the implicit level.

STUDY 1

Study 1 was designed to establish the effectiveness of the IAT as a measure of brand

attitudes and strength of brand relationships. To do so we chose an uncontroversial topic, where

implicit and explicit attitudes are expected to converge. Computer platforms, more specifically

Macintosh by Apple (Mac) and PC (Microsoft Windows-based) machines, were chosen as the

focal targets for this study of implicit attitudes and implicit brand relationships. We did not

expect significant differences between explicit and implicit attitudes, since consumers should

know their attitudes and lack motivation to disguise them, as computers are not considered a

sensitive topic. This study was also designed to test the IAT as an instrument for measuring

brand relationships, or the degree to which some brands are part of consumers’ self-concept.

Procedure and Design

Fifty-six introductory psychology students participated in the study on a voluntary basis

for extra course credit. For each participant, all data was collected during one experimental

session lasting under one hour. All participants first completed a 3-page survey demographic,

Page 16: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

14

vision, and computer proficiency questions, explicit measures of Mac versus PC attitudes,

computer ownership, and usage frequency. Even though prior research has demonstrated that the

order of implicit versus explicit measures has inconsequential effects on the results (Greenwald

and Farnham 2000), we selected the most conservative option and captured the explicit measures

first because the IAT is less likely than explicit measures to be influenced by prior measures.

Then, participants completed two IATs whose order was counterbalanced. One of the IATs

measured implicit attitudes by using stimuli representing Macintosh and PC-based computers

(the target-concepts) and pleasant and unpleasant words (the attribute dimension; see Figure 1).

------------------------------------ FIGURE 1 ABOUT HERE ------------------------------------

The other IAT measured implicit brand relationships by pairing the Mac and PC-related

stimuli with words representing the concepts “self” and “other”. Self-related words included “I”,

“me”, “my”, and “mine”; other-related words included “they”, “them”, “their”, and “other”. The

first IAT consisted of 7 blocks with 32 trials during the practice blocks and 40 trials during the

measured blocks. Each trial consisted of the presentation of a single stimulus item. The second

IAT only required 6 blocks, since the block in Step 1 of Figure 1 was unnecessary for the IAT

that was administered second because the Mac versus PC categorization had already been

practiced and the key assignments remained unchanged for each subject.

Subjects were randomly assigned to one of eight counterbalanced task orders to

accommodate three procedural factors (i.e., a 2×2×2 design): whether the brand attitude or brand

relationship IAT was administered first, whether pleasant or unpleasant were initially assigned to

the left or right key (in other words: presentation order of the favorable versus unfavorable

attitude), and whether self or other were initially assigned to the left or right key.

Page 17: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

15

Measures

During the IAT, the computer recorded participants’ response latencies (in milliseconds)

for the two measured blocks during the brand attitude and brand relationship IAT. Trial, block,

and stimuli information and error rates were also recorded. Consistent with prior procedures and

recommended guidelines established for the IAT (Greenwald and Farnham 2000; Greenwald,

McGhee and Schwartz 1998), the first two trials in the measured blocks were dropped because

they are typically longer; latencies longer than 3,000 ms were recoded to 3,000 ms, and latencies

shorter than 300 ms were recoded as 300 ms. After the data transformations, the IAT effect was

calculated as the difference in response latencies between the third and fifth step depicted in

Figure 1. A pro-Mac implicit attitude effect occurred when a subject was quicker to categorize a

stimulus when Mac and pleasant shared the same response key compared to when Mac and

unpleasant shared the same key. A self-Mac implicit brand relationship effect occurred when a

subject was quicker to categorize Mac and self together compared to Mac and other. Higher

scores on the IAT effects described in this study indicate more favorable implicit attitude and

brand relationship towards Macs relative to PCs.

Explicit attitudes toward Macs and PC were measured in the survey with a 5-item

semantic differential scale, anchored by good-bad, pleasant-unpleasant, inferior-superior,

unsatisfactory-satisfactory, and favorable-unfavorable (α = .90 for both Mac and PC scales).

Two ownership measures (Mac and PC) asked subjects to indicate how many computers of each

type they owned. For each brand, usage frequency was measured with semantic differential

scales anchored by not at all–very frequently.

Participants’ scores on the explicit attitude, ownership, and usage measures for PCs were

subtracted from their Macintosh scores to generate a relative measure of Mac versus PC

Page 18: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

16

tendencies. Consistent with the IAT effect, higher scores on these measures indicated a greater

preference for Macs versus PCs.

Results

Initial analyses tested the effects of the counterbalancing factors (e.g., order of the two

IATs), and none of these factors had a significant effect on the IAT results. These findings are

consistent with prior studies using the IAT demonstrating the robustness of the IAT across

several procedural variations (Greenwald, McGhee and Schwartz 1998; Greenwald and Nosek

2001). Therefore, the analysis that follows is collapsed across the eight procedural conditions.

The focal analysis of this study is the degree to which the explicit measures of brand attitudes,

ownership, and usage correlated with IAT-based measures of implicit brand attitudes and brand

relationship. Table 1 illustrates that all of the explicit difference measures were significantly and

strongly correlated with the IAT-based measures. Further, we show that in this context where we

do not expect subjects to hide their true beliefs, the explicit brand attitudes and the implicit

attitudes are strongly correlated (r=.504, p<.01), thereby validating the IAT for brand evaluation.

-------------------------------- Table 1 ABOUT HERE

--------------------------------

Further analysis of the explicit difference scores was conducted to see how well the IAT-

based measures differentiated between respondents who definitively favored Macs or PCs. To do

this, the explicit difference scores for attitudes, ownership, and usage were dummy-coded.

Participants who had reported more favorable Mac-related explicit attitudes, ownership, or usage

were assigned a 1 while a 0 indicated higher measures for PCs. Participants who were

indifferent; that is, whose scores on the attitude, ownership, and usage measures were the same

for PCs and Macs, were excluded from this analysis. This eliminated 11.4%, 20.3%, and 5.6% of

Page 19: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

17

the participants who reported equivalent attitudes, ownership, and usage, respectively, for Macs

versus PCs. It should also be noted that the pattern of results does not change if all respondents

are kept in the analysis.

Participants who reported more favorable explicit attitudes, greater ownership or usage

frequencies for a brand had significantly faster response latencies when the brand was paired

with the attribute pleasant versus unpleasant, thereby yielding consistency between the implicit

and explicit constructs. In all six comparisons the difference is statistically significant (p<.05 or

p<.01, see Figure 2). This confirms that not only the brand IAT is correlated with explicit brand

preferences, but it is also sensitive to individual behavioral differences. Further, a comparison of

implicit attitude effects for PC versus Mac loyalists yielded stronger IAT effects for the Mac

groups than the PC groups. Whether the data were split by prior attitudes, ownerships or usages,

the average IAT effect for the Mac loyalists ranged from 130.28 to 158.8, while ranging only

from 54.78 to 69.46 for the PC group. T-tests confirmed that whatever split we analyzed, we

detected a larger IAT effect for the Mac groups that for the PC groups (t > 4.33, p <.001 for all

three comparisons). These results indicate that for the Mac loyalists attitude strength and

accessibility seem stronger and higher than for the PC loyalists (see Figure 2).

-------------------------------- Figure 2 ABOUT HERE --------------------------------

With respect to the brand relationship IAT, a significant IAT brand relationship effect

was obtained across the three categorization schemes only for the Mac loyalists (M=121.1,

t=2.93, p =.01 for explicit attitude; M=157.3, t=3.10, p <.01 for ownership; M=178.6, t=4.36, p

<.001 for usage; see Figure 2). Subjects who reported more favorable explicit attitudes, greater

ownership or usage frequencies for Macs had significantly faster response latencies when Mac

Page 20: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

18

and self were combined as opposed to Mac and other. Conversely, PC loyalists’ response

latencies when PC and other were combined as opposed to PC and self were not different (t

values ranging from .15 to .76). Further, a comparison of implicit brand relationship effects for

PC versus Mac loyalists confirmed stronger IAT effects for the Mac groups than the PC groups.

Whether the data was split by prior attitudes, ownerships or usages, t-tests confirmed that we

could detect higher IAT effect for the Mac groups that for the PC groups (t>3.25, p<.005 for all

three comparisons). Together, these results suggest that being a “Mac person” is more closely

related to one’s identity than owning a PC. Also, it appears that for our respondents there was no

evidence of a connection between the concept of self and the PC concept, the opposite being true

for the Mac group.

Study 1 Results Discussion

This study demonstrates the validity of the IAT as an instrument for measuring implicit

brand attitudes and brand relationships. Firstly, in a situation where implicit and explicit

constructs would be expected to converge, IAT measures of brand attitudes and brand

relationship were strongly correlated with explicit measures of brand attitudes, ownership, and

usage. Furthermore, IAT measures were sensitive to individual differences, and effectively

differentiated consumers who reported more favorable explicit attitudes, ownership, and usage of

one brand versus the other. Second, the measurement benefits of the IAT are particularly

compelling with respect to brand relationships. Using Fournier’s terminology (1998), the IAT

results showed that Mac loyalists have a stronger self-connection to the brand, thereby

suggesting that the Mac’s brand relationship quality is superior to that of the PC. The strong

Mac brand relationship might stem from the resistance/loyalty that Mac users have developed

after years of being a minority in the computing world (currently and in recent past, Macintosh

Page 21: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

19

has held a small 5% share of all desktop computer sales, Hamilton 1999; Wong 2001) and the

stronger brand community exhibited by Mac users versus PC users (Muniz and O’Guinn 2001).

Because of this small minority status one would expect that Mac users hold “a socially

embedded and entrenched loyalty, brand commitment… and even hyper loyalty (Muniz and

O’Guinn 2001, p. 427), which in turn becomes a central component on one’s identity. The IAT

results also confirm that brands “serve as powerful repositories of meaning purposively and

differently employed in the substantiation, creation, and (re)production of concepts of self in the

marketing age” (Fournier 1998, p. 365). This validation of the IAT in a marketing or brand

evaluation context was a necessary step in order to firmly establish that the IAT is a valid

marketing measure. This is key if one is to also show that under certain conditions or for certain

topics there can be dissociations (i.e., no significant correlations) between explicit marketing

attitude measures and corresponding IAT measures.

STUDY 2

The previous study showed that IAT-based measures of brand attitudes and brand

relationships are correlated with explicit measures in circumstances when consumers know their

attitudes and presumably lack motivation to disguise them. The goal of Study 2 is to establish

that the IAT also allows uncovering consumers’ attitudes that traditional measures do not detect.

In particular, we wish to demonstrate that social desirability in some explicit tasks can lead to

erroneous marketing conclusions if implicit measures are not considered. In this study, we

investigate the sensitive topic of the race of advertising spokespeople. Past IAT research has

shown that the IAT reveals racial biases that explicit measures do not detect (Dasgupta and

McGhee 2000; Greenwald, McGhee and Schwartz 1998). Also, there has been an extensive

Page 22: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

20

body of marketing research dealing with the impact of spokespeople on advertising effectiveness

and persuasion (Caballero, Lumpkin and Madden 1989; Debevec and Iyer 1988; Deshpande and

Stayman 1994; Heath, McCarthy and Mothersbaugh 1994; Kamins 1989; Kamins 1990; Kamins

and Gupta 1994; Lynch and Schuler 1994; Misra and Beatty 1990). Yet, this past research has

only assessed advertising perceptions through explicit measures (see Forehand and Perkins 2002

for an exception). In this second study, we focus on the very well established construct attitude

toward the ad (Aad) (Mitchell and Olson 1981; and see Brown and Stayman 1992 for a meta

analysis of 47 studies on this topic) as a focal variable and intend to show that there can be a

disassociation between explicit Aad and implicit Aad.

Procedure and Design

Ninety-three introductory to business statistics undergraduate students (consisting of 33

men and 60 women, 46 Caucasians, 30 Asians, 6 Hispanics, 3 African-Americans, 8 Multi-

Racial or other ethnicities, median age = 19) participated in the study for course credit. For each

participant, all data were collected during one experimental session lasting under forty-five

minutes. First, participants completed a survey containing demographic, vision, and computer

proficiency questions. Subsequent analysis showed that all subjects could be retained in the

sample. The survey also included measures of the key construct of interest – attitude toward the

ad (5 item scale) – both for ads with white spokespeople and ads with black spokespeople.

Measurement order was counterbalanced, so that half of the subjects reported on their attitude

towards ads that featured white spokespeople first and the other half reported on attitude towards

ads with black spokespersons first. Subjects were randomly assigned to one of the orders. Then

subjects completed a 7 block computer-based IAT. Blocks 4 and 7 were the measurement

blocks. Each block consisted of 32 (practice) and 40 (measured) trials each. In addition to trial

Page 23: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

21

number, block number, and stimuli information (see Appendix 1 for example of stimulus),

subjects’ response latencies (in milliseconds) and error rates were recorded.

Stimuli

For this study we developed thirty-two ads. These ads were very simple in layout in

order to allow for quick processing and classification. They consisted of a picture of an athlete

(male or female), as well as a brand identifier (name or logo). Based on brand familiarity pretest

with a similar population, ads were designed for two different athletics footwear brands: a low

familiarity brand (Etonic) and a high familiarity brand (New Balance). Sports were varied, and

included tennis, basketball, track, golf and bodybuilding. Ads were executed in four versions:

one with a white athlete and a matching one with a black athlete, and one for each of the two

brands (in total: 8 sports pictures × 2 races × 2 brands). All efforts were made to insure that the

black and white race versions of the ads matched each other in all dimensions (see Appendix 1

for examples of the advertising stimuli). In order to minimize differences between ads, they

were displayed in black and white mode. This study also used the same list of pleasant and

unpleasant words that were used in Study 1.

Measures

Explicit measures of Aad were collected for ads with white spokespersons, and for ads

with black spokespersons. They were measured using a six item semantic differential scale

(interesting/boring, good/bad, unpleasant/pleasant, dislike/like, favorable/not favorable, not

irritating/irritating). These items (in different combinations) have been used in past research on

attitude toward the ad (see MacKenzie and Lutz 1996; MacKenzie, Lutz and Belch 1986;

Mitchell 1986; Mitchell and Olson 1981). Reliability for each scale was high (alpha (black) =

.93; alpha (white) = .88). Two versions of the written survey were made so as to counterbalance

Page 24: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

22

presentation order of the explicit measures. Half of the subjects received the version where Aad

black was first and the others the version where Aad white was first.

Two types of explicit measures of attitudes towards whites and blacks were also included

in the survey booklet. The first type of measure was a feeling thermometer (Greenwald, McGhee

and Schwartz 1998) numerically labeled at 10-degree intervals from 0 to 99, with the words

“cold or unfavorable”, “neutral”, and “warm or favorable” placed next to the anchored points of

0, 50, and 99, respectively. Participants were instructed “Please make a horizontal mark across

the scales below indicating how you feel, in general, about each of the ethnic groups listed

below.” Two thermometers (one for each ethnic group) were displayed side by side on the

survey page. The placement of the thermometers (i.e., whether the thermometer for blacks was

on the left or right) was randomized. Next, participants completed two sets of five 7-point

semantic differential scales (beautiful/ugly, good/bad, pleasant/unpleasant, not

trustworthy/trustworthy, and nice/awful) to measure overall race attitude for each ethnicity. As

with the thermometers, the scales’ presentation order was randomized. For each race an average

of the 5 items was computed in order to provide an overall race attitude measure. Then, for each

respondent, and for each type of explicit measures (thermometers and overall race attitude),

difference scores were calculated by subtracting scores towards blacks from the scores towards

whites. Thus, higher values on the difference scores reflect a relatively more positive attitude

towards whites or ads with whites versus blacks.

Implicit attitude toward the ad was measured using a similar methodology to Study One.

In this study, the IAT effect was measured as the difference in response latencies when the

classification target category (“ad with a black spokesperson” versus “ad with a white

spokesperson”) shared the same response key as the attribute (“unpleasant” versus “pleasant”).

Page 25: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

23

Thus, a pro-white spokesperson implicit Aad effect occurred when a subject was quicker to

categorize a stimulus when “ad with white spokesperson” and “pleasant” shared the same

response key compared to when “ad with white spokesperson” and “unpleasant” shared the same

key.

Results

First, and as expected, we found that there were no significant differences between

explicit Aad that was reported for ads with white spokespersons (m=4.67) compared to ads with

black spokespersons (m=4.77) (see Figure 3). Although the means were not significantly

different (t=1.32, p<.20), the small difference favoring ads with black spokespersons suggests

that the participants were trying to avoid the appearance of being racially biased. Within the

implicit measures of Aad, there is a strong effect in favor of the white spokespersons (IAT effect

m=244.53ms, t=11.25, p <.001). Participants were approximately a quarter of a second faster

when classifying ads with white spokespeople with pleasant and black spokespeople with

unpleasant than classifying white with unpleasant and black with pleasant. This appearance of

dissociation between the implicit and explicit results is further confirmed by the correlation

analysis.

--------------------------------- Figure 3 ABOUT HERE

---------------------------------

Table 2 illustrates bivariate correlations between the various implicit and explicit

measures obtained in the study. Of central importance for this study is that the implicit and

explicit measures of Aad are not significantly related to one another. Implicit Aad is not

significantly related to explicit attitudes towards whites versus blacks, as measured by the

Page 26: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

24

thermometer scale, but it is related to the explicit ethnic attitude difference score, as measured by

the 5-item scale, thought not strongly (r<.30).

-------------------------------- Table 2 ABOUT HERE

--------------------------------

Discussion of Study 2 Results

While Study One has demonstrated the validity of the IAT as an instrument for

measuring implicit brand attitudes and brand relationships and has shown that this instrument is

sensitive to individual differences, this second study has shown that the IAT is a useful

measurement tool that allows the measurement and uncovering of results and effects that explicit

measures cannot detect. In this case, we showed that explicit measures of Aad may not represent

automatic associations evoked by the ad. In this case involving the race of a spokesperson, it is

plausible that explicit Aad measures reflect views that participants wish to present, whereas the

implicit measure reflects a more uncontrollable automatic association. The implicit responses

should be accurate portrayals of the stereotypes that are held by the respondents, whereas the

explicit measures are more tented by socially desirability.

GENERAL DISCUSSION

In this article we set out to demonstrate that 1) marketing research and marketing theories

can benefit from better implicit measures, 2) that the IAT is a valid and reliable instrument that

can be used to measure a range of marketing constructs, and 3) that under specific situations IAT

measures are uniquely suited to provide information that is not available through explicit

measures. Findings from our two studies provide the following insights.

Page 27: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

25

In Study 1, we have shown that explicit measures and IAT measures of attitudes and

other marketing constructs converge and are valid when consumers are willing and able to report

their feelings and beliefs, and understand the influence of prior experiences on the knowledge

structures supporting them. IAT-based measures of brand attitudes converged with explicit

measures of brand attitudes in the Mac versus PC study where social desirability or other biases

were not likely to occur. In addition, IAT-based measures of brand relationship strength

revealed distinctive asymmetries between brands. Finally, we showed that the IAT was sensitive

to individual differences, and the magnitude of the IAT effects provides evidence of attitude

availability and strength. However, there are also conditions where respondents do not have

access to their true attitudes or choose to conceal them.

In Study 2, we showed that the IAT can capture automatic associations between target-

concepts and attribute dimensions. The IAT is useful in these circumstances where explicit

measures of brand constructs diverge from their implicit counterparts. In this second study, IAT-

based measures of Aad revealed an influence of ethnic prejudice on Aad that explicit measures

did not. These findings underscore the importance of the IAT for two main domains 1) the

implications and opportunities for future research aimed at better understanding the impact of

ethnic stereotypes on advertising and brand attitudes, and 2) the general usefulness of the IAT as

a measurement tool in marketing theory testing and practice.

Marketing research that investigates the role of unconscious processes in consumer

learning seems to be the number one candidate to benefit from the IAT in the near term.

Research on Aad formation, mere exposure effects, and classical conditioning (e.g., Janiszewski

1988) could use the IAT to determine if automatic/implicit associations between brands, ads, and

attribute dimensions behave as would be expected by these theories. Instead of relying on a lack

Page 28: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

26

of recall or other conscious processes as evidence that preconscious activities are present, the

IAT allows researchers to tap directly into the implicit processes that are presumed to occur.

Other domains of consumer behavior are also affected by unconscious and automatic

processes. In general, the IAT can provide important measures for topics that are controversial or

stigmatized. Past research investigating the impact of stigmas associated with volunteerism

(Snyder, Omoto and Crain 1999) has shown that the public stigmatizes people who engage in

socially-beneficial activities such as volunteering to help someone with AIDS. The IAT can be

used in this context to reveal the associations that drive these perceptions, such as an association

between AIDS and homosexuals, drug users, and other stigmatized groups. Similarly, the IAT

can be used to investigate how negative events that involve spokespeople can impact attitudes

towards the spokespeople and the brands they represent (Louie, Kulik and Jacobson 2001). In

both cases, the IAT can be used to test whether implicit associations have been formed between

attitude objects and stigmatic attributes, and also further understand behaviors that derived from

these associations.

Our IAT results with respect to race biases can be linked to other research on race and

ethnicity in marketing. For example, research on consumer distinctiveness and ethnic self-

awareness (Forehand and Deshpande 2001; Grier and Deshpande 2001) examines the effect of

spokesperson ethnicity and other ethnic primes on brand attitudes and persuasion. IAT-based

measures of implicit ethnic stereotypes, Aad, and brand attitudes can allow researchers to test the

theories that are used to explain these effects, especially when these theories suggest the

presence of “unconscious ethnic processing and categorization” (Forehand and Deshpande 2001,

p. 338). Certainly it is not our intent to suggest that because IAT measures revealed that our

respondents were racially biased that marketers should avoid using minorities in their ads.

Page 29: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

27

Rather, we see this as a two sided outlook where 1) more work is needed to better understand the

role of unconscious ethnic processing, and 2) the IAT can provide more evidence for policy and

decision makers that even when explicit measures can suggest that racial or other biases do not

exist, there can still be strong stereotypes being held by consumers, and that these deserve

special attention, educational efforts or other interventions. Outside of race, one could consider

the use of the IAT to better understand implicit attitudes towards risky behaviors like smoking or

drinking, the use or not of condoms etc, since it is often likely that political correctness and

social desirability tend to influence explicit answers on these issues. Similarly, the IAT can be

useful to better understand consumers’ reactions to companies’ social responsibility programs,

and help better predict when and how doing good will also do well for the company (Sen and

Bhattacharya 2001).

Results from Study 1 demonstrate the IAT’s usefulness for measuring the degree to

which brands are a part of a consumer’s self-concept. These findings demonstrate the IAT’s

potential for advancing research concerning both brand relationships (Fournier 1998) and brand

community (McAlexander, Schouten and Koenig 2002; Muniz and O'Guinn 2001) and consumer

identity. The IAT is also applicable to research on organizational identification (Bergami and

Bagozzi, 2000) and would allow for new understandings and measures of the overlap between

self-definition and organizational identity and new insights on its likely impact on other

marketing variables.

The IAT may provide unique and important information on other topics in brand

management as well. Consumers’ associative brand networks may include concepts and

associations that a consumer either cannot or will not report, but which may surface through the

IAT. Further, since a successful brand extension or brand alliance would share at least some of

Page 30: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

28

the traits associated with the core brand (Simonin and Ruth 1998), the IAT may expand our

understanding of this transfer process.

Finally, we would like to suggest that the IAT be used not just as a dependent measure,

but also as an independent one or in conjunction with others. It seems that much insight can

come from using the IAT as an explanatory factor for behavior, choice or judgments. For

instance, while traditional explicit measures provides satisfactory subjective and normative

measures to understand the link between attitude and behavior, the IAT might increase the

predictability of behavior by adding an unconscious or implicit component to traditional models.

In general, any contexts where associations between attributes and concepts are presumed to

operate at an implicit level would provide a suitable and necessary setting for the use of the

Implicit Association Test. Our studies offer a demonstration of the IAT’s use in marketing and

its potential contribution in consumer research. It is our hope and opinion that future research

will undoubtedly uncover even greater applicability and value of this measurement tool.

Page 31: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

29

TABLE 1

STUDY 1 CORRELATION BETWEEN KEY VARIABLES

Pearson Correlation

Implicit Attitudea

Implicit Brand-

Relationship

Explicit Brand

Attitude

Computer Ownership

Implicit Brand Relationship

.542** (n=63)

Explicit Brand Attitude (difference score)

.504** (n=54)

.307* (n=54)

Computer Ownership (difference score)

.468** (n=54)

.411** (n=54)

.581** (n=79)

Computer Usage (difference score)

.688** (n=50)

.543** (n=50)

.692** (n=72)

.689** (n=72)

* p<.05 ** p<.01

aHigh scores on the IAT and the explicit difference scores indicate preferences for Macintosh relative to PC-type computers.

Page 32: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

30

TABLE 2

STUDY 2 CORRELATION BETWEEN KEY VARIABLES

Implicit Aad (positive-white)

Explicit Aad (white vs. black spokespeople)

Explicit attitude towards white vs. blacks (thermometer)

Explicit Aad (white vs. black spokespeople)

.054 n=93

Explicit attitude towards white vs. blacks (thermometer)

.108 n=93

.302** n=93

Explicit attitude towards white vs. blacks (scale)

.284** n=93

.279** n=93

.623** n=93

* p<.05

** p<.01 *** p<.001

Page 33: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

31

FIGURE 1

SCHEMATIC DESCRIPTION OF THE ATTITUDE IMPLICIT ASSOCIATION TEST (IAT) Category labels Sample stimuli Category labels Step 1: Apple/Macintosh PC-type\IBM Practice block (32 trials) ● Apple ○ ○

Step 2: Pleasant Unpleasant Practice block (32 trials) ● lucky ○ ○ hatred ●

Step 3: Apple/Macintosh or

Pleasant

PC-type\IBM or

Unpleasant Practice block (32 trials) ● lucky ○ Critical block (40 trials) ○

○ hatred ● ●

Step 4: Unpleasant Pleasant Practice block (32 trials) ○ lucky ● ● hatred ○

Step 5: Apple/Macintosh or

Unpleasant

PC-type\IBM or

Pleasant Practice block (32 trials) ○ lucky ● Critical block (40 trials) ○

● hatred ○ ●

Categorization tasks for the five steps of the attitude IAT. The correct response for each sample stimulus indicated by the black dots. The IAT effect is calculated as the difference in average response latencies between Steps 3 and 5. (Adapted from Greenwald and Farnham 2000)

Page 34: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

32

FIGURE 2 STUDY1: IMPLICIT ATTITUDE AND IMPLICIT BRAND RELATIONSHIP RESULTS

Implicit Attitude Effect by Explicit Attitude

500

600

700

800

Pro PC attitude Pro Mac attitude

Lat

ency

(ms)

IAT EffectM=61.7SD =127.6t = 2.78 p < .01

IAT EffectM=130.28SD = 182.7t = 2.94 p = .01

Implicit Attitude Effect by Computer Ownership

500

600

700

800

Own more PCs Own more Macs

Lat

ency

(ms)

IAT EffectM=54.78SD = 117.8t = 2.63 p < .05

IAT EffectM=141.6SD = 199.3t = 2.66 p < .05

Implicit Attitude Effect by Usage Frequency

500

600

700

800

PC-user Mac-user

Lat

ency

(ms)

IAT EffectM=158.8 SD = 179.1t = 3.66p < .01

IAT EffectM=69.46SD = 133.1t = 2.81p < .01

Implicit Brand-Relationship Effect by Explicit Attitude

500

600

700

800

Pro PC attitude Pro Mac attitude

Lat

ency

(ms)

IAT EffectM=16.2SD = 122.05t = .76N.S.

IAT EffectM=121.1SD = 170.6t = 2.93p = .01

Implicit Brand-Relationship Effect by Computer Ownership

500

600

700

800

Own more PCs Own more Macs

Lat

ency

(ms) IAT Effect

M=157.3SD = 189.6t = 3.10p < .01

IAT EffectM=9.2SD = 145.4t = .36N.S.

Implicit Brand-Relationship Effect by Usage Frequency

500

600

700

800

PC-user Mac-user

Lat

ency

(ms)

IAT EffectM=178.6 SD = 168.8t = 4.36p < .001

IAT EffectM=11.10SD = 120.6t = .15N.S.

Mac & Pleasant words Mac & Self words PC & Self words PC & Pleasant words

Page 35: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

33

FIGURE 3 STUDY 2: EXPLICIT AND IMPLICIT ATTITUDE TOWARD THE AD MEASURES

Explicit Aad Measures

(1-7 scale)

Implicit Aad Measures

(in m.s.)

737.41

981.84

0

250

500

750

1000

White Pleasant/Black UnpleasantBlack Pleasant/White Unpleasant

IAT Effect

4.67 4.76

1

2

3

4

5

6

White Spokesperson Black Spokesperson

No Significant Difference

M= 244.43t92=11.25

P<.001

Page 36: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

34

APPENDIX 1

EXAMPLES OF ADVERTISING STIMULI USED FOR STUDY TWO

All ads were executed for both brands. This appendix contains a representative set of the ad stimuli used in study two. In total there were 32 versions created.

Page 37: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

35

Page 38: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

36

REFERENCES Alba, Joseph W. and J. Wesley Hutchinson (2000), "Knowledge Calibration: What Consumers

Know and What They Think They Know," Journal of Consumer Research, 27(2), 123-156.

Anderson, James R. and Gordon H. Bower (1973), Human Associative Memory. Washington,

D.C.: V.H. Winston. Banaji, Mahzarin R. and Curtis D. Hardin (1996), "Automatic Stereotyping," Psychological

Science, 7(May), 136-141. Bargh, John A. (1989), "Conditional Automaticity: Varieties of Automatic Influence in Social

Perception and Cognition," in Unintended Thought, J. S. Uleman and J. S. Bargh, eds. New York, NY: Guilford Press: 3-51.

---- (1994), "The Four Horsemen of Automaticity: Awareness, Intention, Efficiency and Control

in Social Cognition," in Handbook of Social Cognition, R. S. Wyer, Jr. and T. K. Srull, eds. Hillside, NJ: Erlbaum. 1: 1-40.

-----, Shelly Chaiken, Rajen Govender and Felicia Pratto (1992), "The Generality of the

Automatic Attitude Activation Effect," Journal of Personality and Social Psychology, 62(June), 893-912.

-----, and Tanya L. Chartrand (1999), "The Unbearable Automaticity of Being," American

Psychologist, 54(July), 462-479. Battig, W.F. and W.E. Montague (1969), "Category Norms for Verbal Items in 56 Categories: A

Replication and Extension of the Connecticut Category Norms," Journal of Experimental Psychology Monographs, 80(3, Pt. 2), 1-46.

Belk, Russell W. (1988), "Possessions and the Extended Self," Journal of Consumer Research,

15(September), 139-168. Bellezza, F.S., Anthony G. Greenwald and M. R. Banaji (1986), "Words High and Low in

Pleasantness as Rated by Male and Female College Students," Behavior Research Methods, Instruments, & Computers, 18, 299-303.

Bergami, Massimo and Richard Bagozzi (2000), “Self-Categorization, Affective Commitment

and Group Self-Esteem as Distinct Aspects of Social Identity in the Organization,” British Journal of Social Psychology, 39, 555-577.

Bosson, J. K., W. B. Swann and J. W. Pennebaker (2000), "Stalking the Perfect Measure of Self-

Esteem: The Blind Men and the Elephant Revisited?," Journal of Personality and Social Psychology, 79, 631-643.

Bower, Gordon H. (1981), "Mood and Memory," American Psychologist(February), 129-148.

Page 39: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

37

Brendl, C. M., A. B. Markman and C. Messner (2001), "How Do Indirect Measures of

Evaluation Work? Evaluating the Inference of Prejudice in the Implicit Association Test," Journal of Personality and Social Psychology, 81(5), 760-772.

Brown, Steven P. and Douglas M. Stayman (1992), "Antecedents and Consequences of Attitude

toward the Ad: A Meta-Analysis," Journal of Consumer Research, 19(1), 34-51. Caballero, Marjorie J., James R. Lumpkin and Charles S. Madden (1989), "Using Physical

Attractiveness as an Advertising Tool: An Empirical Test of the Attraction Phenomenon," Journal of Advertising Research, 29(4), 16-22.

Campbell, Donald T. (1950), "The Indirect Assessment of Social Attitudes," Psychological

Bulletin, 47, 15-38. Chaiken, Shelly and John A. Bargh (1993), "Occurrence Versus Moderation of the Automatic

Attitude Activation Effect: Reply to Fazio," Journal of Personality and Social Psychology, 64(May), 759-765.

Churchill, Gilbert A. (1995), Marketing Research: Methodological Foundations. Fort Worth,

TX: Dryden Press. Collins, A.M. and E.F. Loftus (1975), "A Spreading-Activation Theory of Semantic Processing,"

Psychological Review, 82, 407-428. Cunningham, William A., Kristopher J. Preacher and Mahzarin R. Banaji (2001), "Implicit

Attitude Measures: Consistency, Stability, and Convergent Validity," Psychological Science, 12(2), 163-170.

Dasgupta, Nilanjana and Anthony G. Greenwald (2000), "Exposure to Admired Group Members

Reduces Automatic Intergroup Bias," Journal of Experimental Social Psychology, 36(3), May (2000). 316-328.

----- and Debbie E. McGhee (2000), "Automatic preference for White Americans: Eliminating

the Familiarity Explanation," Journal of Experimental Social Psychology, 36(3), 316-330. Debevec, Kathleen and Easwar Iyer (1988), "Self-Referencing as a Mediator of the Effectiveness

of Sex-Role Portrayals in Advertising," Psychology & Marketing, 5(1), 71-84. Demo, David (1985), "The Measurement of Self-Esteem: Refining Our Methods," Journal of

Personality and Social Psychology, 48(June), 1490-1502. Deshpande, Rohit and Douglas M. Stayman (1994), "A Tale of Two Cities: Distinctiveness

Theory and Advertising Effectiveness," Journal of Marketing Research, 31(1), 57-64.

Page 40: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

38

Devine, Patricia G. (1989), "Stereotypes and Prejudice: Their Automatic and Controlled Components," Journal of Personality and Social Psychology, 56(January), 5-18.

Dovidio, John F. and Russell H. Fazio (1992), "New Technologies for the Direct and Indirect

Assessment of Attitudes," in Questions About Questions: Inquiries into the Cognitive Bases of Surveys, J. M. Tanur, ed. New York: Sage: 204-237.

Fazio, Russell H. (1986), "How Do Attitudes Guide Behavior?," in Handbook of Motivation and

Cognition, R. M. Sorrentino and E. T. Higgins, eds. New York: Guilford Press. 1: 204-243.

---- (1990), "A Practical Guide to the Use of Response Latency in Social Psychological

Research," in Research Methods in Personality and Social Psychology, C. Hendrick and M. S. Clark, eds. Newbury Park, CA: Sage. 11: 74-97.

---- (1995), "Attitudes as Object-Evaluation Associations: Determinants, Consequences, and

Correlates of Attitude Accessibility," in Attitude Strength: Antecedents and Consequences, R. E. Petty and J. A. Krosnick, eds. Hillsdale, NJ: Erlbaum: 247-282.

-----, J. Chen, E.C. McDonel and S.J. Sherman (1982), "Attitude Accessibility, Attitude-

Behavior Consistency, and the Strength of the Object-Evaluation Association," Journal of Experimental Social Psychology, 18, 339-357.

-----, D.M. Sanbonmatsu, M.C. Powell and F.R. Kardes (1986), "On the Automatic Activation of

Attitudes," Journal of Personality and Social Psychology, 50(February), 229-238. Forehand, Mark R. and Rohit Deshpande (2001), "What We See Makes Us Who We Are:

Priming Ethnic Self-Awareness and Advertising Response," Journal of Marketing Research, 38(3), 336-348.

----- and Andrew Perkins (2002), "Unconscious Processing of Spokesperson Information: The

Influence of Implicit Cognition," Working Paper, University of Washington. Fournier, Susan (1998), "Consumers and Their Brands: Developing Relationship Theory in

Consumer Research," Journal of Consumer Research, 24(March), 343-373. Gaertner, Samuel L. and John F. Dovidio (1986), "The Aversive Form of Racism," in Prejudice,

Discrimination, and Racism, J. F. Dovidio and S. L. Gaertner, eds. Orlando, FL: Academic Press: 61-89.

Greenwald, Anthony G. and Mahzarin R. Banaji (1995), "Implicit Social Cognition: Attitudes,

Self-Esteem, and Stereotypes," Psychological Review, 102(1), 4-27. -----, -----, Laurie A. Rudman, Shelly D. Farnham, Brian A. Nosek and Deborah S. Mellott

(2002), "A Unified Theory of Implicit Attitudes, Stereotypes, Self-Esteem, and Self-Concept," Psychological Review, 109(1), 3-25.

Page 41: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

39

----- and Shelly D. Farnham (2000), "Using the Implicit Association Test to Measure Self-

Esteem and Self-Concept," Journal of Personality and Social Psychology, 79(6), 1022-1038.

-----, Mark R. Klinger and T J. Liu (1989), "Unconscious Processing of Dichoptically Masked

Words," Memory and Cognition, 17(January), 35-47. -----, Debbie E. McGhee and Jordan L. K. Schwartz (1998), "Measuring Individual Differences

in Implicit Cognition: The Implicit Association Test," Journal of Personality and Social Psychology, 74(June), 1464-1480.

----- and Brian A. Nosek (2001), "Health of the Implicit Association Test at Age 3," Zeitschrift

fur Experimentelle Psychologie, 48(2), 85-93. Grier, Sonya A. and Rohit Deshpande (2001), "Social Dimensions of Consumer Distinctiveness:

The Influence of Social Status on Group Identity and Advertising Persuasion," Journal of Marketing Research, 38(2), 216-224.

Haire, Mason (1950), "Projective Techniques in Marketing Research," Journal of Marketing,

14(April), 649-656. Hamilton, David P. (1999), "Apple Computer Releases New Operating System for Web

Servers," The Wall Street Journal(March 17), B8. Haugvedt, Curtis P., Richard E. Petty and John T. Cacioppo (1992), "Need for Cognition and

Advertising: Understanding the Role of Personality Variables in Consumer Behavior," Journal of Consumer Psychology, 1(3), 239-260.

Hawkins, Del I. and Kenneth A. Coney (1981), "Uninformed Response Error in Survey

Research," Journal of Marketing Research, 18(August), 370-374. Heath, Timothy B., Michael S. McCarthy and David L. Mothersbaugh (1994), "Spokesperson

Fame and Vividness Effects in the Context of Issue-Relevant Thinking: The Moderating Role of Competitive Setting," Journal of Consumer Research, 20(4), 520-534.

Jacoby, Larry L., D. Stephen Lindsay and Jeffrey P. Toth (1992), "Unconscious Influences

Revealed," American Psychologist, 47(June), 802-809. Janiszewski, Chris (1988), "Preconscious Processing Effects: The Independence of Attitude

Formation and Conscious Thought," Journal of Consumer Research, 15(September), 199-209.

----- (1990), "The Influence of Print Advertisement Organization on Affect toward a Brand

Name," Journal of Consumer Research, 17(June), 53-65.

Page 42: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

40

----- (1993), "Preattentive Mere Exposure Effects," Journal of Consumer Research, 20(December), 376-392.

Kamins, Michael A. (1989), "Celebrity and Noncelebrity Advertising in a Two-Sided Context,"

Journal of Advertising Research, 29(3), 34-42. ----- (1990), "An Investigation into the 'Match-up' Hypothesis in Celebrity Advertising: When

Beauty May Be Only Skin Deep," Journal of Advertising, 19(1), 4-13. ----- and Kamal Gupta (1994), "Congruence between Spokesperson and Product Type: A

Matchup Hypothesis Perspective," Psychology & Marketing, 11(6), 569-586. Kleine, Susan Schultz, Robert E. Kleine, III and Chris T. Allen (1995), "How Is a Possession

'Me' or 'Not Me'? Characterizing Types and an Antecedent of Material Possession Attachment," Journal of Consumer Research, 22(December), 327-343.

Kuehnen, U., M. Schiessl, N. Bauer, N. Paulig, C. Poehlmann and K. Schmidthals (2001), "How

Robust Is the IAT? Measuring and Manipulating Implicit Attitudes of East- and West-Germans," Zeitschrift fur Experimentelle Psychologie, 48(2), 135-144.

Lemon, Nigel (1973), Attitudes and Their Measurement. New York: John Wiley & Sons. Louie, Therese A., Robert L. Kulik and Robert Jacobson (2001), "When Bad Things Happen to

Endorsers of Good Products," Marketing Letters, 12(February), 13-23. Lynch, James and Drue Schuler (1994), "The Matchup Effect of Spokesperson and Product

Congruency: A Schema Theory Interpretation," Psychology & Marketing, 11(5), 417-445.

MacKenzie, Scott B. and Richard J. Lutz (1996), "An Empirical Examination of the Structural

Antecedents of Attitude toward the Ad in Advertising Pretesting Context," Journal of Marketing, 53(2), 48-65.

-----, ----- and George E. Belch (1986), "The Role of Attitude toward the Ad as a Mediator of

Advertising Effectiveness: A Test of Competing Explanations," Journal of Marketing Research, 23(2), 130-143.

Maison, Dominika, Anthony G. Greenwald and Ralph Bruin (2001), "The Implicit Association

Test as a Measure of Implicit Consumer Attitudes," Polish Psychological Bulletin, 32(1), 1-9.

McAlexander, James H., John W. Schouten and Harold F. Koenig (2002), "Building Brand

Community," Journal of Marketing, 66(1), 38-54.

Page 43: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

41

Mellott, D.S. and Anthony G. Greenwald (2000). Measuring Implicit Ageism: Do the Implicit Association Test and Semantic Priming Measure the Same Contruct? Midwestern Psychological Association, Chicago, IL.

Meyer, David E. and Roger W. Schvaneveldt (1971), "Facilitation in Recognizing Pairs of

Words: Evidence of Dependence between Retrieval Operations," Journal of Experimental Psychology, 90(October), 227-234.

Misra, Shekhar and Sharon E. Beatty (1990), "Celebrity Spokesperson and Brand Congruence:

An Assessment of Recall and Affect," Journal of Business Research, 21(2), 159-173. Mitchell, Andrew A. (1986), "The Effect of Verbal and Visual Components of Advertisements

on Brand Attitudes and Attitude toward the Advertisement," Journal of Consumer Research, 13(1), 12-24.

----- and Jerry C. Olson (1981), "Are Product Attribute Beliefs the Only Mediator of Advertising

Effects on Brand Attitude?," Journal of Marketing Research, 18(3), 318-332. Muniz, Albert M. Jr. and Thomas C. O'Guinn (2001), "Brand Community," Journal of Consumer

Research, 27(4), 412-432. Netemeyer, Richard G. and William O. Bearden, eds. (1998). Handbook of Marketing Scales.

Thousand Oaks, Sage Publications. Nosek, B., M. R. Banaji and Anthony G. Greenwald (2000). Math = Male, Me = Female,

Therefore Math Doesn't Equal Me. Working Paper, Yale University. Peter, J. Paul (1979), "Reliability: A Review of Psychometric Basics and Recent Marketing

Practices," Journal of Marketing Research, 16(February), 6-17. Phelps, Elizabeth A. , Kevine J. O'Connor, William A. Cunningham, E. Sumie Funayama,

J.Christopher Gatenby, John C. Gore and Mahzarin R. Banaji (2000), "Amygala Activation Predicts Performance on Indirect Measures of Racial Bias," Journal of Cognitive Neuroscience, 12(5), 729-738.

Rothermund, K. and D. Wentura (2001), "Figure-Ground Asymmetries in the Implicit

Association Test," Zeitschrift fur Experimentelle Psychologie, 48(2), 94-106. Rudman, Laurie A. and P. Glick (2001), "Prescriptive Gender Stereotypes and Backlash against

Agentic Women," Journal of Social Issues, 57(4), 743-762. ----- and S.E. Kilianski (2000), "Implicit and Explicit Attitudes Towards Female Authority,"

Personality and Social Psychology Bulletin, 26(11), 1315-1328. Seger, Carol Augart (1994), "Implicit Learning," Psychological Bulletin, 115(March), 163-196.

Page 44: Implicit Measures of Marketing Constructs With the ...questromapps.bu.edu/qstnet/Personal/Faculty/Publication/pubUploads/... · Implicit Measures of Marketing Constructs With the

42

Sen, Sankar and C.B. Bhattacharya (2001), "Does Doing Good Always Lead to Doing Better? Consumer Reactions to Corporate Social Responsibility," Journal of Marketing Research, 38(2), 225-243.

Shapiro, Stewart (1999), "When an Ad's Influence Is Beyond Our Conscious Control: Perceptual

and Conceptual Fluency Effects Caused by Incidental Ad Exposure," Journal of Consumer Research, 26(June), 16-36.

----- and Deborah J. MacInnis (1992), "Mapping the Relationship between Preattentive

Processing and Attitude," in Advances in Consumer Research, J. F. Sherry, Jr. and B. Sternthal, eds. Chicago: Association for Consumer Research. 19: 505-513.

-----, ----- and Susan E. Heckler (1997), "The Effects of Incidental Ad Exposure on the

Formation of Consideration Sets," Journal of Consumer Research, 24(1), 94-104. Simonin, Bernard L. and Julie A. Ruth (1998), "Is a Company Known by the Company It Keeps?

Accessing the Spillover Effects of Brand Alliances on Consumer Brand Attitudes," Journal of Marketing Research, 35(February), 30-42.

Sirgy, M. Joseph (1982), "Self-Concept in Consumer Behavior: A Critical Review," Journal of

Consumer Research, 9(December), 287-300. Snyder, Mark, Allen M. Omoto and A. Lauren Crain (1999), "Punished for Their Good Deeds:

Stigmatization of Aids Volunteers," American Behavioral Scientist, 42(7), 1175-1192. Tulving, Endel and Daniel L. Schacter (1990), "Priming and Human Memory Systems," Science,

247(January), 301-306. Underwood, Geoffrey D.M. and James E.H. Bright (1996), "Cognition with and without

Awareness," in Implicit Cognition, G. D. M. Underwood, ed. New York, NY: Oxford University Press: 1-40.

Wong, Nicole C. (2001). Apple's Time to Grow; Computer Maker Expanding in Downturn. The

Washington Post. Washington, D.C.: E01.


Top Related