the effect of repeated exposure to unpredictable …€¦ · the effect of repeated exposure to...

72
THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE REWARD ON DOPAMINE NEUROPLASTICITY by Sarah Mathewson A thesis submitted in conformity with the requirements for the degree of Master of Arts Graduate Department of Psychology University of Toronto © Copyright by Sarah Mathewson 2009

Upload: others

Post on 12-Dec-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE REWARD ON

DOPAMINE NEUROPLASTICITY

by

Sarah Mathewson

A thesis submitted in conformity with the requirements

for the degree of Master of Arts

Graduate Department of Psychology

University of Toronto

© Copyright by Sarah Mathewson 2009

Page 2: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

The Effect of Repeated Exposure to Unpredictable Reward

on Dopamine Neuroplasticity

Master of Arts 2009

Sarah Mathewson

Department of Psychology, Program in Neuroscience, University of Toronto

Abstract

Drugs of abuse elicit dopamine release unconditionally, sensitizing the reward system to

drugs and drug-associated stimuli resulting in compulsive drug-seeking and drug-taking

behaviour. It has been discovered that these same dopamine neurons consistently respond to

natural rewards when the reward delivery is at maximum uncertainty (50%). Reward

uncertainty is a defining feature of gambling. Therefore, chronic increases in dopamine

release from gambling-like stimuli could lead to sensitization of the reward pathways and

contribute to gambling pathology. This study investigated the effects of repeated exposure to

different probabilities of sucrose reward (0, 25%, 50%, 75%, 100%) on sensitivity to an

amphetamine challenge (0.5 mg/kg) and development of sensitization after multiple

amphetamine doses (5 x 1.0/kg) in Sprague–Dawley and Lewis rats. No significant group

differences were found during the amphetamine challenge or amphetamine sensitization in

either strain. Opportunities for improvement in the experimental paradigm and for future

research are discussed.

ii

Page 3: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

Acknowledgements

This study was supported by grants from Natural Science and Engineering Research Council.

The author would like to thank: Dr. Paul Fletcher, who served as thesis supervisor, for his

assistance in conducting the study and his helpful suggestions and insightful comments on

the final version; Dr. Suzanne Erb and Dr. Martin Zack for their input and feedback on the

experimental design as it evolved; and Christie Burton, Zoë Rizos and Judy Sinyard for their

technical guidance during the study.

iii

Page 4: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

Table of Contents

1. Introduction 1

1.1 Objective 1

1.2 Dopamine and its Role in Addiction 3

1.3 Sensitization 5

1.4 Cross Sensitization 6

1.5 Comorbidity between Gambling and Drug Use 7

1.6 Gambling and Dopamine 8

1.7 Genetic Factors in Pathological Gambling 10

1.8 Lewis Inbred Strain 11

1.9 Purpose 13

1.10 Hypotheses 14

2. Methods 15

2.1 Animals 15

2.2 Training Apparatus 15

2.3 Experimental Procedures 16

2.4 Statistical Analyses 17

3. Results 20

3.1 Experiment 1: Sprague-Dawley Strain 20

3.1.1 Reward Probability Training 20

3.1.2 Locomotor Activity: Habituation 21

3.1.3 Locomotor Activity: Acute Amphetamine Challenge 22

3.1.4 Locomotor Activity: Amphetamine Sensitization 22

iv

Page 5: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

3.1.5 Locomotor Activity: AMPH Challenge Retest 22

3.2 Experiment 2: Lewis Strain 24

3.2.1 Reward Probability Training 24

3.2.2 Locomotor Activity: Habituation 25

3.2.3 Locomotor Activity: Acute Amphetamine Challenge 25

3.2.4 Locomotor Activity: Amphetamine Sensitization 26

3.2.5 Locomotor Activity: AMPH Challenge Retest 26

4. Discussion 28

4.1 Experiment 1: Sprague-Dawley Strain 29

4.1.1 Reward Probability Training 29

4.1.2 Habituation 30

4.1.3 Locomotor Response to Amphetamine 31

4.2 Experiment 2: Lewis Strain 32

4.2.1 Reward Probability Training 32

4.2.2 Habituation 34

4.2.3 Locomotor Response to Amphetamine 34

4.3 Strain Characteristics 35

4.4 Conclusion 36

5. References 43

6. Figure Captions 50

7. Figures 53

v

Page 6: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

vi

List of Figures

Figure 1: Experimental Design

Figure 2A: Sprague-Dawley Nose Pokes during Conditioned Stimulus Presentation

Figure 2B: Sprague-Dawley Nose Pokes Prior to Conditioned Stimulus Presentation

Figure 3: Sprague-Dawley Locomotor Response during First Habituation Session

Figure 4: Sprague-Dawley Locomotor Response across Three Habituation Sessions

Figure 5: Sprague-Dawley Locomotor Response to Saline and First Amphetamine Challenge

Figure 6: Sprague-Dawley Locomotor Response across Amphetamine Sensitization Regime

Figure 7: Sprague-Dawley Locomotor Response during Second Amphetamine Challenge

Figure 8: Sprague-Dawley Locomotor Response to First and Second Amphetamine

Challenge

Figure 9A: Lewis Nose Pokes during Conditioned Stimulus Presentation

Figure 9B: Lewis Nose Pokes Prior to Conditioned Stimulus Presentation

Figure 10: Lewis Locomotor Response during First Habituation Session

Figure 11: Lewis Locomotor Response across Three Habituation Sessions

Figure 12: Lewis Locomotor Response to Saline and First Amphetamine Challenge

Figure 13: Lewis Locomotor Response across Amphetamine Sensitization Regime

Figure 14: Lewis Locomotor Response during Second Amphetamine Challenge

Figure 15: Lewis Locomotor Response to First and Second Amphetamine Challenge

Page 7: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 1

The Effect of Repeated Exposure to Unpredictable Reward

on Dopamine Neuroplasticity

1.1 Objective

Addiction has been defined as a compulsive pattern of drug-seeking and drug-taking

behaviour that occurs at the expense of most other activities and persists despite adverse

consequences (Robinson & Berridge, 2003). Addiction research traditionally focused solely on

drugs of abuse such as morphine, cocaine, amphetamine (AMPH) and alcohol. Recently both

researchers and clinicians have proposed that the term addiction be expanded to include a variety

of non-drug-related behaviours, such as pathological gambling (Martin & Petry, 2005; Petry

2006). Pathological gambling is a persistent and recurrent maladaptive gambling behaviour,

affecting between 0.5 to 1% of the adult population, that disrupts social, occupational, and

financial functioning (DSM-IV-TR, 2000; Statistics Canada, 2004). Although pathological

gambling is currently classified as an impulse disorder, research indicates that it shares many

diagnostic features with drug addiction, including compulsive reward seeking, tolerance (a need

to increase the wager or frequency of gambling), withdrawal (restlessness or irritability when

prevented from gambling), unsuccessful efforts to reduce or stop the behaviour, and forgoing

social, occupational, or recreational activities (in order to gamble) (DSM-IV-TR, 2000; Potenza,

2008).

According to the Incentive Sensitization Theory of Addiction (Robinson & Berridge, 1993)

repeated exposure to addictive drugs results in increased drug craving or “wanting” that is

independent from the pleasurable effects of the drug. It has been proposed that enduring

hypersensitivities (or sensitization) of the reward-related dopamine pathway in the brain, from

repeated drug administration, causes drugs to become compulsively and enduringly “wanted”

Page 8: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 2

mediating the transition from casual drug use to drug addiction. If pathological gambling should

be characterized as a behavioural addiction, then gambling-like stimuli should act on and alter

this system in a manner similar to that seen with drugs of abuse.

Animal models can play an important role in unraveling the complex neurobiological

processes underlying pathological gambling. These models allow for the development and direct

testing of hypotheses about the neural mechanisms responsible for certain pathologies

(Szechtman & Eilam, 2005). For example, the notion that dopamine is implicated in the

rewarding properties of a variety of drugs of abuse was derived from studies that demonstrated

that disruption of the dopamine system attenuates drug-conditioned place preference and drug

reinforcement (Acquas, Carboni, Leone, & Chiara, 1989; Spyraki, Fibiger, & Phillips, 1983;

Yokel & Wise, 1976). Animal models can also be used to screen candidate medications and to

assist in understanding the pharmacodynamics of these drugs. For example, the drug

reinstatement procedure, an animal model of drug relapse, has played an important role in the

development of methadone and buprenorphine used in the treatment of opiate addiction (Epstein,

Preston, Stewart, & Shaham, 2006). It is likely that an animal model of the fundamental features

of gambling will be necessary for understanding the basic neurobiology of pathological gambling

and its possible relation to drug addiction. The purpose of the present study is to investigate

whether repeated exposure to gambling-like stimuli, characterized by unpredictable reward,

results in sensitization of the dopamine pathways, as assessed by an increased sensitivity to an

AMPH challenge and greater susceptibility to AMPH sensitization in two different strains of

rats. These findings may provide an animal model for the compulsive reward-seeking believed to

underlie pathological gambling in humans.

Page 9: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 3

1.2 Mesolimbic Dopamine and its Role in Addiction

The mesolimbic dopamine pathway is one of the primary pathways involved in reward

(for review see Berridge, 2007). It originates in the ventral tegmental area (VTA) of the midbrain

and innervates several structures of the limbic system, including the nucleus accumbens (N.Acc.)

and prefrontal cortex. It has been established that all addictive drugs, regardless of their primary

neurochemical actions, either directly or indirectly increase neurotransmission of dopamine in

this pathway (Hyman, Malenka, & Nesler, 2006). For example, the psychostimulant drug AMPH

increases dopamine transmission by entering dopamine neurons and interacting with the

dopamine transporter (DAT) to reverse transport of dopamine out of the neuron into the synapse

(Azzaro & Rutledge, 1973; Besson, Cheramy, & Glowinski, 1969). Heroin, an opiate narcotic,

increases dopamine firing in the mesolimbic pathway indirectly by decreasing inhibitory

GABAergic neurotransmission, thus disinhibiting dopamine neurons in the VTA, which then

releases dopamine in the N.Acc. (Johnson, & North, 1992).

Despite the enormous research focus on dopamine and its known role in reward, debate

continues over the precise causal contribution made by mesolimbic dopamingeric neurons to

reward in general and to drug addiction in particular (Berridge, 2007). Dopamine activation in

response to drugs of abuse was originally thought to represent the hedonic (pleasurable) effects

of the drug; hence addiction resulted from the desire to obtain pleasure (Wise, 1982). This

hypothesis however has been shown to be unlikely since animals can display hedonic responses

to both natural rewards and drugs of abuse in the absence of dopamine. Both pharmacological

blocking of dopamine neurotransmission and lesions of dopamine terminals in the N.Acc. fail to

alter hedonic preferences for sucrose in rats (Peciña, Berridge, & Parker, 1997; Berridge &

Robinson, 1998). In addition, dopamine-deficient mice display a robust conditioned place

Page 10: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 4

preference (an indirect measure of hedonic value) for morphine when given caffeine, which

stimulates locomotion in the absence of dopamine, suggesting that the hedonic experience of

morphine is independent from dopamine release (Hnasko, Sotak, & Palmiter, 2005).

Recent evidence in humans also indicates that dopamine may not mediate the subjective

pleasurable effects of drugs of abuse. Leyton et al., (2002) found that dopamine levels in the

mesolimbic pathway of healthy male volunteers, as measured by positron emission tomography

(PET), correlated significantly with drug “wanting” as oppose to drug “liking”. This finding has

been replicated in patients with Parkinson’s disease who show an addiction-like phenomenon

called dopamine dysregulation syndrome. These patients compulsively consume greater amounts

of their dopaminergic medication (L-DOPA) than prescribed, despite the external appearance of

being well-medicated and the disabling drug-induced effects of abnormal involuntary

movements. Using PET, Evans et al., (2006) found that these patients displayed enhanced

dopamine release in the mesolimbic pathway when challenged with an oral dose of L-DOPA

compared to other Parkinson’s patients. Importantly, the excessive dopamine release measured

by the PET correlated with self-reported compulsive drug “wanting” but not “liking”.

Experimental evidence indicating that dopamine affects “wanting” for drugs and that this is

dissociable from the drug’s subjective pleasurable effects has led Berridge and Robinson (1998)

to propose that dopamine transmission in the mesolimbic pathway mediates the assignment of

incentive salience or “wanting” for drugs and drug-related stimuli. The Incentive Sensitization

Theory of Addiction (Berridge & Robinson, 1993) posits that repeated intermittent drug-use

enhances mesolimbic dopamine release, resulting in neuroadaptations to this system, which

renders it hypersensitive or sensitized causing pathological incentive salience or “wanting”

motivation for drugs and drug-associated cues. They further argue that it is this sensitization of

Page 11: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 5

the mesolimbic dopamine system that produces excessive drug craving triggering addictive

behaviour. This implies that addiction is caused primarily by neuroplastic changes in the

functioning of the dopamine system resulting from repeated experience with drugs.

1.3 Sensitization

Sensitization refers to the increased behavioural and neurochemical response to the effects of

a drug following its repeated intermittent administration. A common behavioural manifestation

of sensitization to many drugs of abuse is a progressive and enduring enhancement of their

psychomotor activating effects after repeated drug administration (Stewart & Badiani, 1993).

This behavioural sensitization has been extensively studied under experimental conditions in

animals. It has been well established that repeated injections of psychomotor stimulant drugs,

such as AMPH, result in increased locomotor activity in rats relative to the first exposure, when

challenged with the drug at a later time (Robinson & Becker, 1986; Anagnostaras & Robinson,

1996). Research has also revealed that sensitization is remarkably persistent. Psychomotor

sensitization in animals has been shown to endure for months to years after drug treatment is

discontinued (Paulson, Camp, & Robinson, 1991).

Recently, direct evidence for AMPH-induced sensitization has also been demonstrated in

humans (Strakowski & Sax, 1998; Boileau et al., 2006). For example, Strakowski and Sax

(1998) found that both eye-blink rate and motor activity in drug-naïve participants progressively

increased with each exposure when given three single low doses of AMPH at 48-hour intervals.

Similar behavioural findings were reported by Boileau et al., (2006), when they administered

three single doses of AMPH to healthy participants on alternating days. Consistent with

behavioural sensitization, participants showed an increased eye-blink response across exposures

and after a two-week latency period. This increased psychomotor response was still present with

Page 12: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 6

AMPH re-exposure one year later indicating that sensitization after repeated AMPH

administrations in humans is also long-lasting.

Sensitization of psychomotor behaviours reflects reorganization and enhanced sensitivity

(sensitization) of the brain’s reward system (Robinson & Kolb, 1997; Lorrain, Arnold, & Vezina,

2000). The reward system includes the mesolimbic dopamine pathway, in addition to dopamine

projections to prefrontal cortex, and glutamate innervations from the prefrontal cortex, amygdala

and hippocampus to N.Acc. (Robinson & Berridge, 2003). Neural sensitization is shown by an

enhanced ability of a number of drugs to increase extracellular levels of dopamine in the N.Acc.

(Lorrain, Arnold & Vezina, 2000; Vezina, Lorrain, Arnold, Austin, & Suto, 2002), in addition to

a variety of molecular, morphological and neurochemical changes that extend beyond the

dopamine system (Nestler, 2001; Robinson & Kolb, 1997; Everitt & Wolf, 2002). For example,

repeated exposure to AMPH has been shown to decrease the sensitivity of metabotropic

glutamate receptors in the ventral tegmental area (Wolf, 1998) and to increase the length of

dendrites and the density of dendritic spines in the N.Acc. and prefrontal cortex (Robinson &

Kolb, 1997). The sensitization related structural changes to dendrites in the reward pathway are

thought to reflect changes in synaptic connectivity, and therefore may alter information

processing within this brain region (Robinson & Berridge, 2003).

1.4 Cross-sensitization

Both humans and animals sensitized to one substance often show cross-sensitization to a

different drug or substance (Stewart & Badiani, 1993). This phenomenon has been demonstrated

most often with several different classes of drugs of abuse. For example, chronic treatment with

either morphine or caffeine has been shown to enhance the locomotor response to AMPH

(Vezina, Giovino, Wise, & Stewart, 1989; Cauli, Pinna, Valentini, & Morelli, 2003). Cross-

Page 13: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 7

sensitization can also occur between drugs of abuse and other non-drug rewarding events. For

example, a diet of intermittently high sugar consumption produces behavioral cross-sensitization

to a low dose of AMPH (Avena & Hoebel, 2003b), and animals sensitized to AMPH display

enhanced appetitive behaviour for sexual reward (Nocjar & Panksepp, 2002). Cross-sensitization

is thought to occur when different drugs or substances activate overlapping components of, or

the same, neural circuitry (Nestler, 2005). Therefore, cross-sensitization between a non-drug

manipulation and an addictive substance can be taken as evidence that the manipulation induced

similar neural adaptations as repeated drug administrations (Avena & Hoebel, 2003a).

1.5 Comorbidity between Gambling and Drug Use

Considerable epidemiological and clinical research has shown that pathological gambling

and substance use disorders often co-occur (for review see Petry, 2007). Research reports higher

rates of alcoholism and other substance use among problem gamblers than among the general

population. In the Canadian Community Health Survey, Statistics Canada (2002) reported that 15

percent of problem gamblers also suffered from alcohol dependence, compared to two percent of

non-gamblers. Data from a survey of 2,016 adults in Ontario also demonstrated a strong

association between alcohol use and gambling (Smart & Ferris, 1996). Using logistic regression

models the authors reported that alcohol dependence was a significant predictor of future

gambling problems. Gambling is also related to other drug use problems. From a sample of 580

individuals admitted to a Canadian residential addictions program, Toneatto & Brennan (2002)

found that the rate of pathological gambling was considerably higher for cannabis (24%),

cocaine (11.5%) and opiate (4.8%) abusers than the rate found in the general population. These

high rates of comorbidity between pathological gambling and drug addiction suggest that these

Page 14: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 8

two psychiatric disorders may be linked by some shared neurobiology. It may be that both are

associated with alterations in some of the same neurotransmitter systems.

1.6 Dopamine and Gambling

Most drugs of abuse elicit dopamine release unconditionally; in time, this leads to

sensitization of dopamine pathways (Vezina, 2007). Indirect evidence in humans indicates that

dopamine may be implicated in gambling behaviours and may be altered in individuals who

suffer from pathological gambling. Plasma concentrations of dopamine, although a weak

indicator of neural dopamine activity, is elevated in healthy participants while playing Pachinko,

a Japanese gambling game, which is essentially a combination of pinball and slots (Shinohara, et

al., 1999). Neuroimaging studies of healthy volunteers indicate that cues associated with the

delivery of monetary reward result in activation of the ventral striatum, a region of the brain

containing the N.Acc. and innervated by dopamine neurons (Knutson, Fong, Adams, Varner, &

Hommer, 2001). Pathological gamblers, compared to healthy controls, show reduced activation

of the ventral striatum during a simulated gambling paradigm where the probability of reward is

at maximum uncertainty--that is probability of reward was 50% (Reuter et al., 2005). In the same

study, gambling severity among pathological gamblers was inversely correlated with responses

in this brain region. The finding of relatively diminished activation in the ventral striatum of

severe pathological gamblers parallels findings from studies of reward anticipation in individuals

with drug addiction. For example, reduced activation of the ventral striatum during anticipation

of monetary gain has been reported in individuals with alcohol and cocaine dependence (Wrase,

et al., 2007; Potenza, 2008). The findings from neuroimaging studies suggest that gambling-like

stimuli may alter reward systems in a manner similar to that seen with drugs of abuse. The

specific role of dopamine, however, cannot be fully established from these results, since other

Page 15: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 9

neurotransmitters apart from dopamine, including glutamate and opioids, innervate these brain

regions. Furthermore, it is unclear whether activational differences in pathological gamblers,

compared to controls, existed prior to their involvement with gambling or whether these altered

responses resulted from gambling exposure (Zack, 2008).

Natural rewards, such as food, water, and sex, initially cause dopamine release. In contrast to

drugs of abuse, dopamine release induced by natural rewards diminishes with repeated exposure

(Avena, Rada, Hoebel, 2008). Recently, electrophysiological studies have shown that midbrain

dopamine neurons consistently respond to natural rewards if they are unexpected (Fiorillo,

Tobler, & Schultz, 2003; Fiorillo, Newsome & Schultz, 2008). It has been suggested that

dopamine neurons encode a ‘reward prediction error’: the difference between the probability of

an expected reward and the actual outcome (Waelti, Dickson, & Schultz, 2001). This information

is then subsequently used as a teaching signal in order to improve future predictions (Shizgal &

Arvanitogiannis, 2003). Thus, when an unpredicted (surprise) reward is first presented, it elicits

strong firing of dopaminergic neurons. With repeated presentation, cues (conditioned stimuli)

that reliably predict the occurrence of the reward become capable of activating these dopamine

neurons, while the reward itself, now redundant, elicits weaker activation. Fiorillo, et al., (2003;

2008) found that midbrain dopamine neuron firing after conditioned stimulus (CS) presentation

increased as a function of reward uncertainty. According to the authors, when a CS completely

predicts a particular outcome, probability=0.0 (no reward) or probability=1.0 (certain reward),

post-CS dopamine activation is negligible. In contrast, if a CS signals the maximum uncertainty,

probability = 0.5, when a reward is equally likely to be delivered or absent, post-CS dopamine

firing is maximal. At intermediate uncertainty, probability = 0.25 or probability = 0.75, post-CS

dopamine firing is moderate. These findings suggest that dopamine is repeatedly elevated during

Page 16: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 10

gambling due to uncertain reward. This uncertainty-induced increase in dopamine can lead to

sensitization, which could explain the allure of gambling and the compulsive pattern of reward

seeking found in pathological gamblers.

1.7 Genetic Factors in Pathological Gambling

The results from Fiorillo et al. (2003, 2008) suggest a possible neurobiological mechanism,

dopamine sensitization, which could contribute to the development of pathological gambling.

However, these results do not explain the fact that the majority of Canadian adults participate in

some form of gambling and most do so without encountering significant problems (Canadian

Gaming Association, 2007). It is estimated that only 5% of the adult population exhibit

behaviours that would classify them as being either at-risk or problem gamblers (Statistics

Canada, 2007) and between 0.5 to 1% of adults go on to develop pathological gambling, the

most severe form of problem gambling (National Council of Welfare, 1996). A key question in

problem gambling research, therefore, is why do some individuals develop this persistent and

recurrent maladaptive behaviour while others remain unaffected.

Although environmental factors are involved in the etiology of pathological gambling

(Blaszczynski, & Nower, 2002), genetic factors are also thought to contribute to an individual’s

vulnerability to develop this disorder. Elevated rates of problem and pathological gambling have

been found in male monozygotic twins, compared to dizygotic twins, when their fathers were

problem or pathological gamblers (Eisen, et al., 1998). Biological investigations have suggested

that a shared genetic vulnerability could be a factor in explaining the similarities and high rates

of co-morbidity between substance use disorders and pathological gambling. One study of male

twins found that between 12% and 20% of the genetic variation in the risk for pathological

gambling was accounted for by the risk for alcohol dependence (Slutske, et al., 2000).

Page 17: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 11

Ascertaining genetic vulnerabilities that contribute to the development of pathological gambling

in humans is difficult due to an inability to control environmental factors and to directly establish

the relative genetic contribution (Shah, Eisen, Xian & Potenza, 2005). However, the role genetic

factors play in this susceptibility can potentially be evaluated by examining neurobiological

differences between a heterogeneous outbred and a genetically-uniform inbred strain and relating

these differences to particular behaviours.

1.8 Lewis Inbred Strain

A common strategy used to examine genetic contributions to a particular disorder has been to

compared inbred Lewis (LEW) with Fisher 344 (F344) rats, since both strains are derived from

Sprague-Dawley’s (SD) yet they show marked differences in their behavioural and

neurochemical responses to stress and a variety of addictive substances (for review see Kosten &

Ambrosio, 2002). LEW rats acquire self-administration of opiates (Ambrosio, Goldberg, &

Elmer, 1995; Martin, et al.,1999), cocaine (Kosten, et al., 1997; Kosten Freeman, Kearns, Kohut,

& Riley, 2009), and alcohol (Suzuki, George, & Meisch, 1988 ) faster and display greater

conditioned place preference for morphine (Guitart, Beitner-Johnson, Marby, Kosten, & Nestler,

1992), cocaine (Kosten, Miserendino, Chi & Nesler, 1994) and nicotine (Horan, Smith, Gardner,

Lepore, & Ashby, 1997) compared to F344 rats. LEW rats display greater behavioural

sensitization to methamphetamine, exhibiting lower levels of activity initially that increase with

repeated drug administrations, (Camp, Browman, & Robinson, 1994), and to low and high doses

of cocaine (Kosten et al., 1994; Haile, Hiroi, Nestler, & Kosten, 2001). In addition, LEW rats

have a greater preference for naturally rewarding behaviours such as running. When given free

access to running wheels LEW rats will run excessively covering approximately 10 km per day

compared to F344 rats who run considerable less averaging 1.5km per day (Werme, Thoren,

Page 18: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 12

Olson, & Brene 1999; Werme, et al., 2002). These studies have led some researchers to suggest

that the LEW rat may have a generalizable enhanced sensitivity to the rewarding effects of

addictive drugs and behaviours and may provide a model of genetic vulnerability for factors

related to drug abuse (Nestler, 1992; George, 1993; Werme, et al., 2002).

Like substance addictions, pathological gambling is thought to involve disturbances in

dopamine function (Reuter et al., 2005; Steeves, et al., 2009). Drug-naive LEW rats display

many features in the mesolimbic dopamine pathway that are similar to those of addicted SD rats

(Nestler, 1992). Tyrosine hydroxylase (TH), the rate-limiting enzyme for dopamine synthesis, is

lower in the nucleus accumbens and higher in the ventral tegmental area in LEW versus F344

rats (Guitart, et al., 1992; Haile et al., 2001). The level of dopamine transporter, a primary target

for AMPH and cocaine, in both the dorsal striatum and nucleus accumbens is lower in the LEW

versus F344 strain (Flores, Wood, Barbeau, Quirion, & Srivastava 1998; Gulley, Everett, &

Zahniser, 2007). LEW rats have lower dopamine metabolite levels in the nucleus accumbens;

however, they have only slightly lower extracellular dopamine levels compared to F344 rats

(Camp et al., 1994). Finally, LEW compared to F344 rats have lower levels of dopamine D2 and

D3 receptors in the striatum and nucleus accumbens (Flores et al., 1998), a direct site of action

for both AMPH and cocaine (Ferris, Tang, & Maxwell, 1972). These biochemical differences in

the mesolimbic dopamine system between LEW and F344 rats presumably reflect differences in

dopaminergic functioning that could account for their distinctive behavioural responses to drugs

of abuse.

Given the similarities and co-occurrence between pathological gambling and substance

abuse, the role of dopamine in gambling behaviour and the abnormalities in this neurochemical

system in pathological gamblers, and that LEW rats displays greater behavioural sensitization to

Page 19: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 13

psychostimulants and alterations in the mesolimbic dopamine system, when compared to F344

rats, it seems plausible that the addiction-prone LEW rat might be especially sensitive to the

effects of repeated exposure to gambling-like stimuli.

1.9 Purpose

The previous sections have established that repeated exposure to drugs of abuse results in

sensitization of the mesolimbic dopamine pathway, which is thought to underlie drug addiction.

A common behaviour indicator of dopamine sensitization is increased locomotor activity in

response to a psychostimulant challenge. Electrophysiological results have shown that these

same dopamine neurons consistently respond when reward delivery is most uncertain (50%).

This reward schedule closely resembles that found in gambling. Therefore, repeated exposure to

unpredictable reward may result in intermittent increases in dopamine activation that could lead

to sensitization of the mesolimbic dopamine system and could partly explain compulsive reward-

seeking in pathological gamblers. In order to explore this possibility, the present study sought to

examine the effects of repeated exposure to different probabilities of reward delivery on acute

AMPH response and AMPH sensitization in both the outbred SD and inbred LEW strain. This

was achieved by first exposing separate groups of animals to a CS that differentially predicted

sucrose reward on 0, 25%, 50%, 75% and 100% of the trails. One week following the last

training session, animals were tested for their locomotor response to an acute low dose AMPH

challenge. They were then administered a sensitizing regimen of AMPH following by an AMPH

re-challenge.

Page 20: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 14

1.10 Hypotheses

Experiment 1 and Experiment 2 were conducted sequentially, since it was thought that an

effect would be seen in the SD strain. Experiment 2, therefore, was designed based on the results

obtained from Experiment 1.

Experiment 1: Sprague-Dawley Strain

1) It is predicted that repeated exposure to unpredictable reward (50%) should induce

sensitization of the mesolimbic dopamine neurons by virtue of intermittently elevating dopamine

release. Further this should result in an increased sensitivity to the locomotor stimulant effects of

an AMPH challenge (cross-sensitization) and/or facilitate the development of sensitization after

multiple AMPH doses compared to intermediate (25% or 75%) or certain (0 or 100%) reward

probabilities.

Experiment 2: Lewis Strain

1) It is predicted that the vulnerable LEW strain will show sensitization of the

mesolimbic dopamine neurons after repeated exposure to unpredictable reward (50%), resulting

in an increased sensitivity to the locomotor stimulant effects of an AMPH challenge (cross-

sensitization) and/or facilitating the development of sensitization after multiple AMPH doses

compared to intermediate (25% or 75%) or certain (0 or 100%) reward probabilities.

2) It is hypothesized that the inbred LEW strain will display greater sensitivity to an

AMPH challenge and sensitization regime after reward exposure that the outbred SD strain.

Page 21: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 15

Method

2.1 Animals

The experimental procedures followed the guidelines of the Canadian Council on Animal

Care and were approved by the Centre for Addiction and Mental Health Animal Care

Committee. Forty adult male Sprague-Dawley rats (300-350 g upon arrival; Charles River

Laboratories, St. Constant, QC, Canada) and 40 adult male Lewis rats (200-225 g upon arrival;

Charles River Laboratories, St. Constant, QC, Canada) were used. All animals were housed

individually in clear polycarbonate cages (20cm x 43cm x 22cm). The housing room was

maintained at approximately 22°C under a 12:12 light-dark cycle (lights on at 07:00), with

testing occurring during the light phase of the cycle (between 10:00 and 15:00). All rats were

drug-and-behaviourally naïve at the start of the experiment. Except for the one week

acclimatization period during which food and water was freely available, rats were maintained

on five pellets of laboratory chow per day with water freely available.

2.2 Training Apparatus

Training on the reward probability task was conducted in eight operant conditioning

boxes, measuring 33 x 31x 29 cm, (Med Associates, St. Albans, VT). A 5 cm square reinforcer

magazine was centered in the front wall 2.5 cm above the floor. The magazine contained an

infrared photo-detector at the entrance and a light mounted in the roof. A motor-driven dipper

arm could be raised to deliver 0.06 ml of liquid through a hole in the floor of the magazine. Each

operant box was illuminated by a houselight and was enclosed in a sound-attenuating chamber

equipped with a ventilation fan. The boxes were controlled by an IBM-compatible computer

running Med-PC for Windows.

Page 22: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 16

2.3 Experimental Procedures

The effects of repeated unpredictable reward on sensitivity and sensitization to the

locomotor stimulant effect of AMPH in the 1) Sprague-Dawley and 2) Lewis strains were

measured in separate experiments; however the experimental procedures used in each

experiment were the same. A schematic of the experimental design is displayed in Figure 1.

Reward probability training. One day prior to training, rats were provided with free

access to a bottle containing 10% sucrose in the home cage in order to familiarize them with this

solution. In each experiment forty rats were randomly assigned to one of five experimental

conditions: probability of reward delivery: 0, 25%, 50%, 75%, 100% (n=8 per group). Each

session began with the illumination of the houselight, which remained illuminated throughout the

session. All experimental groups received 20 CS presentations (illumination of the magazine

light for 30 seconds). During the last 5 seconds of CS presentation, depending on the

experimental group, sucrose (unconditioned stimulus US) was available in the magazine on 0,

25%, 50%, 75% or 100% of the trials. The sucrose dipper was either raised for sucrose access or

not activated. Nose pokes into the magazine 30 seconds prior to CS presentation (preCS

responses) and during the 30 second CS presentation (CS responses) were measured. Each CS

presentation was separated by a variable interstimulus interval that averaged 90 seconds and

ranged between 30-180 seconds. Each training session lasted 40 minutes, and animals received

15 training sessions in total, five days per week for three weeks. This reward training paradigm

was adapted from previous work with Pavlovian conditioning (Fletcher, Tenn, Sinyard, Rizos, &

Kapur, 2007).

Acute response to low dose amphetamine. Nine days after the last reward training

session, locomotor responses to a threshold AMPH challenge was assessed in standard clear

Page 23: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 17

Plexiglas housing cages (27 x 48 x 20 cm). A row of six infrared photocell emitters and detectors

was positioned along the long axis of the cage, 3 cm above the floor, capable of detecting

horizontal movements. Before any drug treatment was administered all rats were given a 90

minute session to habituate them to the test boxes for three consecutive days. The following day,

rats were placed in the boxes for 30 minutes and received one intraperitoneal (i.p.) vehicle

injection (0.9% saline, 1.0mg/kg) followed by 90 minutes in the box. On the AMPH test day, rats

were given 30 minutes to habituate to the test boxes, then received an i.p. injection of 0.5mg/kg

D-amphetamine sulfate (Sigma-RBI, Oakville, ON) and immediately returned to the boxes(Tenn,

Fletcher, & Kapur, 2003). A computer was used to detect and record the number of photocell

interruptions during the 90-minute post injection period. The amount of locomotion activity was

quantified as the number of beam breaks measured in 5 min intervals.

Sensitization. Three days after the AMPH challenge rats received one i.p. injection of

AMPH (1.0 mg/kg) per day on a Monday, Wednesday, Friday, Monday, Wednesday, for a total

of five exposures. After each AMPH injection rats were immediately tested for their locomotor

response (as described above). This AMPH treatment regime has been previously shown to

produce a long-lasting sensitized locomotor response to AMPH (Fletcher, Tenn, Rizos, Lovic, &

Kapur, 2005). One week after completion of the sensitization regimen, a retest of their locomotor

responses to an AMPH challenge (0.5mg/kg) was conducted. Rats were given 30 minutes to

habituate to the activity boxes, and then received an i.p. injection of 0.5mg/kg D-amphetamine

sulfate (Sigma-RBI, Oakville, ON) and immediately returned to the boxes. A computer was used

to detect and record the number of photocell interruptions during the 90-minute post injection

period. The amount of locomotion activity was quantified as the number of beam breaks

measured in 5 min intervals.

Page 24: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 18

2.4 Statistical Analysis

The effect of repeated unpredictable reward on sensitivity and sensitization to the

locomotor stimulant effect of AMPH (AMPH) in SD and LEW rats was conducted in separate

experiments; therefore results from each experiment were analyzed separately. All statistical

analyses were conducted with SPSS (v.17 SPSS Inc., Chicago IL) with alpha level set at 0.05.

Reward probability training. Nose-poking into the magazine 30 seconds prior to and

during the CS presentation was analyzed by a three-way repeated measures analysis of variance

(ANOVA) with two between-subject factors (group-5 levels, period (preCS and CS)-2 levels)

and one within-subject factor (day-15 levels). Significant interactions were analyzed using

separate two-way repeated measures ANOVAs for the PreCS and CS period with one between-

subject factor (group -5 levels) and one within-subject factor (day-15 levels). Significant

interactions during each period were further analyzed using separate one-way ANOVAs for each

training session followed by post-hoc comparison using Tukey’s HSD test.

Locomotor activity: habituation. Novelty-induced locomotor activity during the first

exposure to the activity boxes was measured every five minutes for a 90-minute period and

analyzed by a two-way repeated measures ANOVA with one between-subject factor (group -5

levels) and one within-subject factor (5-min periods for 90 mins -18 levels). Habituation to the

activity boxes over the three sessions was assessed by a two-way repeated measures ANOVA

with one between-subject factor (group --5 levels) and one within-subject factor (sessions -3

levels).

Locomotor activity: acute AMPH challenge. A two-way repeated measures ANOVA with

one between-subject factor (group -5 levels) and one within-subject factor (5-min periods for 90

mins -18 levels) assessed locomotion over a 90-minute period post AMPH injection. To analyze

Page 25: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 19

the locomotor response to AMPH treatment a two-way repeated measures ANOVA with one

between-subject factor (group -5 levels) and one within- subject factor (vehicle, AMPH—2

levels) assessed locomotion over the 90 minute period post vehicle and AMPH injection.

Locomotor activity: AMPH sensitization. Locomotor responses to 1.0mg/kg AMPH

across the five test sessions was analyzed with a two-way repeated measures ANOVA with one

between-subject factor (group -5 levels) and one within-subject factor (test session -5 levels).

Locomotor activity: AMPH challenge retest. A two-way repeated measures ANOVA

with one between-subject factor (group --5 levels) and one within-subject factor (5-min periods

for 90 mins --18 levels) assessed locomotion over a 90-minute period post injection. To analyze

sensitization, a two-way repeated measures ANOVA with one between-subject factor (group --5

levels) and one within-subject factor (drug challenge --2 levels) compared the initial 0.5mg/kg

AMPH challenge to the 0.5mg/kg AMPH retest post sensitization regime.

Page 26: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 20

Results

3.1 Experiment 1

The Effect of Repeated Exposure to Unpredictable Reward

on Dopamine Neuroplasticity in Sprague-Dawley Rats

3.1.1 Reward Probability Training

Cumulative nose-poking during the 30-second PreCS period and cumulative nose-poking

during the 30-second CS period were analyzed for all groups across the 15 training sessions. The

results revealed a significant main effect of period (F(1,35)=34.25, p<0.001), indicating that all

animals performed significantly more nose pokes during the CS period compared to the PreCS

period. In addition, a significant main effect of group (F(1,35)=5.40, p<0.01), a significant

period x group interaction (F(4,35)=4.73, p<0.01), a significant day x period interaction

(F(14,56)=3.57, p<0.001) and a significant day x period x group interaction F(56,490)=1.87,

p<0.001) was found, thus indicating that the rate of nose-poke responses was influenced by

group as well as by session.

Figure 2 A and B show cumulative nose pokes during the PreCS and CS period for all

groups across training sessions. It can been seen from Figure 2A that after four days of reward

training, rats exposed to 100% probability of reward showed a significantly higher level of nose-

poking during the CS presentation compared to rats exposed to 0 or 25% probability of reward

(F(4,35) =4.34, p<0.01). This pattern of behaviour continued until the eighth day of reward

training, where rats exposed to 75% probability of reward displayed an increase in nose-poking

during the CS presentation compared to rats exposed to 0 or 25% probability of reward (F(4,39)

=4.49, p<0.01), reaching similar levels as rats exposed to100% reward. Rats exposed to 50%

Page 27: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 21

probability of reward showed a stable midrange pattern of nose-poking behaviour during the CS

periods throughout the training.

During the PreCS period animals exposed to 75% or 100% probability of reward delivery

displayed a higher rate of nose-poking than animals exposed to 0 or 25% probability of reward

(Group F(4,39) =6.34, p<0.01); however, the amount of nose-poking for both the 75% and 100%

groups was significantly less than that displayed during the CS period (75% group F(1,7)=9.11,

p<0.05; 100% group F(1,7)=11.88, p<0.01). Across the 15 sessions there was an initial increase

in nose-poking behaviour during the PreCS period followed by a decrease and then plateau at a

stable low rate of responses (Day F(14,490) =2.24, p<0.01) (Fig. 2B).

3.1.2 Locomotor Activity: Habituation

A two-way repeated measures ANOVA of beam breaks during the initial habituation to

the activity boxes revealed a significant main effect of time (F(17, 595) =89.84, p<0.001),

reflecting a decline in locomotion during the session (Fig. 3). No significant main effect of group

(F(4, 35) =0.57, p=n.s) or significant time x group interaction (F(68, 595) =1.04, p=n.s) was

found, indicating that initial exposure to the activity boxes was not affected by reward

experience.

A two-way repeated measures ANOVA of locomotor response across the three

habituations sessions yielded a significant main effect of session (F(2, 70) =60.01, p<0.001),

indicating a decline in locomotion over the sessions (Fig. 4). No other significant effects (group

main effect (F(4,35) =0.62, p=n.s) and time x group interaction (F(8, 70) =0.38, p=n.s) were

found, indicating that habituation was not affected by reward experience.

Page 28: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 22

3.1.3 Locomotor Activity: Acute AMPH Challenge

A two-way repeated measures ANOVA revealed a significant main effect of time (F(17,

595) =6.42, p<0.001), reflecting a reduction in locomotor activity over time. No significant main

effect of group (F(4,35) =0.62, p=n.s) or significant time x group interaction (F(68, 595) =0.86,

p=n.s) was found, indicating that locomotor response to an acute AMPH challenge was not

affected by reward experience.

Compared to the vehicle injection, all groups displayed a significant increase in

locomotor response to AMPH (Fig. 5). A two-way repeated measures ANOVA revealed a

significant main effect of treatment (F(1, 35) =213.44, p<0.001), but no other significant effects

(group main effect (F(4,35) =0.70, p=n.s) and treatment x group interaction (F(8, 70) =0.52,

p=n.s).

3.1.4 Locomotor Activity: AMPH Sensitization

A two-way repeated measures ANOVA of locomotor response to a 1 mg/kg dose of

AMPH over five exposures revealed a significant main effect of test session (F(4,140) =6.72,

p<0.001), indicating that locomotor activity increased in all groups over sessions (Fig. 6).

No significant main effect of group (F(4,35) =0.44, p=n.s) or significant test session by group

interaction (F(16,140) =1.57, p=n.s) was found, indicating that locomotor activity to a 1 mg/kg

dose of AMPH over five exposures was not affected by reward experience.

3.1.5 Locomotor activity: AMPH challenge retest.

Figure 7 shows the 90-minute time course of the locomotor response to the AMPH

challenge post sensitization. A two-way repeated measures ANOVA revealed a significant main

effect of time (F(17, 595) =17.07, p<0.001), reflecting a reduction in locomotor activity over

time. No significant main effect of groups (F(4,35) =0.99, p=n.s) or significant time x group

Page 29: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 23

interaction (F(68, 595) =1.19, p=n.s) was found, indicating that locomotor response to the

AMPH challenge post sensitization was not affected by reward exposure.

To confirm that the AMPH treatment regime induced a sensitized state, the locomotor

data from the first challenge were compared to the second challenge. A two-way ANOVA

revealed a significant main effect of drug challenge (F(1,35) =76.26, p=0.00), but no significant

main effect of group (F(4,35) =0.84, p=n.s) or significant challenge x group interaction (F(4,35)

=0.87, p=n.s). These results indicate that a significant increase in locomotor response to the

0.5mg/kg AMPH challenge post sensitization regime occurred when compared to the initial

AMPH challenge; however, this response was not influence by reward experience (Fig. 8).

Page 30: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 24

3.2 Experiment 2

The Effect of Repeated Exposure to Unpredictable Reward

on Dopamine Neuroplasticity in Lewis Rats

3.2.1 Reward Probability Training

Cumulative nose-poking during the 30-second PreCS period and cumulative nose-poking

during the 30-second CS period were analyzed for all groups across the 15 training sessions. The

results revealed a significant main effect of period (F(1,35)=23.25, p<0.001), indicating that all

animals performed significantly more nose pokes during the CS period compared to the PreCS

period. In addition, a significant main effect of day (F(14,490)=3.17, p<0.001), a significant

main effect of group (F(4,35)=6.38, p<0.001), a significant day x group interaction

(F(56,490)=3.17, p<0.05), a significant period x group interaction(F(4,35)=4.58, p<0.01), a

significant day x period interaction (F(14,56)=2.89 p<0.001) and a significant day x period x

group interaction F(56,490)=1.59, p<0.001) was found, thus indicating that the rate of nose-poke

responses was influenced by group as well as by session.

Figure 9 A and B show cumulative nose pokes during the PreCS and CS period for all

groups across training sessions. It can been seen from Figure 9A that initially all groups except

for rats exposed to 100% probability of reward showed little nose-poking behaviour during the

CS period. After five days of training rats exposed to100% probability of reward showed a

significantly higher level of nose-poking during this period compared to all other groups

(F(4,39) =3.10, p<0.05). By the seventh day of training, rats exposed to 75% probability of

reward showed enhanced nose-poking behaviour during the CS period compared to the 0

probability of reward group (F(4,39) =6.35, p<0.01), while all other groups remained stable. This

pattern of behaviour continued until the thirteenth day of training, when rats exposed to 50%

Page 31: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 25

probability of reward gradually increased nose-poking and rats exposed to 75% probability of

reward decreased this behaviour responding at levels similar to the 50% group.

Nose-poking behaviour during the PreCS period varied across days (Day F(14,490)

=3.08, p<0.01) (Fig. 9B). Animals exposed to 100% probability of reward performed more nose-

pokes during this period than groups exposed to 0, 25% or 50% probability of reward (Group

F(4,35) =7.24, p<0.01); however, the amount of nose-poking for the 100% group was

significantly less than that displayed during the CS period (F(1,9)=9.14 p<0.05).

3.2.2 Locomotor Activity: Habituation

A two-way repeated measures ANOVA of locomotor response during the initial

habituation to the activity boxes revealed a significant main effect of time (F(17,595) =85.13,

p<0.001), reflecting a decline in locomotion during the session (Fig. 10). No significant main

effect of group (F(4,35) =0.58, p=n.s) or significant time x group interaction (F(68,595) =0.85,

p=n.s) was found, indicating that initial exposure to the activity boxes was not affected by

reward experience.

A two-way repeated measures ANOVA of locomotor response across the three

habituations sessions yielded a significant main effect of session (F(2,70) =22.39, p<0.001),

indicating a decline in locomotion over the sessions (Fig. 11). No other significant effect (group

main effect (F(4,35) =0.41, p=n.s) and time x group interaction (F(8,70) =1.09, p=n.s) was

found, indicating that habituation was not affected by reward experience.

3.2.3 Locomotor Activity: Acute AMPH Challenge

A two-way repeated measures ANOVA revealed a significant main effect of time (F(17,

595) =13.24, p<0.001), reflecting a reduction in locomotor activity over time. No significant

main effect of group (F(4,35) =0.33, p=n.s) or significant time x group interaction (F(68, 595)

Page 32: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 26

=0.94, p=n.s) was found, indicating that locomotor response to an acute AMPH challenge was

not affected by reward experience.

Compared to the vehicle injection, all groups displayed a significant increase in

locomotor response to AMPH (Fig. 12) A two-way repeated measures ANOVA revealed a

significant main effect of treatment (F(1, 35) =289.11, p<0.001), but no other significant effects

(group main effect (F(4,35) =0.87, p=n.s) and treatment x group interaction (F(8, 70) =0.33,

p=n.s).

3.2.4 Locomotor Activity: AMPH Sensitization

A two-way repeated measures ANOVA of locomotor response to a 1 mg/kg dose of

AMPH over five exposures revealed a significant main effect of test session (F(4,140) =7.10,

p<0.001), indicating an increase in locomotor activity in all groups over sessions (Fig. 13). No

significant main effect of group (F(4,35) =0.67, p=n.s) or significant test session by group

interaction (F(16,140) =0.66, p=n.s) was found, indicating that locomotor activity to a 1 mg/kg

dose of AMPH over five exposures was not affected by reward experience.

3.2.5 Locomotor Activity: AMPH Challenge Retest

Figure 14 shows the 90-minute time course of the locomotor response to the AMPH

challenge post sensitization. A two-way repeated measures ANOVA revealed a significant main

effect of time (F(17, 595)=21.99, p<0.001), reflecting a reduction in locomotor activity over

time. No significant main effect of group (F(4,35)=1.05, p=n.s) or significant time x group

interaction (F(68, 595)=0.76, p=n.s) was found, indicating that locomotor response to the AMPH

challenge post sensitization was not affected by reward experience.

Page 33: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 27

To confirm that the AMPH treatment regime induced a sensitized state the locomotor

data from the first challenge was compared to the second challenge. A two-way ANOVA

revealed a significant main effect of drug challenge (F(1,35)=93.40, p=0.00), but no significant

main effect of group (F(4,35)=0.55, p=n.s) or significant challenge x group interaction

(F(4,35)=1.02, p=n.s). These results indicate that a significant increase in locomotor response to

the 0.5mg/kg AMPH challenge post sensitization regime occurred when compared to the initial

AMPH challenge; however this response was not influenced by reward experience (Fig. 15).

Page 34: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 28

Discussion

Recurrent dopamine release induced by repeated exposure to drugs of abuse leads to

sensitization of the dopamine pathways. This process has been proposed to underlie compulsive

drug-seeking and drug-taking behaviour (Robinson & Berridge, 2000). Exposure to a CS for a

non-drug reward when the probability of reward delivery is at maximum uncertainty (50%) also

leads to high levels of midbrain dopamine activation (Fiorillo et al., 2003, 2008). Reward

unpredictability is a distinguishing feature of gambling, suggesting that repeated exposure to

gambling or gambling-like stimuli could lead to intermittent elevations in dopamine and thus to

sensitization of the dopamine pathways. This repeated uncertainty-induced increase in dopamine

could contribute to the compulsive pattern of reward-seeking behaviour seen in pathological

gamblers.

The present study sought to determine whether repeated exposure to unpredictable

reward (50%) induces sensitization of mesolimbic dopamine neurons in SD and LEW rats. This

was done by repeatedly pairing a CS (illumination of the magazine light) with differing

probabilities of sucrose reward (0, 25%, 50%, 75%, 100%) and then testing for evidence of

sensitization of mesolimbic dopamine neurons. Dopamine sensitization was assessed by

locomotor response to; an acute AMPH challenge, repeated AMPH administrations, and an

AMPH challenge retest. It was hypothesized that SD and LEW animals exposed to 50% reward

delivery would display increased sensitivity to the locomotor stimulant effects of the AMPH

challenge and enhanced development of sensitization after multiple AMPH doses compared to

animals exposed to more certain reward schedules. In addition, it was predicted that the

addiction-prone inbred LEW rats would display greater sensitivity to the AMPH challenge and

sensitization regime than the outbred SD rats. The results indicate that unpredictable reward

Page 35: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 29

delivery did not the affect the acute response to AMPH or AMPH sensitization in either strain,

nor were any significant differences between strains in sensitivities to AMPH observed.

4.1 Experiment 1: Sprague-Dawley Strain

4.1.1 Reward Probability Training

All animals, except those exposed to low probabilities (0% and 25%) of reward delivery,

consistently displayed increased nose-poking behaviour during the 30 second CS presentation

compared to 30 seconds prior to CS presentation (PreCS), indicating that for these animals the

CS had acquired motivational significance. It was expected that if the animals had learned

something about the structure of their probability schedule their behavioural responses to the CS,

as measured by nose-poking into the magazine, would be greater under conditions of higher

reward probability. By the 8th day of reward training a clear differentiation in nose-poking

behaviour during the CS presentation emerged, such that animals exposed to 75% or 100%

probability of reward displayed greater nose-poking behaviour than animals exposed to lower

reward probabilities, with the 50% group showing intermediate behavioural responses. This

behavioural distinction between reward probability groups remained consistent throughout the

rest of the reward training. Both the PreCS and CS behavioural distinction and the apparent

group differences in nose-poking behaviour during the CS presentation indicate that the differing

probabilities of reward delivery governed nose-poking behaviour and that the classical

conditioning regime (15 sessions) used was sufficient for probability learning in the SD rats.

4.1.2 Habituation

A number of studies have demonstrated that locomotor response to a novel environment

is predictive of sensitivity to acute AMPH and of the magnitude of sensitization (Piazza,

Deminiere, Le Moal, & Simon, 1989; Exner, & Clark, 1993; Hooks, Jones, Smith, Neill, &

Page 36: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 30

Justice, 1991). Therefore, individual variations in novelty-induced locomotion could moderate

group differences to the reward probability treatment during the AMPH challenge and

sensitization regime. In addition, research indicates that locomotor response to a novel

environment is influenced by dopamine activation. Hooks and Kalivas (1995) found that

microinjections of fluphenazine, a dopamine receptor antagonist, into the N.Acc. prevented

novelty-induced locomotor activity in SD rats, but did not suppress locomotor activity in

previously habituated animals. Reduced novelty-induced locomotor activity was also found in

rats subcutaneously injected with another dopamine receptor antagonist, haloperidol, while an

effect was not seen in similarly treated habituated animals (Bardo, Bowling & Pierce, 1990).

These studies provide pharmacological evidence that locomotor response induced by exposure to

a novel environment is dependent on dopamine. If repeated exposure to differing probabilities of

reward delivery affects dopamine activation, then group differences in locomotor response

during the initial exposure to the activity boxes could reasonably be expected. Our results,

however, showed no group differences in locomotor response during the initial exposure to the

activity boxes or across the three habituation sessions. These results indicate that reward history

did not affect novelty-induced locomotion or the rate of habituation in SD rats.

4.1.3 Locomotor Response to Amphetamine

All reward probability groups responded similarly to the initial AMPH challenge, the

sensitization regime and the AMPH challenge retest. It has been established that locomotor

response to both acute and repeated intermittent AMPH administration is mediated by

mesolimbic dopamine activation (for review see Stewart & Badiani, 1993). Therefore, these

findings indicate that there is no evidence for mesolimbic dopamine alterations after repeated

exposure to unpredictable reward delivery in SD rats. It is important to note that comparison

Page 37: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 31

between the initial and the final AMPH challenge did produce a robust sensitized locomotor

response indicating that the AMPH injection regime used in this experiment was adequate to

induce sensitization in this strain. Therefore, the lack of group differences during the final

AMPH challenge cannot be attributed to a lack of AMPH sensitization.

To the best of our knowledge, this is the first study to use behavioural measures to

examine the effects of maximum uncertainty of reward delivery (50%) on dopamine functioning

in rats. Our findings are in contrast to the electrophysiological results found in primates from

Fiorillo et al., (2003, 2008). This discrepancy, however, could have resulted from

methodological differences. Fiorillo et al., (2003, 2008) directly assessed activation of midbrain

dopamine neurons in primates, via single unit recordings, during a classical conditioning

procedure where unique visual stimuli were associated with differing probabilities of liquid

reward. In contrast, the present study indirectly inferred dopamine activation in rats under

differing conditions of reward probability from their locomotor response to AMPH. Although

this method has been shown to be a valid means of inferring mesolimbic dopamine sensitization

(Lorraine, Arnold, & Vezina, 2000), direct assessment of dopamine levels by microdialysis

might provide a more sensitive and direct measure of subtle group differences in dopamine

function.

Clinical research indicates that only certain susceptible individuals develop gambling

pathology (Potenza, Kosten, & Rounsaville, 2001; Blaszczynski, & Nower, 2002). One possible

reason for the lack of group differences found in the SD rats during the AMPH challenge and

subsequent sensitization in the first experiment could relate to the strain of rat used. Repeated

exposures to unpredictable reward did not increase sensitivity to the locomotor response to an

AMPH challenge or enhance sensitization in the SD rat; this suggests that perhaps dopamine

Page 38: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 32

neuroadaptations due to reward uncertainty might only be induced in a vulnerable strain. The

LEW rat was selected as a plausible “vulnerable candidate” because of: alterations in its

mesolimbic dopamine functioning, its sensitivity to the rewarding effects of a variety of

addictive substances and behaviours and its enhanced behavioural sensitization to

psychostimulants.

4.2 Experiment 2: Lewis Strain

In the second experiment LEW rats underwent the same experimental procedure that had

been used with the SD rats.

4.2.1 Reward Probability Training

By the 12th day of reward training, all animals, except those exposed to low probabilities

(0% and 25%) of reward delivery, displayed increased nose-poking behaviour during the 30

second CS presentation compared to 30 seconds prior to CS presentation (PreCS). These results

indicate that by the end of training the CS had acquired motivational significance for animals

exposed to 50%, 75% or 100% reward delivery. Unlike the SD rats, which showed a clear

divergence between groups in nose-poking during the CS presentation, a divergence of

behavioural responses for LEW rats during the CS presentation between all groups did not

emerge. Although the behavioural responses for LEW rats from the 100% group and

subsequently the 75% group were distinctly higher than the other groups, the 50% group failed to

differentiate from the lower reward probability groups until the second last day of training. The

lack of divergence in nose-poking behaviour during the CS period suggests that LEW rats

exposed to 50% probability of reward may have had difficulty learning the CS-US connection.

It is also possible, however, that the behavioural measure used to assess CS-US learning,

nose-poking into the magazine (which is one of a range of possible conditioned responses), did

Page 39: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 33

not accurately reflect the learning of the CS-US contingency. Research has established that in

rats there are large individual differences in response to cues associated with rewards (Boakes,

1977; Davey & Cleland, 1982; Robinson & Flagell, 2009). Upon cue presentation some animals

will come to approach the cue and engage it, performing a “sign-tracking” conditioned response;

others will not approach the cue, but instead, approach the site of reward delivery, performing a

“goal-tracking” conditioned response (Boakes, 1977).

Visual observation of rats exposed to 50% reward delivery during the final training

session revealed that some animals displayed sign-tracking like behaviour upon CS presentation

(illumination of the magazine light) by nose-poking into the magazine, while others displayed

goal-tracking like behaviour by approaching the magazine upon CS presentation, and only nose-

poking into the magazine when the motor-driven dipper arm was raised in order to retrieve the

liquid sucrose. For these goal oriented animals relatively few nose pokes were performed during

the training session. Therefore, continuous video recording and subsequent scoring of all activity

in the operant boxes during the CS presentation might provide a more valid measure of all

conditioned behaviours. However, in both cases the CS produced a conditioned response directed

either at the CS or at the reward, which suggests that by the end of training the CS had acquired

some predictive value.

4.2.2 Habituation

The group similarities during the initial exposure to the activity boxes and across the

three habituation sessions indicated that reward history did not affect dopamine dependent

novelty-induced locomotor activity or the rate of habituation in the LEW rats.

Page 40: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 34

4.2.3 Locomotor Response to Amphetamine

The lack of significant group differences in response to the initial AMPH challenge, the

sensitization regime and the AMPH challenge retest did not support our hypothesis that

unpredictable reward delivery would alter dopamine activation in LEW rats. Comparison of the

initial and the final AMPH challenge showed a robust sensitized locomotor response indicating

that the AMPH injection regime used in this experiment was adequate to induce sensitization in

this strain. Despite the lack of significant group differences during the sensitization regime and

final AMPH challenge, it is worth noting that by the fifth 1 mg/kg dose of AMPH, there appears

to be a trend where LEW rats exposed to 50% probability of reward displayed slighter greater,

although not significantly greater, locomotor responses than animals under the other probability

conditions (Fig. 13). This suggests that an enhanced dopaminergic tone may be required to reveal

the effects of differing reward probability schedules in this strain. Exposure to a low-dose

AMPH regime prior to reward training, in order to augment dopamine release, might amplify the

slight group differences observed here. In addition, AMPH treatment prior to reward training

might enhance the acquisition of the CS-US contingency. Harmer and Philips (1998)

demonstrated that repeated injections of AMPH (1 injection of 2mg/kg i.p. for 5 days) in rats two

weeks before moderate training (ten 1hr sessions of 13 CS-US trails) on a Pavlovian

conditioning task (light or tone paired with 10% sucrose solution) resulted in more rapid

acquisition of conditioned appetitive approach responses.

4.3 Strain Characteristics

Since the first and second experiments were not conducted simultaneously direct

comparison between strains is impossible; however, it is interesting to note certain distinguishing

strain characteristics. In the reward training portion of the study, SD rats appeared to require

Page 41: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 35

fewer reward probability conditioning trials (8 sessions) than LEW rats to demonstrate learning

the CS-US probability schedule, as shown by the differentiation in nose-poke behaviour during

the CS period. LEW rats required considerably more reward probability trials (13 sessions) to

produce a moderate behavioural differentiation, and unlike the SD rats, a clear divergence of

behavioural responses to the CS between all groups never occurred. This raises the possibility

that LEW rats may possess a learning deficit relative to SD rats. Currently no comparative

research using LEW and SD strains on learning tasks exist; however, it has been found that LEW

rats more readily acquire self-administration of alcohol, opiates and psychostimulants (Kosten &

Ambrosio, 2002) and autoshaping behaviour compared to F344 rats (Kearns, Gomez-Serrano,

Weiss & Riley, 2006). Both of these conditioning tasks are more complicated than the simple

Pavlovian procedure used in the present study, suggesting that LEW rats do not possess any

general operant or appetitive learning difficulties relative to F344 rats. A possibility for future

research would be to examine LEW and SD strains on simple and complex learning tasks, in

order to elucidate the strain differences observed in this study.

In addition to differences in the rate of acquisition of the conditioned behaviour, these

strains exhibited differences in their initial locomotor response to the activity boxes. LEW rats

displayed a lower level of novelty-induced locomotion during the first 90 minute habituation

session (Mean beam breaks = 1041) compared to SD rats (Mean beam breaks = 2162).

Locomotor activity in an unfamiliar environment has been shown to be influence by dopamine

(Hooks & Kalivas, 1995; Bardo, Bowling & Pierce, 1990). Several studies have compared

locomotor response to a novel environment in inbred LEW and F344 strains; however, the

findings are inconsistent. Upon initial exposure to an experimental apparatus, some researchers

have reported greater locomotor activity in LEW rats (Camp et al., 1994; Stöhr, Wermeling,

Page 42: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 36

Weiner, & Feldon, 1998; Rex, Sondern, Voigt, Franck, & Fink, 1996), while others have

reported reduced activity in comparison to F344 rats (Chaouloff, Kulikov, Sarrieau, Castanon, &

Mormède, 1995; Haile, et al., 2001). Despite these inconsistencies, as discussed previously,

considerable research has shown strain differences in mesolimbic dopamine functioning between

LEW and F344 rats (Kosten & Ambrosio, 2002). LEW rats have lower levels of tyrosine

hydroxylase (TH) in the N.Acc (Guitart, et al., 1992), dopamine transporter in dorsal striatum

and N.Acc. (Flores, et at., 1998; Gulley et al., 2007), dopamine metabolite in the N.Acc (Camp

et al., 1994) and dopamine D2 and D3 receptors in the striatum and N.Acc (Flores, et at., 1998).

Currently, few studies have examined strain differences in the dopamine system between LEW

and SD rats. However, one study by Minabe, Gardner, and Ashby (1998) found that LEW rats

have significantly fewer spontaneously active substantia nigra pars compacta and ventral

tegmental area dopamine neurons compared to both SD and F344 rats. The strain differences in

the dopamine system between LEW and F344 rats and the results from Minabe et al., (1998)

suggest that LEW rats may have a hypoactive midbrain dopamine system, which could explain

their reduced novelty-induced locomotion in the present study.

In addition to being dopamine dependent, locomotor activity in an unfamiliar

environment is also regarded as a behavioural response to stress (Dantzer & Mormède, 1983).

Exposure to stress activates the hypothalamic-pituitary-adrenal axis, which stimulates a cascade

of events including the release of adrenocorticotropic hormone (ACTH) from the anterior

pituitary gland leading to corticosteorne (CORT) release from the adrenal cortex (Nelson, 2005).

Data indicate that LEW rats exhibit a blunted HPA axis response to stress when compared to

F344 rats (Sternberg, et al., 1992; Dhabhar, McEwen, & Spencer 1993; Kosten & Ambrosio,

2002). Sternberg, et al., (1992) exposed LEW and F344 rats to an open field test, swim stress,

Page 43: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 37

and restraint and found that LEW rats consistently exhibited lower levels of ACTH and CORT in

response to these stressors.

To date, relatively few studies have examined differential stress responses between SD

and LEW strains. Dhabhar, et al., (1993) reported that LEW rats fail to show a normal circadian

diurnal rise in CORT levels, which is expected at the beginning of their active period (evening),

and display impaired ACTH and CORT responses to one hour of restraint stress in comparison to

both F344 and SD rats. According to Cohen, Zohar, Gidron, Matar, Belkind et al., (2006) LEW

rats exhibit greater baseline startle responses and fearful behaviours in the elevated plus maze

and greater stress-induced increases in these behaviours following extreme stress (scent of the

urine of a prime predator) compared to SD rats. Although LEW rats display a reduced stress-like

response in the present study, inconsistencies in previous novelty-induced locomotor response

findings with F344 rats and limited research with the SD strain make drawing a conclusion

difficult. The findings from Dhabhar et al. (1993) and Cohen et al., (2006), however, do suggest

that differences between strains in the locomotor response during the first habituation observed

in the present study could be influenced by deficiencies in the HPA axis’ response to stress found

in the LEW rat.

Given that SD and LEW rats appear to differ on the rate of acquisition of the conditioned

nose-poking behaviour and on novelty-induced locomotor activity, it is surprising that the LEW

rats, a strain known for its high levels of drug intake (Kosten & Ambrosio, 2002) and sensitivity

to methamphetamine and cocaine sensitization when compared to F344 rats (Camp et al., 1994;

Kosten et al., 1994; Haile et al., 2001) did not show evidence of greater behavioural sensitization

to AMPH than SD rats. When comparing the locomotor responses from the initial AMPH

challenge to the AMPH challenge retest (post sensitization regime), LEW rats appear only

Page 44: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 38

moderately more sensitive to repeated AMPH administration than SD rats (percent change 65 %

SD vs. 80% LEW, non significant). To the best of our knowledge, no research comparing

sensitivity to repeated AMPH exposure in SD and LEW rats has been published. Sicar and Kim

(1999), however, have reported that male LEW rats show an enhanced behavioural response to

multiple cocaine injections (15 mg/kg/day x 5) compared to F344 rats, with SD rats rank

intermediate in their behavioural sensitivity.

One possible explanation for the lack of substantial strain differences in response to

repeated AMPH administration seen in the present study could relate to the behavioural measure

of psychomotor activity used. In the study by Sicar and Kim (1999) the authors used a 12-point

behavioural ratings scale to assess all activity over a 60-minute post-injection period. A mean

behavioural score was then tabulated for each animal by adding the ratings from all post-

injection observation periods. The behavioural score for each animal at each testing was then

averaged to create a mean behavioural strain score. Various studies have reported that LEW and

F344 rats exhibit very different psychostimulant-induced locomotor behaviours, with LEW rats

displaying greater stereotypy than F344 rats (Camp et al., 1994; Numachi, Yoshida, Toda,

Matsuoka, & Sato, 2000). Stereotypic behaviour in rats involves repetitive activity (head

movements, gnawing, downward sniffing, and licking) not directed towards any specific goal,

that occurs in place (McKim, 2006). Some authors have criticized the reliance on cumulative

photobeam counts as a measure of psychostimulant-induced activity (Camp et al., 1994). When

comparing the behavioural response induced by repeated methamphetamine injections in LEW

and F344, Camp et al. 1994 found robust psychomotor activity differences between strains when

drug-induced behaviours were visually rated on a nine-point scale; however, these results were

less consistent when only photobeam counts were analyzed. Perhaps SD and LEW rats in the

Page 45: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 39

present study displayed differing psychostimulant-induced behaviours, which are difficult to

interpret using cumulative photobeam counts. This might account for the similar increases in

locomotion from repeated AMPH administration seen in both strains. Videotaping each animal

following drug administration and subsequently rating drug-induced behaviours might provide a

more valid measure of stimulant-induced psychomotor activity and might reveal strain

differences.

4.4 Study Limitations

The present study had a number of limitations. First, the number of reward training

sessions (15) used in the present study may have not been sufficient to induce changes in the

mesolimbic dopamine system. Scott-Railton & Vezina (Society For Neuroscience poster, 2006)

examined the effects of chronic intermittent reinforcement compared to certain reinforcement on

AMPH sensitivity in rats by extensively training animals (55 training sessions) in an operant

conditioning paradigm to lever press for saccharin using escalating schedules of fixed or variable

ratio reinforcement. Two weeks post training all animals were given an AMPH challenge

(0.5mg/kg) followed by an AMPH sensitizing regimen. The authors found that animals trained

extensively on the variable-ratio reinforcement schedule displayed significantly greater

locomotor responses during the acute AMPH challenge and AMPH sensitizing regimen than rats

trained on the fixed-ratio schedule. Repeated exposure to intermittent reinforcement in the

variable ratio condition resulted in unpredictable reward delivery, and induced sensitization-like

neuroadaptations in the dopamine system, providing evidence that repeated exposure to

unpredictable reward alters dopamine functioning. This study’s experimental objective and

design were similar to the present study, which suggest that greater exposure to the reward

probability training may result in group differences in the SD rats and amplify the trend observed

Page 46: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 40

in LEW rats. Second, dopamine activation was assessed indirectly by AMPH-induced locomotor

response. Although this method has been shown to be a valid means of inferring dopamine

sensitization (Lorraine, Arnold, & Vezina, 2000), future research might benefit from a direct

assessment of dopamine levels by using microdialysis. Third, although repeated exposure to

unpredictable reward is a distinguishing feature of gambling, the procedure used may have been

too simple to truly model the complicated phenomena of gambling. Gambling includes not only

uncertain reward, but also the risk of material loss. The loss of resources when a wager is

unsuccessful was a feature which was not included in this experimental design. Recently, Zeeb,

Robins and Winstanley (2009) have developed a novel rat gambling task which includes

differing probabilities of reward and loss of resources wagered. In this task rats choose among

four different options in order to earn as many sugar pellet rewards as possible during a 30

minute period. Each option is associated with different probabilities and amounts of reward as

well as different durations of punishing time-out periods, during which a reward can not be

obtained. Larger reward options are associated with a higher probability of long timeouts,

resulting in fewer rewards per session. In order to maximize reward earnings rats must learn to

avoid these risky options. These authors found that following repeated exposure to the gambling

task, acute administration of AMPH (1.0mg/kg or 1.5mg/kg, i.p.) impaired gambling

performance, by shifting preference towards the option associated with the smallest reward, and

the lowest frequency and duration of punishment. Despite the lack of significant group

differences in locomotor response to acute AMPH or AMPH sensitization in both strains in the

present study, the findings from Zeeb et al. (2009) give support to the hypothesis that there is a

critical relationship between dopamine and repeated exposure to gambling-like stimuli.

Page 47: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 41

4.5 Conclusion

Over the last decade, gambling in Canada has grown rapidly and become an

increasingly popular form of recreation (Statistics Canada, 2007). New technologies, including

video lottery terminals, mega-lotteries and internet gambling, have resulted in wide accessibility.

As well, public perception of gambling has shifted from what was once viewed as disreputable to

an acceptable form of entertainment (Korn, 2000). Nonetheless, for susceptible individuals

gambling has the potential to develop into a serious problem affecting all aspects of their lives

(Centre for Addiction and Mental Health, 2004). As gambling becomes more accessible and

acceptable in Canada, the number of people affected by problem gambling will increase.

Currently, behavioural pharmacological research on the causal mechanisms of

pathological gambling is in its preliminary stages, largely due to limits in modeling the

fundamental features of gambling in animals. Repeated exposure to a CS for non-drug reward

consistently results in maximum midbrain dopamine release in primates when the probability of

reward is most uncertain (50%) (Fiorillo et al., 2003, 2008). This repeated increase in dopamine

release can lead to sensitization of the mesolimbic dopamine pathways and could contribute to

gambling pathology. In the present study, however, unpredictable reward delivery did not alter

dopamine activation as assessed by acute and sensitized locomotor response to AMPH in either

SD or LEW rats.

Page 48: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 42

References

Acquas, E., Carboni, E., Leone, P., & Chiara, G. (1989). SCH 23390 blocks drug-conditioned place-preference and place-aversion: anhedonia (lack of reward) or apathy (lack of motivation) after dopamine-receptor blockade? Psychopharmacology, 99(2), 151-155.

Ambrosio, E., Goldberg, S., & Elmer, G. (1995) Behavior genetic investigations of the relationship between spontaneous locomotor activity and the acquisition of morphine self-administration behavior. Behavioural Pharmacology, 6, 229–237.

American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders. (4th ed.). Washington, DC: American Psychiatric Association.

Anagnostaras, S., & Robinson, T. (1996). Sensitization to the psychomotor stimulant effects of amphetamine: Modulation by associative learning. Behavioral Neuroscience, 110(6), 1397-1414.

Avena, N., & Hoebem, B. (2003a). Amphetamine-sensitized rats show sugar-induced hyperactivity (cross-sensitization) and sugar hyperphagia. Pharmacology, Biochemistry and Behavior, 74(3), 635-639.

Avena, N., & Hoebem, B. (2003b). A diet promoting sugar dependency causes behavioral cross-sensitization to a low dose of amphetamine. Neuroscience, 122, 17–20.

Azzaro, A., & Rutledge, C. (1973). Selectivity of release of norepinephrine, dopamine and 5-hydroxytryptamine by amphetamine in various regions of the rat brain. Biochemical Pharmacology, 13(10), 2801-2813.

Bardo, M., Bowling, S., & Pierce, R. (1990). Changes in locomotion and dopamine neurotransmission following amphetamine, haloperidol, and exposure to novel environmental stimuli. Psychopharmacology, 101, 338-343.

Berridge, K. (2007) The debate over dopamine’s role in reward: the case for incentive salience. Psychopharmacology, 191, 391-431.

Berridge, K., & Robinson, T. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain research. Brain research reviews, 18(3), 247-291.

Berridge, K., & Robinson, T. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Research Review, 28, 309-369.

Besson, M., Cheramy,A., & Glowinski, J. (1969). Effects of amphetamine and desmethylimipramine on amines synthesis and release in central catecholamine-containing neurons. European Journal of Pharmacology, 7(1), 111-114.

Boakes, R. (1977). Performance on learning to associate a stimulus with positive reinforcement. Operant-Pavlovian Interactions. Hillsdale, NJ: Erlbaum, 67-97.

Boileau, I., Dagher, A., Leyton, M., Çunn, R., Baker, G., Diksic, M., et al. (2006). Modeling sensitization to stimulants in humans. Arch Gen Psychiatry, 63, 1386-1395.

Canadian Gaming Industry: Key Facts and Figures. (2007). Canadian Gaming Association [Brochure]. Burns, P: Author.

Cauli, O., Pinna, A., Valentini, V., & Morelli, M. (2003). Subchronic caffeine exposure induces sensitization to caffeine and cross-sensitization to amphetamine ipsilateral turning behavior independent from dopamine release. Neuropsychopharmacology, 28 (10), 1752-1759.

Center for Addiction and Mental Health. (2004). Problem gambling: the issues, the options. [Brochure]. A Pan American Health Organization / World Health Organization Collaborating Centre Affiliated with the University of Toronto.

Page 49: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 43

Chaouloff, F., Kulikov, A., Sarrieau, A., Castanon, N., & Mormède, P. (1995). Male Fischer 344 and Lewis rats display differences in locomotor reactivity, but not in anxiety-related behaviours: relationship with the hippocampal serotonergic system. Brain Research, 693, 169-178.

Dantzer, R., & Mormède, P. (1983). Stress in farm animals: a need for reevaluation. Journal of Animal Science, 57, 6-18.

Davey, G. & Cleland, G. (1982). The effect of partial reinforcement on the acquisition and extinction of sign-tracking and goal-tracking in the rat. Bulletin of the Psychonomic Society, 19(2), 115-118.

Dhabhar, F., McEwen, B., & Spencer, R. (1993). Stress response, adrenal steroid receptor levels and corticosteroid-binding globulin levels — a comparison between Sprague–Dawley, Fischer 344, and Lewis rats. Brain Research, 616, 89–98.

Epstein, D., Preston, K., Stewart, J., & Shaham, Y. (2006) Toward a model of drug relapse: An assessment of the validity of the reinstatement procedure. Psychopharmacology, 189 (1), 1-16.

Evans., A., Pavese, N., Lawrence, A., Tai, Y., Appel., S., et al., (2006). Compulsive drug use linked to sensitized ventral striatal dopamine transmission. Annals of Neurology, 59(5), 852-858.

Exner, M., & Clark, D. (1993). Behaviour in the novel environment predicts responsiveness to d-amphetamine in the rat: a multivariate approach. Behavioural Pharmacology, 4, 47-56.

Gulley, J., Everett, C., & Zahniser, N. (2007). Inbred Lewis and Fischer 344 rat strains differ not only in novelty- and amphetamine-induced behaviors, but also in dopamine transporter activity in vivo. Brain Research, 1151, 32-45.

Eisen, S., Lin, N., Lyons, M., Scherrer, J., Griffith, K., et al. (1998). Familial influences on gambling behavior: an analysis of 3359 twin pairs. Addiction, 93, 1375-1384.

Everitt, B., & Wolf, M. (2002). Psychomotor stimulant addiction: a neural systems perspective. Journal of Neuroscience, 22, 3312-3320.

Fiorillo, C., Tobler, P., & Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902.

Fiorillo, C., Newsome, W., & Schultz, W. (2008). The temporal precision of reward prediction in dopamine neurons. Nature Neuroscience, 11, 966 – 973.

Fletcher, P., Tenn, C., Sinyard, J., Rizos, Z., & Kapur, S. (2007) A sensitizing regimen of amphetamine impairs visual attention in the 5-choice serial reaction time test: reversal by a D1 receptor agonist injected into the medial prefrontal. Neuropsychopharmacology,32(5), 1122-1132.

Fletcher, P., Tenn, C., Rizos, Z., Lovic, V., & Kapur, S. (2005). Sensitization to amphetamine, but not PCP, impairs attentional set shifting: reversal by a D1 receptor agonist injected into the medial prefrontal cortex. Psychopharmacology, 183,190-200.

Flores, G., Wood, G., Barbeau, D., Quirion, R., & Srivastava, L. (1998). Lewis and Fischer rats: a comparison of dopamine transporter and receptors levels. Brain Research, 814, 34–40.

Freeman, K., Kearns, D., Kohut, S., & Riley, A. (2009). Strain differences in patterns of drug-intake during prolonged access to cocaine self-administration. Behavioral Neuroscience, 123(1), 156-164.

Ferris, R., Tang, F., & Maxwell, R. (1972). A comparison of the capacities of isomers of amphetamine, deoxypipradrol and methylphenidate to inhibit the uptake of tritiated catecholamines into rat cerebral cortex slices, synaptosomal preparations of rat cerebral

Page 50: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 44

cortex, hypothalamus and striatum and into adrenergic nerves of rabbit aorta. Journal of Pharmacology and Experimental Therapeutics, 181, 407-416.

George, F. (1993). Genetic models in the study of alcoholism and substance abuse mechanisms. Progress in Neuropsychopharmacology and Biological Psychiatry, 17(3), 345-361.

George, F., & Goldberg, S. (1989) Genetic approaches to the analysis of addiction processes. Trends in Pharmacological Sciences, 10, 78-83.

Guitart, X., Beitner-Johnson, D., Marby, D., Kosten, T., & Nestler, E. (1992). Fischer and Lewis rat strains differ in basal levels of neurofilament proteins and their regulation by chronic morphine in the mesolimbic dopamine system. Synapse, 12, 242-253.

Haile, C., Hiroi, N., Nestler, E., & Kosten, T. (2001). Differential behavioral responses to cocaine are associated with dynamics of mesolimbic proteins in Lewis and Fischer 344 rats. Synapse, 41, 179-190.

Harmer, C., & Phillips, G. (1998). Enhanced appetitive conditioning following repeated pretreatment with d-amphetamine. Behavioural Pharmacology, 9, 299-308.

Hooks, M., Jones, G., Smith, A., Neill, D., & Justice, J. (1991). Individual differences in locomotor activity and sensitization. Pharmacology, Biochemistry and Behaviour, 38, 467-470.

Hooks, M., & Kalivas, P.(1995). The role of the mesoaccumbens-pallidial circuitry in novelty-induced behavioural activation. Neuroscience, 64(3), 587-597.

Horan, B., Smith, M., Gardner, E., Lepore, M., & Ashby, C. (1997). (-)-Nicotine produces conditioned place preference in Lewis, but not in Fischer 344 rats. Synapse, 26, 93–94.

Howell, D. C. (2007). Statistical methods for psychology (6th ed.) Belmont, CA: Thomson Wadsworth.

Hnasko, T., Sotak, B., & Palmiter, R. (2005). Morphine reward in dopamine-deficient mice. Nature, 438(8), 854-857.

Hyman, S., Malenka, R., & Nesler, E. (2006). Neural Mechanisms of Addiction: The Role of Reward-Related Learning and Memory. Annual Review of Neuroscience, 29, 565-598.

Johnson, S., & North, R. (1992). Opioids excite dopamine neurons by hyperpolarization of local interneurons. Journal of Neuroscience, 12, 483-488.

Kearns, D., Gomez-Serrano, M., Weiss, S., & Riley, A.(2006). A comparison of Lewis and Fischer rat strains on autoshaping (sign-tracking), discrimination reversal learning and negative automaintenance. Behavioural Brain Research, 169, 193–200.

Knutson, B., Fong, G., Adams, C., Varner, J., & Hommer, D. (2001). Dissociation of reward anticipation and outcome with event-related fMRI. NeuroReport, 12(17), 3683-3687.

Korn, D. (2000). Expansion of gambling in Canada: implications for health and social policy. Canadian Medical Association Journal, 163 (1), 61-64.

Kosten, T., & Ambrosio, E. (2002). HPA axis function and drug addictive behaviors: insight from studies with Lewis and Fisher inbred rats. Psychoneuroendocrinology, 27, 35-69.

Kosten, T., Miserendino, M., Chi, S., & Nestler, E., (1994). Fischer and Lewis rat strains show differential cocaine effects in conditioned place preference and behavioral sensitization but not in locomotor activity or conditioned taste aversion. Journal of Pharmacology Experimental Therapeutics, 269, 137-144.

Kosten, T., Miserendino, M., Haile, C., DeCaprio, J., Jatlow, P., & Nestler, E. (1997). Acquisition and maintenance of intravenous cocaine self-administration in Lewis and Fischer inbred rat strains. Brain Research, 778, 418-429.

Page 51: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 45

Ladouceur, R., Dube, D., Giroux, I., Legendre, N., & Gaudet, C. (1995). Cognitive biases in gambling: American roulette and 6/49 lottery. Journal of Social Behavior and Personality, 10(2), 473-479.

Leyton, M., Boileau, I., Benkelfat, C., Diksic, M., Baker, G., & Dagher, A. (2002). Amphetamine-induced increases in extracellular dopamine, drug wanting, and novelty seeking: a PET/[11C]raclopride study in healthy men. Psychopharmacology, 27(6), 1027-1035.

Lorrain, D., Arnold, G., & Vezina, P. (2000). Previous exposure to amphetamine increases incentive to obtain the drug: long-lasting effects revealed by the progressive ratio schedule. Behavioural Brain Research, 107, 9-19.

Martin, P., & Petry, N. (2005). Are non-substance-related addictions really addictions? The American Journal on Addictions, 14, 1-7.

Martin, S., Manzanares, J., Corchero, J., Garcia-Lecumberri, C., Crespo, J., Fuentes, J., et al., (1999) Differential basal proenkephalin gene expression in dorsal striatum and nucleus accumbens, and vulnerability to morphine self-administration in Fisher 344 and Lewis rats. Brain Research, 821, 350-355.

McKim, W. (2006). Drugs and Behavior: An introduction to behavioral. New Jersey: Prentice Hall.

Meyer, G., Schwertfeger, J., Exton, M., Janssen, O., Knapp, W., et al., (2004). Neuroendocrine response to casino gambling in problem gamblers. Psychoneuroendocrinology, 29, 1272-1280.

Minabe, Y., Gardner, E., & Ashby, C. (1998). Differential effects of chronic haloperidol administration on midbrain dopamine neurons in Sprague-Dawley, Fischer 344, and Lewis rats: An in vivo electrophysiological study. Synapse, 29(3), 269-271.

National Council of Welfare. (1996). Gambling in Canada (Report No. 94). Ottawa, ON: Canada, Minister of Public Works and Government Services.

Nelson, R. (2005). An introduction to behavioral endocriniology (3rd edition). Sunderland, MA: Sinauer Associates, Inc.

Nestler, E. (1992). Molecular mechanisms of drug addiction. Journal of Neuroscience, 12 (7), 2439-2450.

Nestler, E. (2001). Molecular basis of long-term plasticity underlying addiction. Nature Reviews Neuroscience, 2, 119-128.

Nestler, E. (2005). Is there a common molecular pathway for addiction? Nature Neuroscience, 8(11), 1445-1449.

Nocjar, C., & Panksepp, J. (2002). Chronic intermittent amphetamine pretreatment enhances future appetitive behavior for drug- and natural-reward: interaction with environmental variables. Behavioural Brain Research, 128, 189-203.

Nordin, C., & Eklundh, T. (1999). Altered CSF 5-HIAA disposition in pathologic male gamblers. CNS Spectrum, 4, 25-33.

Numachi, Y., Yoshida, S., Toda, S., Matsuoka, H., & Sato, M. (2000). Two inbred strains of rats, Fischer 344 and Lewis, showed differential behavior and brain expression of corticosterone receptor mRNA induced by methamphetamine. Annals of the New York Academy of Sciences, 914, 33-45.

Peciña, S., Berridge, K., & Parker, L.(1997). Pimozide does not shift palatability: separation of anhedonia from sensorimotor suppressionby taste reactivity. Pharmacological Biochemical Behavior, 58, 801-811.

Page 52: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 46

Paulson, P., Camp, D., & Robinson, T. (1991). Time course of transient behavioral depression and persistent behavioral sensitization in relation to regional brain monoamine concentrations during amphetamine withdrawal in rats. Psychopharmacology, 103, 480-492.

Petry, N. (2006). Should the scope of addictive behaviors be broadened to include pathological gambling? Addiction, 101 (Suppl. 1), 152-160.

Petry, N. (2007). Gambling and Substance Use Disorders: Current Status and Future Directions. American Journal on Addictions, 16, 1-9.

Petry, N., Stinson, F., & Grant, B. (2005). Comorbidity of DSM-IV pathological gambling and other psychiatric disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Journal of Clinical Psychiatry, 66, 564-574.

Potenza, M. (2008). The neurobiology of pathological gambling and drug addiction: an overview and new findings. Phil. Trans. R. Soc. B, 363, 3181-3189.

Potenza, M., Kosten, T., & Rounsaville, B. (2001). Pathological gambling. Journal of American Medical Association, 286(2), 141-144.

Reuter, J., Raedler, T., Rose, M., Hand, I., Gläscher, J., & Büchel, C. (2005). Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nature Neuroscience, 8, 147-148.

Rex, A., Sondern, U., Voigt, J., Franck, S., & Fink, H. (1996). Strain differences in fear-motivated behavior of rats. Pharmacology, biochemistry, and behaviour, 54(1), 107-111.

Robinson, T., & Becker, J. (1986). Enduring changes in brain and behavior produced by chronic amphetamine administration: a review and evaluation of animal models of amphetamine psychosis. Brain Research, 396(2), 157-198.

Robinson, T., & Berridge, K. (1993). The neural basis of drug craving: an incentive-sensitization of addiction theory of addiction. Brain Research Reviews, 18, 247-291.

Robinson, T., & Berridge, K. (2000). The psychology and neurobiology of addiction: an incentive–sensitization view. Addiction, 95 (Supplement 2), S91-S117.

Robinson, T., & Berridge, K. (2003). Addiction. Annual Review of Psychology, 54, 25-53. Robinson, T., & Flagell, S. (2009). Dissociating the predictive and incentive motivational

properties of reward-related cues through the study of individual differences. Biological Psychiatry, 65, 869-873.

Robinson, T., & Kolb, B. (1997). Persistent structural modifications in nucleus accumbens and prefrontal cortex neurons produced by previous experience with amphetamine. Journal of Neuroscience, 17(21), 8491-8497.

Rush, B., Bassani, D., Urbanoski, K., & Castel, S.(2008). Influence of co-occurring mental and substance use disorders on the prevalence of problem gambling in Canada. Addiction, 103(11), 1847-1856.

Scott-Railton, J., & Vezina, P. (2006, October). Sensitization-like neuroplasticity in rats chronically exposed to intermittent reinforcement. Poster session presented at the annual meeting of the Society for Neuroscience, Atlanta, GA.

Shah, K., Eisen, S., Xian, H., & Potenza, M. (2005). Genetic studies of pathological gambling: a review of methodology and analyses of data from the Vietnam Era Twin (VET) Registry. Journal Gambling Studies, 21(2), 179-203.

Shinohara, K., Yanagisawa, A., Kagota, A., Gomi, A., Nemoto, K., Moriya, E., et al.,(1999). Physiological changes in Pachinko players; beta-endorphin, catecholamines, immune system substances and heart rate. Applied Human Science, 18 (2), 37-42.

Page 53: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 47

Shizgal, P., & Arvanitogiannis, A. (2003). Gambling on dopamine. Science, 299, 1856-1858. Sicar, R., & Kim, D. (1999). Female gonadal hormones differentially modulate cocaine-induced

behavioral sensitization in Fischer, Lewis, and Sprague-Dawley rats. The Journal of Pharmacology and Experimental Therapeutics, 289, 54-65.

Slutske, W., Eisen, S., True, W., Lyons, M., Goldberg, J., & Tsuang, M.(2000) Common genetic vulnerability for pathological gambling and alcohol dependence in men. Archives of General Psychiatry, 57, 666-673.

Smart, R. & Ferris, J. Alcohol, drugs and gambling in the Ontario adult population, 1994. Canadian Journal of Psychiatry, 41(1), 36-45.

Spyraki, C., Fibiger, H., & Phillips, A.(1983). Attenuation of heroin reward in rats by disruption of the mesolimbic dopamine system. Psychopharmacology, 79 (2-3), 278-283.

Statistics Canada. (2007). Perspective on labour and income: gambling. (Statistics Canada Catalogue no. 75-001-XIE). Ottawa, ON: Canada.

Statistics Canada. (2002). Canadian Community Health Survey: Mental Health and Well Being. (Statistics Canada Catalogue no. 82M0021GPE). Ottawa, ON: Canada.

Steeves, T., Miyasaki, J., Zurowski, M., Lang, A., Pellecchia, G., et al., (2009). Increased striatal dopamine release in Parkinsonian patients with pathologicalgambling: a [11C] raclopride PET study. Brain, [Epub ahead of print].

Sternberg, E., Glowa, J., Smith, M., Calogero, A., Listwak, S., Aksentijevich, S., et al.(1992). Corticotropin releasing hormone related behavioral and neuroendocrine responses to stress in Lewis and Fischer rats. Brain Research, 570, 54-60.

Stewart, J., & Badiani, A. (1993). Tolerance and sensitization to the behavioural effects of drugs. Behavioural Pharmacology, 4, 289-312.

Stöhr, T., Wermeling, D., Weiner, I., & Feldon, J. (1998). Rat strain differences in open-field behavior and the locomotor stimulating and rewarding effects of amphetamine. Pharmacology, biochemistry, and behaviour, 59(4), 813-818.

Strakowski, S., & Sax, K. (1998). Progressive behavioral response to repeated d-amphetamine challenge: further evidence for sensitization in humans. Biological Psychiatry, 44, 1171-1177.

Suzuki, T., George, F., & Meisch, R. (1988). Differential establishment and maintenance of oral ethanol reinforced behavior in Lewis and Fisher 344 inbred rat strains. Journal of Pharmacology Experimental Therapeutics, 245, 164-170.

Szechtman, H., & Eilam, D. (2005). Psychiatric Models. The Behavior of the Laboratory Rat. New York: Oxford University Press.

Tenn, C., Fletcher, P., & Kapur, S. (2003). Amphetamine-sensitized animals show a sensorimotor gating and neurochemical abnormality similar to that of schizophrenia. Schizophrenia Research, 64,103-114.

Toneatto, T., & Brennan, J. (2002). Pathological gambling in treatment-seeking substance abusers. Addictive Behaviors, 27, 465-469.

Waelti, P., Dickson, A., & Schultz, W. (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature, 412, 43-48.

Werme, M., Thoren, P., Olson, L., & Brene, S. (1999). Addiction-prone Lewis but not Fischer rats develop compulsive running that coincides with downregulation of nerve growth factor inducible-B and neuron-derived orphan receptor 1. Journal of Neuroscience, 19, 6169-6174.

Page 54: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 48

Werme, M., Messer, C., Olson, L., Gilden, L., Thorén, P., Nestler, E., et al., (2002). ΔFosB regulates wheel running. The Journal of Neuroscience, 22(18), 8133-8138.

Wise, R. (1982). Neuroleptics and operant behavior: the anhedonia hypothesis. Behavioral Brain Science, 5, 39–87.

Wolf, M. (1998). The role of excitatory amino acids in behavioural sensitization to psychomotor stimulants. Progress in Neurobiology, 54, 679-720.

Wrase, J., Schlagenhauf, F., Kienast, T., Wüstenberg, T., Bermpohl, F., et al., (2007). Dysfunction of reward processing correlates with alcohol craving in detoxified alcoholics. Neuroimage, 35(2), 787-794.

Vezina, P., Giovino, A., Wise, R., & Stewart, J. (1989). Environment-specific cross-sensitization between the locomotor activating effects of morphine and amphetamine. Pharmacology Biochemistry & Behavior, 32, 581-584.

Vezina, P., Lorrain, D., Arnold, G., Austin, J., & Suto, N. (2002). Sensitization of Midbrain Dopamine Neuron Reactivity Promotes the Pursuit of Amphetamine. The Journal of Neuroscience, 22(11), 4654-4662.

Vezina, P. (2004). Sensitization of midbrain dopamine neuron reactivity and the self administration of psychomotor stimulant drugs. Neuroscience Biobehavioral Review, 27, 827-839.

Vezina, P. (2007). Sensitization, drug addiction and psychopathology in animals and humans. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 31, 1553-1555.

Yokel, R., & Wise, R. (1976). Attenuation of intravenous amphetamine reinforcement by central dopamine blockade in rats. Psychopharmacology, 48(3), 311-318.

Zack, M. (2008). Does chronic exposure to intermittent, unpredictable reinforcement lead to sensitization? An investigation with rats. Unpublished Research Plan, Center for Addiction and Mental Health.

Zeeb, F., Robins, T., & Winstanley, C. (2009) Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology, 1-15.

Page 55: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 49

Figure Captions

Figure 1. A schematic representation of the experimental design used for Experiment 1 and 2.

Figure 2A. Mean (± S.E.s) nose pokes during conditioned stimulus presentation (30 seconds) for

Sprague-Dawley rats (n=8 per group) exposed to 0, 25%, 50%, 75% or 100% sucrose reward

probability.

Figure 2B. Mean (± S.E.s) nose pokes 30 seconds prior to conditioned stimulus presentation for

Sprague-Dawley rats (n=8 per group) exposed to 0, 25%, 50%, 75% or 100% sucrose reward

probability.

Figure 3. Time-course (5-min bins) of beam breaks (mean ± S.E.s) during initial exposure to

locomotor boxes for Sprague-Dawley rats (n=8 per group) previously exposed to 0, 25%, 50%,

75% or 100% sucrose reward probability.

Figure 4. Mean beam breaks (± S.E.) across three 90 minute habituation session for Sprague-

Dawley rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100% sucrose reward

probability.

Figure 5. Mean beam breaks (± S.E.) after saline (1.0ml/kg, i.p.) and first amphetamine

challenge (0.5 mg/kg, i.p.) for Sprague-Dawley rats (n=8 per group) previously exposed to 0,

25%, 50%, 75% or 100% sucrose reward probability.

Figure 6. Mean beam breaks (± S.E.) over the course of 5 amphetamine injections (1.0mg/kg,

i.p.) for Sprague-Dawley rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100%

sucrose reward probability.

Figure 7. Time-course (5-min bins) of beam breaks (mean ± S.E.s) after second amphetamine

challenge (0.5 mg/kg, i.p.) for Sprague-Dawley rats (n=8 per group) previously exposed to 0,

25%, 50%, 75% or 100% sucrose reward probability.

Page 56: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 50

Figure 8. Mean beam breaks (± S.E.) after the first and second amphetamine challenge for

Sprague-Dawley rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100% sucrose

reward probability.

Figure 9A. Mean (± S.E.s) nose pokes during conditioned stimulus presentation (30 seconds) for

Lewis rats (n=8 per group) exposed to 0, 25%, 50%, 75% or 100% sucrose reward probability.

Figure 9B. Mean (± S.E.s) nose pokes 30 seconds prior to conditioned stimulus presentation for

Lewis rats (n=8 per group) exposed to 0, 25%, 50%, 75% or 100% sucrose reward probability.

Figure 10. Time-course (5-min bins) of beam breaks (mean ± S.E.s) during initial exposure to

locomotor boxes for Lewis rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or

100% sucrose reward probability.

Figure 11. Mean beam breaks (± S.E.) across three 90 minute habituation session for Lewis rats

(n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100% sucrose reward probability.

Figure 12. Mean beam breaks (± S.E.) after saline (1.0ml/kg, i.p.) and first amphetamine

challenge (0.5 mg/kg, i.p.) for Lewis rats (n=8 per group) previously exposed to 0, 25%, 50%,

75% or 100% sucrose reward probability.

Figure 13. Mean beam breaks (± S.E.) over the course of 5 amphetamine injections (1mg/kg,

i.p.) for Lewis rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100% sucrose

reward probability.

Figure 14. Time-course (5-min bins) of beam breaks (mean ± S.E.s) after second amphetamine

challenge (0.5 mg/kg, i.p.) for Lewis rats (n=8 per group) previously exposed to 0, 25%, 50%,

75% or 100% sucrose reward probability.

Page 57: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 51

Figure 15 . Mean beam breaks (± S.E.) after the first and second amphetamine challenge for

Lewis rats (n=8 per group) previously exposed to 0, 25%, 50%, 75% or 100% sucrose reward

probability.

Page 58: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

52

Experimental Design

Reward Probability Training Probability of reward delivery

0, 25%, 50%, 75%, 100% (n=8 per group) Day 1-21

Habituation to Locomotor Activity Boxes

Day 22-24

Vehicle Injection (1.0 ml/kg) Day 25

1st AMPH Challenge (0.5 mg/kg) Day 29

AMPH Sensitizing Regime (5 x 1.0 mg/kg)

Day 33-43

2nd AMPH Challenge (0.5mg/kg) Day 50

Page 59: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

53

Training Sessions

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Mea

n N

ose

Poke

s

0

50

100

150

200025% 50% 75% 100%

A

Training Sessions

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Mea

n N

ose

Poke

s

0

50

100

150

200

025% 50% 75% 100%

B

Page 60: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 54

Time (min)

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90

Mea

n B

eam

Bre

aks

0

100

200

300

400

500

600

025% 50% 75% 100%

Page 61: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 55

Habituation Session

1 2 3

Mea

n B

eam

Bre

aks

0

1000

2000

3000

4000 0 25% 50% 75% 100%

Page 62: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 56

Treatment

Vehicle AMPH (0.5 mg/kg)

Mea

n B

eam

Bre

aks

0

1000

2000

3000

4000

5000 0 25% 50% 75% 100%

Page 63: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 57

Amphetamine Treament (1.0 mg/kg)

1 2 3 4 5

Mea

n B

eam

Bre

aks

0

2000

4000

6000

8000

10000

0 25% 50% 75% 100%

Page 64: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 58

Time (min)

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90

Mea

n B

eam

Bre

aks

0

200

400

600

800

025% 50% 75% 100%

Page 65: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 59

Amphetamine Challenge (0.5mg/kg)

1st 2nd

Mea

n B

eam

Bre

aks

0

2000

4000

6000

8000

10000

0 25% 50% 75% 100%

Page 66: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

60

Training Session

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Mea

n N

ose

Pok

es

0

20

40

60

80

100

025% 50% 75% 100%

A

Training Session

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Mean

Nos

e P

oke

s

0

20

40

60

80

100

025% 50% 75% 100%

B

Page 67: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward

61

Time (min)

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90

Mea

n B

eam

Bre

aks

0

100

200

300

400

500

600

025% 50% 75% 100%

Page 68: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 62

Habituation

1 2 3

Mea

n B

eam

Bre

aks

0

1000

2000

3000

4000

0 25% 50% 75% 100%

Page 69: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 63

Treatment

Vehicle AMPH (0.5 mg/kg)

Mea

n B

eam

Bre

aks

0

1000

2000

3000

4000

5000

0 25% 50% 75% 100%

Page 70: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 64

Amphetamine Treatment (1.0mg/kg)

1 2 3 4 5

Mea

n B

eam

Bre

aks

0

2000

4000

6000

8000

10000

0 25% 50% 75% 100%

Page 71: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 65

Time (min)

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90

Mea

n B

eam

Bre

aks

0

200

400

600

800

025% 50% 75% 100%

Page 72: THE EFFECT OF REPEATED EXPOSURE TO UNPREDICTABLE …€¦ · The Effect of Repeated Exposure to Unpredictable Reward . ... that disruption of the dopamine system attenuates drug-conditioned

Unpredictable Reward 66

Amphetamine Challenge (0.5mg/kg)

1st 2nd

Mea

n B

eam

Bre

aks

0

2000

4000

6000

8000

100000 25% 50% 75% 100%