neuroscience and biobehavioral reviews · anxiety, sleep, appetite, pessimism and...

15
Neuroscience and Biobehavioral Reviews 65 (2016) 21–35 Contents lists available at ScienceDirect Neuroscience and Biobehavioral Reviews jou rn al h om epage: www.elsevier.com/locate/neubiorev Review article Assessing anhedonia in depression: Potentials and pitfalls Sakina J. Rizvi a,b,, Diego A. Pizzagalli c , Beth A. Sproule d,e , Sidney H. Kennedy a,b,f a ASR Chair in Suicide and Depression Studies Program, Department of Psychiatry, St. Michael’s Hospital, Toronto, Ontario, Canada b Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada c Department of Psychiatry, Harvard Medical School and McLean Hospital, Belmont, MA, USA d Department of Clinical Pharmacy, Centre for Addiction and Mental Health, Toronto, Ontario, Canada e Department of Pharmaceutical Sciences, University of Toronto, Toronto, Ontario, Canada f Institute of Medical Sciences, University of Toronto, Toronto, Ontario, Canada a r t i c l e i n f o Article history: Received 8 September 2014 Received in revised form 23 September 2015 Accepted 3 March 2016 Available online 6 March 2016 Keywords: Anhedonia Reward Major depression Effort Anticipation Scale Delay discounting Prediction error Monetary incentive delay Gambling Response bias a b s t r a c t The resurgence of interest in anhedonia within major depression has been fuelled by clinical trials demon- strating its utility in predicting antidepressant response as well as recent conceptualizations focused on the role and manifestation of anhedonia in depression. Historically, anhedonia has been understood as a “loss of pleasure”, yet neuropsychological and neurobiological studies reveal a multifaceted recon- ceptualization that emphasizes different facets of hedonic function, including desire, effort/motivation, anticipation and consummatory pleasure. To ensure generalizability across studies, evaluation of the available subjective and objective methods to assess anhedonia is necessary. The majority of research regarding anhedonia and its neurobiological underpinnings comes from preclinical research, which uses primary reward (e.g. food) to probe hedonic responding. In contrast, behavioural studies in humans pri- marily use secondary reward (e.g. money) to measure many aspects of reward responding, including delay discounting, response bias, prediction error, probabilistic reversal learning, effort, anticipation and consummatory pleasure. The development of subjective scales to measure anhedonia has also increased in the last decade. This review will assess the current methodology to measure anhedonia, with a focus on scales and behavioural tasks in humans. Limitations of current work and recommendations for future studies are discussed. © 2016 Elsevier Ltd. All rights reserved. Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 1.1. Conceptualizing anhedonia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 1.2. Neurobiology of anhedonia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 1.3. Primary vs. secondary reward . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 1.4. Preclinical methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 1.5. Sucrose preference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 1.6. Place preference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 1.7. Intracranial self-stimulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 1.8. Reward tasks not tested in animal models of depression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 2. Clinical methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 2.1. “First generation” questionnaire-based methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 2.2. “Second generation” anhedonia scales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 2.3. Additional scales to measure aspects of anhedonia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 2.4. Clinical scale summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3. Behavioural tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Corresponding author at: Department of Psychiatry, St. Michael’s Hospital, 193 Yonge Street, 6-009, Toronto, ON M5B 1M8, Canada. Fax: +1 416 864 5996. E-mail address: [email protected] (S.J. Rizvi). http://dx.doi.org/10.1016/j.neubiorev.2016.03.004 0149-7634/© 2016 Elsevier Ltd. All rights reserved.

Upload: others

Post on 22-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

  • R

    A

    Sa

    b

    c

    d

    e

    f

    a

    ARR2AA

    KARMEASDPMGR

    C

    h0

    Neuroscience and Biobehavioral Reviews 65 (2016) 21–35

    Contents lists available at ScienceDirect

    Neuroscience and Biobehavioral Reviews

    jou rn al h om epage: www.elsev ier .com/ locate /neubiorev

    eview article

    ssessing anhedonia in depression: Potentials and pitfalls

    akina J. Rizvia,b,∗, Diego A. Pizzagalli c, Beth A. Sprouled,e, Sidney H. Kennedya,b,f

    ASR Chair in Suicide and Depression Studies Program, Department of Psychiatry, St. Michael’s Hospital, Toronto, Ontario, CanadaDepartment of Psychiatry, University of Toronto, Toronto, Ontario, CanadaDepartment of Psychiatry, Harvard Medical School and McLean Hospital, Belmont, MA, USADepartment of Clinical Pharmacy, Centre for Addiction and Mental Health, Toronto, Ontario, CanadaDepartment of Pharmaceutical Sciences, University of Toronto, Toronto, Ontario, CanadaInstitute of Medical Sciences, University of Toronto, Toronto, Ontario, Canada

    r t i c l e i n f o

    rticle history:eceived 8 September 2014eceived in revised form3 September 2015ccepted 3 March 2016vailable online 6 March 2016

    eywords:nhedoniaewardajor depression

    ffort

    a b s t r a c t

    The resurgence of interest in anhedonia within major depression has been fuelled by clinical trials demon-strating its utility in predicting antidepressant response as well as recent conceptualizations focused onthe role and manifestation of anhedonia in depression. Historically, anhedonia has been understood asa “loss of pleasure”, yet neuropsychological and neurobiological studies reveal a multifaceted recon-ceptualization that emphasizes different facets of hedonic function, including desire, effort/motivation,anticipation and consummatory pleasure. To ensure generalizability across studies, evaluation of theavailable subjective and objective methods to assess anhedonia is necessary. The majority of researchregarding anhedonia and its neurobiological underpinnings comes from preclinical research, which usesprimary reward (e.g. food) to probe hedonic responding. In contrast, behavioural studies in humans pri-marily use secondary reward (e.g. money) to measure many aspects of reward responding, includingdelay discounting, response bias, prediction error, probabilistic reversal learning, effort, anticipation and

    nticipationcaleelay discountingrediction erroronetary incentive delayambling

    consummatory pleasure. The development of subjective scales to measure anhedonia has also increasedin the last decade. This review will assess the current methodology to measure anhedonia, with a focuson scales and behavioural tasks in humans. Limitations of current work and recommendations for futurestudies are discussed.

    © 2016 Elsevier Ltd. All rights reserved.

    esponse bias

    ontents

    1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221.1. Conceptualizing anhedonia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221.2. Neurobiology of anhedonia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231.3. Primary vs. secondary reward . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231.4. Preclinical methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231.5. Sucrose preference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241.6. Place preference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241.7. Intracranial self-stimulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241.8. Reward tasks not tested in animal models of depression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

    2. Clinical methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242.1. “First generation” questionnaire-based methods. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .252.2. “Second generation” anhedonia scales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25

    2.3. Additional scales to measure aspects of anhedonia . . . . . . . . . . . . . . . .2.4. Clinical scale summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

    3. Behavioural tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

    ∗ Corresponding author at: Department of Psychiatry, St. Michael’s Hospital, 193 YongeE-mail address: [email protected] (S.J. Rizvi).

    ttp://dx.doi.org/10.1016/j.neubiorev.2016.03.004149-7634/© 2016 Elsevier Ltd. All rights reserved.

    . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

    . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

    Street, 6-009, Toronto, ON M5B 1M8, Canada. Fax: +1 416 864 5996.

    dx.doi.org/10.1016/j.neubiorev.2016.03.004http://www.sciencedirect.com/science/journal/01497634http://www.elsevier.com/locate/neubiorevhttp://crossmark.crossref.org/dialog/?doi=10.1016/j.neubiorev.2016.03.004&domain=pdfmailto:[email protected]/10.1016/j.neubiorev.2016.03.004

  • 22 S.J. Rizvi et al. / Neuroscience and Biobehavioral Reviews 65 (2016) 21–35

    3.1. Association and valuation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283.2. Anticipation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293.3. Expectation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303.4. Effort . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303.5. Outcome . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313.6. Feedback integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313.7. Behavioural tasks summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

    4. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32Conflict of interest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33

    . . . . . .

    1

    battssmn

    DteDwmpwsw2Adwad

    Ettctmrltca

    1

    psatasSa

    References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

    . Introduction

    Treatments for Major Depressive Disorder (MDD) are hamperedy relatively low rates of remission with various antidepressantsnd adjunctive treatments (Warden et al., 2007), prompting a needo define other avenues of therapy. Towards this aim, there is a needo understand the various neurobiological substrates for depressiveymptoms in order to detect predictive biomarkers for treatmentelection. Identifying the symptoms that actually predict treat-ent failure is also a logical springboard from which to elucidate

    eurobiology-symptom links.Two large trials, the Genome Based Therapeutic Drugs for

    epression (GENDEP) and the Sequenced Treatment Alternativeso Relieve Depression (STAR*D), have provided an opportunity toxplore factors related to antidepressant outcomes. In the GEN-EP trial, Uher et al. (2008) identified 6 symptom dimensions thatere needed to describe the structure of depressive symptoms:ood, anxiety, sleep, appetite, pessimism and interest-activity. In

    articular, low interest-activity, reflecting reduced enjoyment asell as interest and activity, strongly predicted poor antidepres-

    ant outcome (Uher et al., 2008). Generalizability of this findingas enhanced with replication using the STAR*D data (Uher et al.,

    012). Furthermore in the Treatment of Resistant Depression indolescents (TORDIA) trial, anhedonia (as measured by the anhe-onia dimension on the Child Depression Rating Scale-Revised)as the only unique negative predictor of time to remission with

    selective serotonin reuptake inhibitor (SSRI) and the number ofepression-free days (McMakin et al., 2012).

    Though anhedonia is a core feature of a Major Depressivepisode according to DSM-5 and is a key diagnostic criterion forhe depressive subtype melancholia (APA, 2013), the assessment ofhis construct has received disproportionately less attention in theontext of MDD. This may be partly due to the inconsistent concep-ualization of anhedonia that has resulted in a paucity of adequate

    easures and tasks that tap into the different facets of a “pleasureesponse”. Despite increasing research in this domain, several keyimitations remain in anhedonia research. The goal of this review iso evaluate the benefits and disadvantages of preclinical and clini-al methods to measure anhedonia with a focus on human studies,nd advance future directions for anhedonia research.

    .1. Conceptualizing anhedonia

    Traditionally, anhedonia has been defined as a “loss ofleasure” (Ribot, 1896), a definition that emphasizes the con-ummatory/enjoyment aspect of reward function. However, thessessment of anhedonia according to the Diagnostic and Statis-ical Manual of Axis I Disorders-5th edition (APA, 2013) reflects

    broader conceptualization that includes interest as well as con-ummatory pleasure. Even within the Hamilton Depression Ratingcale, one of the most widely used depression scales, the singlenhedonia item is measured as a dimensional construct represent-

    . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

    ing desire, effort and consummatory pleasure: “loss of interest inactivities”, “decrease in actual time spent on activities”, “experienc-ing pleasure” (Hamilton, 1960). This equivocal conceptualizationmakes anhedonia measurement imprecise. As Treadway and Zald(2011) assert “heterogeneity at the level of symptom definitionis at least as problematic as. . .issues of comorbidity. . .” (p.3), andrefining the construct is imperative if we hope to understand theneurobiological underpinnings of anhedonia. Consequently, it maybe more helpful to address more precise facets of hedonic func-tion (Der-Avakian and Markou, 2012). Based on a modified versionof the reward process described by Kring and Barch (2014), wedescribe the process as initially building a stimulus-reward asso-ciation, which then leads to interest/desire (wanting a reward),anticipation (state of readiness for a reward), motivation (initialenergy expenditure to attain a reward), effort (sustained energyexpenditure to attain reward), hedonic response (e.g. enjoyment ofreward), and feedback integration (updating reward presence andvalues) (Fig. 1). In this model, expectation of a reward is necessaryfor anticipation and important for feedback integration followingreward outcome. Conceptually, it is helpful to define a linear rewardprocess but it is important to emphasize that, behaviourally, thesefacets of reward can occur in parallel (i.e. one can feel interested andanticipating, and effort to attain reward can be in itself pleasurable).

    Growing neuroscientific evidence also supports unique aspectsof reward processing that can give rise to loss of pleasure, ormay even act independently of pleasure. This was evaluated ina reward task whereby MDD patients viewed cartoons for whichthey provided “liking” scores (and thus measures of consummatorypleasure). In order to view the liked cartoons once again, subjectswere required to expend a specified level effort (number of clickson a moving square). While MDD patients experienced similar lev-els of consummatory pleasure as healthy controls, lower levels ofreward anticipation were associated with reduced motivation foreffort expenditure in the MDD group; conversely, liking predictedmotivation in the healthy control group (Sherdell et al., 2012). Thissupports distinct processes in MDD, whereby anticipation may be alimiting factor in the experience of reward in depression. An alter-native explanation is that the ability to translate the prospect ofreward into motivation is impaired. This fits evidence that MDDpatients display a reduced ability to detect reward and incorporateexperience of reward into reward-learning associations (reviewedin Pizzagalli, 2014). Consistent with this work are data showingreduced prediction error in response to reward in depression, sug-gesting patients are not characterized by the same level of neuralfeedback from rewards as healthy controls (Gradin et al., 2011;Kumar et al., 2008). Taken together, it is clear that available tasksand tools need to reflect a refinement in anhedonia conceptualiza-tion in order to yield an adequate assessment of this core symptomof depression. Critically, there is mounting evidence that different

    facets of reward processing such as motivation, reward learning,effort-based reward-related decision making as well as anticipa-tion and consummatory pleasure map onto partially dissociable

  • S.J. Rizvi et al. / Neuroscience and Biobehavioral Reviews 65 (2016) 21–35 23

    f rewa(

    ntbips

    1

    biMcitagv(canmigniabi

    1

    irrsrmo

    Fig. 1. Model oModified from Kring and Barch, 2014).

    eural pathways and signaling (Der-Avakian and Markou, 2012). Inhis vein, a more multi-faceted and precise definition of anhedonicehavior promises to improve our understanding of the pathophys-

    ology of this cardinal feature of MDD, and identify sub-groups ofatients that might preferentially benefit from particular treatmenttrategies.

    .2. Neurobiology of anhedonia

    An in-depth discussion of the neurobiology of anhedonia iseyond the scope of this review, but has been well summarized

    n other articles (see Treadway and Zald, 2011; Der-Avakian andarkou, 2012 for review). Briefly, we assume that anhedonia

    an arise from impairments in various facets of reward process-ng, including desire for reward, anticipation of reward, efforto attain reward, consummatory pleasure, as well as cognitivespects of learning stimulus-reward associations. Evidence sug-ests that there are specific neuroanatomical areas that underliearious facets of reward processing, including the prefrontal cortexorbitofrontal cortex, ventromedial prefrontal cortex and anterioringulate cortex), dorsal striatum (caudate and putamen), nucleusccumbens and amygdala. While dopamine has been the maineurotransmitter investigated in relation to reward, there is alsoounting evidence that systems other than dopamine are critically

    nvolved in the reward process. Specifically, opioids, glutamate,amma-aminobutyric acid (GABA) and serotonin also play a sig-ificant role. Opioids and GABA, for example, may be particularly

    mportant in the experience of consummatory pleasure (Barbanond Cador, 2007; van Zessen et al., 2012), while serotonin maye more associated with increased impulsivity and preference for

    mmediate reward (Schweighofer et al., 2008).

    .3. Primary vs. secondary reward

    The experience of pleasure can pertain to many stimuli that arenstinctual (e.g. food, sex) versus non-instinctual (e.g. photography,eading). It could be argued that food and sex represent “primary”ewards (inherent rewards), whereas photography or money are

    econdary rewards (no inherent reward in itself and for whicheward value must be learned). This distinction of “reward type”ay complicate anhedonia research in two ways. Firstly, neurobi-

    logical response to a primary reward may overlap with secondary

    rd processing.

    reward, but may also have independent actions (Beck et al., 2010;Sescousse et al., 2013). In a meta-analysis of 87 studies to deter-mine the overlapping and distinct brain areas activated in responseto monetary, erotic and food rewards, there were some differencesin activation within a common network, which included the ven-tromedial prefrontal cortex, ventral striatum, amygdala, anteriorinsula and mediodorsal thalamus (Sescousse et al., 2013). Notably, astudy evaluating fluid and monetary incentives demonstrated thatfluids were not as susceptible to contextual framing as secondaryreward, and were more related to the experience of satiety or tem-perature (McClure et al., 2007), which also may affect distinctionsin neural activation. In particular, the primary rewards (food anderotic) resulted in activation of the anterior insula and amygdala (inthe case of erotic reward), while the monetary secondary rewardactivated the orbitofrontal cortex. Furthermore, the authors sug-gest that even within the neocortex there may be a difference inhow primary and secondary rewards are encoded. Accordingly, themore phylogenetically recent anterior portion of the OFC was morelikely to respond to monetary reward. While the same group pre-viously demonstrated that the posterior OFC is more activated inresponse to primary stimuli (e.g. erotic) (Sescousse et al., 2010),this requires replication due to some inconsistencies in findings(Sescousse et al., 2013). In contrast to the view of distinct activitywith reward type, in a meta-analysis of 206 studies, Bartra and col-leagues (2013) reported that both primary and secondary rewardsactivated the same brain regions including the striatum and ven-tromedial prefrontal cortex. Based on these findings, the authorssuggest that assertions of domain-based differences in functionalactivity should be interpreted with caution.

    Secondly, the distinction of incentive type limits the transla-tion from preclinical to clinical studies, considering most preclinicalwork uses primary reward as incentive while most human studiesemploy secondary rewards. Importantly, investigation of primaryreward provides a more direct comparison with animal studies.The following sections will expand on this idea through a reviewof the preclinical and clinical methods that have been developedto measure anhedonia and will also evaluate their generalizabilityand ability to measure the different facets of anhedonia. Indeed, oneof the ultimate difficulties in measuring anhedonia lies in devising

    measures that tap into the objective or subjective nature of thisconstruct.

  • 2 Biobeh

    1

    cldto1cdLthait

    1

    uostrpAmmH

    iitinitidmpse

    1

    bpdpeduttwnemhm2

    4 S.J. Rizvi et al. / Neuroscience and

    .4. Preclinical methods

    Animal models for depression that induce anhedonia includehronic unpredictable mild stress (CMS), social defeat, and early-ife stress among others (reviewed in Duman, 2010). All evokeepression-like behaviour that occurs following ongoing stressors,hereby providing greater face validity based on the chronic naturef depression than models such as learned helplessness (Willner,984; Nestler and Hyman, 2010). This is supported by findings thathronic but not acute antidepressant administration relieves anhe-onia in these models (Tsankova et al., 2006; Papp et al., 1996;eventopoulos et al., 2009). Only tasks that have been employedo measure reward in animal depression models will be discussederein, including the sucrose preference test, place preference test,nd intracranial self-stimulation (ICSS). These tasks assess interestn reward and levels of consummatory pleasure cannot be ascer-ained.

    .5. Sucrose preference

    The anhedonia-inducing CMS model was initially validatedsing the sucrose preference task. In this task, rats are given theption of seeking out a sucrose solution or plain water. Sinceucrose is more palatable, choosing to drink plain water instead ofhe sucrose water after a period of food deprivation is considered toeflect levels of anhedonia (Willner et al., 2005). After CMS, sucrosereference decreases compared to a baseline (no-stress) condition.ntidepressant effects have frequently been measured using thisodel to demonstrate reversal of anhedonia through reinstate-ent of sucrose preference (Willner et al., 1987; Papp et al., 2003;amani et al., 2012).

    Ultimately, the sucrose preference test is a proxy of an animal’snterest in a pleasurable stimulus, from which “liking” can only benferred. Considering anhedonia encompasses a subjective qualityhat cannot be gleaned from rodents (e.g. desire, motivation, lik-ng), a primary concern for using sucrose as a reward is whetherot preferring sucrose water actually reflects anhedonia. This test

    s considered a proxy of liking because prior studies demonstratehat a decrease in sucrose consumption within the CMS model: (1)s not related to calorie content, and (2) does not reflect a globalecrease in consummatory behavior (Willner et al., 1992). Further-ore, CMS-exposed rodents treated with an antidepressant exhibit

    lace preference (described below) for sucrose, suggesting rein-tatement of motivation to attain a rewarding stimulus (Willnert al., 1992).

    .6. Place preference

    The objective of this task is to evaluate an animal’s preferenceetween environments where a stimulus was or was not previouslyresented (Carr and White, 1983; Bevins and Besheer, 2005). Con-itioned place preference is widely used to assess the rewardingroperties of a drug in the context of addiction research (Shinoharat al., 2014; Collier and Echevarria, 2013; Aguilar et al., 2009). Inepression models, animals are freely exposed to a rewarding stim-lus (e.g. food) only on one side of a chamber for several days andhen assessed for side preference in the absence of the reward. Con-rol animals show a strong preference for the area where a rewardas received, while animals with depression-like phenotypes doot – an effect that can be reversed by antidepressants (Muscatt al., 1992). It has been suggested this task probes the incentive-

    otivational aspect of acquiring a reward, while other researchers

    ave suggested that performance on a place preference task mayerely reflect reinforcement learning of a reward (Huston et al.,

    013).

    avioral Reviews 65 (2016) 21–35

    1.7. Intracranial self-stimulation

    In ICSS trials, animals learn to press a lever in order to receiveelectrical stimulation to a specific brain area along the brainreward pathway (e.g. posterior lateral hypothalamus, medial fore-brain bundle). In depression models, the stimulation threshold forbar pressing increases compared to control animals, suggestinga decrease in the rewarding properties of stimulation. However,treatment with antidepressants can reverse this effect in CMS rats(Moreau et al., 1992). Performance is considered to be a metric ofmotivation; since this task can be trained on different schedules(e.g. fixed interval, progressive ratio), the degree of effort a stressedvs. control animal will put forth to receive reward can be evaluated.It is also a measure of the rewarding properties of a stimulus, whichis why it continues to be a gold standard method to assess a drug’sabuse potential with strong predictive validity (Horton et al., 2013).

    In all of the above tasks, only primary reward incentive is used toassess levels of anhedonia. Furthermore, facets of anhedonia, suchas interest and liking, cannot be determined using animal models.These constructs can only be inferred by the animals’ response to areward. Finally, the reproducibility of the sucrose and ICSS tests (asindicators of the effects of stress on anhedonia) following CMS hasbeen questioned (Harris et al., 1997; Nielsen et al., 2000; Hatcheret al., 1997). For example, in a study to evaluate the hedonic prop-erties of sucrose preference and ICSS, Nielsen et al. (2000) used theCMS model of depression in different strains of rats. They foundsucrose preference was demonstrated with certain rat strains andonly a subgroup of rats exhibited attenuated ICSS behaviour.

    In summary, animal models have utility in measuring observ-able aspects of reward processing, including motivation and effort.Indeed, preclinical models have been integral to elucidating theneurobiology of reward function (see Schultz, 2013 for review).The extent to which data from animal models can be generalizedto human populations remains unclear. For example, in animalmodels of depression, SSRIs have demonstrated positive effects onsucrose consumption (Willner, 1997), whereas SSRI non-responsewas predicted by anhedonia in human studies (Uher et al., 2012;McMakin et al., 2012). Highlighting convergence with human stud-ies, recent work suggests the phenotype of anhedonia in animalmodels may actually map onto treatment resistance (Christensenet al., 2011). Further complicating the picture, translational studiesusing the sucrose test in humans, for example, have largely beennegative (Berlin et al., 1998; Dichter et al., 2010; McCabe et al.,2009) (see “Behavioural Tasks” below).

    1.8. Reward tasks not tested in animal models of depression

    Tasks measuring prediction error, reward bias, learning andeffort have been used preclinically, although not in animal mod-els of depression (Schultz, 1998; Der-Avakian et al., 2013; Ineichenet al., 2012; Bari et al., 2010; Salamone et al., 1994). However,they have been utilized in human MDD studies. Consequently,their use in animal MDD models could provide more informativetranslational data. Description of preclinical tasks not employed indepression research is beyond the scope of this article; therefore,details regarding prediction error, signal detection, probabilisticreward learning, and reward effort tasks as they pertain to humanstudies are presented in the clinical section below (see “Task-basedmethods”).

    2. Clinical methods

    Anhedonia measurement in depressed humans utilizes directsymptom scales or behavioral tasks. While scale methods pro-vide direct evidence of patients’ experience, combining behavioral

  • Biobeh

    mdl

    2

    i((d(daiap

    Wnpcrctelepwt

    ot(vitasF“msbeauIspnoba2

    acvwFadNq

    S.J. Rizvi et al. / Neuroscience and

    ethods with neuroimaging offers an opportunity to disentangleifferent components of reward processing and identify neurobio-

    ogical underpinnings associated with such abnormalities.

    .1. “First generation” questionnaire-based methods

    The four main validated self-report measures of anhedonia usedn clinical research are the Snaith–Hamilton Pleasure Scale (SHAPS)Snaith et al., 1995), the Fawcett–Clark Pleasure Capacity ScaleFCPS) (Fawcett et al., 1983), the Revised Chapman Physical Anhe-onia Scale (CPAS) and the Chapman Social Anhedonia Scale (CSAS)Chapman et al., 1976) (Table 1). Ideally, a scale quantifying anhe-onia in the context of MDD should be able to measure differentspects of anhedonia, detect state versus trait differences, and takento account varying cultural beliefs and preferences (generaliz-bility). Although all of these scales have been validated in clinicalopulations, they differ in their ability to meet these criteria.

    The aspects of anhedonia measured differ among the four scales.hereas the CPAS and CSAS measure various aspects of anhedo-

    ia (motivation, effort, and consummatory pleasure) in addition toersonality traits, both the FCPS and SHAPS focus exclusively ononsummatory pleasure. Factor analysis of the FCPS and SHAPSevealed a unitary structure that primarily loaded onto hedonicapacity (Nakonezny et al., 2010; Leventhal et al., 2006), whereashe CPAS did not significantly relate to hedonic capacity (Leventhalt al., 2006). In this aspect, the CPAS and CSAS may be moreikely to detect individual differences where hedonic capacity is notxpected to significantly correlate with a task outcome. For exam-le, in one study, high scores on the CPAS and CSAS were correlatedith low willingness to expend effort for a reward task, whereas

    he SHAPS did not (Treadway et al., 2009).It is also still unclear whether anhedonia is a stable construct

    ver time in depressed patients (trait) or a symptom that fluc-uates depending on severity or even antidepressant mechanismstate). Therefore, a scale that is able to assess responses “right now”ersus “over time” or “in general” would be ideal for measurementn MDD. The CPAS and CSAS measure anhedonia “in general” andhe items reflect anhedonia as a personality trait instead of specificspects of hedonic function (e.g. “when I move to a new city, I feel atrong need to make new friends” on the CSAS). In contrast, both theCPS and SHAPS measure state anhedonia (FCPS right now, SHAPSlast two days”), which may be more beneficial in capturing infor-ation in the context of a depressive episode. For example, in a

    ample of inpatients anhedonia scores based on the FCPS were sta-le over 7 months despite recovery in two thirds of patients (Clarkt al., 1984). In another naturalistic study in chronic MDD patients,nhedonia (based on the FCPS) did not change over a 1-year follow-p despite reductions in depressive symptoms (Schrader, 1997).

    t is unclear whether the same effect would be observed in otheramples and to what extent anhedonia is related to failure of antide-ressants to target this symptom. Importantly, a trait measure willot be as sensitive to the acute and perhaps early changes that canccur with antidepressant treatment. Consistent with this notion,oth the SHAPS and FCPS have demonstrated ability to measurecute changes in anhedonia (Martinotti et al., 2012; Willner et al.,005).

    In order for a scale to effectively evaluate a construct, it needs tovoid unnecessary measurement of other overlapping but differentonstructs (e.g. mood and anxiety in the context of MDD; divergentalidity), while retaining the ability to demonstrate a correlationith similar constructs (convergent validity). Both the SHAPS and

    CPS exhibit good convergent and divergent validity: they moder-

    tely correlate with depression severity as would be expected, buto not correlate with measures of anxiety (Leventhal et al., 2006;akonezny et al., 2010). The SHAPS is also positively correlated withuality of life and functioning (Nakonezny et al., 2010). Contrary

    avioral Reviews 65 (2016) 21–35 25

    to this, the CPAS has a weak correlation with depression severity,while both the CPAS and CSAS have strong associations with non-affective aspects of personality and psychotic disorders (Leventhalet al., 2006), likely due to the development of these scales for usein schizophrenia. In addition, the Chapman scales include itemsthat are not clearly related to anhedonia (CPAS: “I have often feltuncomfortable when my friends touch me; CSAS: ‘My emotionalresponses seem very different from those of other people’).

    All of these scales incorporate questions relating to both primaryand secondary reward. The SHAPS, in particular, devised itemsbased on the domains of pastimes, social interaction, food/drink,achievement and sensory experience. This is in contrast to the CPASand CSAS, which separate physical and social anhedonia. Whilethey may be separate facets of anhedonia, it would be more feasiblefor clinical use if a questionnaire incorporated different domainsof anhedonia in a single scale. However, as discussed, the SHAPSencompasses a unitary construct of consummatory anhedonia anddoes not separate based on domain.

    The CPAS, CSAS as well as the FCPS lack generalizability due tothe high degree of cultural bias demonstrated from questions suchas “I always find organ music dull and unexciting” (CPAS) and “youare skiing down a mountain very fast while still in good control ofyourself” (FCPS). In contrast, the SHAPS was developed to avoid cul-tural bias and so contains items with wider applicability (“I wouldbe able to enjoy my favourite meal”). As a result, one could arguethat it does not capture the events or activities that are likely to elicitstrong hedonic responses. The ability to accurately tap into the sub-jective nature of what individuals find pleasurable or interesting is,perhaps, the greatest challenge in measuring anhedonia.

    2.2. “Second generation” anhedonia scales

    In the last 8 years there has been a resurgence in refininganhedonia scales with at least 5 new published self-report ques-tionnaires (Table 2), which attempt to take into account differentfacets of reward function instead of only consummatory pleasure.All of these scales take approximately 5–10 minutes to complete.

    The Temporal Experience of Pleasure Scale (TEPS) has 18 itemsand two subscales designed to distinguish between anticipatoryand consummatory pleasure (Gard et al., 2006). Items only reflectphysical anhedonia as the authors believed this would result inmore homogenous and interpretable results. The scale was val-idated using a student population, and extended, to the best ofour knowledge, only to schizophrenia and bipolar disorder psy-chiatric populations (Gard et al., 2007; Tso et al., 2014). Althoughthe authors report that items were developed to avoid cultural bias,certain questions could still be seen as culture specific (“When I’mon my way to an amusement park, I can hardly wait to ride the rollercoasters”). Furthermore, the scale also includes questions that maybe too vague to elicit a strong hedonic response (“Looking forwardto a pleasurable experience is in itself pleasurable”). Finally, duringthe validation trial, the anticipation scale had an internal consis-tency reliability of 0.64, which is below the recommended 0.70.Additional validation trials in psychiatric groups should be com-pleted to confirm the psychometric and factor analytic properties.A significant advantage of this scale is that its two-factor structurethat separates anticipatory and consummatory aspects of reward.

    More recently, Llerena et al. (2013) developed the Motivationand Pleasure Scale-Self Report (MAP-SR) to measure negativesymptoms in schizophrenia (Llerena et al., 2013). The MAP-SRcontains 15 questions across four domains: social pleasure, recre-ational or work pleasure, feelings and motivations about close,

    caring relationships, motivation and effort to engage in activities.The questions are answered on a 4-point Likert scale, where a highscore is indicative of low anhedonia. Notably, within each domain,both intensity and frequency are gauged (“. . ..what is the most plea-

  • 26 S.J. Rizvi et al. / Neuroscience and Biobehavioral Reviews 65 (2016) 21–35

    Table 1First generation scales to measure anhedonia.

    Scale Authors Description Reliability(Cronbach-�)

    Populations tested

    Fawcett–Clark pleasurecapacity scale (FCPCS)

    Fawcett et al. (1983) 36-item, 9-point scale(extreme and lastingdispleasure to extreme andlasting pleasure)

    .85 Major depressivedisorder

    SHAPS Snaith et al. (1995) 14-item scale (stronglydisagree to strongly agree)

    - very general

    .74 MDD Healthy controlsMajor depressivedisorder

    Revised socialanhedonia acale

    Eckbald et al. (1982)(Original in: Chapmanet al., 1976)

    61 Item true-false scale

    - more dimensions, taps intomore specific experience

    - no gradation in score

    .79 male and female Healthy controls,schizophrenia,personality disorder,major depressivedisorder, alcohol abuse

    Revised physicalanhedonia scale

    (Original in: Chapmanet al., 1976)

    40-Item true-false scale

    - no gradation in score

    Male: .82Female: .78

    Healthy controls,schizophrenia, majordepressive disorder,alcohol abuse

    Table 2Second generation scales to measure anhedonia.

    Scale Authors Description Reliability(Cronbach-�)

    Populations tested

    Temporal experienceof pleasure scale

    Gard et al. (2006) 18-item, 6 point scale

    - assesses physical anhedonia- separate scale for

    anticipatory andconsummatory reward

    Total scale: .78TEPS-ANT: .72TEPS-CON: .64

    Healthy students

    Motivation andpleasure scale

    Llerena et al. (2013) 15-item, 5 point scale

    - evaluates effort, pleasureacross different domains

    .90 Schizophrenia

    Specific loss of interestscale

    Winer et al. (2014) 23-item, 4 point scale

    - measures social anhedonia- timeframe is 2 weeks

    .94 Healthy controls

    Anticipatory andconsummatoryinterpersonal pleasurescale (ACIPS)

    Gooding and Pflum(2014a,b)

    17-item, 6 point scale

    - measures social anhedonia

    .86 Healthy controls

    Dimensionalanhedonia rating scale

    Rizvi et al. (2015) 17-item, 5 point scale

    - evaluates interest,motivation, effort, and

    ross d

    0.92–0.96 Community sampleHealthy controlsMajor DepressiveDisorder

    seftdaitrida

    pleasure acreward

    ure you have experienced this week. . .”, “. . .how often have youxperienced pleasure from being with other people”). A uniqueeature of the MAP-SR is that it contains items querying predic-ion of future reward (“in the next few weeks, how much pleasureo you expect you will experience. . .”). Scale items avoid issuesround generalizability by presenting broader questions (“Whats the most pleasure you experienced from your hobbies. . .”), butherefore do not have specificity that may produce a strong reward

    esponse. Furthermore the motivation and effort to engage in activ-ties is solely centred around those at work or school. The scaleemonstrates high internal consistency reliability (0.90), as wells appropriate convergent and divergent validity. Thus far, nor-

    omains of

    mative data do not exist and the scale has only been validated inschizophrenia.

    The Specific Loss of Interest Scale (SLIPS) was primarilydesigned to measure levels of interest over time (2 week period)(Winer et al., 2014). Each of the 23-items has a 3-point scale,with higher scores denoting increasing levels of anhedonia. TheSLIPS demonstrated high reliability (0.94) as well as convergentvalidity with the SHAPS, moderate correlation with the TEPS antic-

    ipatory scale and small correlation with the TEPS consummatoryscale. A 1-factor solution mostly encompassing social anhedoniaitems was reported. This is consistent with the disparate correla-tions observed with the TEPS, which measures physical anhedonia.

  • Biobeh

    Jsb

    SsarttnaasaWti“ccnscCute

    aaiaraqomtpecchDipirocbD

    2

    Atol(itsi

    S.J. Rizvi et al. / Neuroscience and

    ustification for the two week time point is not clear, especially con-idering the stability of anhedonia as a construct over time has noteen established.

    The Anticipatory and Consummatory Interpersonal Pleasurecale (ACIPS) (Gooding and Pflum, 2014a,b) is a 17-item self-reportcale that focuses on measuring anhedonia related to social inter-ctions. The focus on social anhedonia is derived from researcheporting high levels of social anhedonia as being a risk factor forhe development of schizophrenia-spectrum disorders. Althoughhe revised CSAS measures the same construct as the ACIPS, it doesot distinguish between anticipation and consummatory pleasure,nd it is unclear whether the CSAS would be useful in youth ordolescent groups due to the age bias of the items. The ACIPS waspecifically designed to address these limitations as well as achieve

    shorter scale, which would be more useful in clinical settings.hile the ACIPS theoretically has an anticipatory and consumma-

    ory component, this was not reflected in the 3-factor structuredentified in the preliminary validation trial, which mapped ontointimate social interactions”, “social interactions within a groupontext”, and “pleasure derived from social bonding and makingonnections with others” (Gooding and Pflum, 2014a,b). The inter-al consistency was high for the overall scale (0.86), and the totalcores were significantly correlated with both the anticipatory andonsummatory subscales of the TEPS, more so than with the revisedSAS. Test-retest reliability of the ACIPS was good in a healthy pop-lation (r = 0.78). Although the authors devised scale items in ordero avoid age, gender, and cultural biases, these factors were notvaluated in the validation trial.

    Finally, the Dimensional Anhedonia Rating Scale (DARS) is 17-item self-report questionnaire that was designed to assessnhedonia in MDD, and particularly to increase scale generalizabil-ty while maintaining specificity (Rizvi et al., 2015). Towards thisim, respondents provide their own examples of rewarding expe-iences across the domains of hobbies, social activities, food/drink,nd sensory experience (increase in item specificity). They subse-uently answer a set of standardized questions with the timeframef “right now” evaluating interest, motivation, effort, and enjoy-ent of reward within each domain. The reliability and validity of

    he DARS was evaluated in three studies, two in community sam-les, and the third in an MDD and healthy control sample (Rizvit al., 2015). Principal components analysis demonstrated a fouromponent solution that mapped onto reward domain. Internalonsistency reliability of the total DARS score and subscales wasigh across studies (0.92–0.96 and 0.75–0.92, respectively). TheARS also demonstrated good convergent and divergent valid-

    ty with the SHAPS and depression scores, respectively. In MDDatients, the DARS also showed utility over the SHAPS in predict-

    ng treatment resistant status. The timeframe of the DARS enablesepeat testing that can aid in assessing the stability of anhedoniaver time. However, further research is required to confirm theomponent structure and test-retest reliability, which is currentlyeing evaluated in the Canadian Biomarker Integration Network forepression research program (Kennedy et al., 2012).

    .3. Additional scales to measure aspects of anhedonia

    BIS/BAS. The Behavioral Inhibition System and the Behavioralctivation System (BIS/BAS) was developed to measure personality

    raits of behavioral approach and inhibition based on Gray’s theoryf behaviour, the concept being that there are two distinct neuro-ogical systems for aversive motivation and appetitive motivationCarver and White, 1994). Accordingly, the BIS system is activated

    n response to non-rewarding, novel stimuli that can lead to nega-ive outcomes and inhibits behavior towards these stimuli. The BASystem, in contrast, is activated by rewarding stimuli. The BIS/BASs a 24-item self-report scale with 4 factors: one for the BIS and 3

    avioral Reviews 65 (2016) 21–35 27

    subscales for the BAS (drive, reward response and fun seeking). Psy-chometric properties of the BIS/BAS reflect convergent validity withdepression and anxiety, as well as other personality measures (e.g.positive correlation between BIS and neuroticism) (Campbell-Sillset al., 2004). In the context of mood disorders, high BIS sensitiv-ity and low BAS sensitivity have been associated with depression(Hundt et al., 2007; Kasch et al., 2002). Interestingly, low BAS sen-sitivity at baseline is predictive of poor depression outcomes inMDD (McFarland et al., 2006); however, in bipolar disorder highBAS sensitivity is predictive of time to manic episodes, while theBIS is predictive of depressive episodes (Alloy et al., 2008).

    Motivation Scales. Considering motivation is a key componentof reward function, it follows that adequate measurement of thisconstruct is necessary to obtain a full assessment of anhedonia.There is a general paucity of motivation scales available, with mostassessment of motivation extracted from quality of life and healthsurveys.

    Apathy Evaluation Scale. In the psychological context, apathy isconceptualized as an overall lack of motivation based on decreasedgoal-directed behavior or thoughts, as well as affective flatten-ing or indifference (Marin et al., 1991). Indeed, a lack of desire topursue a reward or pleasure from a reward is common to bothapathy and anhedonia, while emotional blunting/indifference isspecific to apathy. An anhedonic individual may still view socialrelationships as being important despite a lack of drive to pursuethem while an apathetic individual no longer finds social relation-ships to be a valuable endeavor. The Apathy Evaluation Scale (AES;also known as Marin Apathy Scale) (Marin et al., 1991), is a 14-item scale that can be administered as a self-report, observer-rated(e.g. caregiver, spouse, family member), or clinician-rated scale. Inthe validation trial involving Alzheimer’s, depression and strokepatients, all three versions of the AES demonstrated high internalconsistency reliability ( ̨ = 0.86–0.94) and adequate test-retest reli-ability (r = 0.76–0.94). However, the informant version was not ableto distinguish between apathy and depression, while the self-reportand clinician rated version did. This could be due to several factors,including the level of variability in responses as well as differencesamong how the groups understood the questions. Furthermore,specifically in depressed subjects, high apathy was correlated withfunctional impairment (Rothschild et al., 2014).

    The Motivation and Energy Inventory (MEI). To our knowledge,this is the only published motivation scale to be developed specif-ically for MDD. The self-report inventory is designed to measurechanges in lassitude and energy with antidepressant treatment.The original scale includes 27-items with 3 subscales measuringsocial motivation, physical energy and mental energy with ade-quate internal reliability across the subscales (Fehnel et al., 2004).Poor motivation was weakly correlated with higher depressionseverity and moderately correlated with decreased quality of lifeand functioning. Subsequently, the scale has been shortened to an18-item version that has been used in clinical trials to evaluateefficacy of bupropion XR (Hewett et al., 2009).

    2.4. Clinical scale summary

    The SHAPS remains the gold standard for measuring anhedoniain depression. It is recommended that any scale should be vali-dated in the population of interest prior to use. While the CPAS andCSAS have been used in to assess anhedonia in studies of depres-sion, only the SHAPS, FCPS and DARS have undergone empiricalscale validation procedures in MDD samples. Although the SHAPSonly measures consummatory pleasure, it does so across several

    domains and with limited cultural biases. Considering consumma-tory reward is not consistently impaired in depression, the SHAPSmay be useful to identify subgroups within MDD or test specificeffects of treatment, but may not have the sensitivity to be utilized

  • 2 Biobeh

    adobnopsfcw

    3

    oaiewiaIit

    3

    wmrwc

    mtw(ataatFap2

    tuattccbotcbmt(

    8 S.J. Rizvi et al. / Neuroscience and

    s a predictor of treatment response. Further study is needed toetermine whether deficits in reward responding are dependentn reward type (e.g. social, food, physical), for which the DARS maye able to tease apart any potential differences given its compo-ent structure is based on reward type. Most importantly, in lightf emerging evidence indicating that different facets of rewardrocessing are subserved by partially dissociable neurobiologicalystems (Der-Avakian and Markou, 2012), it will be imperative foruture scale development to evaluate desire, motivation, effort, andonsummatory pleasure across different domains of anhedonia, asell as measuring the stability of the construct.

    . Behavioural tasks

    Various tasks have been developed to objectively assess facetsf reward processing in MDD. These include paradigms probingnticipation and consumption of positive stimuli, delay discount-ng, reward response bias, prediction error, reversal learning, andffort to acquire rewards (Table 3). For the purposes of this review,e will discuss how tasks can be used to evaluate the follow-

    ng aspects of reward function: association/valuation, expectation,nticipation, effort, outcome, and feedback integration (see Fig. 1).nterest will not be discussed in this section as at present, levels ofnterest are probed using questionnaire-based methods as opposedo behavioural tasks.

    .1. Association and valuation

    At the outset of the reward process, association of a stimulusith a reward needs to be established in addition to a value judg-ent on the rewarding properties of a stimulus. The ability to make

    eward associations is best tested using reward response bias tasks,hile valuation of future reward can be tested using delayed dis-

    ounting.Reward Response Bias. Tasks based on signal detection theory

    easure a participant’s ability to accurately discriminate betweenarget and nontarget stimuli (“discriminability” or “sensitivity”), asell as the tendency to define an ambiguous stimulus as the target

    response bias) (Henriques and Davidson, 2000). When the rewardssociated with correctly identifying a stimulus is manipulated,here is a change in response bias towards the stimulus associ-ted with the larger (or more frequent) reward. Response bias is

    key component of signal detection theory and allows investiga-ors to assess disorder-related sensitivity to reward or punishment.indings of a lack of response bias towards reward in depressionre interpreted as reflecting impairment in an approach-relatedositive affect system (low reward engagement) (Pizzagalli et al.,008).

    The stimuli and reward contingencies employed in signal detec-ion tasks can vary. For example, Henriques and Davidson (2000)sed word recognition as the discriminating stimulus. Individu-ls with MDD and healthy controls were given three blocks ofrials (neutral, reward and punishment) and viewed a series ofarget words, followed by a color distraction task, and then dis-rimination trials. Participants were presented with the rewardontingencies at the beginning of each block (no reward in neutrallock, $0.10/correct word identification in reward block, deductionf $0.10/failure to identify target word in punishment block), sohey did not have to learn reward contingencies. Relative to healthyontrols, MDD participants showed a significantly lower response

    ias during the reward condition, and therefore, failed to maxi-ize their earnings. Highlighting the specificity of these findings,

    here was no group effect observed for the punishment conditionHenriques and Davidson, 2000).

    avioral Reviews 65 (2016) 21–35

    Subsequently, Pizzagalli et al. (2005, 2008) extended thisresearch using a different task to evaluate response bias as a func-tion of reward, depression and anhedonia (see also Tripp and Alsop,1999). During each trial a mouth-less cartoon face is presented, fol-lowed by a brief presentation (100 ms) of a long or short mouth.The goal is to identify whether the mouth presented was long orshort. Unbeknownst to the participants, correct identifications forone stimulus (e.g. the long mouth) are rewarded with monetaryrewards three times more frequently than correct identification ofthe other stimulus. Among healthy controls, such differential rein-forcement schedules elicit a reliable response bias (i.e. a preferencefor the stimulus that has been paired with more frequent reward).Individuals with elevated depressive symptoms were characterizedby blunted response bias (Pizzagalli et al., 2005). While this effectwas correlated with levels of anhedonia based on the melancholicsubscores of the Beck Depression Inventory (BDI; Beck et al., 1961),they did not correlate with CPAS or CSAS scores. Test-retest relia-bility of this task was satisfactory. In subsequent studies a similarpattern of results emerged whereby MDD patients demonstratedreduced reward learning associated with high levels of anhedonia(Pizzagalli et al., 2008; Vrieze et al., 2013). Reduced reward learningalso predicted poor antidepressant response after 8 weeks (Vriezeet al., 2013), and was observed in fully remitted MDD patientscompared to healthy controls (Pechtel et al., 2013), suggestingthat blunted reward learning might be a trait-like characteristicof depression. Of note, Pizzagalli et al. recently developed a rodentversion of this task, which is conceptually analogous to that usedin humans, opening new avenues for cross-species translationalresearch (Der-Avakian et al., 2013; Pergadia et al., 2014).

    The main differences between the Henriques and Davidson(2000) and Pizzagalli et al. (2005) tasks pertain to the stimuli usedas well as the reward contingencies. The first task described usedword recognition as the targets, while the second task used dis-crimination of a non-verbal stimulus. Consequently, the Henriques& Davidson task is more susceptible to confounding due to the ver-bal working memory impairment observed in depression (Walshet al., 2007); non-affective visual discrimination impairment is notconsistently reported in MDD (Feinberg et al., 1986). Furthermore,in the word recognition task, the reward contingency for a cor-rect response was known for all trials, while in the cartoon facetask, participants had to learn which response was associated withgreater reward. Therefore, the second task incorporates probabilis-tic reward learning. Moreover, whether participants know aboutprobabilistic contingencies may not impact the lack of responsebias to reward in MDD (Liu et al., 2011). Importantly, for signaldetection tasks the reward is always fixed (unlike for delay dis-counting and other probabilistic reward tasks), limiting the abilityto assess the effect of depression on subjective evaluation of differ-ent reward magnitudes.

    Delay discounting. Decision making concerning future rewardis another aspect of reward function that can be measured indepression. Delay discounting is a phenomenon where the valueof a future reward decreases as the time to acquiring it increases(Green et al., 1997). It is typically measured using a monetary choicetask of immediate versus delayed reward (“would you prefer $2now or $10 in 30 days”) (Kirby et al., 1999; Richards et al., 1999).Monetary values and time delays vary across studies; in some stud-ies a range of reward magnitudes is used (Pulcu et al., 2014), while inothers a fixed reward value is used (Lempert and Pizzagalli, 2010);however, the immediate reward is always smaller than the delayedreward.

    Indeed, the extent to which individuals value future reward

    varies considerably and can be acutely affected by different fac-tors. The main issue regarding these tasks is that high impulsivityand low working memory capacity have been noted to result in abias towards immediate reward, thereby confounding the results

  • S.J. Rizvi et al. / Neuroscience and Biobehavioral Reviews 65 (2016) 21–35 29

    Table 3Behavioural tasks to measure facets of reward in depression.

    Task Reward process measured Reward Studies in MDD

    Delay discounting - Future reward Money Pulcu et al. (2014)Takahashi et al. (2008)Dombrovski et al. (2012)

    Monetary incentive delay - Anticipation- Reward outcome- Reward association learning

    Money Knutson et al. (2008)Dichter et al. (2010)Ossewaarde et al. (2011)Pizzagalli et al. (2009)Stoy et al. (2012)

    Gambling paradigms - Anticipation- Reward outcome- Feedback integration- Reward association learning- Prediction error- Risk taking

    Money Capuron et al. (2012)Must et al. (2013)

    Reward response bias - Reward sensitivity(behavioural approachsystem)

    - Reward association learning

    Money Henriques and Davidson (2000)Pizzagalli et al. (2005)Pizzagalli et al. (2008)Vrieze et al. (2013)Pechtel et al. (2013)Liu et al. (2011)

    Prediction error - Reward expectation- Reward association learning- Feedback integration

    Money, water Kumar et al. (2008)Forbes et al. (2009)Cohen et al. (2009)Gradin et al. (2011)Chase et al. (2013)

    Probabilistic reversal learning - Feedback integration Money Murphy et al. (2003)Taylor Tavares et al. (2008)Hasler et al. (2009)

    (ic2ddgiuiP

    irDabps2mpSdi2s

    3

    T

    Effort - Effort to acquire reward

    Crean et al., 2000; Li et al., 2013; Hinson et al., 2003). However,mpulsivity as assessed on established personality scales in healthyontrols did not affect delayed discounting (McLeish and Oxoby,007), and a preclinical study where impulse control in rats wasecreased by inactivation of the ventral medial prefrontal cortexid not affect delayed discounting (Feja and Koch, 2014). This sug-ests impulsivity, in particular, may only relate to discounting ratesn subsamples of individuals. Still other studies have shown that thencertainty of the future and psychosocial stress can both result in

    ncreased delayed discounting (Kimura et al., 2013; Lempert andizzagalli, 2010).

    In depression, there have been few studies of delayed discount-ng, although they consistently show an increased discountingate in MDD compared to healthy controls (Pulcu et al., 2014;ombrovski et al., 2012; Takahashi et al., 2008), demonstrating

    preference for immediate rewards. This effect was sustainedetween acutely depressed patients compared to remitted MDDatients and healthy controls, whereby depressed patients demon-trated increased discounting of large future rewards (Pulcu et al.,014). This suggests that preference for immediate smaller rewardsay be a state phenomenon in depression for at least a subset of

    atients. Interestingly, higher levels of anhedonia (rated by theHAPS) among a student sample were associated with reducediscounting of large future reward even after controlling for work-

    ng memory capacity and impulsiveness (Lempert and Pizzagalli,010). The authors propose this may be due to a decreased respon-iveness to immediate reward in anhedonic individuals.

    .2. Anticipation

    Many tasks can be modified to evaluate anticipation of reward.ypically this is measured using brain imaging during the delay just

    Money, humour Treadway et al. (2012)Sherdell et al. (2012)

    before a reward is received. The monetary incentive delay (MID)task and gambling paradigms are frequently used for this purpose.

    Monetary incentive delay. Developed by Knutson et al. (2000),the monetary incentive delay (MID) task was designed to disen-tangle anticipatory vs. consummatory phases of reward processing,and has been extensively used across clinical and non-clinical pop-ulations in conjunction with functional neuroimaging. It involvesthree trial types where participants gain (reward trial), lose (pun-ishment trial), or no win/lose (no-incentive trial). Each trial requiresparticipants to quickly respond to a target preceded by an incentivecue and followed by feedback. For example, participants receive areward in a reward trial or avoid losing in a punishment trial ifthey respond to the target within an individually titrated responsewindow. In healthy individuals, increased striatal activity dur-ing reward anticipation has been reported (Knutson et al., 2000;Kumar et al., 2014; Dillon et al., 2008), as well as increased activ-ity in the anterior cingulate (Dillon et al., 2008). Similar to healthycontrols, depressed patients demonstrate increased activation inthe anterior cingulate gyrus during anticipation (Knutson et al.,2008), an effect that persists in remission (Dichter et al., 2010).However, striatal activity is not consistently observed (Knutsonet al., 2008; Dichter et al., 2010; Stoy et al., 2012). In two reports,decreased ventral striatal activity was normalized with an SSRIor SNRI (Ossewaarde et al., 2011; Stoy et al., 2012). With respectto consummatory reward outcome, in healthy controls increasedactivation in the orbitofrontal cortex and medial prefrontal cor-tex is observed (Knutson et al., 2001; Dillon et al., 2008), while indepressed patients in a current episode outcomes are associatedwith decreased nucleus accumbens and caudate activity (Pizzagalli

    et al., 2009); among individuals with remitted depression, activa-tion in response to reward outcome is blunted in the orbitofrontalcortex, insula and thalamus (Dichter et al., 2010). Limitations of

  • 3 Biobeh

    taapfi

    eotebwatliltilcretvlif

    3

    itt

    tadaortptcidatpi2aw

    ftimdwotew

    0 S.J. Rizvi et al. / Neuroscience and

    ask-based neuroimaging using the monetary incentive delay taskre the assumption that anticipation and consummatory pleasurere temporally independent and that the task elicits these rewardrocesses in all participants, which can lead to inconsistencies inndings.

    Gambling paradigms. These tasks can be used to evaluate sev-ral aspects of reward function including risk-taking, anticipationf reward, hedonic response to reward and punishment, predic-ion error, and feedback integration (Steele et al., 2007; Capuront al., 2012; Adida et al., 2011). One of the most common gam-ling tasks is the Iowa Gambling Task (IGT) (Bechara et al., 1994),hich involves choosing a card from 4 decks of cards. Two decks

    re associated with high gains but unpredictable high losses, whilehe other two decks are associated with smaller reward and lowerosses over time (advantageous deck). A variant of this task alsoncludes the reverse, where two decks are associated with highoss but periodic and unpredictable high reward, while the otherwo are associated with smaller loss (Bechara et al., 1994). Find-ngs using the IGT in depression show that MDD patients are lessikely to choose from the advantageous deck and fail to adjust theirhoices based on feedback, preferring immediate high short-termeward (Must et al., 2013), consistent with the delay discounting lit-rature described above. Furthermore, in gambling tasks designedo measure hedonic response to gains, decreased activation in theentral striatum to reward was correlated with greater anhedoniaevels (Capuron et al., 2012). As with delay discounting limitations,t is difficult to dissociate risky behaviour/impulsivity from a desireor immediate reward.

    .3. Expectation

    Expectation of reward can be based on available probabilitynformation or on previous stimulus-reward associations. The lat-er is the most frequently assessed in terms of prediction error –he brain signal that results from unexpected reward outcomes.

    Prediction error. Prediction error has been studied with respecto dopamine neuronal functioning in corticolimbic and nigrostri-tal circuits (reviewed in Schultz, 2013). Research in this area hasemonstrated that dopamine activity in response to reward actss a metric to evaluate whether a stimulus is a reward (in therbitofrontal cortex), as well as whether the expected reward waseceived (in the ventral striatum). Prediction error occurs whenhe reward magnitude is not accurately predicted: specifically, ahasic burst of dopamine is observed when the outcome is betterhan expected, whereas a dopamine “dip” is seen when the out-ome is worse than expected. There is no response when a rewards fully predicted. Given growing evidence to support dopaminergiceficits in MDD (Dunlop and Nemeroff, 2007; Pizzagalli, 2014), thedaptation of this task in human models provides an opportunityo more fully understand deficits in reward learning among MDDatients. Several paradigms have been used to test prediction error

    n depression (Kumar et al., 2008; Cohen et al., 2009; Gradin et al.,011; Steele et al., 2007; Chase et al., 2013). The common threadmong the tasks is to have a learned reward contingency changehere the received reward is greater or less than expected.

    Initial studies used a primary reward by depriving participantsrom water the night before and delivering drops of water whenhey correctly identified which of two pictures predicted receiv-ng water. Participants were told the picture predicting outcomes

    ight change (Kumar et al., 2008; Gradin et al., 2011). Water waselivered based on a probability contingency whereby one pictureas associated with high reward probability (60–90%), and the

    ther was associated with low probability (0–20%). Importantly,hese associations changed over 100 trials to elicit a predictionrror signal. In both studies prediction error signal in MDD patientsas blunted compared to healthy controls (Kumar et al., 2008;

    avioral Reviews 65 (2016) 21–35

    Gradin et al., 2011). In addition, there were differences betweenMDD and schizophrenia patients, whereby MDD patients demon-strated reduced activation in striatal and midbrain regions thatcorrelated with anhedonia severity, while schizophrenia patientsdemonstrated decreases in the caudate, thalamus, insula, amyg-dala and hippocampus that correlated with psychotic symptoms(Gradin et al., 2011).

    A card guessing game task has also been employed to evalu-ate prediction error in depression (Chase et al., 2013; Forbes et al.,2009), which was adapted from Delgado et al. (2000) to probe stri-atal response to feedback. Participants can earn $1, lose $0.50 orwin nothing: there are win trials (expectation of a win, followedby win), disappointment trials (expectation of win followed by noreward), loss trials (expectation of loss, followed by loss), or relieftrials (expectation of loss followed by no loss). This task does notinvolve a learning component, so is more suited to assess feedbackintegration than prediction error which is dependent on develop-ing a cue/reward or cue/punishment association. This may be whythere were no prediction-related differences among MDD, bipo-lar and healthy controls, despite demonstrating differences acrossgroups during reward-expectancy and anticipation (Chase et al.,2013).

    A further modification to this task involves separating acqui-sition of reward contingencies and already learned associations(Cohen et al., 2009). Based on preclinical studies (Morris et al.,2006), this task features two phases: learning and choosing. In thelearning phase, participants click a left or right button in responseto a left or right visual cue, respectively, after which they weregiven feedback about winning either $.06 (safe trial with 100% con-tingency) or winning or losing $0.12 (risky trial with 75% chanceof reward and 25% chance of loss). Once this phase is complete,the choosing phase begins with participants freely selecting one ofthe two cues presented to them from the first phase, which some-times results in winning money and sometimes not. The rewardcontingencies are the same, although participants are not informedabout this. MDD patients demonstrated greater nucleus accumbensactivity to risky compared to safe cues, consistent with predic-tion error findings (Schultz, 1998). However, nucleus accumbensactivity during the choose phase only occurred during feedbackpresentation, which the authors suggest reflects that the partici-pants have already learned the task and so the nucleus accumbensis not needed (Cohen et al., 2009).

    3.4. Effort

    Effort-Expenditure for Rewards (EEfRT). The EEfRT task(Treadway et al., 2009) was developed based on two streams ofresearch: (1) Depression is not consistently associated with deficitsin consummatory pleasure, but may be more related to anticipationor reward cost/benefit decision making, and (2) animal researchhas demonstrated neurobiological differences in the componentsof reward (e.g. anticipation, consummatory reward), whereby lowdopamine levels appear to bias animals towards low rewardsrequiring low effort, and high levels of dopamine bias animalstowards high rewards requiring high efforts (Salamone et al., 2007).There is also greater dopamine release in the nucleus accumbenswhen high cost/high rewards cannot be accurately predicted, butthis effect is not observed for consummatory pleasure. Therefore,the dopaminergic dysfunction observed in depression (Dunlop andNemeroff, 2007), would not be detected by the majority of rewardtasks that emphasize consummatory reward response.

    Based on the animal task developed by Salamone et al. (2007),

    the EEfRT task (Treadway et al., 2009) allows analysis of the pre-dictive value of reward probability and magnitude on effort-baseddecision making. This computerized task lasts 20 min and has mul-tiple trials, in which participants have 5 s to choose whether they

  • Biobeh

    wedalgrpovciwat

    hsAaoSsaIpat2

    misaep

    e(attp

    ofwtptweataD

    tapsTwp

    of general cognitive impairment in MDD (Gualtieri et al., 2006;McClintock et al., 2010; Porter et al., 2003), although these deficits

    S.J. Rizvi et al. / Neuroscience and

    ant to perform an “easy” or “hard” task for monetary reward. Theasy trials last a total of 15 s, require 30 button presses in 7 s (using aominant finger) and are always associated with winning the samemount ($1.00) (low cost/low reward). The hard trials are twice asong, require 100 button presses in 21 s (using a non-dominant fin-er) and are associated with winning varying amounts of monetaryeward ($1.24-$4.30) (high cost/low or high reward). Since partici-ants are not guaranteed to win all trials, one of three probabilitiesf winning the trial (12%, 50%, and 88%) along with the monetaryalue associated with the easy vs. hard task is presented prior tohoosing. Participants receive “win/no win” feedback once the trials completed. The number of variables in the task and the speed

    ith which participants have to choose limit the ability to develop strategy for optimal performance, which helps to ensure that theask is measuring willingness to expend effort for a reward value.

    In the initial study of this task in healthy volunteers, those withigher levels of anhedonia (based on the CPAS, melancholy sub-cale of the BDI and negative affect on the Positive and Negativeffect Schedule) were less willing to expend effort for rewards,n effect that was particularly pronounced when the uncertaintyf obtaining the reward was highest (Treadway et al., 2009). TheHAPS, which as described above measures consummatory plea-ure, did not correlate with task performance, further suggesting

    distinction between reward-related effort and hedonic capacity.n a subsequent study in MDD vs. healthy controls, MDD partici-ants were less likely to choose the high cost/high reward tasksnd both probability and magnitude of reward were more predic-ive of choosing hard tasks among healthy controls (Treadway et al.,012).

    Importantly, a gender effect was noted in both studies, whereen were more likely to choose high cost/high reward options. It

    s unclear whether this effect is related to aspects of the task orex differences in effort-based decision making. As a component ofnhedonia, effort to acquire reward may be correlated with gen-ral levels of energy. Consequently, it follows that in the EEfRT taskerformance was associated with physical anhedonia.

    Other effort-based tasks. Sherdell et al. (2012) employed anffort-based task in MDD patients modified from Waugh and Gotlib2008). Instead of using money as a reward, they used cartoons. Theuthors contend that humour does not have an inherent anticipa-ory effect as money nor does it have the satiety effects of juice, andherefore allows for a more precise evaluation of consummatoryleasure that can be measured over many trials.

    Participants viewed two series of cartoons and rated their levelf enjoyment. Subsequently, they had to choose to see a cartoonrom one of the series again. The enjoyed cartoon was associatedith greater expenditure of effort based on mouse clicks. Overall,

    here were no differences in consummatory pleasure between MDDarticipants and healthy controls. However, among healthy con-rols, levels of cartoon liking predicted motivation to expend effort,hile in MDD liking and motivation were dissociated (Sherdell

    t al., 2012). Furthermore, among MDD participants, levels ofnticipatory pleasure predicted likelihood to expend effort for car-oons. However, it should be noted that the method to evaluatenticipation using a question from the Hamilton Rating Scale forepression, is not solely a representation of anticipation.

    Finally, Cléry-Melin et al. (2011) developed an incentive forceask to evaluate the effects of monetary incentive and emotionalrousal on grip force in MDD patients and healthy controls. Partici-ants viewed an emotional picture (positive, neutral, negative) andubsequently had to squeeze a grip for money (0.01, 0.10 and 1D ).he authors reported a lack of money value on grip force in patients,

    hile emotionally arousing pictures (irrespective of valence) didredict force production. These findings highlight an impairment

    avioral Reviews 65 (2016) 21–35 31

    in incentivized motivation in MDD. It also supports a distinctionamong stimulus types in generating effort to obtain a reward.

    3.5. Outcome

    The pleasurable endpoint of reward (consummatory pleasure)can be evaluated with most paradigms. Gambling and MID tasks,as described above, are useful for assessing outcome with reward.Response to positive stimuli and the sweet taste test have also beenused to evaluate reward outcome.

    Evidence suggests that there is an overall affect dysregulationin depression that impairs response to both positive and nega-tive stimuli. Some studies show a lack of recognition of happyfaces and reduced activation to positive pictures, while others sup-port an attentional bias to negative stimuli (Harmer et al., 2009;Leppänen, 2006; Bourke et al., 2010). Most commonly, the negativeand positive stimuli are emotional faces (happy, angry, fearful), oremotional pictures with varying levels of salience (happy, neutral,sad) (reviewed in Pizzagalli, 2014). These tasks may reflect atten-tional biases or general emotional dysregulation rather than rewardresponse.

    The sweet taste test (STT) represents a direct human trans-lational task to the sucrose task in animals. It involves havingparticipants taste different concentrations of a sucrose solutionand then rate them based on intensity and pleasantness (Kampov-Polevoy et al., 2006). Contrary to the traditional conceptualizationof anhedonia as a “loss of pleasure,” the few studies that have beenconducted using the SST or a variant of this task mostly show nodifference in hedonic response to sucrose in MDD participants com-pared to healthy controls (Berlin et al., 1998; Dichter et al., 2010;McCabe et al., 2009). However, while ratings may not have beendifferent, McCabe et al. (2009) reported decreased activation inthe ventral striatum in response to tasting chocolate in depressedpatients compared to healthy controls, indicating impairment inreward circuitry may exist without self-reported reduced liking.

    An important distinction with respect to consummatory plea-sure is related to “relative anhedonia”. This concept reflects theprobable phenomenon that the liking of a stimulus is dependenton the reward value of a stimulus experienced before it. For exam-ple, liking of a neutral stimulus might be rated higher if it waspreceded by an unpleasant stimulus versus a pleasurable one.Because depression is often characterized by a prolonged low-levelof reward in daily life, absolute consummatory pleasure might beblunted in MDD. Consequently, patients may report higher “liking”of stimuli in reference to their low reward experience in a depressedstate, as opposed to their higher reward experience when notdepressed. This could result in inflated liking scores in depressedindividuals that are not representative of the overall reduction inconsummatory pleasure. [We thank an anonymous reviewer forraising this point].

    3.6. Feedback integration

    The ability to integrate information regarding a rewarding stim-ulus is important in order to maintain updated and accurateassociations and expectations of reward. Prediction error tasksand gambling paradigms can both be used to evaluate feedbackintegration, however, probabilistic reversal learning is a simpleinterpretable task to evaluate this construct.

    Probabilistic reversal learning. There is substantial evidence

    are not specific to depression. However, there are data to suggestthat individuals with MDD are impaired in integrating negative

  • 3 Biobeh

    ftrfetpstartrrpalrTwt

    3

    lvwcrbosmcseasMieMrDs

    habeoTuhaicaboaiaaw

    2 S.J. Rizvi et al. / Neuroscience and

    eedback in order to optimize their performance on a task, an effecthat may be depression-specific (Elliott et al., 1997). Probabilisticeversal learning tasks were developed to evaluate the effects ofeedback on reward response (Budhani and Blair, 2005; Swainsont al., 2000). Again tasks can vary, but the common elements arehat participants are presented with a choice of two stimuli (e.g.ictures, two types of colored lines). Based on their first choice, theelected stimulus will be rewarded with a high probability, whilehe other will be rewarded with a low probability. Participants aresked to choose the one that most frequently is associated witheward and to continue choosing that stimulus despite any poten-ial loss trials they may incur. They are also told that this rule mayeverse, and thus the other stimulus might become more frequentlyewarded, which should prompt them to select such stimulus. MDDatients demonstrate hypersensitivity to negative feedback andre more likely than healthy controls as well as depressed bipo-ar patients to switch to the incorrect stimulus following negativeeinforcement (Murphy et al., 2003; Taylor Tavares et al., 2008).his effect was not observed in remitted MDD patients who under-ent catecholamine depletion (Hasler et al., 2009), indicating that

    he effects of negative feedback is a state phenomenon of MDD.

    .7. Behavioural tasks summary

    Tasks to measure aspects of anhedonia primarily tap into rewardearning as opposed to the experience of desire, anticipation, moti-ation, effort and pleasure. The monetary incentive delay task, asell as the gambling task can be utilized to parse anticipation and

    onsummatory pleasure, while the EffRT task maps onto the expe-ience of effort. In all three of these tasks, MDD is characterizedy impaired performance, which is exacerbated by the presencef anhedonia as measured by various symptom scales. In sometudies, however, the SHAPS did not correlate with task perfor-ance, which is not surprising given the focus of this scale on

    onsummatory pleasure. Critically, the “type” of anhedonia mea-ured symptomatically may be relevant to the task at hand. Forxample, reduced effort in MDD was associated with physicalnhedonia (Treadway et al., 2012). Moreover, neuroimaging datauggest that there is a lack of striatal activity during anticipation inDD (Knutson et al., 2008; Dichter et al., 2010), although activity

    n this region is triggered during consummatory pleasure. Inter-stingly, anhedonia is associated with decreased striatal volume inDD patients (Pizzagalli et al., 2009). In contrast, healthy controls

    ecruit striatal activation during anticipation (Kumar et al., 2014;illon et al., 2008), and cortical regions during consummatory plea-

    ure (Dillon et al., 2008).A few key considerations with the tasks described should be

    ighlighted. Firstly, they have not all been adequately validated. As scale must undergo the rigors of validation prior to use, so shouldehavioural tasks in order to ensure the appropriate constructs arevaluated and to ascertain the stability of repeated testing. Sec-ndly, they mostly use secondary reward (money) as an incentive.his limits translation to and from animal models. In addition, taskssed in humans and animals are considerably different, which alsoinders translation (for exceptions, see Der-Avakian et al., 2013nd Treadway et al., 2009 for two tasks that probe reward learn-ng and effort-based decision making, respectively, in ways that areonceptually identical across species). Lastly, while there are manyspects of anhedonia and reward learning that can be tested, it wille difficult to have a task that is able to measure all componentsf reward effectively, both theoretically and logistically. Tasks thatre overly complex are likely to be hindered by participants’ learn-

    ng effects or technical ability considering the vast majority of tasksre computerized. However, it is essential to systematically evalu-te the different components of anhedonia in order to determinehat features are episode- (state) versus disorder- (trait) specific.

    avioral Reviews 65 (2016) 21–35

    For example, response bias to reward appears to persist in remittedpatients (Pechtel et al., 2013), while delayed discounting and theeffects of negative feedback do not (Hasler et al., 2009; Pulcu et al.,2014).

    4. Conclusion

    While anhedonia has been evaluated in preclinical models fordecades, behavioural measurement in humans is relatively nascent.However, anhedonia mechanisms may be a promising area forbiomarker research in MDD, since they map onto specific andpartially dissociable neurocircuitry and signaling pathways (Der-Avakian and Markou, 2012; Pizzagalli, 2014). It is important toemphasize that an ideal biomarker will be clearly linked to aclinical phenotype, which is why the development of scales andtasks in concert would be a useful endeavor. Currently used anhe-donia questionnaires do not always correlate with reward taskperformance, which follows considering some scales only measureconsummatory pleasure, or domains of anhedonia (e.g. physicalvs. social), whereas tasks evaluate specific aspects of reward func-tion (e.g. prediction error, anticipation). Additionally scales, albeitvaluable, do not allow the disentanglement of different cognitiveprocesses despite a similar outcome, and require introspection. Forexample, imagining versus remembering a pleasurable experiencecould have the same subjective hedonic effect, although via dif-ferent mechanisms and activation of neural pathways. Thereforein order to discern the neurobiological correlates of anhedonia,combining behavioural tasks with neuroimaging is particularly rel-evant. To this end, task components need to be clearly distinguishedin order to interpret functional imaging data. Furthermore, taskdevelopment must demonstrate utility in depression as well astest-retest reliability.

    As a final note, individuals with MDD who are anhedonic appearto respond differently than healthy controls to reward tasks, a find-ing that needs to be further evaluated in both human and animalstudies. Development of preclinical models of depression that dis-tinguish anhedonic animals from non-anhedonic animals wouldalso provide more face validity when testing drug compounds, suchas SSRIs, for which anhedonia is a predictor of non-response inhuman studies (Uher et al., 2012; McMakin et al., 2012). Similarlyin human tasks, enriching study samples with anhedonic versusnon-anhedonic participants from the outset may provide a clearerpicture of the behavioural and neurocircuitry phenotype of MDDwith anhedonia. For example, overall participants with MDD tendto prefer immediate smaller reward (Pulcu et al., 2014), while indi-viduals with anhedonia do not (Lempert and Pizzagalli, 2010).

    Measurement of anhedonia in depression is a complex processas it encompasses aspects of personality, learning and biases. Futureresearch should focus on and prioritize direct translational modelsof anhedonia in depression, more refined scale and task devel-opment, as well as evaluation of potential differences betweenprimary and secondary rewards. For increased generaliz