Article | Published:

Striatal dopamine D2 receptors regulate effort but not value-based decision making and alter the dopaminergic encoding of cost

Neuropsychopharmacologyvolume 43pages21802189 (2018) | Download Citation

Abstract

Deficits in goal-directed motivation represent a debilitating symptom for many patients with schizophrenia. Impairments in motivation can arise from deficits in processing information about effort and or value, disrupting effective cost-benefit decision making. We have previously shown that upregulated dopamine D2 receptor expression within the striatum (D2R-OE mice) decreases goal-directed motivation. Here, we determine the behavioral and neurochemical mechanisms behind this deficit. Female D2R-OE mice were tested in several behavioral paradigms including recently developed tasks that independently assess the impact of Value or Effort manipulations on cost-benefit decision making. In vivo microdialysis was used to measure extracellular dopamine in the striatum during behavior. In a value-based choice task, D2R-OE mice show normal sensitivity to changes in reward value and used reward value to guide their actions. In an effort-based choice task, D2R-OE mice evaluate the cost of increasing the number of responses greater relative to the effort cost of longer duration responses compared to controls. This shift away from choosing to repeatedly execute a response is accompanied by a dampening of extracellular dopamine in the striatum during goal-directed behavior. In the ventral striatum, extracellular dopamine level negatively correlates with response cost in controls, but this relationship is lost in D2R-OE mice. These results show that D2R signaling in the striatum, as observed in some patients with schizophrenia, alters the relationship between effort expenditure and extracellular dopamine. This dysregulation produces motivation deficits that are specific to effort but not value-based decision making, paralleling the effort-based motivational deficits observed in schizophrenia.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

Additional information

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Faerden A, Friis S, Agartz I, Barrett EA, Nesvåg R, Finset A, et al. Apathy and functioning in first-episode psychosis. Psychiatr Serv. 2009;60:1495–503.

  2. 2.

    Kiang M, Christensen BK, Remington G, Kapur S. Apathy in schizophrenia: clinical correlates and association with functional outcome. Schizophr Res. 2003;63:79–88.

  3. 3.

    Fervaha G, Foussias G, Agid O, Remington G. Amotivation and functional outcomes in early schizophrenia. Psychiatry Res. 2013;210:665–8.

  4. 4.

    Saperia S, Da Silva S, Siddiqui I, McDonald K, Agid O, Remington G, et al. Investigating the predictors of happiness, life satisfaction and success in schizophrenia. Compr Psychiatry. 2018;81:42–47.

  5. 5.

    Barch DM, Dowd EC. Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr Bull. 2010;36:919–34.

  6. 6.

    Gold JM, Waltz JA, Matveeva TM, Kasanova Z, Strauss GP, Herbener ES, et al. Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence. Arch Gen Psychiatry. 2012;69:129–38.

  7. 7.

    Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA. Reward processing in schizophrenia: a deficit in the representation of value. Schizophr Bull. 2008;34:835–47.

  8. 8.

    Barch DM, Treadway MT, Schoen N. Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment. J Abnorm Psychol. 2014;123:387–97.

  9. 9.

    Fervaha G, Foussias G, Agid O, Remington G. Neural substrates underlying effort computation in schizophrenia. Neurosci Biobehav Rev. 2013;37(10 Pt 2):2649–65.

  10. 10.

    Gold JM, Strauss GP, Waltz JA, Robinson BM, Brown JK, Frank MJ. Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol Psychiatry. 2013;74:130–6.

  11. 11.

    Treadway MT, Peterman JS, Zald DH, Park S. Impaired effort allocation in patients with schizophrenia. Schizophr Res. 2015;161:382–5.

  12. 12.

    Bezzina G, Body S, Cheung THC, Hampson CL, Deakin JFW, Anderson IM, et al. Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: implications for inter-temporal choice. Psychopharmacology (Berl). 2008;197:339–50.

  13. 13.

    Hamill S, Trevitt JT, Nowend KL, Carlson BB, Salamone JD. Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacol Biochem Behav. 1999;64:21–27.

  14. 14.

    Bari AA, Pierce RC. D1-like and d2 dopamine receptor antagonists administered into the shell subregion of the rat nucleus accumbens decrease cocaine, but not food, reinforcement. Neuroscience. 2005;135:959–68.

  15. 15.

    Du Hoffmann J, Nicola SM. Dopamine invigorates reward seeking by promoting cue-evoked excitation in the nucleus accumbens. J Neurosci. 2014;34:14349–64.

  16. 16.

    Ghods-Sharifi S, Floresco SB. Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav Neurosci. 2010;124:179–91.

  17. 17.

    Hauber W, Sommer S. Prefrontostriatal circuitry regulates effort-related decision making. Cereb Cortex. 2009;19:2240–7.

  18. 18.

    Aberman JE, Salamone JD. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience. 1999;92:545–52.

  19. 19.

    Salamone JD, Cousins MS, Bucher S. Anhedonia or anergia? effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a t-maze cost/benefit procedure. Behav Brain Res. 1994;65:221–9.

  20. 20.

    Nowend KL, Arizzi M, Carlson BB, Salamone JD. D1 or d2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol Biochem Behav. 2001;69:373–82.

  21. 21.

    Bailey MR, Goldman O, Bello EP, Chohan MO, Jeong N, Winiger V, et al. An interaction between serotonin receptor signaling and dopamine enhances goal-directed vigor and persistence in mice. J Neurosci. 2018;38:2149–62.

  22. 22.

    Kellendonk C, Simpson EH, Polan HJ, Malleret G, Vronskaya S, Winiger V, et al. Transient and selective overexpression of dopamine d2 receptors in the striatum causes persistent abnormalities in prefrontal cortex functioning. Neuron . 2006;49:603–15.

  23. 23.

    Breier A, Su TP, Saunders R, Carson RE, Kolachana BS, de Bartolomeis A, et al. Schizophrenia is associated with elevated amphetamine-induced synaptic dopamine concentrations: evidence from a novel positron emission tomography method. Proc Natl Acad Sci USA. 1997;94:2569–74.

  24. 24.

    Laruelle M, Abi-Dargham A, van Dyck CH, Gil R, D’Souza CD, Erdos J, et al. Single photon emission computerized tomography imaging of amphetamine-induced dopamine release in drug-free schizophrenic subjects. Proc Natl Acad Sci USA. 1996;93:9235–40.

  25. 25.

    Wong DF, Wagner HN, Tune LE, Dannals RF, Pearlson GD, Links JM, et al. Positron emission tomography reveals elevated d2 dopamine receptors in drug-naive schizophrenics. [erratum appears inscience 1987 feb 6;235(4789):623]. Science (80-). 1986;234:1558–63.

  26. 26.

    Howes OD, Kambeitz J, Kim E, Stahl D, Slifstein M, Abi-Dargham A, et al. The nature of dopamine dysfunction in schizophrenia and what this means for treatment. Arch Gen Psychiatry. 2012;69:776–86.

  27. 27.

    Drew MR, Simpson EH, Kellendonk C, Herzberg WG, Lipatova O, Fairhurst S, et al. Transient overexpression of striatal d2 receptors impairs operant motivation and interval timing. J Neurosci. 2007;27:7731–9.

  28. 28.

    Simpson EH, Kellendonk C, Ward RD, Richards V, Lipatova O, Fairhurst S, et al. Pharmacologic rescue of motivational deficit in an animal model of the negative symptoms of schizophrenia. Biol Psychiatry. 2011;69:928–35.

  29. 29.

    Ward RD, Simpson EH, Richards VL, Deo G, Taylor K, Glendinning JI, et al. Dissociation of hedonic reaction to reward and incentive motivation in an animal model of the negative symptoms of schizophrenia. Neuropsychopharmacology . 2012;37:1699–707.

  30. 30.

    Ward RD, Winiger V, Higa KK, Kahn JB, Kandel ER, Balsam PD, et al. The impact of motivation on cognitive performance in an animal model of the negative and cognitive symptoms of schizophrenia. Behav Neurosci. 2015;129:292–9.

  31. 31.

    Bailey MR, Jensen G, Taylor K, Mezias C, Williamson C, Silver R, et al. A novel strategy for dissecting goal-directed action and arousal components of motivated behavior with a progressive hold-down task. Behav Neurosci. 2015;129:269–80.

  32. 32.

    Bailey MR, Williamson C, Mezias C, Winiger V, Silver R, Balsam PD, et al. The effects of pharmacological modulation of the serotonin 2c receptor on goal-directed behavior in mice. Psychopharmacology (Berl). 2016;233:615–24.

  33. 33.

    Hilário MRF, Clouse E, Yin HH, Costa RM. Endocannabinoid signaling is critical for habit formation. Front Integr Neurosci. 2007;1:6.

  34. 34.

    Nirogi R, Komarneni P, Kandikere V, Boggavarapu R, Bhyrapuneni G, Benade V, et al. A sensitive and selective quantification of catecholamine neurotransmitters in rat microdialysates by pre-column dansyl chloride derivatization using liquid chromatography-tandem mass spectrometry. J Chromatogr B Anal Technol Biomed Life Sci. 2013;913-4:41–47.

  35. 35.

    Paxinos G, Franklin KBJ (2004): The mouse brain in stereotaxic coordinates, books.google.com.

  36. 36.

    Salamone JD, Steinpreis RE, McCullough LD, Smith P, Grebel D, Mahan K. Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology (Berl). 1991;104:515–21.

  37. 37.

    Krabbe S, Duda J, Schiemann J, Poetschke C, Schneider G, Kandel ER, et al. Increased dopamine d2 receptor activity in the striatum alters the firing pattern of dopamine neurons in the ventral tegmental area. Proc Natl Acad Sci USA. 2015;112:E1498–506.

  38. 38.

    Duvarci S, Simpson EH, Gaby S, Kandel ER, Roeper J, Sigurdsson T (2018): Impaired recruitment of dopamine neurons during working memory in mice with striatal d2 receptor overexpression. Nat. Commun 2018 Jul 19;9(1):2822.

  39. 39.

    Lönnroth P, Jansson PA, Smith U. A microdialysis method allowing characterization of intercellular water space in humans. Am J Physiol. 1987;253(2 Pt 1):E228–31.

  40. 40.

    Justice JB. Quantitative microdialysis of neurotransmitters. J Neurosci Methods. 1993;48:263–76.

  41. 41.

    Ostlund SB, Wassum KM, Murphy NP, Balleine BW, Maidment NT. Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci. 2011;31:200–7.

  42. 42.

    Fervaha G, Graff-Guerrero A, Zakzanis KK, Foussias G, Agid O, Remington G. Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res. 2013;47:1590–6.

  43. 43.

    McCarthy JM, Treadway MT, Bennett ME, Blanchard JJ. Inefficient effort allocation and negative symptoms in individuals with schizophrenia. Schizophr Res. 2016;170:278–84.

  44. 44.

    Yu LQ, Lee S, Katchmar N, Satterthwaite TD, Kable JW, Wolf DH. Steeper discounting of delayed rewards in schizophrenia but not first-degree relatives. Psychiatry Res. 2017;252:303–9.

  45. 45.

    Ahn W-Y, Rass O, Fridberg DJ, Bishara AJ, Forsyth JK, Breier A, et al. Temporal discounting of rewards in patients with bipolar disorder and schizophrenia. J Abnorm Psychol. 2011;120:911–21.

  46. 46.

    Heerey EA, Robinson BM, McMahon RP, Gold JM. Delay discounting in schizophrenia. Cogn Neuropsychiatry. 2007;12:213–21.

  47. 47.

    Docx L, de la Asuncion J, Sabbe B, Hoste L, Baeten R, Warnaerts N, et al. Effort discounting and its association with negative symptoms in schizophrenia. Cogn Neuropsychiatry. 2015;20:172–85.

  48. 48.

    Salamone JD, Correa M, Farrar A, Mingote SM. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacol (Berl). 2007;191:461–82.

  49. 49.

    Salamone JD, Correa M, Nunes EJ, Randall PA, Pardo M. The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond. J Exp Anal Behav. 2012;97:125–46.

  50. 50.

    Niv Y, Daw ND, Joel D, Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl). 2007;191:507–20.

  51. 51.

    Glendinning JI, Gresack J, Spector AC. A high-throughput screening procedure for identifying mice with aberrant taste and oromotor function. Chem Senses. 2002;27:461–74.

  52. 52.

    Walton ME, Bannerman DM, Alterescu K, Rushworth MFS. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J Neurosci. 2003;23:6475–9.

  53. 53.

    Bardgett ME, Depenbrock M, Downs N, Points M, Green L. Dopamine modulates effort-based decision making in rats. Behav Neurosci. 2009;123:242–51.

  54. 54.

    Elston TW, Bilkey DK. Anterior cingulate cortex modulation of the ventral tegmental area in an effort task. Cell Rep. 2017;19:2220–30.

  55. 55.

    Kegeles LS, Abi-Dargham A, Frankle WG, Gil R, Cooper TB, Slifstein M, et al. Increased synaptic dopamine function in associative regions of the striatum in schizophrenia. Arch Gen Psychiatry. 2010;67:231–9.

  56. 56.

    Slifstein M, van de Giessen E, Van Snellenberg J, Thompson JL, Narendran R, Gil R, et al. Deficits in prefrontal cortical and extrastriatal dopamine release in schizophrenia: a positron emission tomographic functional magnetic resonance imaging study. JAMA Psychiatry. 2015;72:316–24.

  57. 57.

    Weinstein JJ, Chohan MO, Slifstein M, Kegeles LS, Moore H, Abi-Dargham A. Pathway-specific dopamine abnormalities in schizophrenia. Biol Psychiatry. 2017;81:31–42.

Download references

Acknowledgements

The authors are grateful to Tamara Azayeva and Hongfeng Jiang for technical help. This work was supported by the National Institute of Mental Health (NIMH) Grants: P50MH086404 (EHS) and R01MH068073 (P.D.B), The Lieber Institute for Brain Development and the German Academic Exchange Service, DAAD (IF).

Author information

Author notes

  1. These authors contributed equally: Ina Filla, Matthew R. Bailey

Affiliations

  1. Department of Neuroscience, Columbia University, New York, NY, USA

    • Ina Filla
  2. Department of Psychology, Columbia University, New York, NY, USA

    • Matthew R. Bailey
    •  & Peter D. Balsam
  3. Department of Psychiatry, Columbia University, New York, NY, USA

    • Elke Schipani
    • , Vanessa Winiger
    •  & Eleanor H. Simpson
  4. New York State Psychiatric Institute, New York, NY, USA

    • Elke Schipani
    • , Peter D. Balsam
    •  & Eleanor H. Simpson
  5. Barnard college, Columbia University, New York, NY, USA

    • Chris Mezias
    •  & Peter D. Balsam

Authors

  1. Search for Ina Filla in:

  2. Search for Matthew R. Bailey in:

  3. Search for Elke Schipani in:

  4. Search for Vanessa Winiger in:

  5. Search for Chris Mezias in:

  6. Search for Peter D. Balsam in:

  7. Search for Eleanor H. Simpson in:

Competing interests

None of the authors report any biomedical financial interests or potential conflicts of interest.

Corresponding author

Correspondence to Eleanor H. Simpson.

Electronic supplementary material

About this article

Publication history

Received

Revised

Accepted

Published

DOI

https://doi.org/10.1038/s41386-018-0159-9