Letter | Published:

A cellular mechanism of reward-related learning

Nature volume 413, pages 6770 (06 September 2001) | Download Citation

Subjects

Abstract

Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning1, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra2,3. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons4. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    & Positive reinforcement produced by electrical stimulation of septal and other regions of the rat brain. J. Comp. Physiol. Psychol. 47, 419–427 (1954).

  2. 2.

    , & Schedule control of behavior reinforced by electrical stimulation of the brain. Science 196, 547–549 (1977).

  3. 3.

    & Memory facilitation by self-stimulation reinforcement mediated by the nigro-neostriatal bundle. Physiol. Behav. 20, 723–733 (1978).

  4. 4.

    & The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones. Trends Neurosci. 13, 259–265 (1990).

  5. 5.

    Multiple reward signals in the brain. Nature Rev. Neurosci. 1, 199–207 (2000).

  6. 6.

    & Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72, 1024–1027 (1994).

  7. 7.

    & Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449–451 (1996).

  8. 8.

    , , , & Role of nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner. J. Neurophysiol. 82, 978–998 (1999).

  9. 9.

    , & Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 265, 412–415 (1994).

  10. 10.

    & An evaluation of response rate as a measure of rewarding intracranial stimulation. J. Comp. Physiol. Psychol. 55, 80–84 (1962).

  11. 11.

    The relationship between stimulation voltage and rate of hypothalamic self-stimulation in the rat. J. Comp. Physiol. Psychol. 51, 193–198 (1958).

  12. 12.

    & The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J. Neurosci. 16, 2397–2410 (1996).

  13. 13.

    , & Membrane potential synchrony of simultaneously recorded striatal spiny neurons in vivo. Nature 394, 475–478 (1998).

  14. 14.

    Postsynaptic potentials evoked in spiny neostriatal projection neurons by stimulation of ipsilateral and contralateral neocortex. Brain Res. 367, 201–213 (1986).

  15. 15.

    & Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo. Neuroscience 99, 199–203 (2000).

  16. 16.

    & Spontaneous firing patterns of identified spiny neurons in the rat neostriatum. Brain Res. 220, 67–80 (1981).

  17. 17.

    & Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J. Neurophysiol. 64, 133–150 (1990).

  18. 18.

    Behaviorally contingent property of movement-related activity of the primate putamen. J. Neurophysiol. 63, 1277–1296 (1990).

  19. 19.

    & Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: a moveable electrode mapping study. Brain Res. 185, 1–15 (1980).

  20. 20.

    , , & The role of dopamine in intracranial self-stimulation of the ventral tegmental area. J. Neurosci. 7, 3888–3896 (1987).

  21. 21.

    Addictive drugs and brain stimulation reward. Annu. Rev. Neurosci. 19, 319–340 (1996).

  22. 22.

    & Evidence implicating descending fibers in self-stimulation of the medial forebrain bundle. J. Neurosci. 6, 919–929 (1986).

  23. 23.

    The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res. Bull. 9, 321–353 (1982).

  24. 24.

    & A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91, 871–890 (1999).

  25. 25.

    , & A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936–1947 (1996).

  26. 26.

    , & Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357–381 (1986).

  27. 27.

    & In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. Proc. Natl Acad. Sci. USA 94, 7036–7040 (1997).

  28. 28.

    Meaning and Purpose in the Intact Brain 62–120 (Clarendon Press, Oxford, 1981).

  29. 29.

    , & Reward summation and the effects of dopamine D1 and D2 agonists and antagonists on fixed-interval responding for brain stimulation. Pharmacol. Biochem. Behav. 48, 853–862 (1994).

  30. 30.

    & The Rat Brain in Stereotaxic Coordinates (Academic, New York, 1998).

Download references

Acknowledgements

We thank A. Kean and C. Booker for technical assistance. This work was supported by the Health Research Council of New Zealand, Lottery Health Research and the New Zealand Neurological Foundation.

Author information

Affiliations

  1. *The Neuroscience Research Centre, University of Otago, School of Medical Sciences, Dunedin, New Zealand

    • John N. J. Reynolds
    • , Brian I. Hyland
    •  & Jeffery R. Wickens
  2. †Department of Anatomy and Structural Biology, University of Otago, School of Medical Sciences, Dunedin, New Zealand

    • John N. J. Reynolds
    •  & Jeffery R. Wickens
  3. ‡Department of Physiology, University of Otago, School of Medical Sciences, Dunedin, New Zealand

    • John N. J. Reynolds
    •  & Brian I. Hyland

Authors

  1. Search for John N. J. Reynolds in:

  2. Search for Brian I. Hyland in:

  3. Search for Jeffery R. Wickens in:

Corresponding author

Correspondence to Jeffery R. Wickens.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/35092560

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.