Primates are equipped with neural circuits in the prefrontal cortex1,2,3,4,5,6, the parietal cortex7 and the basal ganglia6,8,9,10,11 that predict the availability of reward during the performance of behavioural tasks. It is not known, however, how reward value is incorporated in the control of action. Here we identify neurons in the monkey caudate nucleus that create a spatially selective response bias depending on the expected gain. In behavioural tasks, the monkey had to make a visually guided eye movement in every trial, but was rewarded for a correct response in only half of the trials. Reward availability was predictable on the basis of the spatial position of the visual target. We found that caudate neurons change their discharge rate systematically, even before the appearance of the visual target, and usually fire more when the contralateral position is associated with reward. Strong anticipatory activity of neurons with a contralateral preference is associated with decreased latency for eye movements in the contralateral direction. We conclude that this neuronal mechanism creates an advance bias that favours a spatial response when it is associated with a high reward value.
Subscribe to Journal
Get full journal access for 1 year
only $3.90 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
Amador, N., Schlag-Rey, M. & Schlag, J. Reward-predicting and reward-detecting neuronal activity in the supplementary eye field. J. Neurophysiol. 84, 2166–2170 (2000)
Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M. & Hikosaka, O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J. Neurophysiol. 87, 1488–1498 (2002)
Leon, M. I. & Shadlen, M. N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24, 415–425 (1999)
Tremblay, L. & Schultz, W. Relative reward preference in primate orbitofrontal cortex. Nature 398, 704–708 (1999)
Watanabe, M. Reward expectancy in primate prefrontal neurons. Nature 382, 629–632 (1996)
Rolls, E. T. The Brain and Emotion (Oxford Univ. Press, New York, 1999)
Platt, M. L. & Glimcher, P. W. Neural correlates of decision variables in parietal cortex. Nature 400, 233–238 (1999)
Hikosaka, O., Sakamato, M. & Usui, S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61, 814–832 (1989)
Kawagoe, R., Takikawa, Y. & Hikosaka, O. Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci. 1, 411–416 (1998)
Schultz, W., Apicella, P., Scarnati, E. & Ljungberg, T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595–4610 (1992)
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997)
Bindra, D. Neuropsychological interpretation of the effects of drive and incentive-motivation on general activity and instrumental behaviour. Psychol. Rev. 75, 1–22 (1968)
Dickinson, A. & Baleine, B. Motivational control of goal-directed action. Anim. Learn. Behav. 22, 1–18 (1994)
Watanabe, M. et al. Behavioral reactions reflecting differential reward expectations in monkeys. Exp. Brain Res. 140, 511–518 (2001)
Apicella, P., Scarnati, E., Ljungberg, T. & Schultz, W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68, 945–960 (1992)
Rolls, E. T., Thorpe, S. J. & Maddison, S. P. Responses of striatal neurons in the behaving monkey. I. Head of the caudate nucleus. Behav. Brain Res. 7, 179–210 (1983)
Hikosaka, O., Sakamato, M. & Usui, S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J. Neurophysiol. 61, 780–798 (1989)
Kawaguchi, Y., Wilson, C. J. & Emson, P. C. Projection subtypes of rat neostriatal matrix cells revealed by intracellular injection of biocytin. J. Neurosci. 10, 3421–3438 (1990)
Fisher, R. S., Buchwald, N. A., Hull, C. D. & Levine, M. S. The GABAergic striatonigral neurons of the cat: Demonstration by double peroxidase labeling. Brain Res. 398, 148–156 (1986)
Hikosaka, O. & Wurtz, R. H. Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. J. Neurophysiol. 49, 1268–1284 (1983)
Lauwereyns, J. et al. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33, 463–473 (2002)
Takikawa, Y., Kawagoe, R. & Hikosaka, O. Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J. Neurophysiol. 87, 508–515 (2002)
Rescorla, R. A. & Wagner, A. R. in Classical Conditioning II: Current Research and Theory (eds Black, A. H. & Prokasy, W. F.) 64–99 (Appleton Century Crofts, New York, 1972)
Basso, M. A. & Wurtz, R. H. Modulation of neuronal activity by target uncertainty. Nature 389, 66–69 (1997)
Dorris, M. C. & Munoz, D. P. Saccadic probability influences motor preparation signals and time to saccadic initiation. J. Neurosci. 18, 7015–7026 (1998)
Hikosaka, O., Kawagoe, R. & Takikawa, Y. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 80, 953–978 (2000)
Ikeda, T., Takikawa, Y. & Hikosaka, O. Visuo-motor and anticipatory activities of monkey superior colliculus neurons are modulated by reward. Soc. Neurosci. Abstr. 27, 59.1 (2001)
Sato, M. & Hikosaka, O. Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J. Neurosci. 22, 2363–2373 (2002)
We thank H. Nakahara, Y. Shimo, M. Sato, Y. Takikawa, R. Kawagoe, H. Itoh, S. Kobayashi, M. Koizumi and M. Sakagami for comments and technical assistance. This research was supported by the Japanese Society for the Promotion of Science.
The authors declare that they have no competing financial interests.
About this article
Cite this article
Lauwereyns, J., Watanabe, K., Coe, B. et al. A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413–417 (2002). https://doi.org/10.1038/nature00892
The caudate nucleus contributes causally to decisions that balance reward and uncertain visual information
The credit assignment problem in cortico‐basal ganglia‐thalamic networks: A review, a problem and a possible solution
European Journal of Neuroscience (2020)
Frontiers in Cellular Neuroscience (2020)
Nature Communications (2020)
Bipolar oscillations between positive and negative mood states in a computational model of Basal Ganglia
Cognitive Neurodynamics (2020)