Access
To read this story in full you will need to login or make a payment (see right).
Letters to Nature
Nature 429, 664-667 (10 June 2004) | doi:10.1038/nature02581; Received 2 December 2003; Accepted 19 April 2004
Open Innovation Challenges
-
Efficient Chromosome Doubling: Plant Cell Division
The Seeker is looking for an efficient chromosome doubling method in plants and in particular, metho...
-
Fast Growth of Transformed Soybean Shoots
A method for accelerating growth of soybean shoots is desired.
nature jobs
PhD Student
- German Cancer Research Center
- Heidelberg 69120 Germany
Molecular Biology Team Leader
- AstraZeneca
- Alderley, Cheshire United Kingdom
Temporal difference models describe higher-order learning in humans
Ben Seymour1, John P. O'Doherty1, Peter Dayan2, Martin Koltzenburg3, Anthony K. Jones4, Raymond J. Dolan1, Karl J. Friston1 & Richard S. Frackowiak1,5
- Wellcome Department of Imaging Neuroscience, 12 Queen Square, London WC1N 3BG, UK
- Gatsby Computational Neuroscience Unit, Alexandra House, 17 Queen Square, London WC1N 3AR, UK
- Institute of Child Health, University College London, 30 Guilford St, London WC1N 1EH, UK
- University of Manchester Rheumatic Diseases Centre, Hope Hospital, Manchester M6 8HD, UK
- Fondazione Santa Lucia, 00179 Rome, Italy
Correspondence to: Ben Seymour1 Email: bseymour@fil.ion.ucl.ac.uk
Abstract
The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning1. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning2, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.
To read this story in full you will need to login or make a payment (see right).
MORE ARTICLES LIKE THIS
These links to content published by NPG are automatically generated.
NEWS AND VIEWS
The rhythms of learningNature Neuroscience News and Views (01 Jun 2009)
Ambiguity and anxiety: when a glass half full is emptyNature Neuroscience News and Views (01 Jul 2007)
RESEARCH
Opponent appetitive-aversive neural processes underlie predictive learning of pain reliefNature Neuroscience Article (01 Sep 2005)
Spared caudal brainstem SERT binding in early Parkinson's diseaseJournal of Cerebral Blood Flow & Metabolism Brief Communication
See all 73 matches for Research
