Journal home
Advance online publication
Current issue
Archive
Press releases
Supplements
Focuses
Guide to authors
Online submissionOnline submission
Permissions
For referees
Free online issue
Contact the journal
Subscribe
Advertising
work@npg
naturereprints
About this site
For librarians
 
NPG Resources
Nature
Nature Reviews Neuroscience
Nature Cell Biology
Nature Medicine
Neuroscience Gateway
UCSD-Nature Signaling Gateway
NPG Subject areas
Biotechnology
Cancer
Chemistry
Clinical Medicine
Dentistry
Development
Drug Discovery
Earth Sciences
Evolution & Ecology
Genetics
Immunology
Materials Science
Medical Research
Microbiology
Molecular Cell Biology
Neuroscience
Pharmacology
Physics
Browse all publications
Article
Focus on Computational and Systems Neuroscience
   Contents      Editorial   Perspectives   Articles  


Nature Neuroscience 8, 1704 - 1711 (2005)
Published online: 6 November 2005; | doi:10.1038/nn1560

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

Nathaniel D Daw1, Yael Niv1, 2 & Peter Dayan1

1  Gatsby Computational Neuroscience Unit, University College London, Alexandra House, 17 Queen Square, London WC1N 3AR, UK.

2  Interdisciplinary Center for Neural Computation, Hebrew University, P.O. Box 1255, Jerusalem 91904, Israel.

Correspondence should be addressed to Nathaniel D Daw daw@gatsby.ucl.ac.uk

A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system.

MORE ARTICLES LIKE THIS

These links to content published by NPG are automatically generated.

NEWS AND VIEWS

Should I stay or should I go: genetic bases for uncertainty-driven exploration

Nature Neuroscience News and Views (01 Aug 2009)

 Top
Abstract
Previous | Next
Table of contents
Full textFull text
Download PDFDownload PDF
Send to a friendSend to a friend
rights and permissionsRights and permissions
Order commercial reprintsOrder commercial reprints
CrossRef lists 38 articles citing this articleCrossRef lists 38 articles citing this article
Save this linkSave this link
Figures & Tables
Supplementary info
Export citation

Open Innovation Challenges

  • Optimizing Sub-cellular Localization Tags

    • Deadline: Jan 31 2010
    • Reward: $20,000 USD

    The Seeker is looking for methods to optimize sub-cellular localization tags for protein expression....

  • Single-cell Analysis Platform

    • Deadline: Dec 02 2009
    • Reward: $5,000 USD

    This Challenge is looking for novel approaches to analyzing changes at a single-cell level. This is...

naturejobs

natureproducts

Search buyers guide:

 
Nature Neuroscience
ISSN: 1097-6256
EISSN: 1546-1726
Journal home | Advance online publication | Current issue | Archive | Press releases | Supplements | Focuses | For authors | Online submission | Permissions | For referees | Free online issue | About the journal | Contact the journal | Subscribe | Advertising | work@npg | naturereprints | About this site | For librarians
Nature Publishing Group, publisher of Nature, and other science journals and reference works©2005 Nature Publishing Group | Privacy policy