Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • News & Views
  • Published:

Should I stay or should I go: genetic bases for uncertainty-driven exploration

Nature Neuroscience volume 12, pages 963–965 (2009)Cite this article

In the face of uncertainty, how do we choose between maintaining our current strategy or trying new strategies? A study shows that a gene controlling prefrontal dopamine function is predictive of uncertainty-driven exploration.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Figure 1: The neural substrates of learning from rewards, errors and exploring.

References

  1. Frank, M.J., Doll, B.B., Oas-Terpstra, J. & Moreno, F. Nat. Neurosci. 12, 1062–1068 (2009).

    Article  CAS  Google Scholar 

  2. Frank, M.J., Moustafa, A.A., Haughey, H.M., Curran, T. & Hutchison, K.E. Proc. Natl. Acad. Sci. USA 104, 16311–16316 (2007).

    Article  CAS  Google Scholar 

  3. Schultz, W., Dayan, P. & Montague, P.R. Science 275, 1593–1599 (1997).

    Article  CAS  Google Scholar 

  4. Frank, M.J., Seeberger, L.C. & O'Reilly, R. Science 306, 1940–1943 (2004).

    Article  CAS  Google Scholar 

  5. Isoda, M. & Hikosaka, O. J. Neurosci. 28, 7209–7218 (2008).

    Article  CAS  Google Scholar 

  6. Mars, R.B. et al. J. Neurosci. 29, 6926–6931 (2009).

    Article  CAS  Google Scholar 

  7. Sutton, R.S. & Barto, A.G. Reinforcement Learning: an Introduction (MIT Press, Cambridge, Massachusetts, 1998).

    Google Scholar 

  8. Behrens, T.E., Woolrich, M.W., Walton, M.E. & Rushworth, M.F. Nat. Neurosci. 10, 1214–1221 (2007).

    Article  CAS  Google Scholar 

  9. Cohen, J.D., McClure, S.M. & Yu, A.J. Phil. Trans. R. Soc. Lond. B 362, 933–942 (2007).

    Article  Google Scholar 

  10. Klein, T.A. et al. Science 318, 1642–1645 (2007).

    Article  CAS  Google Scholar 

  11. Calzavara, R., Mailly, P. & Haber, S.N. Eur. J. Neurosci. 26, 2005–2024 (2007).

    Article  Google Scholar 

  12. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B. & Dolan, R.J. Nature 441, 876–879 (2006).

    Article  CAS  Google Scholar 

  13. Boorman, E.D., Behrens, T., Woolrich, M.W. & Rushworth, M. Neuron 62, 733–743 (2009).

    Article  CAS  Google Scholar 

  14. Dreher, J.C., Kohn, P., Kolachana, B., Weinberger, D.R. & Berman, K.F. Proc. Natl. Acad. Sci. USA 106, 617–622 (2009).

    Article  CAS  Google Scholar 

  15. Quilodran, R., Rothe, M. & Procyk, E. Neuron 57, 314–325 (2008).

    Article  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Experimental Psychology, University of Oxford, Oxford, UK. jerome.sallet@psy.ox.ac.uk or matthew.rushworth@psy.ox.ac.uk,

    Jérôme Sallet & Matthew F S Rushworth

Authors
  1. Jérôme Sallet
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthew F S Rushworth
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sallet, J., Rushworth, M. Should I stay or should I go: genetic bases for uncertainty-driven exploration. Nat Neurosci 12, 963–965 (2009). https://doi.org/10.1038/nn0809-963

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1038/nn0809-963

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing