Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Volume 577 Issue 7792, 30 January 2020

Mapping the future

Reward prediction errors are part of the brain’s learning process. They account for the difference between the expected and the actual outcome of an event. The neurotransmitter dopamine is intimately involved in this form of learning — dopamine neurons tend to show increased activity when the outcome of an event is better than expected, but their activity decreases when the outcome is worse than predicted. As a result, learning has been viewed as the brain assessing the likely mean outcome as the basis for predicting the outcome of future events. In this issue, Will Dabney and his colleagues suggest that the picture is more complex. Taking inspiration from distributional reinforcement learning in artificial intelligence, the researchers analysed neuronal recordings from the mouse midbrain and found that instead of the brain representing the future as a single mean, it uses a probability distribution, effectively considering multiple possible future rewards simultaneously.

Cover image: DeepMind Technologies Ltd

This Week

Top of page ⤴

News in Focus

Top of page ⤴

Books & Arts

  • Essay

Top of page ⤴

Opinion

Top of page ⤴

Work

Top of page ⤴

Research

Top of page ⤴

Amendments & Corrections

Top of page ⤴

Nature Outlook

  • Researchers are homing in on the myriad ways in which the bacteria and other microorganisms that inhabit the human digestive system affect our health – and how they could point the way towards new therapies.

    Nature Outlook
Top of page ⤴
Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Quick links