Article | Published:

Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task

Nature Neuroscience volume 17, pages 9951002 (2014) | Download Citation

Abstract

Disappointment entails the recognition that one did not get the value expected. In contrast, regret entails recognition that an alternative (counterfactual) action would have produced a more valued outcome. In humans, the orbitofrontal cortex is active during expressions of regret, and humans with damage to the orbitofrontal cortex do not express regret. In rats and nonhuman primates, both the orbitofrontal cortex and the ventral striatum have been implicated in reward computations. We recorded neural ensembles from orbitofrontal cortex and ventral striatum in rats encountering wait or skip choices for delayed delivery of different flavors using an economic framework. Economically, encountering a high-cost choice after skipping a low-cost choice should induce regret. In these situations, rats looked backwards toward the lost option, cells within orbitofrontal cortex and ventral striatum represented the missed action, rats were more likely to wait for the long delay, and rats rushed through eating the food after that delay.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    , & Brain, emotion and decision making: the paradigmatic example of regret. Trends Cogn. Sci. 11, 258–265 (2007).

  2. 2.

    et al. The involvement of the orbitofrontal cortex in the experience of regret. Science 304, 1167–1170 (2004).

  3. 3.

    & The experience of regret: what, when, and why. Psychol. Rev. 102, 379–395 (1995).

  4. 4.

    Regret in decision making under uncertainty. Oper. Res. 30, 961–981 (1982).

  5. 5.

    & What might have been: counterfactual thought concerning personal decisions. Br. J. Psychol. 83, 473–477 (1992).

  6. 6.

    & Regret theory: an alternative theory of rational choice under uncertainty. Econ. J. 92, 805–824 (1982).

  7. 7.

    & Disappointment and dynamic consistency in choice under uncertainty. Rev. Econ. Stud. 53, 271–282 (1986).

  8. 8.

    Disappointment in decision making under uncertainty. Oper. Res. 33, 1–27 (1985).

  9. 9.

    Regret: a theoretical and conceptual analysis. J. Theory Soc. Behav. 17, 135–160 (1987).

  10. 10.

    Neural basis of quasi-rational decision making. Curr. Opin. Neurobiol. 16, 191–198 (2006).

  11. 11.

    et al. Regret and its avoidance: a neuroimaging study of choice behavior. Nat. Neurosci. 8, 1255–1262 (2005).

  12. 12.

    , & Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1, 155–159 (1998).

  13. 13.

    & Relative reward preference in primate orbitofrontal cortex. Nature 398, 704–708 (1999).

  14. 14.

    & Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226 (2006).

  15. 15.

    et al. Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338, 953–956 (2012).

  16. 16.

    et al. Neural estimates of imagined outcomes in the orbitofrontal cortex drive behavior and learning. Neuron 80, 507–518 (2013).

  17. 17.

    , , & Orbitofrontal cortex as a cognitive map of task space. Neuron 81, 267–279 (2014).

  18. 18.

    , , , & Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66, 449–460 (2010).

  19. 19.

    & Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 70, 731–741 (2011).

  20. 20.

    , , & Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport 13, 885–890 (2002).

  21. 21.

    & Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 126, 1830–1837 (2003).

  22. 22.

    , , , & Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat. Neurosci. 16, 1140–1145 (2013).

  23. 23.

    , , , & Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. J. Neurosci. 31, 2700–2705 (2011).

  24. 24.

    et al. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur. J. Neurosci. 35, 991–996 (2012).

  25. 25.

    & The road not taken: neural correlates of decision making in orbitofrontal cortex. Front. Neurosci. 6, 131 (2012).

  26. 26.

    & Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J. Neurophysiol. 89, 2823–2838 (2003).

  27. 27.

    et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452–454 (2004).

  28. 28.

    , , , & Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J. Neurosci. 29, 13365–13376 (2009).

  29. 29.

    & Covert expectation-of-reward in rat ventral striatum at decision points. Front. Integr. Neurosci 3, 1–15 (2009).

  30. 30.

    & Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Res. 638, 157–168 (1994).

  31. 31.

    , & Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38, 625–636 (2003).

  32. 32.

    et al. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62, 269–280 (2009).

  33. 33.

    et al. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat. Neurosci. 14, 1590–1597 (2011).

  34. 34.

    & Information coding in the rodent prefrontal cortex. I. Single-neuron activity in orbitofrontal cortex compared with that in pyriform cortex. J. Neurophysiol. 74, 733–750 (1995).

  35. 35.

    , & Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45, 587–597 (2005).

  36. 36.

    Regret: The Persistence of the Possible (Oxford Univ. Press, 1993).

  37. 37.

    & Regret in economic and psychological theories of choice. J. Behav. Decis. Mak. 19, 139–154 (2006).

  38. 38.

    The effect of effort on the attractiveness of rewarded and unrewarded stimuli. J. Abnorm. Soc. Psychol. 63, 375–380 (1961).

  39. 39.

    & The sunk cost and Concorde effects: are humans less rational than lower animals? Psychol. Bull. 125, 591 (1999).

  40. 40.

    , & Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324, 646–648 (2009).

  41. 41.

    , & Visual fixations and the computation and comparison of value in simple choice. Nat. Neurosci. 13, 1292–1298 (2010).

  42. 42.

    , & Human medial orbitofrontal cortex is recruited during experience of imagined and real rewards. J. Neurophysiol. 103, 2506–2512 (2010).

  43. 43.

    , , , & Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927–939 (2010).

  44. 44.

    et al. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 107, 20547–20552 (2010).

  45. 45.

    , , , & Frontal cortex and reward-guided learning and decision-making. Neuron 70, 1054–1069 (2011).

  46. 46.

    & Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615–641 (1995).

  47. 47.

    & Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 363, 642–664 (1995).

  48. 48.

    & The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 10, 206–219 (2000).

  49. 49.

    , , , & The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neurosci. Lett. 432, 40–45 (2008).

  50. 50.

    , , , & The rat prefrontostriatal system analyzed in 3D: evidence for multiple interacting functional units. J. Neurosci. 33, 5718–5727 (2013).

  51. 51.

    , & Discrete-time adaptive windowing for velocity estimation. IEEE Trans. Control Syst. Technol. 8, 1003–1009 (2000).

  52. 52.

    , , , & Measurement and classification of retinal vascular tortuosity. Int. J. Med. Inform. 53, 239–252 (1999).

  53. 53.

    , , & Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J. Neurophysiol. 79, 1017–1044 (1998).

Download references

Acknowledgements

We thank C. Boldt and K. Seeland for technical support and other members of the Redish laboratory for discussion. This work was supported by US National Institutes of Health grants T32 NS048944 (A.P.S.), T32 DA007234 (A.P.S.) and R01-DA030672 (A.D.R.).

Author information

Affiliations

  1. Graduate Program in Neuroscience, University of Minnesota, Minneapolis, Minnesota, USA.

    • Adam P Steiner
  2. Department of Neuroscience, University of Minnesota, Minneapolis, Minnesota, USA.

    • A David Redish

Authors

  1. Search for Adam P Steiner in:

  2. Search for A David Redish in:

Contributions

A.P.S. and A.D.R. conducted the experiments, collected the data, performed the analysis and wrote the manuscript.

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to A David Redish.

Supplementary information

PDF files

  1. 1.

    Supplementary Text and Figures

    Supplementary Figures 1–17 and Supplementary Tables 1 and 2

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nn.3740

Further reading