Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Game theory and neural basis of social decision making

Abstract

Decision making in a social group has two distinguishing features. First, humans and other animals routinely alter their behavior in response to changes in their physical and social environment. As a result, the outcomes of decisions that depend on the behavior of multiple decision makers are difficult to predict and require highly adaptive decision-making strategies. Second, decision makers may have preferences regarding consequences to other individuals and therefore choose their actions to improve or reduce the well-being of others. Many neurobiological studies have exploited game theory to probe the neural basis of decision making and suggested that these features of social decision making might be reflected in the functions of brain areas involved in reward evaluation and reinforcement learning. Molecular genetic studies have also begun to identify genetic mechanisms for personal traits related to reinforcement learning and complex social decision making, further illuminating the biological basis of social behavior.

This is a preview of subscription content, access via your institution

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Prices may be subject to local taxes which are calculated during checkout

Figure 1: Payoff matrix for the games of matching pennies and prisoner's dilemma.
Figure 2: A model-based reinforcement learning model applied to social decision making.
Figure 3: Brain areas involved in social decision making.

Similar content being viewed by others

References

  1. Kahneman, D. & Tversky, A. Prospect theory: an analysis of decision under risk. Econometrica 47, 263–292 (1979).

    Google Scholar 

  2. Sutton, R.S. & Barton, A.G. Reinforcement Learning: An Introduction (MIT Press, Cambridge, Massachusetts, USA, 1998).

    Google Scholar 

  3. Platt, M.L. & Glimcher, P.W. Neural correlates of decision variables in parietal cortex. Nature 400, 233–238 (1999).

    CAS  PubMed  Google Scholar 

  4. Breiter, H.C., Aharon, I., Kahneman, D., Dale, A. & Shizgal, P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30, 619–639 (2001).

    CAS  PubMed  Google Scholar 

  5. Fiorillo, C.D., Tobler, P.N. & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898–1902 (2003).

    CAS  PubMed  Google Scholar 

  6. Glimcher, P.W. & Rustichini, A. Neuroeconomics: the consilience of brain and decision. Science 306, 447–452 (2004).

    CAS  PubMed  Google Scholar 

  7. Knutson, B., Taylor, J., Kaufman, M., Peterson, R. & Glover, G. Distributed neural representation of expected value. J. Neurosci. 25, 4806–4812 (2005).

    CAS  PubMed  Google Scholar 

  8. Hsu, M., Bhatt, M., Adolphs, R., Tranel, D. & Camerer, C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 310, 1680–1683 (2005).

    CAS  PubMed  Google Scholar 

  9. Preuschoff, K., Bossaerts, P. & Quartz, S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51, 381–390 (2006).

    CAS  PubMed  Google Scholar 

  10. Schultz, W., Dayan, P. & Montague, P.R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997).

    CAS  PubMed  Google Scholar 

  11. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H. & Dolan, R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38, 329–337 (2003).

    CAS  PubMed  Google Scholar 

  12. McClure, S.M., Berns, G.S. & Montague, P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 339–346 (2003).

    CAS  PubMed  Google Scholar 

  13. O'Doherty, J. et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452–454 (2004).

    CAS  PubMed  Google Scholar 

  14. Tricomi, E.M., Delgado, M.R. & Fiez, J.A. Modulation of caudate activity by action contingency. Neuron 41, 281–292 (2004).

    CAS  PubMed  Google Scholar 

  15. Adolphs, R. Social cognition and the human brain. Trends Cogn. Sci. 3, 469–479 (1999).

    CAS  PubMed  Google Scholar 

  16. Fudenberg, D. & Levine, D.K. The Theory of Learning in Games (MIT Press, Cambridge, Massachusetts, USA, 1998).

    Google Scholar 

  17. Camerer, C.F. Behavioral Game Theory: Experiments in Strategic Interaction (Princeton Univ. Press, Princeton, New Jersey, USA, 2003).

    Google Scholar 

  18. von Neumann, J. & Morgenstern, O. Theory of Games and Economic Behavior (Princeton Univ. Press, Princeton, New Jersey, USA, 1944).

    Google Scholar 

  19. Nash, J.F. Equilibrium points in n-person games. Proc. Natl. Acad. Sci. USA 36, 48–49 (1950).

    CAS  PubMed  Google Scholar 

  20. Erev, I. & Roth, A.E. Predicting how people play games: reinforcement learning in experimental games with unique, mixed strategy equilibria. Am. Econ. Rev. 88, 848–881 (1998).

    Google Scholar 

  21. Lee, D., Conroy, M.L., McGreevy, B.P. & Barraclough, D.J. Reinforcement learning and decision making in monkeys during a competitive game. Brain Res. Cogn. Brain Res. 22, 45–58 (2004).

    PubMed  Google Scholar 

  22. Sally, D. Conversation and cooperation in social dilemmas. Ration. Soc. 7, 58–92 (1995).

    Google Scholar 

  23. Fehr, E. & Fischbacher, U. The nature of human altruism. Nature 425, 785–791 (2003).

    CAS  PubMed  Google Scholar 

  24. Hauser, M.D., Chen, M.K., Chen, F. & Chuang, E. Give unto others: genetically unrelated cotton-top tamarin monkeys preferentially give food to those who altruistically give food back. Proc. R. Soc. Lond. B 270, 2363–2370 (2003).

    Google Scholar 

  25. Warneken, F. & Tomasello, M. Altruistic helping in human infants and young chimpanzees. Science 311, 1301–1303 (2006).

    CAS  PubMed  Google Scholar 

  26. de Waal, F.B.M. Putting the altruism back into altruism: the evolution of empathy. Annu. Rev. Psychol. 59, 279–300 (2008).

    PubMed  Google Scholar 

  27. Nowak, M.A. Five rules for the evolution of cooperation. Science 314, 1560–1563 (2006).

    CAS  PubMed  PubMed Central  Google Scholar 

  28. Clutton-Brock, T.H. & Parker, G.A. Punishment in animal societies. Nature 373, 209–216 (1995).

    CAS  PubMed  Google Scholar 

  29. Fehr, E. & Gächter, S. Altruistic punishment in humans. Nature 415, 137–140 (2002).

    CAS  PubMed  Google Scholar 

  30. Boyd, R., Gintis, H., Bowles, S. & Richerson, P.J. The evolution of altruistic punishment. Proc. Natl. Acad. Sci. USA 100, 3531–3535 (2003).

    CAS  PubMed  Google Scholar 

  31. Fehr, E. & Schmidt, K.M. A theory of fairness, competition, and cooperation. Q. J. Econ. 114, 817–868 (1999).

    Google Scholar 

  32. Fehr, E. & Camerer, C.F. Social neuroeconomics: the neural circuitry of social preferences. Trends Cogn. Sci. 11, 419–427 (2007).

    PubMed  Google Scholar 

  33. Sanfey, A.G. Social decision-making: insights from game theory and neuroscience. Science 318, 598–602 (2007).

    CAS  PubMed  Google Scholar 

  34. Jensen, K., Call, J. & Tomasello, M. Chimpanzees are rational maximizers in an ultimatum game. Science 318, 107–109 (2007).

    CAS  PubMed  Google Scholar 

  35. Sandholm, T.W. & Crites, R.H. Multiagent reinforcement learning in the iterated prisoner's dilemma. Biosystems 37, 147–166 (1996).

    CAS  PubMed  Google Scholar 

  36. Lee, D., McGreevy, B.P. & Barraclough, D.J. Learning and decision making in monkeys during a rock-paper-scissors game. Brain Res. Cogn. Brain Res. 25, 416–430 (2005).

    PubMed  Google Scholar 

  37. Lohrenz, T., McCabe, K., Camerer, C.F. & Montague, P.R. Neural signature of fictive learning signals in a sequential investment task. Proc. Natl. Acad. Sci. USA 104, 9493–9498 (2007).

    CAS  PubMed  Google Scholar 

  38. Coricelli, G., Dolan, R.J. & Sirigu, A. Brain, emotion and decision making: the paradigmatic example of regret. Trends Cogn. Sci. 11, 258–265 (2007).

    PubMed  Google Scholar 

  39. Mookherjee, D. & Sopher, B. Learning and decision costs in experimental constant sum games. Games Econ. Behav. 19, 97–132 (1997).

    Google Scholar 

  40. Feltovich, N. Reinforcement learning vs. belief-based learning models in experimental asymmetric-information games. Econometrica 68, 605–641 (2000).

    Google Scholar 

  41. Nowak, M.A. & Sigmund, K. Evolution of indirect reciprocity by image scoring. Nature 393, 573–577 (1998).

    CAS  PubMed  Google Scholar 

  42. Wedekind, C. & Milinski, M. Cooperation through image scoring in humans. Science 288, 850–852 (2000).

    CAS  PubMed  Google Scholar 

  43. Delgado, M.R., Frank, R.H. & Phelps, E.A. Perceptions of moral character modulate the neural systems of reward during the trust game. Nat. Neurosci. 8, 1611–1618 (2005).

    CAS  PubMed  Google Scholar 

  44. Kawato, M. & Samejima, K. Efficient reinforcement learning: computational theories, neuroscience and robotics. Curr. Opin. Neurobiol. 17, 205–212 (2007).

    CAS  PubMed  Google Scholar 

  45. Schultz, W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87–115 (2006).

    PubMed  Google Scholar 

  46. Roesch, M.R., Calu, D.J. & Schoenbaum, G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615–1624 (2007).

    CAS  PubMed  PubMed Central  Google Scholar 

  47. Bayer, H.M. & Glimcher, P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129–141 (2005).

    CAS  PubMed  PubMed Central  Google Scholar 

  48. Paton, J.J., Belova, M.A., Morrison, S.E. & Salzman, C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865–870 (2006).

    CAS  PubMed  PubMed Central  Google Scholar 

  49. Kawagoe, R., Takikawa, Y. & Hikosaka, O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat. Neurosci. 1, 411–416 (1998).

    CAS  PubMed  Google Scholar 

  50. Cromwell, H.C. & Schultz, W. Effects of expectations for different reward magnitude on neuronal activity in primate striatum. J. Neurophysiol. 89, 2823–2838 (2003).

    PubMed  Google Scholar 

  51. Samejima, K., Ueda, Y., Doya, K. & Kimura, M. Representation of action-specific reward values in the striatum. Science 310, 1337–1340 (2005).

    CAS  PubMed  Google Scholar 

  52. Sugrue, L.P., Corrado, G.S. & Newsome, W.T. Matching behavior and the representation of value in the parietal cortex. Science 304, 1782–1787 (2004).

    CAS  PubMed  Google Scholar 

  53. Dorris, M.C. & Glimcher, P.W. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44, 365–378 (2004).

    CAS  PubMed  Google Scholar 

  54. Watanabe, M. Reward expectancy in primate prefrontal neurons. Nature 382, 629–632 (1996).

    CAS  PubMed  Google Scholar 

  55. Leon, M.I. & Shadlen, M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24, 415–425 (1999).

    CAS  Google Scholar 

  56. Barraclough, D.J., Conroy, M.L. & Lee, D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7, 404–410 (2004).

    CAS  PubMed  Google Scholar 

  57. Shidara, M. & Richmond, B.J. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296, 1709–1711 (2002).

    Google Scholar 

  58. Seo, H. & Lee, D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci. 27, 8366–8377 (2007).

    CAS  PubMed  PubMed Central  Google Scholar 

  59. Sohn, J.-W. & Lee, D. Order-dependent modulation of directional signals in the supplementary and presupplementary motor areas. J. Neurosci. 27, 13655–13666 (2007).

    CAS  PubMed  PubMed Central  Google Scholar 

  60. Tremblay, L. & Schultz, W. Relative reward preference in primate orbitofrontal cortex. Nature 398, 704–708 (1999).

    CAS  PubMed  Google Scholar 

  61. Roesch, M.R. & Olson, C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304, 307–310 (2004).

    CAS  PubMed  Google Scholar 

  62. Padoa-Schioppa, C. & Assad, J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226 (2006).

    CAS  PubMed  PubMed Central  Google Scholar 

  63. Lee, D., Rushworth, M.F.S., Walton, M.E., Watanabe, M. & Sakagami, M. Functional specialization of the primate frontal cortex during decision making. J. Neurosci. 27, 8170–8173 (2007).

    CAS  PubMed  PubMed Central  Google Scholar 

  64. O'Doherty, J.P. Reward representation and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14, 769–776 (2004).

    CAS  PubMed  Google Scholar 

  65. Knutson, B. & Cooper, J.C. Functional magnetic resonance imaging of reward prediction. Curr. Opin. Neurol. 18, 411–417 (2005).

    PubMed  Google Scholar 

  66. Montague, P.R., King-Casas, B.K. & Cohen, J.D. Imaging valuation models in human choice. Annu. Rev. Neurosci. 29, 417–448 (2006).

    CAS  PubMed  Google Scholar 

  67. Logothetis, N.K. & Wandell, B.A. Interpreting the BOLD signal. Annu. Rev. Physiol. 66, 735–769 (2004).

    CAS  PubMed  Google Scholar 

  68. Tsujimoto, S. & Sawaguchi, T. Neuronal representation of response-outcome in the primate prefrontal cortex. Cereb. Cortex 14, 47–55 (2004).

    PubMed  Google Scholar 

  69. Rilling, J.K. et al. A neural basis for social cooperation. Neuron 35, 395–405 (2002).

    CAS  PubMed  Google Scholar 

  70. Rilling, J.K., Sanfey, A.G., Aronson, J.A., Nystrom, L.E. & Cohen, J.D. Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways. Neuroreport 15, 2539–2543 (2004).

    PubMed  Google Scholar 

  71. King-Casas, B. et al. Getting to know you: reputation and trust in a two-person economic exchange. Science 308, 78–83 (2005).

    CAS  PubMed  Google Scholar 

  72. Sanfey, A.G., Rilling, J.K., Aronson, J.A., Nystrom, L.E. & Cohen, J.D. The neural basis of economic decision making in the ultimatum game. Science 300, 1755–1758 (2003).

    CAS  PubMed  Google Scholar 

  73. Phillips, M.L. et al. A specific neural substrate for perceiving facial expressions of disgust. Nature 389, 495–498 (1997).

    CAS  PubMed  Google Scholar 

  74. de Quervain, D.J.-F. et al. The neural basis of altruistic punishment. Science 305, 1254–1258 (2004).

    CAS  PubMed  Google Scholar 

  75. Spitzer, M., Fischbacher, U., Herrnberger, B., Grön, G. & Fehr, E. The neural signature of social norm compliance. Neuron 56, 185–196 (2007).

    CAS  PubMed  Google Scholar 

  76. Moll, J. et al. Human fronto-mesolimbic networks guide decisions about charitable donation. Proc. Natl. Acad. Sci. USA 103, 15623–15628 (2006).

    CAS  PubMed  Google Scholar 

  77. Harbaugh, W.T., Mayr, U. & Burghart, D.R. Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 316, 1622–1625 (2007).

    CAS  PubMed  Google Scholar 

  78. Hoffman, E., McCabe, K., Shachat, K. & Smith, V. Preferences, property rights, and anonymity in bargaining games. Games Econ. Behav. 7, 346–380 (1994).

    Google Scholar 

  79. Schotter, A., Weiss, A. & Zapater, I. Fairness and survival in ultimatum and dictatorship games. J. Econ. Behav. Organ. 31, 37–56 (1996).

    Google Scholar 

  80. Fliessbach, K. et al. Social comparison affects reward-related brain activity in the human ventral striatum. Science 318, 1305–1308 (2007).

    CAS  PubMed  Google Scholar 

  81. Decety, J., Jackson, P.L., Sommerville, J.A., Chaminade, T. & Meltzoff, A.N. The neural bases of cooperation and competition: an fMRI investigation. Neuroimage 23, 744–751 (2004).

    PubMed  PubMed Central  Google Scholar 

  82. Gallagher, H.L. & Frith, C.D. Functional imaging of 'theory of mind'. Trends Cogn. Sci. 7, 77–83 (2003).

    PubMed  Google Scholar 

  83. Saxe, R. Uniquely human social cognition. Curr. Opin. Neurobiol. 16, 235–239 (2006).

    CAS  PubMed  Google Scholar 

  84. McCabe, K., Houser, D., Ryan, L., Smith, V. & Trouard, T. A functional imaging study of cooperation in two-person reciprocal exchange. Proc. Natl. Acad. Sci. USA 98, 11832–11835 (2001).

    CAS  PubMed  Google Scholar 

  85. Gallagher, H.L., Jack, A.I., Roepstorff, A. & Frith, C.D. Imaging the intentional stance in a competitive game. Neuroimage 16, 814–821 (2002).

    PubMed  Google Scholar 

  86. Rilling, J.K., Sanfey, A.G., Aronson, J.A., Nystrom, L.E. & Cohen, J.D. The neural correlates of theory of mind with interpersonal interactions. Neuroimage 22, 1694–1703 (2004).

    PubMed  Google Scholar 

  87. Bhatt, M. & Camerer, C.F. Self-referential thinking and equilibrium as states of mind in games: fMRI evidence. Games Econ. Behav. 52, 424–459 (2005).

    Google Scholar 

  88. Fukui, H. et al. The neural basis of social tactics: an fMRI study. Neuroimage 32, 913–920 (2006).

    PubMed  Google Scholar 

  89. Tomlin, D. et al. Agent-specific responses in the cingulate cortex during economic exchange. Science 312, 1047–1050 (2006).

    CAS  PubMed  Google Scholar 

  90. Tankersley, D., Stowe, C.J. & Huettel, S.A. Altruism is associated with an increased neural response to agency. Nat. Neurosci. 10, 150–151 (2007).

    CAS  PubMed  Google Scholar 

  91. Penke, L., Denissen, J.J.A. & Miller, G.F. The evolutionary genetics of personality. Eur. J. Pers. 21, 549–587 (2007).

    Google Scholar 

  92. Wallace, B., Cesarini, D., Lichtenstein, P. & Johannesson, M. Heritability of ultimatum game responder behavior. Proc. Natl. Acad. Sci. USA 104, 15631–15634 (2007).

    CAS  PubMed  Google Scholar 

  93. Klein, T.A. et al. Genetically determined differences in learning from errors. Science 318, 1642–1645 (2007).

    CAS  PubMed  Google Scholar 

  94. Frank, M.J., Moustafa, A.A., Haughey, H.M., Curran, T. & Hutchison, K.E. Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc. Natl. Acad. Sci. USA 104, 16311–16316 (2007).

    CAS  PubMed  Google Scholar 

  95. Hariri, A.R., Drabant, E.M. & Weinberger, D.R. Imaging genetics: perspectives from studies of genetically driven variation in serotonin function and corticolimbic affective processing. Biol. Psychiatry 59, 888–897 (2006).

    CAS  PubMed  Google Scholar 

  96. Canli, T. & Lesch, K.-P. Long story short: the serotonin transporter in emotion regulation and social cognition. Nat. Neurosci. 10, 1103–1109 (2007).

    CAS  PubMed  Google Scholar 

  97. Izquierdo, A., Newman, T.K., Higley, J.D. & Murray, E.A. Genetic modulation of cognitive flexibility and socioemotional behavior in rhesus monkeys. Proc. Natl. Acad. Sci. USA 104, 14128–14133 (2007).

    CAS  PubMed  Google Scholar 

  98. Yacubian, J. et al. Gene-gene interaction associated with neural reward sensitivity. Proc. Natl. Acad. Sci. USA 104, 8125–8130 (2007).

    CAS  PubMed  Google Scholar 

  99. Burnham, T.C. High-testosterone men reject low ultimatum game offers. Proc. R. Soc. Lond. B 274, 2327–2330 (2007).

    Google Scholar 

  100. Kosfeld, M., Heinrichs, M., Zak, P.J., Fischbacher, U. & Fehr, E. Oxytocin increases trust in humans. Nature 435, 673–676 (2005).

    CAS  PubMed  Google Scholar 

Download references

Acknowledgements

I am grateful to Michael Frank for discussions. This research was supported by the US National Institutes of Health (MH073246 and DA024855).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daeyeol Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, D. Game theory and neural basis of social decision making. Nat Neurosci 11, 404–409 (2008). https://doi.org/10.1038/nn2065

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/nn2065

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing