Letter

Coherency-maximizing exploration in the supermarket

  • Nature Human Behaviour 1, Article number: 0017 (2017)
  • doi:10.1038/s41562-016-0017
  • Download Citation
Received:
Accepted:
Published online:

Abstract

In uncertain environments, effective decision makers balance exploiting options that are currently preferred against exploring alternative options that may prove superior 1,2 . For example, a honeybee foraging for nectar must decide whether to continue exploiting the current patch or move to a new location 3,​4,​5,​6 . When the relative reward of options changes over time, humans explore in a normatively correct fashion, exploring more often when they are uncertain about the relative value of competing options 7,​8,​9,​10,​11 . However, rewards in these laboratory studies were objective (for example, monetary payoff), whereas many real-world decision environments involve subjective evaluations of reward (for example, satisfaction with food choice). In such cases, rather than choices following preferences, preferences may follow choices with subjective reward (that is, value) to maximize coherency between preferences and behaviour 12,13 . If so, increasing coherency would lessen the tendency to explore while uncertainty increases, contrary to previous findings. To evaluate this possibility, we examined the exploratory choices of more than 280,000 anonymized individuals in supermarkets over several years. Consumers’ patterns of exploratory choice ran counter to normative models for objective rewards 7,​8,​9,14 —the longer the exploitation streak for a product, the less likely people were to explore an alternative. Furthermore, customers preferred coupons to explore alternative products when they had recently started an exploitation streak. These findings suggest interventions to promote healthy lifestyle choices.

  • Subscribe to Nature Human Behaviour for full access:

    $99

    Subscribe

  • Purchase article full text and PDF:

    $32

    Buy now

Additional access options:

Already a subscriber?  Log in  now or  Register  for online access.

References

  1. 1.

    , & Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Phil. Trans. R. Soc. B 362, 933–942 (2007).

  2. 2.

    et al. Exploration versus exploitation in space, mind, and society. Trends Cogn. Sci. 19, 46–54 (2015).

  3. 3.

    , & Patch leaving in humans: can a generalist adapt its rules to dispersal of items across patches? Anim. Behav. 75, 1331–1349 (2008).

  4. 4.

    & Exploration versus exploitation: a field study of time allocation to environmental tracking by foraging chipmunks. Anim. Behav. 41, 443–449 (1991).

  5. 5.

    , & Test of optimal sampling by foraging great tits. Nature 275, 27–31 (1978).

  6. 6.

    et al. Foraging under competition: the neural basis of input-matching in humans. J. Neurosci. 33, 9866–9872 (2013).

  7. 7.

    , , , & The influence of depression symptoms on exploratory decision-making. Cognition 129, 563–568 (2013).

  8. 8.

    , , & The nature of belief-directed exploratory choice in human decision-making. Front. Psychol. 2, 398 (2012).

  9. 9.

    , , & Physiological and behavioral signatures of reflective exploratory choice. Cogn. Affect. Behav. Neurosci. 14, 1167–1183 (2014).

  10. 10.

    & Unfazed by both the bull and bear: strategic exploration in dynamic environments. Games 6, 251–261 (2015).

  11. 11.

    & Uncertainty and exploration in a restless bandit problem. Top. Cogn. Sci. 7, 351–367 (2015).

  12. 12.

    , , , & Magic at the marketplace: choice blindness for the taste of jam and the smell of tea. Cognition 117, 54–61 (2010).

  13. 13.

    , & in Neuroscience of Preference and Choice: Cognitive and Neural Mechanisms (eds Dolan, R. J. & Sharot, T. ) 121–138 (Academic Press, 2012).

  14. 14.

    et al. A frontal dopamine system for reflective exploratory behavior. Neurobiol. Learn. Mem. 123, 84–91 (2015).

  15. 15.

    , , , & Cortical substrates for exploratory decisions in humans. Nature 441, 876–879 (2006).

  16. 16.

    , & Choice-induced preferences in the absence of choice: evidence from a blind two choice paradigm with young children and capuchin monkeys. J. Exp. Soc. Psychol. 46, 204–207 (2010).

  17. 17.

    , , , & Is choice-induced preference change long lasting? Psychol. Sci. 23, 1123–1129 (2012).

  18. 18.

    , & Do decisions shape preference? Evidence from blind choice. Psychol. Sci. 21, 1231–1235 (2010).

  19. 19.

    , & Lifting the veil of morality: choice blindness and attitude reversals on a self-transforming survey. PloS ONE 7, e45457 (2012).

  20. 20.

    , , & Failure to detect mismatches between intention and outcome in a simple decision task. Science 310, 116–119 (2005).

  21. 21.

    A Theory of Cognitive Dissonance (Stanford Univ. Press, 1957).

  22. 22.

    Recent research on selective exposure to information. Adv. Exp. Soc. Psychol. 19, 41–80 (1986).

  23. 23.

    , , & Confirmation bias in sequential information search after preliminary decisions: an expansion of dissonance theoretical research on selective exposure to information. J. Pers. Soc. Psychol. 80, 557–571 (2001).

  24. 24.

    & Reinforcement Learning: An Introduction (MIT Press, 1998).

  25. 25.

    , & Search in external and internal spaces evidence for generalized cognitive search processes. Psychol. Sci. 19, 802–808 (2008).

  26. 26.

    , , & Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 12, 1062–1068 (2009).

  27. 27.

    , , , & Choice blindness and preference change: you will like this paper better if you (believe you) chose to read it! J. Behav. Decis. Making 27, 281–289 (2014).

  28. 28.

    & How actions create—not just reveal—preferences. Trends Cogn. Sci. 12, 13–16 (2008).

Download references

Acknowledgements

We thank P. Todd for comments. This work was supported by the Leverhulme Trust grant RPG-2014-075, National Institutes of Health (grant 1P01HD080679) and Wellcome Trust Senior Investigator Award WT106931MA to B.C.L. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript. At the time of submission, R.P., N.B. and G.P. were employed by dunnhumby Ltd. This work was carried out as part of P.S.R.’s PhD thesis, which was co-sponsored by dunnhumby Ltd. and UCL. dunnhumby Ltd. did not place any restrictions on the design, data collection and analysis, decision to publish or preparation of the manuscript, beyond the requirement that this work was to be done in compliance with its data policy.

Author information

Affiliations

  1. Department of Experimental Psychology, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK

    • Peter S. Riefer
    •  & Bradley C. Love
  2. dunnhumby Ltd, 184 Shepherd’s Bush Road, London W6 7NL, UK

    • Peter S. Riefer
    • , Rosie Prior
    • , Nicholas Blair
    •  & Giles Pavey
  3. The Alan Turing Institute, 96 Euston Road, London NW1 2DB, UK

    • Bradley C. Love

Authors

  1. Search for Peter S. Riefer in:

  2. Search for Rosie Prior in:

  3. Search for Nicholas Blair in:

  4. Search for Giles Pavey in:

  5. Search for Bradley C. Love in:

Contributions

P.S.R. was involved in all parts of this project, supported by R.P., N.B. and G.P. regarding the data analysis and with input from B.C.L. for the design, analysis and write-up of the manuscript.

Competing interests

The authors declare no competing interests.

Corresponding author

Correspondence to Peter S. Riefer.

Supplementary information

PDF files

  1. 1.

    Supplementary Information

    Supplementary Data and Analyses, Supplementary Tables 1–4, Supplementary References