Large language models show remarkable capacities, but it is unclear what abstractions support their behaviour. Methods from developmental psychology can help researchers to understand the representations used by these models, complementing standard computational approaches — and perhaps leading to insights about the nature of mind.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 digital issues and online access to articles
$59.00 per year
only $4.92 per issue
Buy this article
- Purchase on SpringerLink
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
References
Brown, T. et al. Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 33, 1877–1901 (2020).
Ullman, T. (2023). Large language models fail on trivial alterations to theory-of-mind tasks. Preprint at https://doi.org/10.48550/arXiv.2302.08399 (2023).
Geiger, A., Carstensen, A., Frank, M. C. & Potts, C. Relational reasoning and generalization using nonsymbolic neural networks. Psychol. Rev. 130, 308–333 (2023).
Sober, E. in The Evolution of Mind (eds. Cummins, D. D. & Allen, C.) 224–242 (Oxford Univ. Press, 1998).
Kominsky, J. F., Lucca, K., Thomas, A. J., Frank, M. C. & Hamlin, J. K. Simplicity and validity in infant research. Cogn. Dev. 63, 101213 (2022).
Liu, S., Ullman, T. D., Tenenbaum, J. B. & Spelke, E. S. Ten-month-old infants infer the value of goals from the costs of actions. Science 358, 1038–1041 (2017).
Saffran, J. R., Aslin, R. N. & Newport, E. L. Statistical learning by 8-month-old infants. Science 274, 1926–1928 (1996).
Davidson, K., Eng, K. & Barner, D. Does learning to count involve a semantic induction? Cognition 123, 162–173 (2012).
Ruffman, T., Slade, L. & Crowe, E. The relation between children’s and mothers’ mental state language and theory-of-mind understanding. Child Dev. 73, 734–751 (2002).
Geiger, A., Lu, H., Icard, T. & Potts, C. Causal abstractions of neural networks. Adv. Neural Inf. Process. Syst. 34, 9574–9586 (2021).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The author declares no competing interests.
Rights and permissions
About this article
Cite this article
Frank, M.C. Baby steps in evaluating the capacities of large language models. Nat Rev Psychol 2, 451–452 (2023). https://doi.org/10.1038/s44159-023-00211-x
Published:
Issue Date:
DOI: https://doi.org/10.1038/s44159-023-00211-x
