Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Correspondence
  • Published:

Does it matter if empathic AI has no empathy?

Nature Machine Intelligence volume 6, pages 496–497 (2024)Cite this article

Subjects

Access through your institution
Buy or subscribe

Imagine a machine that provides a simulation of any experience a person might want, but once the machine is activated, the person is unable to tell that the experience isn’t real. When Robert Nozick formulated this thought experiment in 1974 (ref. 1), it was meant to be obvious that people in otherwise ordinary circumstances would be making a horrible mistake if they hooked themselves up to such a machine permanently. During the intervening decades, however, cultural commitment to that core value — the value of being in contact with reality as it is — has become more tenuous, and the empathic use of AI, in which people seek to be understood, cared for and even loved by a large language model (LLM), is on the rise.

The use of LLMs for information, entertainment and even behavioural encouragement (such as encouragement to go for a walk or make a friend) can be constructive. Applications of LLM chatbots in certain therapeutic domains, from diagnosis to health advice, also seem promising2. However, we, as a team of psychologists, philosophers and computer scientists, have concerns about LLMs as a source of empathic care. We list several research questions on the consequences and risks of empathic AI that must be addressed (Table 1), and in the following, we challenge four reassurances that have been offered in defence of empathic AI.

Table 1 Questions to probe the ethics and consequences of empathic AI
Full size table

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Access through your institution

Buy this article

  • Purchase on SpringerLink
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

References

  1. Nozick, R. Anarchy, State, and Utopia (Basic Books, 1974).

  2. Ayers, J. W. et al. JAMA Int. Med. 183, 589–596 (2023).

    Article  Google Scholar 

  3. Shteynberg, G. et al. Trends Cogn. Sci. 11, 1019–1031 (2023).

    Article  Google Scholar 

  4. Brandtzaeg, P. B., Skjuve, M. & Følstad, A. Hum. Commun. Res. 48, 404–429 (2022).

    Article  Google Scholar 

  5. Inzlicht, M., Cameron, C. D., D’Cruz, J. & Bloom, P. Trends Cogn. Sci. 28, 89–91 (2023).

    Article  Google Scholar 

  6. Zaki, J. Fast Company https://go.nature.com/3UjKGPR (2023).

  7. Montemayor, C., Halpern, J. & Fairweather, A. AI Soc. 37, 1353–1359 (2022).

    Article  Google Scholar 

  8. Perry, A. Nat. Hum. Behav. 7, 1808–1809 (2023).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, University of Tennessee, Knoxville, TN, USA

    Garriy Shteynberg, Jessica Hay, Michael A. Olson & Tim L. Hulsey

  2. School of Public Health, University of California, Berkeley, Berkeley, CA, USA

    Jodi Halpern

  3. Center for AI Security Research, Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Amir Sadovnik

  4. Department of Philosophy, University of Tennessee, Knoxville, TN, USA

    Jon Garthoff

  5. Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel

    Anat Perry

  6. Department of Philosophy, San Francisco State University, San Francisco, CA, USA

    Carlos Montemayor & Abrol Fairweather

Authors
  1. Garriy Shteynberg
    View author publications

    Search author on:PubMed Google Scholar

  2. Jodi Halpern
    View author publications

    Search author on:PubMed Google Scholar

  3. Amir Sadovnik
    View author publications

    Search author on:PubMed Google Scholar

  4. Jon Garthoff
    View author publications

    Search author on:PubMed Google Scholar

  5. Anat Perry
    View author publications

    Search author on:PubMed Google Scholar

  6. Jessica Hay
    View author publications

    Search author on:PubMed Google Scholar

  7. Carlos Montemayor
    View author publications

    Search author on:PubMed Google Scholar

  8. Michael A. Olson
    View author publications

    Search author on:PubMed Google Scholar

  9. Tim L. Hulsey
    View author publications

    Search author on:PubMed Google Scholar

  10. Abrol Fairweather
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Garriy Shteynberg.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shteynberg, G., Halpern, J., Sadovnik, A. et al. Does it matter if empathic AI has no empathy?. Nat Mach Intell 6, 496–497 (2024). https://doi.org/10.1038/s42256-024-00841-7

Download citation

  • Published:

  • Issue date:

  • DOI: https://doi.org/10.1038/s42256-024-00841-7

This article is cited by

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing