Abstract
Inequality in treatment access is a pressing issue in most healthcare systems across many medical disciplines. In mental healthcare, reduced treatment access for minorities is ubiquitous but remedies are sparse. Here we demonstrate that digital tools can reduce the accessibility gap by addressing several key barriers. In a multisite observational study of 129,400 patients within England’s NHS services, we evaluated the impact of a personalized artificial intelligence-enabled self-referral chatbot on patient referral volume and diversity in ethnicity, gender and sexual orientation. We found that services that used this digital solution identified substantially increased referrals (15% increase versus 6% increase in control services). Critically, this increase was particularly pronounced in minorities, such as nonbinary (179% increase) and ethnic minority individuals (29% increase). Using natural language processing to analyze qualitative feedback from 42,332 individuals, we found that the chatbot’s human-free nature and the patients’ self-realization of their need for treatment were potential drivers for the observed improvement in the diversity of access. This provides strong evidence that digital tools may help overcome the pervasive inequality in mental healthcare.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Data availability
The referral data is publicly available on the NHS Digital database. The specific data used for the referral analysis is available in a dedicated GitHub repository. The qualitative feedback data will not be publicly available because the individuals did not provide explicit consent for the public sharing of this feedback data.
Code availability
The code used for the analyses is available at a dedicated GitHub repository.
References
World Health Organization. World mental health report: transforming mental health for all. www.who.int/publications/i/item/9789240049338 (2022).
Steel, Z. et al. The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013. Int J. Epidemiol. 43, 476–493 (2014).
Thome, J. et al. The impact of the early phase of the COVID-19 pandemic on mental-health services in Europe. World J. Biol. Psychiatry 22, 516–525 (2021).
Ornell, F. et al. The next pandemic: impact of COVID-19 in mental healthcare assistance in a nationwide epidemiological study. Lancet Reg. Health Am. 4, 100061 (2021).
Loosen, A. M., Skvortsova, V. & Hauser, T. U. Obsessive–compulsive symptoms and information seeking during the COVID-19 pandemic. Transl. Psychiatry 11, 309 (2021).
COVID-19 Mental Disorders Collaborators Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. Lancet 398, 1700–1712 (2021).
The Lancet Global Health. Mental health matters. Lancet. Glob. Health. 8, e1352 (2020).
Cuijpers, P. et al. The effects of psychotherapies for major depression in adults on remission, recovery and improvement: a meta-analysis. J. Affect. Disord. 159, 118–126 (2014).
Hofmann, S. G. & Smits, J. A. Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials. J. Clin. Psychiatry 69, 621 (2008).
World Health Organization. WHO report highlights global shortfall in investment in mental health. www.who.int/news/item/08-10-2021-who-report-highlights-global-shortfall-in-investment-in-mental-health (2021).
Mahase, E. Workforce crisis has left mental health staff at ‘breaking point’ as demand rises. BMJ. 368, m88 (2020).
Wang, P. S. et al. Delay and failure in treatment seeking after first onset of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry. 6, 177–185 (2007).
Department of Health and Social Care. Progress in improving mental health services in England. www.nao.org.uk/wp-content/uploads/2023/02/Progress-in-improving-mental-health-services-CS.pdf (2023).
Andrade, L. H. et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol. Med. 44, 1303–1317 (2014).
Thornicroft, G. et al. The Lancet Commission on ending stigma and discrimination in mental health. Lancet 400, 1438–1480 (2022).
Clement, S. et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol. Med. 45, 11–27 (2015).
Corrigan, P. W., Druss, B. G. & Perlick, D. A. The impact of mental illness stigma on seeking and participating in mental health care. Psychol. Sci. Public Interest 15, 37–70 (2014).
Williams, M. E., Latta, J. & Conversano, P. Eliminating the wait for mental health services. J. Behav. Health Serv. Res. 35, 107–114 (2008).
Reichert, A. & Jacobs, R. The impact of waiting time on patient outcomes: evidence from early intervention in psychosis services in England. Health Econ. 27, 1772–1787 (2018).
De Girolamo, G., Dagani, J., Purcell, R., Cocchi, A. & McGorry, P. Age of onset of mental disorders and use of mental health services: needs, opportunities and obstacles. Epidemiol. Psychiatr. Sci. 21, 47–57 (2012).
Moitra, M. et al. The global gap in treatment coverage for major depressive disorder in 84 countries from 2000–2019: a systematic review and Bayesian meta-regression analysis. PLoS Med. 19, e1003901 (2022).
Volpe, U., Mihai, A., Jordanova, V. & Sartorius, N. The pathways to mental healthcare worldwide: a systematic review. Curr. Opin. Psychiatry 28, 299–306 (2015).
Brown, J. S., Boardman, J., Whittinger, N. & Ashworth, M. Can a self-referral system help improve access to psychological treatments? Br. J. Gen. Pract. 60, 365–371 (2010).
The National Collaborating Centre for Mental Health. The improving access to psychological therapies manual. www.england.nhs.uk/wp-content/uploads/2018/06/the-nhs-talking-therapies-manual-v6.pdf (2021).
NHS Digital. Improving access to psychological therapies self-referral process research. digital.nhs.uk/publication-system/statistical/improving-access-to-psychological-therapies-key-performance-indicators-iapt-kpis/iapt-self-referral-process-research (2019).
Car, L. et al. Conversational agents in healthcare: scoping review and conceptual analysis. J. Med. Internet Res. 22, e17158 (2020).
Rudd, B. N. & Beidas, R. S. Digital mental health: the answer to the global mental health crisis? JMIR Ment. Health 7, e18472 (2020).
Taylor, C. B., Fitzsimmons-Craft, E. E. & Graham, A. K. Digital technology can revolutionize mental health services delivery: the COVID-19 crisis as a catalyst for change. Int. J. Eat. Disord. 53, 1155–1157 (2020).
Kola, L. et al. COVID-19 mental health impact and responses in low-income and middle-income countries: reimagining global mental health. Lancet Psychiatry 8, 535–550 (2021).
Rollwage, M. et al. Using conversational AI to facilitate mental health assessments and improve clinical efficiency within psychotherapy services: real-world observational study. JMIR AI 2, e44358 (2023).
Jayaraajan, K. et al. The use of digital solutions in alleviating the burden of IAPT’s waiting times. Int. J. Risk Saf. Med. 33, S1–S8 (2022).
Koutsouleris, N., Hauser, T. U., Skvortsova, V. & DeChoudhury, M. From promise to practice: towards the realisation of AI-informed mental healthcare.Lancet Digit Health. 4, e829–e840 (2022).
Rodríguez-Rivas, M. E., Cangas, A. J., Cariola, L. A., Varela, J. J. & Valdebenito, S. Innovative technology-based interventions to reduce stigma toward people with mental illness: systematic review and meta-analysis. JMIR Serious Games 10, e35099 (2022).
Johnson, J. A., Sanghvi, P. & Mehrotra, S. Technology-based interventions to improve help-seeking for mental health concerns: a systematic review. Indian J. Psychol. Med. 44, 332–340 (2022).
Te Pas, M. E., Rutten, W. G., Bouwman, R. A. & Buise, M. P. User experience of a chatbot questionnaire versus a regular computer questionnaire: prospective comparative study. JMIR Med. Inform. 8, e21982 (2020).
Bhakta, R., Savin-Baden, M. & Tombs, G. Sharing secrets with robots? In Proc. EdMedia+ Innovate Learning (eds Viteli, J. & Leikomaa, M.) 2295–2301 (Association for the Advancement of Computing in Education, 2014).
Kim, S., Lee, J. & Gweon, G. Comparing data from chatbot and web surveys: effects of platform and conversational style on survey response quality. In Proc. 2019 CHI Conference on Human Factors in Computing Systems 1–12 (Association for Computing Machinery, 2019).
Lee, Y.-C. et al. ‘I hear you, I feel you’: encouraging deep self-disclosure through a chatbot. In Proc. 2020 CHI Conference on Human Factors in Computing Systems 1–12 (Association for Computing Machinery, 2020).
Viduani, A. et al. in Digital Mental Health (eds Passos, I. C., Rabelo-da-Ponte, F. D. & Kapczinski, F.) 133–148 (Springer, 2023). https://doi.org/10.1007/978-3-031-10698-9
Lee, Y.-C. et al. Exploring effects of chatbot-based social contact on reducing mental illness stigma. In Proc. 2023 CHI Conference on Human Factors in Computing Systems (eds Schmidt, A. & Vaananen, K.) 1–16 (Association for Computing Machinery, 2023).
Bansal, N. et al. Understanding ethnic inequalities in mental healthcare in the UK: a meta-ethnography. PLoS Med. 19, e1004139 (2022).
World Health Organization. Global strategy on digital health 2020–2025. www.who.int/docs/default-source/documents/gs4dhdaa2a9f352b0445bafbc79ca799dce4d.pdf (2021).
The Lancet. Can digital technologies improve health? Lancet 398, 1663 (2021).
Rollwage, M. et al. Conversational AI facilitates mental health assessments and is associated with improved recovery rates. Preprint at medRxiv https://doi.org/10.1101/2022.11.03.22281887 (2022).
Kroenke, K., Spitzer, R. L. & Williams, J. B. The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern Med. 16, 606–613 (2001).
Spitzer, R. L., Kroenke, K., Williams, J. B. & Löwe, B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097 (2006).
Mundt, J. C., Marks, I. M., Shear, M. K. & Greist, J. M. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br. J. Psychiatry 180, 461–464 (2002).
Rose, S. & Van der Laan, M. J. Why match? Investigating matched cag19se-control study designs with causal effect estimation. Int. J. Biostat. 5, 1 (2009).
NHS Digital. Psychological therapies: reports on the use of IAPT services, England September 2020 Final including report on the EA in IAPT pilot. digital.nhs.uk/data-and-information/publications/statistical/psychological-therapies-report-on-the-use-of-iapt-services/september-2020-final-including-a-report-on-the-iapt-employment-advisors-pilot (2001).
National Institute for Clinical Excellence. Principles for Best Practice in Clinical Audit (Radcliffe Medical Press, 2002).
Khanbhai, M. et al. Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review. BMJ Health Care Inform. 28, e100262 (2021).
Clarke, V. & Braun, V. Thematic analysis. J. Posit. Psychol. 12, 297–298 (2016).
Laugwitz, B., Held, T. & Schrepp, M. Construction and evaluation of a user experience questionnaire. In HCI and Usability for Education and Work. USAB 2008. Lecture Notes in Computer Science, Vol. 5298 (ed. Holzinger, A.) 63–76 (Springer, 2008).
Acknowledgements
This work was supported by Limbic Limited. We thank E. Ivanova for her contribution to the figures and illustrations and S. Pisupati for reviewing the analysis code.
Author information
Authors and Affiliations
Contributions
J.H. and M.R. conceived and planned the study with input from B.C. and R.H. J.H. analyzed the data with input from M.R. and T.U.H. S.V. performed the thematic analysis, which was further discussed with J.H. and M.R.; M.R. and J.H. developed the NLP model. J.H. wrote the first draft of the manuscript with edits from all other authors.
Corresponding author
Ethics declarations
Competing interests
J.H., S.V., B.C., R.H. and M.R. are employed by Limbic Limited and hold shares in the company. T.U.H. is working as a paid consultant for Limbic Limited and holds shares in the company.
Peer review
Peer review information
Nature Medicine thanks Stefan Rennick-Egglestone and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Primary Handling Editor: Lorenzo Righetto, in collaboration with the Nature Medicine team.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Extended data
Extended Data Fig. 1 Percentage change for different sexuality groups for services implementing the personalized self-referral chatbot (pink) and the matched control services (gray).
No difference between the percentage change in referrals for services using the chatbot compared to the control services was observed for non-binary individuals (OR = 1.12, CI = [0.998, 1.251], p = 0.053) or gay and lesbians (OR = 1.01, CI = [0.838, 1.228], p = 0.882). There was a significant increase in heterosexual individuals in services using the chatbot compared to matched services (OR = 1.05, CI = [1.026, 1.084], p < 0.001). We did not find any difference between the referrals from bisexual and heterosexual individuals between services (interaction term: OR = 1.06, CI = [0.944,1.190], p = 0.326), or between gay/lesbian and heterosexual individuals (OR = 0.96, CI = [0.793,1.167], p = 0.695). ***p < 0.001, n.s. p > 0.05.
Supplementary information
Supplementary Information
Supplementary Figs. 1–5 and Supplementary Tables 1–4.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Habicht, J., Viswanathan, S., Carrington, B. et al. Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot. Nat Med 30, 595–602 (2024). https://doi.org/10.1038/s41591-023-02766-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41591-023-02766-x
This article is cited by
-
Using computer algorithms to understand why mental illnesses emerge
Nature Mental Health (2024)
-
An AI chatbot for talking therapy referrals
Nature Medicine (2024)