Abstract
Restrictive measures during the COVID-19 epidemic have led to increased levels of loneliness, especially among university students, although the influence on suicidal thoughts remains unclear. In this cross-sectional study of 1913 French university students, those with the highest level of loneliness had a fourfold increased risk of suicidal thoughts. Perceived loneliness should be incorporated into suicide risk assessment, and assistance in coping with loneliness should be considered as a means of reducing suicidal risk in vulnerable groups, like university students.
Introduction
Loneliness is defined as a subjective experience where one perceives a discrepancy between their desired and current levels of social relationships1,2. The negative effects of loneliness on mental health are well documented3,4,5,6. In particular, loneliness has been associated with increased risk of engaging in suicidal behaviors, supported by theoretical models of suicide, such as Joiner’s interpersonal theory of suicide7. According to this theory, suicidal desire is caused by the simultaneous presence of two interpersonal constructs: thwarted belongingness and perceived burdensomeness. Thwarted belongingness includes loneliness and the absence of reciprocal care. Self-reported loneliness is considered as one of the six observable risk factors described by Joiner to measure loneliness7.
University students are particularly exposed to suicidal behaviors and psychiatric disorders which often start in young adulthood8,9,10. Emerging adulthood is already a specific period of multiple changes11 and university life implies adaptation to a new environment. Factors that may contribute to an increased risk of mental health disorders and suicidal behaviors in this population include the transition from high-school to university, increasing workload and psychosocial stress or academic pressure12. Thus, before the COVID-19 pandemic, college students already had a high prevalence of mental health problems13,14,15.
In response to the pandemic, numerous countries implemented restrictions, such as lockdowns, curfews, physical distancing requirements, and university closures. This context affected social support and limited personal interactions, while increasing the intensity of several stressors especially among the vulnerable population16,17. Some recent studies have revealed that, due to the social-distancing measures, loneliness became a predominant determinant for anxiety, depression, and their comorbidity18,19. These restrictions have increased levels of loneliness among the general population including university students during the COVID-19 pandemic20,21, which could have negatively impacted their mental health22,23.
A recent study showed that loneliness was consistently associated with the incidence of suicidal ideation, while other objectives measures of social relationship during the COVID-19 outbreak, such as living alone, or the number of days practicing social distancing, were not24. However, information on the association between perceived loneliness and suicidality among university students in this epidemic context is scarce. The objectives of this study were to measure the contribution of perceived loneliness to suicidal ideation among French college students during the COVID-19 pandemic, and to explore the role of depressive symptoms in this association.
Methods
Design, study population, and data source
Our study sample comprised participants in the web-based CONFINS cohort (www.confins.org), a prospective population-based study launched in March 2020, at the very beginning of the first lockdown in France, to address the psychological impact of COVID-19. Participants were recruited through advertisements on traditional and social media. Eligible university students had to be ≥ 18 years of age, and to have been confined in France. In this cross-sectional study, baseline data were collected between March 2020 and January 2021. Over this period, data collection occurred during different key periods of the COVID-19 epidemic in France.
Measures
Perceived loneliness was investigated with the question: “In the last seven days, on a scale of 0–10 (0 = not at all, 10 = totally), how lonely do you feel?” We decided to compare students with high versus low levels of loneliness. For this purpose, we compared the group of students in the highest quartile of the scale (score ≥ 7) (later labeled “loneliness”) to the remaining students (labeled “no loneliness”). The questionnaire included a single-item question about suicidal thoughts during the last seven days: “In the last seven days, how often have you thought of attempting suicide (had suicidal ideation)?” Participants selected one of three responses: no suicidal thoughts, occasional suicidal thoughts, or frequent suicidal thoughts. In the present analysis, occasional and frequent suicidal thoughts were grouped together. The analyses included the following covariates as potential confounders: age, gender (male, female, other), marital status (single, married, in a couple), inclusion period (first national lockdown: March 17–May 11, 2020; no lockdown restrictions: May 12–October 27, 2020; second national lockdown and curfew: October 28, 2020–January 25, 2021), social interactions by phone (never, less than once weekly, more than once weekly), social interactions on social networks (never, less than once weekly, more than once weekly), history of psychiatric disorders (yes, no), and depressive symptoms measured with the 9-item Patient Health Questionnaire (PHQ-9)25,26 using a cut-off of 10 to define the presence of depressive symptoms. Participants with a PHQ-9 score ≥ 10 were further later labeled “with depressive symptoms” and the others were labeled “without depressive symptoms”27.
Statistical analyses
We used binary logistic regression models to measure the association between loneliness and suicidal thoughts. To explore whether the effect of loneliness on the risk of suicidal thoughts was independent of depressive symptoms, we repeated analyses in the two strata with and without depressive symptoms defined above. Finally, we estimated the contribution of loneliness to suicidal thoughts by calculating its attributable fraction (AF), which is the proportion of suicidal thoughts attributable to loneliness, calculated as follows: AF = [p*(aOR − 1)]/[1 + (p*(aOR − 1)], where p represents the prevalence of loneliness in our study sample, and aOR represents the adjusted odds ratio related to the association between exposure and the outcome in multivariate models. All analyses were performed using SAS version 9.4. Two-sided p values of < 0.05 were considered statistically significant.
Ethical approval and consent to participate
The study follows the principles of the Declaration of Helsinki, and the data collection, storage, and analysis comply with the General Data Protection Regulation (EU GDPR). The study was approved by the French Committee for the Protection of Individuals (Comité de Protection des Personnes – CPP IDF X, nr. 46-2020) and by the National Commission on Informatics and Liberty (Commission Nationale de l'Informatique et des Libertes) CNIL, nr. MLD/MFI/AR205600). Participants were informed of the nature and purpose of the study, and provided online consent. Informed consent was obtained from all subjects.
Results
The study population included 1913 college students. The mean age was 23.5 years (± 3.8), and 80.7% were female (N = 1544). Loneliness was reported by 26.9% of participants (N = 514). The prevalence of suicidal thoughts was 12.7% (N = 242) including occasional (10.3%; N = 197) or frequent (2.35%; N = 45). Students with loneliness reported significantly more suicidal thoughts (27.2% vs 7.3%; p < 0.0001), depressive symptoms (67.1% vs 26.1%; p < 0.0001), and history of psychiatric disorders (29.6% vs 18.6%; p < 0.0001) compared to students without loneliness (Table 1). During the second lockdown, the proportion of students who reported loneliness was significantly higher than those who did not (22.6% vs 10.4%; p < 0.0001).
Adjusted logistic regression models revealed a strong association between loneliness and suicidal thoughts (Table 2). Loneliness was associated with a fourfold higher risk of suicidal thoughts (aOR = 4.34; 95% CI: 3.17–5.95), with adjustment for age, gender, inclusion period, interactions by phone, interactions on social network, marital status, and history of psychiatric disorders. In analyses stratified for depressive symptoms, this association decreased but remained high, and in the same proportion regardless of whether the participants reported depressive symptoms. Thus, students who reported loneliness were at higher risk of suicidal thoughts with depressive symptoms (aOR = 2.44; 95% CI: 1.68–3.56) or without depressive symptoms (aOR = 3.76; 95% CI:1.43–8.12) (Table 3). Finally, we observed that the AF of suicidal thoughts imputed to loneliness was high within the total study sample (47.3%), as well as among students with depressive symptoms (41.2%) or without (28.0%) (Table 3).
Discussion
In this sample of French university students enrolled during the COVID-19 epidemic, we found that loneliness was associated with a fourfold increased risk of suicidal thoughts (aOR = 4.34; 95% CI: 3.17–5.95), independently of major potential confounders, e.g., social interactions or history of psychiatric disorders. About half of suicidal thoughts (47.3%) could be attributed to loneliness in this population.
Loneliness has been found to be associated with suicidal behavior in the general population28,29 and particularly so during the COVID-19 pandemic18,19 but few studies were performed on the contribution of loneliness to suicidal thoughts among students during the COVID-19 pandemic. The high estimates, and especially the high AFs, we found, confirm the importance of this risk factor in the students population.
Although lonely individuals are more vulnerable to depression30,31, we found that loneliness remained strongly associated with suicidal thoughts regardless of the presence of depressive symptoms. Analyses stratified on depressive symptoms showed that the association was statistically significant in both stratum and that the estimate was even higher among students without depressive symptoms (aOR = 3.76; 95% CI: 1.43–8.12) than in those with (aOR = 2.44; 95% CI: 1.68–3.56). These results suggest that loneliness could have an impact on suicidal thoughts independently of depressive symptoms. In the literature, the role of psychiatric disorders, especially depressive symptoms, on this association is unclear. In some studies loneliness was associated with suicidal thoughts independently of depression32, while in others this relationship was fully33 or partially mediated by depression28.
While we were not able to compare the levels of loneliness before and during the pandemic, we found that the highest level of loneliness was frequent in our study sample (more than one quarter of the sample) and among students who reported depressive symptoms (48.6%, data not shown), which explained the large AF for suicidal thoughts in these groups. One recent study showed that loneliness levels were higher during the COVID-19 pandemic than before34 and another showed that feelings of loneliness significantly increased during the pandemic among students35. The social isolation imposed from the beginning of the pandemic would have directly contributed to loneliness36. Young adults already reported high levels of loneliness37,38 and, because of the lockdowns and the systematic use of online courses and virtual communication, this feeling has increased during the pandemic39. This could also have had important consequences on their academic success, as loneliness may partially mediate the trajectory of mental health outcomes on academic performance40.
Our results should be interpreted in the light of the following limitations. First, since our study was cross-sectional, we could not strictly separate the timing of exposure, outcome, and covariates, and no causality can be inferred between exposure and suicidal thoughts. Longitudinal studies are needed to study this temporal relationship, the importance of loneliness in suicide prediction, and the potential role of depressive symptoms in mediating this relationship. Second, due to the potential self-selection and the over-representation of women in our sample of volunteers, our conclusions cannot be generalized to a wider population. Third, we measured suicidal thoughts by a single item. Since the CONFINS study covers several themes, it was not possible to use a full questionnaire compatible with an acceptable completion time and participation. Therefore, we chose to ask the question with only a single item adapted to young adult population after team’s consensus between psychiatrists and psychologists. This is a common approach, used in most population-based cohort studies41,42. Likewise, we measured loneliness using a self-reported single-item question that may fail to capture participants who under-report loneliness due to stigma43. However, loneliness assessment using a single-item question and a multiple-item scale reportedly show a high level of concordance44. Fourth, the self-reported questionnaires could lead to information bias, particularly if participants under-reported their frequency of suicidal thoughts or history of psychiatric disorders due to concerns about social desirability. Fifth, although we included several major covariates in our multivariate models, unmeasured confounding factors may remain and could partly explain the observed association.
If confirmed, our present results have two potentially important implications. First, in terms of population health, they show that loneliness is an important risk factor for suicidal thoughts among college students, and that interventions targeting loneliness may reduce suicidal risk in the context of aggravated social isolation (e.g., epidemic)45. Future approaches may include community initiatives and prescription of social activities, particularly among vulnerable groups, such as university students. As loneliness is increasingly recognized as a worldwide public health issue related to emerging societal trends37, the questions raised will remain of interest even beyond the context of an epidemic. Second, our results also suggest that perceived loneliness should be incorporated into suicide risk assessment. This question is shorter and less intrusive than questions regarding depressive symptoms or social interactions. This simple marker could be useful during pandemic periods, for stratifying groups and detecting individuals with a higher suicidal risk.
Data availability
The datasets used and/or analyzed during the current study are available from the corresponding authors on reasonable request.
References
Peplau, L. A. & Perlman, D. Perspective on loneliness. In Loneliness: A Sourcebook of Current Theory, Research and Therapy (eds Peplau, L. A. & Perlman, D.) 1–18 (Wiley, 1982).
Perese, E. F. & Wolf, M. Combating loneliness among persons with severe mental illness: Social network intervention’s characteristics, effectiveness, and applicability. Issues Ment. Health Nurs. 26, 591–609 (2005).
Pitman, A. L., King, M. B., Marston, L. & Osborn, D. P. J. The association of loneliness after sudden bereavement with risk of suicide attempt: A nationwide survey of bereaved adults. Soc. Psychiatry Psychiatr. Epidemiol. 55, 1081–1092. https://doi.org/10.1007/s00127-020-01921-w (2020).
Pitman, A., Mann, F. & Johnson, S. Advancing our understanding of loneliness and mental health problems in young people. Lancet Psychiatry 5(12), 955–956. https://doi.org/10.1016/S2215-0366(18)30436-X (2018).
Wang, J., Mann, F., Lloyd-Evans, B., Ma, R. & Johnson, S. Associations between loneliness and perceived social support and outcomes of mental health problems: A systematic review. BMC Psychiatry 18(1), 156. https://doi.org/10.1186/s12888-018-1736-5 (2018).
Meltzer, H. et al. Feelings of loneliness among adults with mental disorder. Soc. Psychiatry Psychiatr. Epidemiol. 48(1), 5–13 (2013).
Van Orden, K. A. et al. The interpersonal theory of suicide. Psychol. Rev. 117(2), 575–600. https://doi.org/10.1037/a0018697 (2010).
Kovess-Masfety, V. et al. Mental health of college students and their non-college-attending peers: results from a large French cross-sectional survey. BMC Psychol. 4, 20. https://doi.org/10.1186/s40359-016-0124-5 (2016).
Kessler, R. C. et al. Age of onset of mental disorders: A review of recent literature. Curr. Opin. Psychiatry 20(4), 359–64. https://doi.org/10.1097/YCO.0b013e32816ebc8c (2007).
Auerbach, R. P. et al. Mental disorders among college students in the World Health Organization world mental health surveys. Psychol. Med. 46(14), 2955–2970. https://doi.org/10.1017/S0033291716001665 (2016).
Arnett, J. J. Emerging adulthood: A theory of development from the late teens through the twenties. Am. Psychol. 55(5), 469–80 (2000).
Blasco, M. J. et al. UNIVERSAL study group. Predictive models for suicidal thoughts and behaviors among Spanish University students: Rationale and methods of the UNIVERSAL (University & mental health) project. BMC Psychiatry 16, 122. https://doi.org/10.1186/s12888-016-0820-y (2016).
Auerbach, R. P. et al. WHO WMH-ICS Collaborators. WHO world mental health surveys international college student project: Prevalence and distribution of mental disorders. J. Abnorm. Psychol. 127 (7), 623–638. https://doi.org/10.1037/abn0000362 (2018).
Bruffaerts, R. et al. WHO WMH-ICS Collaborators. Lifetime and 12-month treatment for mental disorders and suicidal thoughts and behaviors among first year college students. Int. J. Methods Psychiatr. Res. 28 (2), e1764. https://doi.org/10.1002/mpr.1764 (2019).
Macalli, M., Côté, S. & Tzourio, C. Perceived parental support in childhood and adolescence as a tool for mental health screening in students: A longitudinal study in the i-Share cohort. J. Affect. Disord. 266, 512–519. https://doi.org/10.1016/j.jad.2020.02.009 (2020).
Park, C. L. et al. Americans’ COVID-19 Stress, coping, and adherence to CDC guidelines. J. Gen. Intern. Med. 35, 2296–2303. https://doi.org/10.1007/s11606-020-05898-9 (2020).
Monistrol-Mula, A. et al. Mental health symptoms 1 year after the COVID-19 outbreak in Spain: The role of pre-existing mental disorders and their type. J. Affect. Disord. 318, 22–28. https://doi.org/10.1016/j.jad.2022.08.127 (2022).
Palgi, Y. et al. The loneliness pandemic: Loneliness and other concomitants of depression, anxiety and their comorbidity during the COVID-19 outbreak. J. Affect. Disord. 275, 109–111. https://doi.org/10.1016/j.jad.2020.06.036 (2020).
Hoffart, A., Johnson, S. U. & Ebrahimi, O. V. Loneliness and social distancing during the COVID-19 pandemic: Risk factors and associations with psychopathology. Front. Psychiatry 11, 589127. https://doi.org/10.3389/fpsyt.2020.589127 (2020).
Elmer, T., Mepham, K. & Stadtfeld, C. Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLoS One 15(7), e0236337. https://doi.org/10.1371/journal.pone.0236337 (2020).
Fruehwirth, J. C., Biswas, S. & Perreira, K. M. The Covid-19 pandemic and mental health of first-year college students: Examining the effect of Covid-19 stressors using longitudinal data. PLoS One 16(3), e0247999. https://doi.org/10.1371/journal.pone.0247999 (2021).
Arsandaux, J. et al. Mental health condition of college students compared to non-students during COVID-19 lockdown: The CONFINS study. BMJ Open 11(8), e053231. https://doi.org/10.1136/bmjopen-2021-053231(2021) (2021).
Macalli, M., Texier, N., Schück, S., Côté, S. M. & Tzourio, C. A repeated cross-sectional analysis assessing mental health conditions of adults as per student status during key periods of the COVID-19 epidemic in France. Sci. Rep. 11(1), 21455. https://doi.org/10.1038/s41598-021-00471-8 (2021).
Antonelli-Salgado, T. et al. Loneliness, but not social distancing, is associated with the incidence of suicidal ideation during the COVID-19 outbreak: A longitudinal study. J. Affect. Disord. 290, 52–60. https://doi.org/10.1016/j.jad.2021.04.044 (2021).
Kroenke, K., Spitzer, R. L. & Williams, J. B. W. The PHQ-9. J. Gen. Intern. Med. 16, 606–613 (2001).
Arthurs, E. et al. Are scores on English and French versions of the PHQ-9 comparable? An assessment of differential item functioning. PLoS One 7(12), e52028. https://doi.org/10.1371/journal.pone.0052028 (2012).
Manea, L., Gilbody, S. & McMillan, D. Optimal cut-off score for diagnosing depression with the patient health questionnaire (PHQ-9): A meta-analysis. CMAJ 184(3), E191–E196. https://doi.org/10.1503/cmaj.110829 (2012).
Stickley, A. & Koyanagi, A. Loneliness, common mental disorders and suicidal behavior: Findings from a general population survey. J. Affect. Disord. 197, 81–87. https://doi.org/10.1016/j.jad.2016.02.054 (2016).
Stravynski, A. & Boyer, R. Loneliness in relation to suicide ideation and parasuicide: A population-wide study. Suicide Life Threat. Behav. 31(1), 32–40. https://doi.org/10.1521/suli.31.1.32.21312 (2001).
Matthews, T. et al. Social isolation, loneliness and depression in young adulthood: A behavioural genetic analysis. Soc. Psychiatry Psychiatr. Epidemiol. 51(3), 339–348. https://doi.org/10.1007/s00127-016-1178-7 (2016).
Parmar, M. et al. Associations between loneliness and acute hospitalisation outcomes among patients receiving mental healthcare in South London: A retrospective cohort study. Soc. Psychiatry Psychiatr. Epidemiol. https://doi.org/10.1007/s00127-021-02079-9 (2021).
Wiktorsson, S., Runeson, B., Skoog, I., Ostling, S. & Waern, M. Attempted suicide in the elderly: characteristics of suicide attempters 70 years and older and a general population comparison group. Am. J. Geriatr. Psychiatry 18(1), 57–67. https://doi.org/10.1097/JGP.0b013e3181bd1c13 (2010).
Lasgaard, M., Goossens, L. & Elklit, A. Loneliness, depressive symptomatology, and suicide ideation in adolescence: Cross-sectional and longitudinal analyses. J. Abnorm. Child Psychol. 39(1), 137–150. https://doi.org/10.1007/s10802-010-9442-x (2011).
Bu, F., Steptoe, A. & Fancourt, D. Who is lonely in lockdown? Cross-cohort analyses of predictors of loneliness before and during the COVID-19 pandemic. Public Health 186, 31–34. https://doi.org/10.1016/j.puhe.2020.06.036 (2020).
Weber, M., Schulze, L., Bolzenkötter, T., Niemeyer, H. & Renneberg, B. Mental health and loneliness in university students during the COVID-19 pandemic in Germany: A longitudinal study. Front. Psychiatry 13, 848645. https://doi.org/10.3389/fpsyt.2022.848645 (2022).
Allan, N. P. et al. Lonely, anxious, and uncertain: Critical risk factors for suicidal desire during the COVID-19 pandemic. Psychiatry Res. 304, 114144. https://doi.org/10.1016/j.psychres.2021.114144 (2021).
Lim, M. H., Eres, R. & Vasan, S. Understanding loneliness in the twenty-first century: An update on correlates, risk factors, and potential solutions. Soc. Psychiatry Psychiatr. Epidemiol. 55(7), 793–810. https://doi.org/10.1007/s00127-020-01889-7 (2020).
Lasgaard, M., Friis, K. & Shevlin, M. “Where are all the lonely people?” A population-based study of high-risk groups across the life span. Soc. Psychiatry Psychiatr. Epidemiol. 51(10), 1373–1384. https://doi.org/10.1007/s00127-016-1279-3 (2016).
Savolainen, I., Oksa, R., Savela, N., Celuch, M. & Oksanen, A. COVID-19 anxiety-a longitudinal survey study of psychological and situational risks among Finnish workers. Int. J. Environ. Res. Public Health 18(2), 794. https://doi.org/10.3390/ijerph18020794 (2021).
Freyhofer, S., Ziegler, N., de Jong, E. M. & Schippers, M. C. Depression and anxiety in times of COVID-19: How coping strategies and loneliness relate to mental health outcomes and academic performance. Front. Psychol. 12, 682684. https://doi.org/10.3389/fpsyg.2021.682684 (2021).
Mars, B. et al. Predictors of future suicide attempt among adolescents with suicidal thoughts or non-suicidal self-harm: A population-based birth cohort study. Lancet Psychiatry 6(4), 327–337. https://doi.org/10.1016/S2215-0366(19)30030-6 (2019).
Scardera, S. et al. Association of social support during adolescence with depression, anxiety, and suicidal ideation in young adults. JAMA Netw. Open 3(12), e2027491. https://doi.org/10.1001/jamanetworkopen.2020.27491 (2020).
Mann, F. et al. A life less lonely: The state of the art in interventions to reduce loneliness in people with mental health problems. Soc. Psychiatry Psychiatr. Epidemiol. 52(6), 627–638. https://doi.org/10.1007/s00127-017-1392-y (2017).
Fokkema, T., de Jong Gierveld, J. & Dykstra, P. A. Cross-national differences in older adult loneliness. J. Psychol. 146(1–2), 201–28. https://doi.org/10.1080/00223980.2011.631612 (2012).
Wasserman, D., Iosue, M., Wuestefeld, A. & Carli, V. Adaptation of evidence-based suicide prevention strategies during and after the COVID-19 pandemic. World Psychiatry 19(3), 294–306. https://doi.org/10.1002/wps.20801 (2020).
Acknowledgements
The authors are indebted to the i-Share operational team, Kappa Santé, and the Kap Code teams for their expert contributions and assistance.
Funding
This research was supported by the Agence Nationale de la recherche (ANR) (Project No ANR-21-COVR-0029-01), the Direction Générale de l'Offre de Soins (DGOS), as part of a research program on "Suicide and its prevention 2020", organized by the Direction de la Recherche, des Études, de l'Évaluation et des Statistiques (DREES) as part of the work of the Observatoire National du Suicide (ONS) (Grant No 2103306249). This research is also supported by the European Union’s Horizon 2020 research and innovation program (RESPOND). The RESPOND project is funded under Horizon 2020 – the Framework Programme for Research and Innovation (2014–2020). The content of this article reflects only the authors’ views and the European Community is not liable for any use that may be made of the information contained therein.
Author information
Authors and Affiliations
Contributions
M.M. and C.T. designed the study. M.M. conducted the statistical analysis. M.M. and C.T. wrote the first draft of the manuscript. All authors contributed to editing the manuscript and commenting on the final version.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Macalli, M., Kinouani, S., Texier, N. et al. Contribution of perceived loneliness to suicidal thoughts among French university students during the COVID-19 pandemic. Sci Rep 12, 16833 (2022). https://doi.org/10.1038/s41598-022-21288-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-21288-z
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
