Introduction

At the end of December 2019, coronavirus disease 2019 (COVID-19) caused by the Severe Acute Respiratory Syndrome-CoV-2 (SARS-CoV-2) violently shook the health care system worldwide, affecting the entire population. COVID-19 has been defined by the World Health Organization (WHO) as an "infectious disease" characterized by symptoms such as fever, dry cough and fatigue, with also a high level of spread both by airborne droplets (respiratory secretions) and indirect contact with infected secretions1. In the severe acute phase of the disease, the most common symptoms include respiratory distress, cerebrovascular disorders and neurological symptoms (e.g. headache, dizziness, test and smell dysfunctions, etc.), among others2,3,4,5,6,7. Furthermore, the virus can cause both pulmonary and systemic inflammation, affecting multiple organs2. Indeed, COVID-19 is recognized as a multi-organ disease with a wide spectrum of manifestations8,9,10,11. Coherently with the notion that the central nervous system (CNS) could be both directly and indirectly involved in the acute phase of the infection, evidence has been reported about neurological manifestations, such as dizziness/vertigo, headache, hypogeusia, hyposmia, muscular, ischemic stroke, intracerebral hemorrhage, encephalopathy, and others12,13,14,15,16. Several studies have also identified an increasing number of different neuropsychiatric and neuropsychological alterations17,18,19,20, such as anxiety, mood alterations, agitation, confusion and delirium. It is also important to mention that these symptoms, with neuromuscular and cerebrovascular alterations, are much more frequent in older patients with severe infection or in the presence of multiple comorbidities6,8,9,10,11,21. Additionally, several studies have shown evidence of cognitive deficits in patients with COVID-19, both in those with mild symptoms and in those suffering from severe forms of disease and requiring intensive care unit (ICU) admission18. The effects of SARS-CoV-2 infection on cognition may be related to the indirect CNS involvement due to the virus infection, as well as to the infection damage on multiple system, to systemic inflammation, immune system dysregulation or hypoxia22,23. Alternatively, evidence about a direct infection of CNS had been also provided5,6,8,16,21.

In some studies conducted so far, 80% of patients presented neuropsychological deficits; the most common being: visuospatial and executive functions17,18, working memory17,19, abstraction ability17,19 and orientation17 according to the Montreal Cognitive Assessment (MoCA) test, among others.

These symptoms can extend beyond the acute stage of COVID-19 infection24,25,26,27,28,29. The WHO has referred to this phenomenon as post-COVID-19 and has defined it as "a condition that occurs in individuals with a probable or confirmed history of SARS-CoV-2 infection, usually 3 months from the onset of COVID-19 with symptoms that last for at least 2 months and cannot be explained by an alternative diagnosis"30. Additionally, this definition includes common symptoms that impact daily life, such as fatigue, shortness of breath, and cognitive dysfunction19,24,30,31,32. In this review, we will use the terms “post-acute COVID-19 syndrome” and “persistent COVID symptoms.”

Due to the relatively short time since the outbreak of the pandemic, more data is needed on the actual consequences of the disease on the cognitive functions of patients with persistent COVID symptoms (especially in patients who did not require hospitalization), as well as on the uncertain impact of post-acute COVID on respiratory function, fatigue, or cognitive function5,33.

Therefore, the main objective of this systematic review and meta-analysis was to analyze the studies conducted to date, assessing neuropsychological deficits in patients with post-acute COVID-19 syndrome, summarizing the current evidence, and provide a better overview to address this pandemic. Additionally, we assess the quality of the methodology used in each study and propose an outline of the methodology to be followed in future investigations. Furthermore, another objective was to obtain a global index of the magnitude of the effect of post-acute COVID-19 syndrome on the reported cognitive functions.

Methods

Search strategy

This work was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines34. The protocol was also registered in the Prospective International Registry of Systematic Reviews, PROSPERO (CRD42021260286).

A systematic literature search on PubMed, Cochrane Central Register of Controlled Trials (CENTRAL), Scopus and Web of Science databases was carried out to obtain studies or abstracts published between January 2020 and September 2021. A combined set of keywords has been used to identify human studies that reported on neuropsychological symptoms in patients with persistent COVID symptoms. The keywords entered into the search were as follows: (1) “SARS-CoV-2 OR coronavirus OR COVID-19 OR COVID OR severe acute respiratory syndrome”; (2) “long-COVID OR post-COVID syndrome OR post-acute COVID-19 syndrome OR long-term symptoms”; (3) “neuropsychology OR cognition* OR psychology”; (4) “neuropsychological deficits* OR cognitive deficits* OR cognitive function*” and (5) “Neuropsychological evaluation* OR Neuropsychological assessment* OR “neuropsychological battery* OR cognitive evaluation* OR cognitive assessment* OR cognitive test* OR cognitive screening.” Keywords were combined for a more comprehensive search with OR and AND operators as follows: (1) + (2); (1) + (2) + (3); (1) + (2) + (3); (1) + (2) + (4) and (1) + (2) + (4) + (5) (see supplementary material Table S1 for the search keyword combination details). The search terms were specified to be found in the title and abstract of the studies. In addition, to ensure literature saturation, we searched the references of all identified relevant articles and narrative reviews/systematic reviews and/or meta-analyses to consider their inclusion in this review. After removing duplicates manually and with the help of an automation software35, articles were reviewed on the basis of their titles and abstracts separately. Relevant articles were retrieved in full text and subjected to the selection criteria. All the steps mentioned in the search process were conducted independently by two different authors (S.S.-R. and Y.B.-B.). Disagreements were resolved by discussion and, when necessary, by consultation with a third researcher.

Eligibility criteria

The inclusion criteria established for the studies were: (1) patients with a confirmed diagnosis of SARS-COV-2 infection for at least three weeks before the study; (2) patients with post-acute COVID-19 syndrome undergoing a standardized cognitive function assessment; (3) study design (cohort studies, case–control studies, cross-sectional studies, case series, case reports, or quantitative studies); and (4) preprints and letters only if they described original research containing data on patients with suspected or laboratory-confirmed coronavirus infection. The exclusion criteria were as follows: (1) studies limited to examining cognitive deficits without standardized assessments; (2) studies that investigated indirect effects of coronavirus infections on mental health in uninfected persons mediated by physical distancing measures such as self-isolation or quarantine and without a positive PCR; (3) conference abstracts, as they lacked sufficient information for quality assessment and data extraction, and (4) studies that included a sample with previous pathologies that affect or could affect their cognitive function (e.g. neurodegenerative diseases, neuropsychiatric disorders, acquired brain injury, etc.). Alternatively, to perform the meta-analysis, only the studies that met the following eligibility criteria were selected: (1) to have a healthy control group, and (2) to report a global cognitive score.

Quality assessment and risk of bias in the included studies

The quality of the studies used in this systematic review was systematically assessed with the Newcastle–Ottawa Scale (NOS) (see Table 1). This scale was developed to assess the quality of non-randomized studies to incorporate quality assessments in the interpretation of meta-analyses of the results obtained36. The NOS scale is divided into three dimensions of cross-sectional, or case–control investigations36. For each item, the NOS scale has several response options and depending on the answer chosen, it scores (or not) the total evaluation with a star. For example, in the item on the representativeness of cases, the study would score one star if the study sample had a defined time, all cases in a defined catchment area, all cases in a defined hospital or clinic, etc. (response option a.). In this regard, each study assessed can receive a maximum of one star for each numbered item within the categories of Selection and Exposure. For the Comparability category, a maximum of two stars can be awarded depending on the factors controlled for both the case group and the control, obtaining a maximum of 9 points per study for each star obtained36. None of the studies analyzed was excluded since the assessed studies had a total quality score above seven points.

Table 1 Quality assessment of non-randomized studies using the Newcastle–Ottawa Scale (NOS).

Once the quality assessment was performed, we used the Risk of Bias In Non-randomized Studies (ROBINS-I) to assess the risk of bias of the different studies selected for the meta-analysis (Fig. S1, see in supplementary material). ROBINS-I tool evaluates the risk of bias of studies that did not use randomization to allocate the subjects, through different domains. Each domain is rated high, low, or unclear, represented by the colors red, green, and yellow, respectively37. Two investigators (S.S.-R. and Y.B.-B.) independently evaluated the quality and risk of bias of the studies, obtaining an inter-rater reliability agreement of 81.2%. All disagreements were resolved by discussion and, when necessary, by consultation with a third researcher until consensus was reached.

Data extraction

Specific information for the systematic review was extracted from the selected studies, which included: (1) author, (2) date of publication, and (3) study design (see Table 2). In addition, the following descriptive variables were extracted from the studies: (4) setting (i.e., country); (5) sample diagnosis (post COVID-19 infection); (6) sample size (N), sex (%) and age (M ± SD); (7) assessment instrument and total score on the assessment scale (M ± SD); and finally, (8) main outcomes.

Table 2 Overview of cited studies included that examine neuropsychological symptoms in recovered SARS-COV-2 patients.

In the meta-analysis, all effect sizes were calculated from the means and standard deviations. Effect sizes for general cognitive functions were estimated based on the mean scores (with 95% CI) extracted from cognitive screening tests. This was, specifically, the means corresponding to the control group (healthy individuals) and the experimental group (patients with persistent COVID-19 symptoms). For this purpose and due to the variability of the neuropsychological tests used by the studies, those that provided information with different cognitive screening tools, such as MoCA, NIH Toolbox, SCIP or TICS-M, were included in the analyses. The same measures were selected for the sensitivity analyses.

Statistical analysis

A meta-analysis was conducted to compare the means of cognitive deficits in recovered COVID patients and healthy control participants. We estimated the standardized mean difference (SMD) statistic with a 95% confidence interval (CI) from the means and standard deviations (SD) using Cohens’d formula38. All of them were later corrected by Hedges’ g sample size bias adjustment formula39,40. For the main analyses, we used the random-effects model because of the expected high heterogeneity, and pooled results of means and their respective 95% CIs were estimated using the Inverse method of variance.

The I2 index was used to quantify statistical heterogeneity among the selected studies. The heterogeneity test measures the degree of inconsistency among the results of studies and is interpreted as the approximate proportion of the total variation in study estimates due to heterogeneity rather than sampling error41. Heterogeneity (I2) was classified as low (below 25%), moderate (25–75%), and high (above 75%)41. We did not conduct the funnel plot for asymmetry due to an insufficient number of studies (n < 10).

Sensitivity analyses were performed to assess the contribution of individual studies to the overall results of the meta-analysis. All data were analyzed with the Review Manager Software42 (RevMan 5, Version 5.4.1); with the significance threshold set at p values less than 0.05.

Results

Study selection

Initially, 1602 studies were identified in PubMed, Cochrane Central Register of Controlled Trials (CENTRAL), Scopus and Web of Science databases, and 22 additional studies were identified through other sources (citation searching). Three hundred thirty-eight articles were eliminated because they were duplicates (267 of them were detected by EndNote reference manager software). From the remaining 1286 articles, 978 were also discarded because of other reasons (e.g. book sections, protocols, guidelines, etc.). After that, 308 studies remained, which were reduced to 80 articles by reading titles and abstracts. Therefore, 80 papers were fully read and assessed for eligibility. Of those studies, 32 did not meet the previously established eligibility criteria, 14 had insufficient data, and nine were opinion articles, consensus papers o letters to the editor. Finally, 25 studies were selected for the systematic review. Lastly, for the meta-analysis, of the 25 studies included in the systematic review, only 6 of them met the eligibility criteria (having a control group and reporting an overall cognitive score) for conducting the quantitative analyses (see Fig. 1).

Figure 1
figure 1

PRISMA summary of articles included in this meta-analysis. * eligibility criteria for meta-analysis was followed the eligibility criteria for meta-analysis studies, previously mentioned in methods, have been applied.

Characteristics of the studies

Six studies, including 175 patients with persistent COVID-19 symptoms and 275 healthy persons met the above inclusion criteria and were included in the meta-analysis43,44,45,46,47,48. The selected studies were published between December 2020 and April 2021, and the number of participants involved in the studies ranged from 10 to 100. The control group (healthy individuals) of the studies consisted of 150 women (54.72%) and 125 men (45.28%) with a mean age of 53.06 ± 10.96 years old. Moreover, the experimental group (patients with persistent COVID symptoms) was composed of 89 women (50.88%) and 86 men (49.12%) with a mean age of 53.84 ± 11.57 years.

Cognitive dysfunction in patients with post-acute COVID-19 syndrome

The effect size of overall cognitive functions was based on the mean overall cognitive status of the post-acute COVID-19 syndrome patient group and the healthy control group. The results showed a medium–high overall effect size (g =−0.68, p = 0.02) with a 95% CI (−1.05 to −0.31). The heterogeneity test showed a significantly moderate level of heterogeneity between studies (Z = 3.58, p < 0.001; I2 = 63%). The results of the analysis are displayed in Fig. 2. These results indicate that cognitive dysfunctions are more common in patients with persistent COVID symptoms than in healthy volunteers.

Figure 2
figure 2

Comparison of cognitive impairments reported by studies in patients with post-acute COVID-19 syndrome and healthy volunteers.

Sensitivity analysis

Furthermore, due to the moderate heterogeneity of the studies, we performed a sensitivity analysis to inspect the influence of each study individually for the overall results of the meta-analysis described above (see Fig. 3). First, sensitivity analyses were conducted to examine whether the previously obtained results would change if the study by Triana et al.47 was excluded from the analyses because it had the greatest weight of the included studies. Secondly, sensitivity analyses were performed excluding also the study by the authors of Del Brutto et al.43, and so on until it was verified that deleting all the articles did not change the heterogeneity to any significant extent. Despite this, the exclusion of the studies did not significantly change the size or significance of the above domains. The exception was observed in the sensitivity analysis in which the study by Ortelli et al.46 was deleted; heterogeneity dropped to 31% (Z = 3.93, p = 0.22; I2 = 31%). Figure 3 shows all the sensitivity analysis results.

Figure 3
figure 3

Sensitivity analysis. Note: (A) Results without Triana et al. study; (B) results without Miskowiak et al. study; (C) results without Woo et al. study; (D) results without Graham et al. study; and (E) results without Ortelli et al. study.

Discussion

The present study provided a comprehensive review examining the link between post-acute COVID-19 syndrome and neuropsychological manifestations after infection recovery. Twenty-five different studies were identified and reviewed that reported data on the post-disease neuropsychological characteristics of COVID-19 infection, of which six were analyzed in this meta-analysis43,44,46,47,48.

The main findings of this systematic review and meta-analysis showed an increased likelihood of exhibiting cognitive deficits in patients who recovered from COVID-1943,44,46,47,48. Furthermore, the evidence indicated that the prevalence of cognitive deficits was high in patients who, after recovery from COVID, continued to suffer from disease symptoms. However, it should be noted that the lack of a standard protocol for baseline cognitive assessment of patients' cognitive performance may complicate the comparison of the results obtained by different studies. Also, failure to report or assess psychological (e.g., stress, anxiety, etc.), socioeconomic (e.g., unemployment, few resources, lack of support networks, etc.), and contextual (e.g., specific COVID-19 measures such as social distancing) factors possibly affected by the pandemic may complicate the distinction between the effects on cognition of infection and the overall impact of the pandemic. Furthermore, another important variable that has not considered is the role of cognitive reserve (CR). CR is a protective factor against possible neuropsychological deficits49, in addition to being associated with neurobiological structures (brain reserve)50 that could make individuals less susceptible to brain alterations caused by the virus. On the other hand, stress or anxiety disorders, among others, can affect cognitive functioning51,52, and it has been reported that psychological problems have increased since the pandemic53. It would therefore be advisable to report such data for a better understanding of the consequences of the infection. Regarding severity, mean scores of cognitive deficits were below clinical cut-offs43,44,46,47,48. Nevertheless, studies such as Alemanno et al.17 concluded that scores on assessment scales improved relative to patients with the virus at the time of assessment, although cognitive deficits in patients with persistent COVID were lower than in healthy controls.

The main results obtained from the meta-analysis showed moderate differences in global cognitive status (g = −0.70) between recovered coronavirus patients with persistent symptomatology and healthy controls. These results support the information reported by other studies that conducted follow-ups on patients with persistent COVID symptoms. They found that approximately 30–80% of these patients developed long-term COVID symptoms lasting one to 6 months, with the most frequent symptoms being fatigue and neuropsychological deficits in executive functions26,31,32; working memory24,44,47,54; processing speed19,21,24; and attention19,31,32,44,47,48.

On the other hand, it should be noted that the scientific literature reviewed in this study reported data from both hospitalized and non-hospitalized patients (i.e., home isolation) depending on the studies. Therefore, it is important to highlight that the patients evaluated in the different studies analysed experienced different levels of severity of the disease in the acute phase. Some studies evaluate patients with mild COVID-19 symptoms that mostly did not require hospitalization or the intensive care unit43,44,48, while others evaluate patients with more severe COVID-19 symptoms that required hospitalization45,46. In particular, a worse cognitive performance could be observed in hospitalized patients compared to non-hospitalized patients19,24,45,55,56,57,58. This could be due to a more severe alteration of brain structures vulnerable to COVID-1959, and as a consequence a worse cognitive performance. Therefore, when interpreting the results obtained in this meta-analysis, it is necessary to consider the variability in the cognitive performance of individuals.

Moreover, not all studies report extensive details of the characteristics of the matched healthy controls. And among the studies that do so, differences can be observed among the healthy participants: in some studies, the healthy participants have lived with the virus at home but have not been infected55, others have not been previously exposed to the virus43,45,47 and others can not to ensure it44,48. Therefore, caution must be taken when interpreting the results and generalizing the findings regarding the long-term side effects of COVID-19, especially for all patients who did not require hospital admission and therefore underwent different levels of symptomatology severity.

The information available so far suggests that, in the acute stage of the infection, cognitive deficits are a common feature17,18,19,22, so it is probably considered a major clinical problem. However, conclusions should be made with caution since the information available on the acute consequences of pathology is limited and there is no specific data on the pathogenesis of the post-acute phase caused by the virus. The etiology of the neuropsychological consequences of coronavirus could be multifactorial. Several causes could affect cognition, such as the direct effects of the virus, the extent of symptoms such as hypoxia, cerebrovascular disease, the immunological response, medical resources and treatments, social isolation and psychological impact of the pandemic, or the concern of infecting others21,26. There is also a link between inflammation and cognitive dysfunction that could explain some of the neuropsychological morbidity16,60,61,62.

In line with the results obtained in the studies included in this review and meta-analysis, the research by Rogers and colleagues16 concluded that, following recovery from pre-COVID-19 coronavirus infections (e.g., MERS and SARS) and during a follow-up period of between six weeks and 39 months, sleep disturbance, emotional lability, reduced concentration levels, memory deficits, and fatigue were reported in more than 15% of patients16. Therefore, further research and monitoring of the health consequences of the current pandemic are needed.

Limitations and future studies

This study has several limitations that offer opportunities for future research. The main limitations of this meta-analysis include the use of non-peer-reviewed preprint papers, the exclusion of manuscripts published in a language other than English or Spanish, as well as the selection of studies with small sample sizes. In addition, few studies included healthy comparison groups, since a large majority compared the results of patients with post-acute COVID-19 syndrome with the standardized mean score of the test itself in the general population. Another significant limitation that may have affected the research conducted has been the mobility restriction measures applied worldwide, which have reduced the possibilities for data collection to online and/or remote formats (e.g., telephone assessment, online questionnaires, etc.). At the same time, the need, timing and process of publishing information about COVID-19 to facilitate the development of guidelines for clinicians may have affected the methodological quality of some studies. Jung et al.63 assessed the methodological quality of 686 COVID-19 articles and compared them with control articles published before the pandemic. The authors observed that COVID-19 articles were associated with lower methodological quality scores when published within a short time period63.

Another limitation was that there was considerable variation in the follow-up period (between approximately 1 and 5 months) in the studies that evaluated the long-term impact of the virus, which made comparability difficult. These may have also contributed to the heterogeneity present in this study. In addition, different studies used tests such as the Montreal Cognitive Assessment Test (MoCA) to assess cognitive impairment in these patients. The test is a cognitive screening scale validated in different populations and ages but mainly used in people older than 50 years and in the context of possible dementia. Although its purpose is to detect cognitive impairment, more sensitive neuropsychological tests such as the Mini-Mental State Examination (MMSE) (which has been shown to have a high sensitivity in neurocognitive diseases) would be needed64,65. Related to this, another limitation of the present study is to have placed the focus of analysis on global cognitive function, rather than on specific cognitive domains. Although this decision was due to a lack of resources (e.g., insufficient studies when the review was initiated), the analysis of data from extensive (domain-specific) neuropsychological assessments is recommended for future research in order to obtain more detailed data. Finally, although statistical methods were used to standardize the scores of all the studies, the different scales used by the included studies may have also contributed to the heterogeneity shown in this meta-analysis.

Future prospective studies on the subject are urgently needed. It is highly encourage that future studies systematically evaluate the prevalence of neuropsychological symptoms in patients with post-acute COVID-19 syndrome. It would be ideal to assess mental health prior to infection; as well as other relevant factors such as cognitive reserve, lifestyle or socioeconomic status, among others. In addition, it would be interesting if most of the studies used a common or similar, comprehensive psychological assessment test that could detect more specific cognitive deficits.

The long-term effect of the coronavirus infection on quality of life and eventual return to normalcy due to productivity loss and persistent cognitive impairment may be significant as the pandemic continues to escalate. Future longitudinal studies are needed to further investigate the cognitive impact of the infection on non-hospitalized people, as they constitute the majority of patients with COVID-19 and may have a significant impact on workforce productivity.

Conclusion and clinical implications

The main objective of this study was to shed light on a scarcely examined issue and to provide some structure to the growing evidence supporting the importance of assessing cognitive deficits in patients with persistent COVID symptoms19,31,32,44,47,48.

COVID-19 disease is a serious and increasingly widespread social and mental health problem and is becoming the focus of empirical research by investigators worldwide. The current findings support previous results by demonstrating significant relationships between persistent COVID symptoms and neuropsychological deficits. Importantly, the findings of the current study extend those of previous research by providing initial evidence that COVID-19 may affect the CNS increasing the likelihood of neuropsychological deficits even weeks after the infection. In summary, the current study makes an important contribution to understanding the relationship between post-acute COVID-19 syndrome and neuropsychological deficits.

Furthermore, it is very important to take into account the strong relationship between neurological and psychiatric symptoms and cognitive deficits in the study of COVID-19 and its consequences. This relationship is crucial to consideration when treating the disease and subsequent rehabilitation of COVID-19 patients, especially in the clinical setting. Therefore, it is important to take these factors into account for future studies and their impact on clinical practice.

While these findings may provide relevant information for the prevention and treatment of such cognitive dysfunctions, additional research is required to further investigate and define the possible mechanisms that could produce the virus-related cognitive alterations.

In conclusion, although there are multiple potential ways in which this pandemic could affect mental health, the present review suggests, firstly, that a high percentage of recovered COVID-19 individuals suffer from neuropsychological deficits in the aftermath of coronavirus infection and, secondly, that there are few existing studies to suggest that common neuropsychological difficulties are a feature of post-acute COVID-19 syndrome. Nevertheless, the present systematic review emphasizes that professionals treating patients with persistent COVID symptoms should be aware of this phenomenon and incorporate standard tests assessing cognitive function (e.g., MoCA) in their routine evaluation, to avoid the adverse consequences already reported in several studies. Furthermore, collecting all the results obtained in the different investigations reviewed in this study, months after hospital discharge, increased fatigue and problems in concentration, memory and cognitive speed are reported, which could disrupt daily life. Therefore, patients and essential workers could benefit from early neuropsychological testing to evaluate the impairment degree after COVID-19 hospitalization and its potential impact on their return to everyday activities. Future studies should carefully assess the long-term overall course of cognitive deficits in patients with post-acute COVID-19 syndrome as well as the effectiveness of rehabilitation treatments, particularly in younger patients. As research on neuropsychological symptoms in patients with post-acute COVID-19 syndrome advances, the need to examine this symptomatology in a multidisciplinary manner to achieve greater scientific evidence to corroborate the incidence and prevalence of COVID is increasingly clear.