Introduction

Cognitive deficits are core features of severe mental disorders, and include memory, reasoning, attention, and information processing problems [1,2,3,4]. These deficits have been shown to be predictive of clinical and functional outcome, both cross-sectionally and longitudinally, in psychotic [5, 6] as well as mood disorders [7,8,9]. Regrettably, traditional treatment options such as antipsychotics [10, 11], mood stabilizers [12, 13], or antidepressants [14, 15] have limited or no beneficial effects on these cognitive symptoms. Besides monoaminergic signaling [16,17,18], other neurotransmitters including the GABAergic [19], and nicotinergic [20] systems but also hormonal changes [13, 21] and altered neuroplasticity [22] have been connected with cognitive dysfunctioning. Several potential cognitive enhancers targeting these mechanisms have been investigated with limited success [12], in turn stimulating the search for new treatment targets.

Disruption of the immune system is an important feature of psychotic and mood disorders [23,24,25] and is characterized by central immune changes such as altered microglial activity [26,27,28] as well as peripheral changes in cytokine levels [23], alterations in the kynurenine metabolism [29, 30] and white blood cell ratios [31]. While modest beneficial effects of adjunctive therapy with anti-inflammatory agents have been demonstrated for depressive, negative (i.e., apathy, flattened effect, poverty of thought or speech) and psychotic symptoms of severe mental disorders [32,33,34], it is unclear if this is also the case for cognitive symptomatology [35, 36]. Cognitive dysfunction in psychotic and mood disorders has been associated with elevated blood levels of inflammatory cytokines [37,38,39], kynurenine metabolites [40], and markers of microglial activation [40] in observational studies. However, these associations are typically modest and inconsistent in nature and seem to be subject to reporting bias with several studies only highlighting significant correlations between immune and cognitive markers while leaving other non-significant associations unreported [41,42,43,44,45].

The aim of the current meta-analysis is to synthesize all available evidence on the associations between immunomarkers and cognitive symptomatology in clinical observational studies of patients with psychotic and mood disorders.

Materials and methods

We performed a systematic review and meta-analysis of studies reporting on the association between one or more immunomarkers and cognitive functioning in people with psychotic or mood disorders (PROSPERO ID:CRD42021278371, for updates to protocol, see Supplement). The study was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis PRISMA 2020 standard (Supplementary Table 1) [46].

Search strategy

A multistep procedure was used to conduct the literature search and consequent data assessment. The search included original papers published up to 8 November 2021 on Pubmed, Web of Science, and Psycinfo. The full search strings are available in the Supplement. Two authors independently (MM, CO) performed the literature search and completed the screening of article titles and abstracts for eligibility. In case of disagreement, papers were retained for full-text evaluation.

Inclusion criteria were: (1) Cross-sectional or longitudinal studies in peer-reviewed journals, (2) In vivo human studies on patients with primary diagnosis of schizophrenia (DSM-code: 295.90; ICD-10 code: F20.9), schizophreniform (295.40; F20.81), schizoaffective disorder (295.70; F25.2), brief psychotic disorder (298.8; F23), other psychotic disorder (298.9, F29), major depressive disorder (MDD) (296.20–296.36; F32.0-F33.3), persistent depressive disorder (dysthymia) (300.4; F34.1), BD (296.4x, 296.89, F31); (3) measurement of at least one baseline a) standardized neuropsychological outcome measure (NP) and b) immunomarker (IM) in the patient group, and (4) Studies included and reported an association analysis between at least one NP and IM. Exclusion criteria were: Case reports, case series; abstracts, conference proceedings; systematic or narrative reviews; opinion papers; meta-analyses; preprints. No language or time limits were used. Cognitive items on rating scales (e.g., the Positive and Negative Syndrome Scale) were not included as NP. Studies reporting on primary diagnoses of either schizophrenia, schizophreniform, schizoaffective disorder, psychotic disorder not otherwise specified (NOS), or brief psychotic disorder are hereafter combinatorially referred to as schizophrenia spectrum disorder and abbreviated as “SZ”.

Data extraction and evaluation

For each included study, the following meta-analytic data were extracted (MM, CO): publication year, clinical diagnosis, mean age, gender (male participant ratio), mean duration of illness, mean body-mass index (BMI), smoking (ratio) as well as correlation values (Pearson's r or rho value), regression coefficients (beta score) on the association between IM and NP. The number of potentially reportable association measures (n IM × n NP), as well as the number of actually reported association measures, were equally extracted. Authors were contacted by email for additional information if all required data could not be retrieved from the paper; a reminder was sent in case of non-response. Beta coefficients were converted to r values according to the method described by Peterson and Brown [47]. For longitudinal studies, only baseline results were taken into consideration.

The primary NP outcome variable was global cognitive performance (GCP), defined as either (a) the composite score of cognitive functioning as reported by the study or (b) if no composite score was reported a composite correlation coefficient was calculated using the IM × NP associations in two or more separate cognitive domains (based on Fisher’s Z transformation). Higher GCP scores represent better cognitive performance.

Secondary domain-specific NP outcome variables were assigned to one of seven cognitive domains in accordance with the NIMH MATRICS initiative (“Measurement and Treatment Research to Improve Cognition in Schizophrenia”): Verbal learning and memory, Visual learning and memory, Working memory, attention and vigilance, Processing Speed, Reasoning and problem-solving [48]. “Language” was added as a separate category (see Supplementary Table 3).

The primary IM outcome variables were two composite inflammatory indices (Pro-inflammatory Index, PII); Anti-Inflammatory Index, AII). If only a single IM was included in the study, that IM×NP correlation coefficient was used for the PII/AII associations. The following immune markers were categorized as PII: (hs)CRP, IL-1b, IL-2, IL-3, IL-6, IL-7, IL-8, IL-12-p70, IL-15, IL-16, IL-17, IL-18, IL-33, IFN-g, TNF-a, TNF-b, sTNFR1, sTNFR2, CCL-11, CCL-17, CCL-22, CXCL-10, MCP-1, sST2. AII were: IL-1ra, IL-4, IL-10, IL-11, IL-13, TGF-b (see Supplementary Table 4). If more IM were included, PII and AII were calculated for each cognitive domain, averaging out the associations between that specific cognitive domain on one hand and the available immunomarker-based correlations on the other (based on Fisher’s z transformation of the r values [49]). This resulted in a single r score reflecting the association of the merged correlational values between the cognitive domain and the pro-inflammatory and anti-inflammatory markers. This method of combining multiple pro-inflammatory markers in a single composite inflammatory score is in line with previous similar efforts in psychosocial stress [50], depression [51], schizophrenia [52], psychological trauma [53], cerebrovascular disease [54], atherosclerosis [55], aging [56] and carcinoma [57] research. Secondary IM outcome variables were individual IM when more than three studies were available. In case of a significant association, exploratory subgroup analyses were performed to define which of the diagnoses contributed to the statistically significant association.

Quality assessment of eligible papers was performed with the BIOCROSS evaluation tool [58], which is specifically developed for biomarker-based cross-sectional studies. Quality assessment of each included study was performed independently by two different authors (MM, CO, EL), and any disagreement was resolved by deliberation.

Data synthesis and analysis

The correlation meta-analyses were conducted in Comprehensive Meta-Analysis version 3 (CMA v3) using random-effect models, which use the Hedges-Olkin method with a Fisher Z transformation of the correlation coefficient [59]. Heterogeneity was estimated with I2 (heterogeneity classification: I2 = 25–49%: low; I2 = 50–74%: moderate I2 ≥ 75%: high). Because the p value of correlation analysis is known to be strongly influenced by the sample size of the analysis, we opted to evaluate the association based on the strength of the association (using the r value) rather than the p value. Following Evans [60], meta-analytic correlation effect estimates of |0–0.19| were considered to be “very weak”, |0.20–0.39| as “weak”, |0.40–0.59| “moderate”, |0.60–0.79| as “strong” and | 0.80| or above as “very strong”.

The primary meta-analysis was performed on the effects of pro-inflammatory and anti-inflammatory markers (see Supplementary Table 4) in all mood and psychotic disorders combined for global cognitive function. Secondary analysis was performed for each cognitive domain, and for individual immunomarkers if at least three studies were available. Subgroup analysis was performed to evaluate differences between diagnostic groups primary and secondary analyses. The Benjamini–Hochberg procedure was used to account for the False Discovery Rate (FDR) in order to control for multiple hypothesis testing.

Additional meta-regression analyses (Knapp–Hartung method, maximum likelihood) [61] were conducted to evaluate the effect of the following moderators in the primary analysis: publication year, mean age, male participant percentage, mean duration of illness, mean BMI, smoking ratio and sample size. Publication bias was assessed by visual inspection of the funnel plots and Egger’s regression test [62].

The primary meta-analysis was repeated including only high-quality studies as defined by the BIOCROSS quality assessments.

Results

Study selection

The results of the literature search are summarized in the PRISMA Flowchart. Additional data were requested for 88, and granted for 22 papers (response rate 25%). A total of 75 studies [24,41,42,43,44,45,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130] and 627 NP × IM associations were included in the meta-analysis (see Supplementary Figure 1 for PRISMA Flowchart). Forty-two studies focused on SZ, 17 studies investigated BD, and 18 studies included MDD patients, for a total sample of 29,104 patients (see also Supplementary Tables 57). Thirty-one studies reported cognitive associations with a single IM, whereas 44 studies included multiple IM (see Supplementary Table 6).

The following IM were included in the meta-analysis: C-reactive protein ((hs-)CRP), cytokines/chemokines (CCL-11; CCL-17; CCL-22; CXCL-10; IFN-g; IL-1; IL-1b; IL-2; IL-3; IL-4; IL-6; IL-7; IL-10; IL-12; IL-12p70; IL-15; IL-16; IL-17; IL-18; IL-33; MCP-1; sST2; sTNFR-R1; sTNFR2; TGF-b; TNF-a) or kynurenine metabolites (Tryptophan (TRP); Kynurenine (KYN); Kynurenic Acid (KA); 3-hydroxy-kynurenine (3-HK); Quinolinic Acid (QUIN)). A single study [130] looked into the association of cognition with immunomarker levels in CSF while all other studies focused on peripheral assessments (serum/plasma). Therefore, CSF data were not included in the current meta-analysis. No studies investigated associations between NP and leukocyte IM.

PII correlation scores were calculated for a total of 18 out of 39 studies in the verbal memory domain, 6 out of 14 studies in visual memory, working memory (14 out of 15 studies); attention (12 out of 35 studies); processing speed (12 out of 23 studies); reasoning (18 out of 42 studies); language (9 out of 22 studies) (see Supplementary Table 7).

Association of pro-inflammatory (PII) and anti-inflammatory index (AII) with global cognitive performance (GCP)

PII and AII × GCP interactions were available for 53 studies (n = 27.908). Over the three eligible diagnostic groups (MDD, SZ, BD), GCP was very weakly associated with PII (PII × GCP r = −0.076; 95% CI = −0.116 to −0.027, z = −3.011; p = 0.003, I² = 77.4; see Table 1; Supplementary Figures 29), an association that can be considered to be neglectable.

Table 1 Effect sizes for the relationship between pro-inflammatory markers and cognitive dysfunctioning.

Subgroup analysis revealed no significant differences between the three diagnostic groups (Q(2)=2.302; p = 0.316), with very weak associations in each group for PII × GCP (SZ: n studies = 27, r = −0.036, p = 0.370, I² = 70.4; BD: n studies = 13, r = −0.095, p = 0.013, I² = 44.0; MDD n studies = 13, r = −0.133, p = 0.040 (not significant after FDR correction), I² = 83.5); see Table 1).

While only five studies yielded AII × GCP interactions, no significant associations were found (see Table 2; Supplementary Figures S10S14).

Table 2 Effect sizes for the relationship between anti-inflammatory markers and cognitive dysfunctioning.

Association of PII and AII with domain-specific cognitive performances

Overall association measures for PII were smaller than |0.10| for all domain-specific cognitive outcome variables. In the diagnostic subgroups analysis, significant but very weak associations were observed for visual memory in SZ, and for visual and verbal memory, working memory, and language in BD (see Table 1). Notably, the analyses reporting a statistically significant association in the diagnostic subgroups typically contained a lower number of included studies and smaller total sample sizes than analyses reporting non-significant associations. Meta-regression analysis for PII × GCP associations in the total sample with sample size as covariate did not reveal a significant confounding effect (coefficient (SE) = 0.00 (0.00); z = 0.97; p = 0.330).

No significant associations were found between AII and specific domains such as verbal memory, processing speed, and reasoning (see Table 2).

The BIOCROSS evaluation tool [58] was used to assess the quality of the included studies (see Supplementary Table 8). Thirty-seven papers had high quality, 35 papers were rated as having moderate quality, two papers had low quality. When only studies of high quality were retained, the overall correlation between PII and the composite score became non-significant (r = −0.042; z = −1.955; p = 0.051). Similarly, when only considering high quality studies this correlation disappeared in all diagnostic subgroup (BD: k = 7, r = −0.032, z = −1.301, p = 0.193; MDD: k = 6, r = −0.120, z = −1.051, p = 0.293; SZ: k = 14, r = −0.064, z = −1.363, p = 0.173).

Cognitive performance and individual IM

Only for the immunomarkers CRP, IL-1B, IL-6, TNF-a, and IFN-g, there were at least three studies available that assessed their association with cognitive performance in mood and psychotic disorders (See Table 3; Supplementary Figures S15S19).

Table 3 Correlations between individual immunomarkers and cognition in mood and psychotic disorders.

CRP (22 studies; 25,948 patients) was significantly but very weakly associated with GCP (r = −0.124; p < 0.001, I² = 79.8), as well as with verbal and visual memory, working memory, reasoning, and language in the total patient cohort. Follow-up subgroup analyses revealed a significant but very weak association with global cognition to be reflected in schizophrenia (r = 0.139; p = 0.013) and bipolar disorder (r = 0.126; p = 0.016), but not in MDD. Associations remained significant after FDR correction. Significant and weak correlations were observed between CRP and attention, verbal memory and visual memory in SZ, and verbal memory, processing speed, reasoning, and language in BD.

IL-6 (27 studies; n = 2.250) was significantly but very weakly associated with global cognition (r = −0.167; p = 0.001), verbal memory, and processing speed but not with any of the other cognitive domains in the total patient cohort.

IL-1b (10 studies; n = 988), TNF-a (23 studies; n = 1868), and IFN-g (five studies; n = 203) were not associated with either the composite cognitive score or any of the separate cognitive domains.

Seven studies probed relations between several tryptophan catabolism (TRYCAT) metabolites (TRP, KYN KA, 3-HK, QUIN) and cognitive performance in mood and psychotic disorders. Again, none of the metabolites interacted significantly with cognition (see Table 4).

Table 4 Correlations between global cognitive performance and TRYCAT metabolites in mood and psychotic disorders.

Covariate assessment

For the association between pro-inflammatory cytokines and global cognition, publication year (coefficient(SE) = −0.02(0.01); z = −0.38; p = 0.7035), mean patient age (coefficient(SE) = 0.01(0.01); z = 0.36; p = 0.720), mean Duration of Illness (coefficient(SE) = 0.00(0.02); z = −0.17; p = 0.862), BMI (coefficient(SE) = −0.01(0.04); z = −0.40; p = 0.689), gender ratio (coefficient(SE) = 0.00(0.01); z = 0.46; p = 0.642) and smoker/non-smoker ratio (coefficient(SE) = 0.01(0.00); z = 1.24; p = 0.217) all proved non-significant covariates in meta-regression analyses.

Assessment of publication bias

Out of the included 75 papers, a total number of 627 out of the potential 1810 associations (number of cognitive measures × number of immunomarkers) were at disposition for the current meta-analysis (i.e., 35%). On average, 53% of the potential total number of associations were reported per study (MDD: 63%; SZ: 53%; BD: 43%).

Visual inspection of the funnel plots of the standard errors by Fisher’s Z scores for associations between GCP and PII, CRP and IL-6 respectively (see Supplementary Figures 20–22) indeed suggested the presence of a publication bias in favor of more pronounced negative correlations. The Egger regression test confirmed the potential presence of a publication bias (intercept = −1.30; t = 4.26; p < 0.0001). However, when conducted for each diagnosis independently, Egger’s test was only significant for MDD (intercept = −1.74; t = 2.68; p = 0.023), but not for SZ (intercept = 0.64; t = 0.68; p = 0.501) or bipolar disorder (intercept = −0.94; t = 1.37; p = 0.199).

Heterogeneity over studies was moderate to high (see Tables 14), especially for immunomarkers investigated in a larger number of studies. When evaluating individual biomarkers (see Table 4), heterogeneity tended to be higher for those associations with cognitive performance that yielded statistically significant correlations.

Discussion

This is the first meta-analysis to synthesize the results from all available 75 studies investigating the association between cognitive functioning and blood-based immune marker levels in psychotic and mood disorders. Strengths of this study were the availability of a large total patient sample (n = 29,104), the use of a systematic multistep approach toward data assessment and meta-analysis in a transdiagnostic patient group, and the assessment of inflammatory composite scores as well as individual immunomarkers. We found no reliable evidence of a meaningful association between blood-based immune markers and global or domain-specific cognitive performance in mood and psychotic disorders (all r|<0.10|), either combined or stratified by diagnostic subgroup. Slightly larger but still weak associations were observed for individual IM (CRP, IL-6). Quality assessments revealed significant publication and reporting biases that may have contributed to the inflation of observed associations in individual studies.

This unexpected result warrants careful and thorough interpretation. The total sample size in our meta-analysis was sufficient to generate significant outcomes despite very weak association effect estimates, indicating they are not merely attributable to a lack of power. Findings are in line with a previous meta-analysis (including nine studies; n = 1477) demonstrating comparable associations between CRP and cognitive functioning (r = 0.13, p < 0.001) in schizophrenia [131]. We can therefore conclude that observations of blood-based immune markers are not or only (very) weakly related to neuropsychological performance scores in cross-sectional studies of patients with mood and cognitive disorders. However, the absence of an association between immune and cognitive markers does not necessarily imply that the immune system does not affect cognition in these disorders. Because of the dimensional and dynamic nature of both processes, other study designs, including longitudinal and intervention studies, may be required to evaluate the complex interaction between immune mechanisms and cognitive performance. Animals exposed to prenatal immune challenges demonstrate cognitive deficits comparable to those seen in mood and psychotic disorder patients [132]. Similarly, manipulation of brain kynurenic acid levels improves cognitive performance in mice [133, 134]. In humans, several clinical trials with immunomodulatory agents revealed mild cognitive improvements in schizophrenia patients [135, 136] although this was only the case for working memory and not any other cognitive domains, as demonstrated by Jeppesen et al. [137].

An alleged interaction between the altered immune system and cognitive functioning could still be present in the absence of cross-sectional intercorrelations. Two hypothetical mechanisms could be proposed: (1) Prolonged inflammatory stress may accelerate the normal cognitive decline over time through a number of indirect effects (oxidative stress, excitotoxicity, glial dysfunction, decreased synaptic plasticity, “inflammaging”), and/or (2) episodic excessive inflammatory reactions to psychological or environmental stressors could erode cognition step-by-step in a cascade-like fashion. As such, evaluating trait abnormalities like immune-related genetic markers or pre-illness immune abnormalities instead of volatile “snapshots” of individual compounds may be more informative to assess the relationship with cognitive functioning. Furthermore, while peripheral immunomarker levels fluctuate heavily over time [138], cognitive deficits are a more stable or slowly progressive phenomenon in mood and psychotic disorders [139]. As such, the temporal resolution of cross-sectional assessments of blood-based immunomarkers may not be sufficient to detect the long-term and/or long-ago repercussions of immunological causes on cognitive performance. Peripheral CRP and several cytokines (including IL-6 and TNF-a) have been demonstrated to be highly state-dependent in mood and psychotic illness [23, 24,140,141,142,143], suggesting they are more relevant as biomarkers for episodic symptoms like psychosis or mania. Alternatively, longitudinal characterization of immunomarkers and cognitive outcomes over longer time periods may be more informative than single cross-sectional assessments.

Another consideration is that peripheral blood concentrations may not reflect latent or undetected central immune-related processes [144, 145] that do interfere with cognitive performance. Undoubtedly, the lack of studies focusing on central assessments of immune activity in major psychiatric disorders is hampering our ability to determine the interplay between the immune system and cognitive function. The few available studies of central inflammatory responses are mostly small-scale and cross-sectional in nature, and typically do not include neuropsychological assessments [26, 27]. Even so, the most investigated of these molecules (CRP, IL-6, IL-1b) are potent but nonspecific immune markers that are produced by a variety of cells and have a myriad of pleiotropic effects in the brain [146, 147], rendering the interpretation of their potential impact on cognitive functioning difficult. It has been proposed that kynurenine metabolites are more closely related to cognitive functioning, due to their interaction with the glutamatergic and nicotinergic system [25] and while the current meta-analysis did not reveal an association with cognitive functioning, the number of studies focusing on these immune markers was very limited, and studies with larger sample sizes are needed. Finally, a few studies demonstrated increases of anti-inflammatory cytokines in processes associated with low-grade systemic inflammation [148, 149]. As a result, it has been questioned to what extent these changes that may be comparable to those seen in psychiatric illness actually represent anti-inflammatory properties in such conditions.

Several limitations should be acknowledged. Meta-analysis of correlation measures remains methodologically challenging, and this is particularly true for associations between two complex dimensions without standardized outcome measures, as is the case for immunological assays and neuropsychological testing in psychiatric disorders. The method used by meta-analysis software CMA tends to overestimate pooled effects [150], especially when correlation coefficients are higher. However, these coefficients tended to be low in the current series of meta-analyses, and even when present would only confirm the conclusions drawn in the current review. Moreover, although efforts were made to mitigate account for publication and reporting biases, they were demonstrably present and will have fundamentally impacted the results of the current meta-analysis. Several studies had small to very small sample sizes and were of moderate quality, which seems to have impacted the results, as analyses only including high-quality papers revealed even more modest associations between immune markers and cognition. The moderate to high overall heterogeneity might be attributable to several meta-analyses of inherent and individual study design-related factors. First, the calculated pro- and anti-inflammatory indexes amalgamate individual inflammatory compounds into two potentially arbitrary categories, at the risk of oversimplification or effect diffusion. Another limitation to be kept in mind is that basal blood levels of immunomarkers do not necessarily reflect the in vivo reactivity upon immune challenge. It should also be noted that both cognitive and immune assessments have methodological limitations contributing to measurement errors and other forms of noise that may mask the detection of an actual association. Finally, while we did not find a significant influence of publication year, age, gender, and duration of illness as covariates, other sources of confounding such as medication status or psychiatric symptom severity were not well accounted for in the included studies [151].

In conclusion, we found evidence of only a weak association between blood-based immune markers and cognition in mood and psychotic disorders. Although assuming an interaction between immune changes and cognitive symptomatology is appealing, evidence to convincingly support such a relationship in severe mental disorders is weak. Significant publication and reporting biases were observed and most likely underlie the inflation of such associations in individual studies. Efforts including central measures of immune activity, trait markers, longitudinal data, and immune challenges might prove more fruitful to uncover a hypothetical relationship between immune alterations and cognitive functioning in mood and psychotic disorders. Potentially, an extant relationship between these parameters can merely not be unveiled by the currently available methodologies and requires assessment techniques with higher resolution.