Abstract
Cognitively impaired and spared patient subgroups were identified in psychosis and depression, and in clinical high-risk for psychosis (CHR). Studies suggest differences in underlying brain structural and functional characteristics. It is unclear whether cognitive subgroups are transdiagnostic phenomena in early stages of psychotic and affective disorder which can be validated on the neural level. Patients with recent-onset psychosis (ROP; N = 140; female = 54), recent-onset depression (ROD; N = 130; female = 73), CHR (N = 128; female = 61) and healthy controls (HC; N = 270; female = 165) were recruited through the multi-site study PRONIA. The transdiagnostic sample and individual study groups were clustered into subgroups based on their performance in eight cognitive domains and characterized by gray matter volume (sMRI) and resting-state functional connectivity (rsFC) using support vector machine (SVM) classification. We identified an impaired subgroup (NROP = 79, NROD = 30, NCHR = 37) showing cognitive impairment in executive functioning, working memory, processing speed and verbal learning (all p < 0.001). A spared subgroup (NROP = 61, NROD = 100, NCHR = 91) performed comparable to HC. Single-disease subgroups indicated that cognitive impairment is stronger pronounced in impaired ROP compared to impaired ROD and CHR. Subgroups in ROP and ROD showed specific symptom- and functioning-patterns. rsFC showed superior accuracy compared to sMRI in differentiating transdiagnostic subgroups from HC (BACimpaired = 58.5%; BACspared = 61.7%, both: p < 0.01). Cognitive findings were validated in the PRONIA replication sample (N = 409). Individual cognitive subgroups in ROP, ROD and CHR are more informative than transdiagnostic subgroups as they map onto individual cognitive impairment and specific functioning- and symptom-patterns which show limited overlap in sMRI and rsFC.
Clinical trial registry name
German Clinical Trials Register (DRKS). Clinical trial registry URL: https://www.drks.de/drks_web/. Clinical trial registry number: DRKS00005042.
Introduction
Cogive impairment is common to different psychiatric disorders, in particular depression and psychosis. At the same time these disorders show marked heterogeneity regarding the level of impairment of cognitive performance [1, 2]. Cognitive deficits in processing speed and verbal learning are proposed to have a central role in pathogenesis of psychotic illness [3,4,5], they appear prior to the first episode of psychosis in individuals at clinical high-risk (CHR) [6] and can also be observed in patients with mood disorders [7, 8]. Recent unsupervised machine learning (ML) studies investigating cognitive deficits in psychosis spectrum disorders, major depression, and bipolar disorder, found subgroups of individuals exhibiting different degrees of cognitive impairment, ranging from cognitively spared to severely impaired profiles [1, 2, 9,10,11,12,13,14]. This suggests that individuals with different diagnoses might share similar cognitive characteristics.
Mixed samples of patients with schizophrenia, and schizo-affective disorder [15], schizophrenia, and bipolar disorder [16, 17], depression, and bipolar disorder [18, 19], and first episode psychosis, and CHR for psychosis [20], can be subgrouped across diagnoses which supports this notion. In this context neurocognition may serve as an interface across psychiatric diagnoses to identify more homogeneous subgroups that show similarities in clinical symptoms and functioning. Though recent psychopathological models conceptualize cognitive impairment as a transdiagnostic dimension of psychopathology [21], it is unclear to which extent individual diagnoses overlap in severity of cognitive impairment and whether unsupervised ML can identify transdiagnostic subgroups with similar cognitive burden and potentially similar psychopathological pathway.
Neuro-endocrino-immunological alterations early in the development are also suggested to be shared both in depressive [22] and psychotic syndrome [23]. According to the neurodevelopmental hypothesis, particularly in psychosis, pathophysiological processes early in the development affect neuronal circuits which impact cognition and social experiences and eventually increase the vulnerability to the illness. Cognitive subgroups in depression and chronic psychosis are altered in brain structure [15, 24,25,26] and functional brain connectivity [27, 28], suggesting differences in their underlying neurobiological constitution. Supervised ML has shown sensitivity to identify widespread and interrelated brain patterns, which might be helpful to detect the complex patterns underlying cognitive subgroups [29]. To date, no study has investigated whether transdiagnostic cognitive subgroups in the early stages of the illness map onto underlying structural and functional neurobiological signatures. Findings would further clarify the association between early, potentially premorbid, neurobiological alterations and cognitive dysfunction common across disorders.
We aim to investigate whether cognitive subgroups are shared between patients with recent-onset psychosis (ROP), recent-onset depression (ROD) and those at CHR for psychosis using unsupervised ML. We compare single-disease and transdiagnostic subgroup solutions to determine if the transdiagnostic clustering renders single-disease subgrouping obsolete. We confirm this, if cognitive characteristics of the transdiagnostic subgroups overlap with cognitive characteristics of the subgroups identified in the single-disease clusterings. Individuals assigned to more impaired subgroups should show more pronounced brain structural (sMRI) and resting-state functional MRI alterations relative to HC and spared cognitive subgroups as a consequence of early pathophysiological processes.
Materials and methods
Sample
A discovery sample included 465 individuals with psychotic or affective illness or at risk for psychosis and 286 HC, between 15 and 40 years, recruited through the PRONIA study (Personalized Prognostic Tool for Early Psychosis Management, www.pronia.eu; German Clinical Trials Register: DRKS00005042) from seven sites (supplementary material). A replication dataset acquired by the same consortium included 433 patients and 178 HC from the same seven sites (Fig. S1). Written informed consent was obtained from the subjects. Each Local Research Ethics Committee declared their ethical approval for the study [30].
Study group-specific inclusion criteria were used [30] in addition to general inclusion and exclusion criteria (supplementary material). ROP were included in the study, if they fulfilled DSM-IV-TR criteria for a psychotic episode, present in the last three months, lasting longer than one week and with a first onset in the last 24 months. ROD were included, if they fulfilled DSM-IV-TR criteria for a first manifestation of a depressive episode, present in the last 3 months and with onset in the last 24 months. CHR status for psychosis was defined as attenuated psychotic symptoms [31], brief limited intermittent psychotic symptoms, cognitive disturbances [32] or positive family history (1st degree relatives) for psychosis/schizotypal personality disorder according to DSM-IV-TR alongside drop in functioning in the last 6 months. HC volunteers were included, if they did not fulfill any current or past DSM-IV-TR axis I or II diagnosis and/or CHR status for psychosis.
After quality control, the final discovery data set consisted of 668 participants (ROP = 140, ROD = 130, CHR = 128, HC = 270; mean age (yrs; SD) = 25.3 (6.0), females = 353, 52.8%). For the imaging analyses additional 15 discovery participants were excluded due to excessive head movement during the MRI and missing images. The final replication data set consisted of 409 participants (ROP = 108, ROD = 81, CHR = 100, HC = 120; mean age (yrs; SD) = 24.54 (5.7), females = 215, 52.6%; Table 1; Fig. S1; supplementary material).
Clinical and cognitive assessment
We assessed clinical symptoms and functioning using the General Assessment of Functioning Scale (GAF) split into a ‘disability’ (D) and ‘symptom’ (S) score [33], the Positive and Negative Syndrome Scale (PANSS) [34] and the Beck Depression Inventory (BDI) [35].
We characterized cognitive performance using a battery of cognitive tests spanning eight cognitive domains according to the MATRICS Consensus Cognitive Battery (MCCB) [36, 37]: visual memory (Rey-Osterrieth Complex Figure Test [38, 39]), social cognition (Diagnostic Analysis of Nonverbal Accuracy [40]), working memory (auditory digit span [41]; self-ordered pointing task [42]), processing speed (verbal fluency test [43]; Trail Making Test A [44]; Digit Symbol Substitution Test [41]), verbal learning and memory (Rey Auditory Verbal Learning Test [45]), executive functioning (Trail Making Test B [44]), attention/vigilance (Continuous Performance Test-Identical Pairs [46]) and salience [47] (Table S1, S2). We assessed intelligence using proxies from the Wechsler Adult Intelligence Scale (WAIS-IV), the vocabulary subtest, and the matrix subtest [41].
Preprocessing of cognitive variables
Preprocessing and clustering analysis of cognitive variables followed a similar pipeline as recently established [14] (supplementary material). After quality control the final analysis data set consisted of 84 cognitive variables showing on average 0.6% missing values (SD cognitive variables = 0.3%; SD participant = 5.3%). We retained the identical set of cognitive variables in the replication data where preprocessing and statistical analysis followed the same steps (Fig. S1). The final replication data set showed on average 0.6% missing values (SDcognitive variables = 0.8%; SDparticipant = 2.4%) prior to the statistical analysis (Fig. S2).
Dimensionality reduction and K-means clustering analyses
Identical pipelines were conducted for the transdiagnostic clustering and the individual study group clustering and contained the following steps. Cognitive data were imputed and effects of age, sex, years of education, and study site were regressed out. To reduce the dimensionality of the cognitive features, we conducted cognitive domain-wise principal component analyses (PCA) (Table S2; Fig. S3) retaining the first component of each cognitive domain (N = 8). The eight cognitive domain scores were used in a K-means clustering analysis embedded in a resampling procedure to determine the optimal number of clusters and cluster stability (supplementary material). HC were used as a comparison group to the obtained cognitive subgroups and not part of the clustering procedure.
Statistical analyses for cluster characterization
We calculated one-factorial Analyses of Variance (ANOVAs) with the factor ‘cluster + HC’ to characterize cognitive, demographic, clinical and functioning differences between clusters and HC. To characterize cognitive differences between subgroups of individual clusterings (ROP, ROD, CHR), we calculated two-factorial ANOVAs with ‘cluster’ and ‘study group’ as between-factors. P-values were Benjamini-Hochberg false discovery rate (FDR) corrected [48] within their domain (cognitive, demographic and clinical/functioning) and FDR corrected pairwise t tests/chi-squared tests (for nominal scales) were calculated for individual comparisons.
Analyses were conducted in R version 3.6.1 (https://cran.r-project.org/bin/windows/base/). We used the ‘clusterboot’- [49] and ‘kmeansruns’-function contained in the ‘fpc’ package [50] for cluster stability assessment and cluster number estimation.
Preprocessing of neuroimaging data
Preprocessing and quality control of the gray matter (GM) images followed the protocols established previously [30] and the CAT12 manual (www.neuro.uni-jena.de/cat12/CAT12-Manual.pdf), respectively. The rsfMRI data preprocessing followed the protocol established in ref. [51]. In brief, rsfMRI data were parcellated into 160 regions of interest according to the Dosenbach functional atlas [52] and mean signal was extracted from 10 mm spheres around each region. We calculated pairwise Pearson’s correlations of the average time series between ROIs using in-house scripts running in Matlab R2015 resulting in connectivity matrices of 12720 resting-state functional connectivity (rsFC) features per participant (supplementary material).
Neuroimaging classification analyses
We built supervised ML models to assess the discriminability of the transdiagnostic clusters with respect to the GM volume and rsFC brain features. Classification performance between the obtained cognitive subgroups was assessed in two separate supervised ML pipelines each embedded in 10 × 10 repeated nested cross-validation using NeuroMiner (http://www.pronia.eu/neurominer) running in a MATLAB 2019a environment (MathWorks Inc.). We used an optimized linear support vector machine (SVM) algorithm and assessed classification performance based on balanced accuracy (BAC). We applied permutation testing (Nperm = 100; alpha = 0.05) to assess the final model significance (supplementary material). Using the same pipelines, we conducted classification analyses between individual study groups and HC, e.g., all ROP individuals against HC, to investigate whether the transdiagnostic subgrouping increased prediction accuracy relative to the individual study group classification.
External validation analyses
We projected the centroids of the transdiagnostic discovery sample cluster solution into the data spaces of the transdiagnostic replication sample. Similarly, we project the centroids of the individual study group cluster solutions into the data spaces of the respective study groups of the replication sample. Participants were assigned to the closest cluster centroid using Euclidean distance. We evaluated the validity of the external replication of the clusters relative to the effects obtained for the discovery solution (supplementary material).
Results
We identified a highly stable two cluster-solution (supplementary material, Fig. S4). Cluster 1 (N = 146) consisted of 79 (54%) ROP, 30 (21%) ROD and 37 (25%) CHR. Cluster 2 (N = 252) consisted of 61 (21%) ROP, 100 (38%) ROD and 91 (41%) CHR. We obtained a higher proportion of ROD in cluster 2 (p < 0.001) and a higher proportion of ROP in cluster 1 (X2(2, 398) = 37.195, both p < 0.001; table S3).
Differences in cognitive performance between transdiagnostic clusters
Analyses revealed reduced cognitive performance in cluster 1 when compared to cluster 2 across all cognitive domains, i.e., social cognition, working memory, processing speed, executive functioning, attention, visual memory, verbal memory and salience (main effect: cluster 1/cluster 2/HC: F(2,665) > 5.822, p < 0.01; individual cluster comparisons: p < 0.001 for all cognitive domains except for salience: p < 0.01). Whereas cluster 1 performed significantly worse than HC across all cognitive domains (p < 0.01) except for salience (p = 0.110), cluster 2 performed comparable to HC with respect to social cognition (p = 0.920), processing speed (p = 0.170), executive functioning (p = 0.370), verbal memory (p = 0.71), attention (p = 0.130), visual memory (p = 0.640) and salience (p = 0.056). Additionally, cluster 2 performed better than HC with respect to working memory (p < 0.05). We found the same pattern for the WAIS vocabulary and matrix scores which were not part of the clustering procedure (Table 2; Fig. 1).
A represents the cognitive performances of impaired (blue) and spared clusters (green) for the transdiagnostic cluster solution. B represents the cognitive performances of impaired (shades of blue) and spared (shades of green) clusters for the clusterings based on recent-onset depression patients (ROD), recent-onset psychosis patients (ROP) and clinical high-risk individuals (CHR) separately. For comparison impaired and spared clusters of the transdiagnostic cluster solution are shown in gray. For both sections: High principal component (PCA) scores represent high performance. Abbreviations: vismem visual memory, soccog social cognition, wm working memory, proc processing speed, exfun executive functioning, att attention, sal salience, verbmem verbal memory.
Hereafter, cluster 1 is referred to as the impaired cluster, and cluster 2 as the spared cluster.
Differences in clinical and functioning characteristics between transdiagnostic clusters
The impaired cluster in comparison to the spared cluster showed significantly lower functioning with respect to the GAF symptom scale in the last month (main effect: cluster 1/cluster 2/HC: F(2, 660) = 810.080, p < 0.001; impaired vs spared: p < 0.001) and the last year (main effect: cluster 1/cluster 2/HC: F(2, 660) = 253.120, p < 0.001; impaired vs spared: p < 0.001) before study entry as well as across the lifespan (main effect: cluster 1/cluster 2/HC: F(2, 660) = 92.854, p < 0.001; impaired vs spared: p < 0.001). Both impaired and spared cluster show significantly lower functioning with respect to the GAF symptom scale in the last month (impaired: p < 0.001, spared: p < 0.001) and the last year (impaired: p < 0.001, spared: p < 0.001) before study entry as well as across the lifespan (impaired: p < 0.001, spared: p < 0.001) when compared to HC. Effects between clusters and HC are similar with respect to the GAF disability scale (Table S3; Fig. 2).
Functioning differences (A) and psychotic and depressive symptom differences (B, C) of impaired (shades of blue) and spared (shades of green) clusters for the clusterings based on recent-onset depression patients (ROD), recent-onset psychosis patients (ROP) and clinical high-risk individuals (CHR) separately. For comparison impaired and spared clusters of the transdiagnostic cluster solution are shown in gray. Abbreviations: GAF S global assessment of functioning (symptom scale), PANSS positive and negative syndrome scale, BDI Beck’s depression inventory.
The impaired cluster in comparison to the spared cluster showed significantly higher positive (t(245.28) = 4.728, p < 0.001), negative (t(213.82) = 3.955, p < 0.001) and general (t(245.56) = 2.585, p < 0.05) symptoms on the PANSS scale. Both impaired and spared cluster showed significantly higher depressive symptoms on the BDI as compared to HC (main effect: cluster 1/cluster 2/HC: F(2, 621) = 323.526, p < 0.001; impaired vs HC: p < 0.001; spared vs HC: p < 0.001) while the spared subgroup showed higher depressive symptoms in comparison to the impaired subgroup (p < 0.001).
Differences in cognitive performance between single-disease clusterings
Similar to the transdiagnostic cluster solution, the individual clusterings (ROP: impaired: N = 42 [30%], spared: N = 98 [70%]; ROD: impaired: N = 45 [35%], spared: N = 85 [65%]; CHR: impaired: N = 59 [46%], spared: N = 69 [54%]) showed an impaired subgroup with widespread reductions in cognitive performance relative to HC and a spared subgroup often performing similar to or better than HC (Supplementary material, Tables S4–S6).
When comparing impaired and spared subgroups across clusterings, we found that the impaired and spared subgroup of the ROP clustering performed significantly worse in comparison to the impaired and spared subgroups of ROD and CHR in the domains of working memory (main effect study group: F(2, 392) = 12.687, p < 0.001; impaired ROD: p < 0.001; impaired CHR: p < 0.001), processing speed (main effect study group: F(2, 392) = 26.603, p < 0.001; impaired ROD: p < 0.001; impaired CHR: p < 0.001), attention (main effect study group: F(2, 392) = 16.453, p < 0.001; impaired ROD: p < 0.001; impaired CHR: p < 0.001), and verbal memory (main effect study group: F(2, 392) = 19.371, p < 0.001; impaired ROD: p < 0.001; impaired CHR: p < 0.001). Additionally, we obtained a significant interaction for visual memory (interaction effect: F(2, 392) = 14.324, p < 0.001) showing that the impaired ROP group performed significantly worse as compared to impaired ROD (p < 0.001) and CHR (p < 0.001) whereas the spared ROP group performed comparable to the spared ROD (p = 0.058) and CHR group (p = 0.652). We obtained a significant interaction for executive functioning (interaction effect: F(2, 392) = 19.273, p < 0.001; impaired ROD: p < 0.001; impaired CHR: p < 0.001) showing that the impaired ROP group performed significantly worse as compared to impaired ROD and CHR (p < 0.001) whereas reductions between the spared ROP group and the spared ROD (p < 0.05) and CHR group (p < 0.05) were less pronounced (Table S7).
Differences in clinical and functional characteristics between single-disease clusterings
Impaired and spared cognitive subgroups of the individual clusterings were less distinct with respect to functional impairments (Tables S8–S10, Fig. 2). Whereas impaired and spared subgroups in ROP follow a similar pattern than the transdiagnostic cluster solution, i.e., higher functional impairment in the cognitively impaired in comparison to the cognitively spared subgroup, impaired ROD subgroups and impaired CHR subgroups show less functional impairments. Additionally, we find significantly higher negative symptoms for impaired as compared to spared ROP (t(72.823) = 3.006, p < 0.01) as well as significantly higher depressive symptoms for spared ROD as compared to impaired ROD and HC (main effect: cluster 1/cluster 2/HC: F(2, 377) = 281.619, p < 0.001; spared vs impaired: p < 0.01; spared vs HC: p < 0.001).
Differences in GM volume between transdiagnostic clusters
The SVM classification model based on GM volume separated the cognitively spared cluster from HC (BAC = 53.1%, Sensitivity (Sens) = 55.6%, Specificity (Spec) = 50.6%, positive predictive value (PPV) = 51.7%, negative predictive value (NPV) = 54.5%; p = 0.04) while it could neither separate the cognitively impaired cluster from HC (BAC = 51.4, Sens = 47.9%, Spec = 54.8%, PPV = 36.9%, NPV = 65.6%; p = 0.37) nor the cognitively impaired cluster from the cognitively spared cluster (BAC = 53.0, Sens = 42.4%, Spec = 63.7%, PPV = 40.4%, NPV = 65.6%; p = 0.14) (Figs. 3, S5). Classification of the transdiagnostic subgroups provided no or no substantial gain in accuracy over the classification of individual study groups from HC (Table S11).
The upper row in panel (A) shows the predictive connectivity patterns for the ‘impaired vs HC’ rsFC model. The lower row in (A) shows the predictive connectivity patterns for the ‘spared vs HC’ rsFc model. The ten most predictive connectivity patterns for HC status are marked in blue and the ten most predictive connectivity patterns for impaired/spared cluster status are marked in red. A list containing the predictive features is given in supplementary Table S12. Figures were generated using the BrainNet Viewer. B shows the voxel reliability maps for the significant ‘spared vs HC’ sMRI model. Voxels predictive of spared status are represented by positive CV ratio ( = warm colors) and voxels predictive of HC status are represented by negative CV ratio ( = cool colors). Reliability maps are thresholded at the 99th percentile for both positive and negative CV ratio.
Differences in functional connectivity between transdiagnostic clusters
The SVM classification model based on rsFC separated the cognitively impaired cluster (BAC = 58.5, Sens = 73.6%, Spec = 43.3%, PPV = 41.7%, NPV = 74.8%; p < 0.01) and cognitively spared cluster (BAC = 61.7, Sens = 62.5%, Spec = 60.9%, PPV = 60.3%, NPV = 63.1%; p < 0.01) from HC. The model classifying cognitively spared and impaired cluster was not significant (BAC = 55.9, Sens = 49.3%, Spec = 62.5%, PPV = 43.3%, NPV = 68.0%; p > 0.05) (Table S12, Figs. 3, S5). Classification of the transdiagnostic subgroups provided no or no substantial gain in accuracy over the classification of individual study groups from HC (Table S11).
External validation
Differences in cognitive, functional and clinical characteristics between transdiagnostic clusters
Similar to the findings in the discovery sample, the transdiagnostic cluster solution of the replication sample showed an impaired subgroup with widespread reductions in cognitive performance relative to HC and a spared subgroup often performing similar to or better than HC (Table 2, Fig. S6).
Transdiagnostic cluster effects with respect to functioning were less pronounced in the replication sample (Table S13, Fig. S7). The impaired cluster in comparison to the spared cluster showed significantly higher positive (t(270.63) = 4.603, p < 0.001) symptoms on the PANSS scale. The spared subgroup showed higher depressive symptoms in comparison to the impaired subgroup (main effect: cluster 1/cluster 2/HC: F(2, 346) = 128.659, p < 0.001; spared vs impaired: p < 0.05).
Differences in cognitive, functioning, and clinical characteristics between single-disease clusters
Individual clusterings showed an impaired subgroup with widespread reductions in cognitive performance relative to HC and a spared subgroup often performing comparable to or better than HC. When comparing impaired and spared subgroups across clusterings, we found that the impaired and spared subgroup of the ROP clustering performed significantly worse in comparison to the impaired and spared subgroups of ROD and CHR (Tables S7, S14–S16, Fig. S6).
Impaired ROP, ROD and CHR subgroups did not show significantly more functional impairment than their spared subgroups. Impaired and spared clusters were not distinct with respect to BDI and symptoms on the PANSS (Tables S17–S19, Fig. S7).
Discussion
The current study identified spared and impaired cognitive subgroups across a transdiagnostic sample and in patients with affective and psychotic illness and CHR state. Impaired subgroups showed widespread cognitive impairment while the spared subgroups showed cognitive performance comparable to HC. Single-disease clustering analyses indicated that ROP were characterized by more impairment in both impaired and spared subgroups than the ROD and CHR groups and provided a more refined picture on functional impairments and symptoms associated with cognitive subgroups than the transdiagnostic clustering solution. We found a higher discriminability of the transdiagnostic cognitive subgroups based on rsfMRI than on sMRI. Analyses based on rsfMRI showed that transdiagnostic clusters were significantly differentiated from HC.
Previous studies of patients with established psychiatric illness and at CHR identified subgroups showing a ‘severe cognitive deficit’ as well as a subgroup with ‘preserved cognitive performance’ [1, 2, 9, 10, 13,14,15,16, 18,19,20]. We showed that this cognitive heterogeneity is also present at an early stage in psychotic and depressive disorders and at CHR. Cognitive impairments in impaired subgroups were most strongly pronounced in working memory, verbal memory, processing speed and attention. Consistently, metanalytical findings show that processing speed, verbal memory and working memory count among the most strongly impaired cognitive domains in schizophrenia and depression [21, 53]. As evident from single-disease clustering, ROP showed significantly more impairment with respect to these cognitive domains than impaired ROD or CHR. Further, processing speed and verbal memory represent the most predictive cognitive domains for transition to psychosis in CHR [54]. Our findings indicate that though cognitive impairment is a transdiagnostic phenomenon which shows substantial heterogeneity, individuals with impaired cognition in psychosis, depression and CHR state vary in severity [21]. To explain these variations differences in pharmacological treatment [21] as well as in illness duration [55] might play a limited role in the current study as individuals showed only short-term exposure to pharmacological treatment and ROP showed shorter illness duration than ROD. Therefore, illness-specific psychopathological characteristics have likely contributed to the differences [21].
Cognitively impaired subgroups across individual psychiatric conditions have been associated with greater deficits in functioning [20, 56,57,58,59,60,61,62] and higher burden in clinical symptoms [57, 59, 61]. The impaired transdiagnostic subgroup was associated with more functional impairment compared to the transdiagnostic spared subgroup and HC. Consistent with our cognitive findings in the single-disease clustering, we found that functional impairment in the cognitively impaired subgroup is more pronounced in ROP than in ROD and CHR. The transdiagnostic clustering indicated significantly higher positive, negative, and general symptoms in the impaired subgroup as compared to the spared subgroup and HC. The effect for negative symptoms seemed to be driven by the cognitively impaired subgroup in ROP which is consistent with previous literature [61, 62]. The spared transdiagnostic subgroup showed significantly higher depressive symptoms as compared to the impaired subgroup and HC which seemed to be mainly driven by spared ROD. Metanalyses in depression show inconsistent findings for the association of cognition and depressive symptom severity [63,64,65].
Both GMV and functional connectivity alterations have been identified in schizophrenia, CHR and depression [66,67,68]. SVM classifiers based on rsFC showed superior accuracy in differentiating the impaired and spared transdiagnostic subgroups which is in line with findings reporting higher sensitivity of ML algorithms in the functional resting-state compared to the neuroanatomical brain modality [29]. Transdiagnostic spared and impaired clusters were classified with relatively low accuracy in both imaging modalities. We found no or no substantial gains in classification accuracy when classifying the transdiagnostic subgroups as compared to individual study groups against HC. In sum, this suggests that transdiagnostic cognitive impairment in early illness accounts for a small amount of variance in structural and resting-state functional brain measurements.
We validated the discovery sample results regarding the transdiagnostic spared and impaired subgroup in the PRONIA replication sample and confirmed the finding that cognitive dysfunction in the impaired cognitive subgroups is more pronounced in ROP as compared to ROD and CHR. Cognitive subgroups in the replication sample were less associated with differences in general functioning and symptoms.
There are limitations to our findings. First, different numbers of cognitive variables per cognitive domain were used for clustering leading to an underrepresentation of certain cognitive domains, e.g., in social cognition (Table S2) [14]. Second, we used SVM algorithms due to their high interpretability while non-linear classification algorithms, such as deep neural networks [69] might have revealed higher classification accuracies. Further, focusing the analyses on apriori defined brain networks [70] might have increased the sensitivity to differentiate the groups. Third, classification performance in the imaging analyses might have been limited due to differences in sample size between groups though we weighted the hyperplane of the SVM algorithm in favor of the minority group. Fourth, due to low SVM classification accuracies in the discovery sample we did not apply our brain models to the replication sample.
We provide evidence that ROP, ROD and CHR differ in cognitive heterogeneity while cognitive subgroups in individual study groups map onto different general functioning and symptoms characteristics. Transdiagnostic impaired subgroups did not reveal increased classification performance in the investigated structural and functional brain modalities relative to the spared subgroup and HC, indicating heterogeneity in underlying neurobiological patterns for the identified transdiagnostic subgroups. Study group specific cognitive subgroups might be more informative than transdiagnostic subgroups.
References
Green MJ, Girshkin L, Kremerskothen K, Watkeys O, Quidé Y. A systematic review of studies reporting data-driven cognitive subtypes across the psychosis spectrum. Neuropsychol Rev. 2020;30:446–60.
Pu S, Noda T, Setoyama S, Nakagome K. Empirical evidence for discrete neurocognitive subgroups in patients with non-psychotic major depressive disorder: clinical implications. Psychol Med. 2018;48:2717–29.
Sheffield JM, Karcher NR, Barch DM. Cognitive deficits in psychotic disorders: a lifespan perspective. Neuropsychol Rev. 2018;28:509–33.
Kahn RS, Keefe RSE. Schizophrenia is a cognitive illness: time for a change in focus. JAMA Psychiatry. 2013;70:1107–12.
Kremen WS, Seidman LJ, Faraone SV, Toomey R, Tsuang MT. The paradox of normal neuropsychological function in schizophrenia. J Abnorm Psychol. 2000;109:743–52.
Fusar-Poli P, Borgwardt S, Bechdolf A, Addington J, Riecher-Rössler A, Schultze-Lutter F, et al. The psychosis high-risk state: a comprehensive state-of-the-art review. Arch Gen Psychiatry. 2013;70:107–20.
Snyder HR. Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychol Bull. 2013;139:81–132.
Lee RSC, Hermens DF, Porter MA, Redoblado-Hodge MA. A meta-analysis of cognitive deficits in first-episode major depressive disorder. J Affect Disord. 2012;140:113–24.
Martin DM, Wollny-Huttarsch D, Nikolin S, McClintock SM, Alonzo A, Lisanby SH, et al. Neurocognitive subgroups in major depressive disorder. Neuropsychology. 2020;34:726–34.
Russo M, Van Rheenen TE, Shanahan M, Mahon K, Perez-Rodriguez MM, Cuesta-Diaz A, et al. Neurocognitive subtypes in patients with bipolar disorder and their unaffected siblings. Psychol Med. 2017;47:2892–905.
Bora E, Hıdıroğlu C, Özerdem A, Kaçar ÖF, Sarısoy G, Civil Arslan F, et al. Executive dysfunction and cognitive subgroups in a large sample of euthymic patients with bipolar disorder. Eur Neuropsychopharmacol. 2016;26:1338–47.
Burdick KE, Russo M, Frangou S, Mahon K, Braga RJ, Shanahan M, et al. Empirical evidence for discrete neurocognitive subgroups in bipolar disorder: Clinical implications. Psychol Med. 2014;44:3083–96.
Haas SS, Ge R, Sanford N, Modabbernia A, Reichenberg A, Whalley HC, et al. Accelerated global and local brain aging differentiate cognitively impaired from cognitively spared patients with schizophrenia. Front. Psychiatry. 2022;13:913470.
Wenzel J, Haas SS, Dwyer DB, Ruef A, Oeztuerk OF, Antonucci LA, et al. Cognitive subtypes in recent onset psychosis: distinct neurobiological fingerprints? Neuropsychopharmacology. 2021. https://doi.org/10.1038/s41386-021-00963-1.
Van Rheenen TE, Cropley V, Zalesky A, Bousman C, Wells R, Bruggemann J, et al. Widespread volumetric reductions in schizophrenia and schizoaffective patients displaying compromised cognitive abilities. Schizophr Bull. 2018;44:560–74.
Karantonis JA, Rossell SL, Carruthers SP, Sumner P, Hughes M, Green MJ, et al. Cognitive validation of cross-diagnostic cognitive subgroups on the schizophrenia-bipolar spectrum. J Affect Disord. 2020;266:710–21.
Van Rheenen TE, Lewandowski KE, Tan EJ, Ospina LH, Ongur D, Neill E, et al. Characterizing cognitive heterogeneity on the schizophrenia-bipolar disorder spectrum. Psychol Med. 2017;47:1848–64.
Cotrena C, Damiani Branco L, Ponsoni A, Milman Shansis F, Paz Fonseca R. Neuropsychological clustering in bipolar and major depressive disorder. J Int Neuropsychol Soc. 2017;23:584–93.
Iverson GL, Brooks BL, Langenecker SA, Young AH. Identifying a cognitive impairment subgroup in adults with mood disorders. J Affect Disord. 2011;132:360–7.
Haining K, Gajwani R, Gross J, Gumley AI, Ince RAA, Lawrie SM, et al. Characterising cognitive heterogeneity in individuals at clinical high-risk for psychosis: a cluster analysis with clinical and functional outcome prediction. Eur Arch Psychiatry Clin Neurosci. 2021. https://doi.org/10.1007/s00406-021-01315-2.
Abramovitch A, Short T, Schweiger A. The C factor: cognitive dysfunction as a transdiagnostic dimension in psychopathology. Clin Psychol Rev. 2021;86:102007.
Lima-Ojeda JM, Rupprecht R, Baghai TC. Neurobiology of depression: a neurodevelopmental approach. World J Biol Psychiatry. 2018;19:349–59.
Murray RM, Bhavsar V, Tripoli G, Howes O. 30 years on: how the neurodevelopmental hypothesis of schizophrenia morphed into the developmental risk factor model of psychosis. Schizophr Bull. 2017;43:1190–6.
Weinberg D, Lenroot R, Jacomb I, Allen K, Bruggemann J, Wells R, et al. Cognitive subtypes of schizophrenia characterized by differential brain volumetric reductions and cognitive decline. JAMA Psychiatry. 2016;73:1251–9.
Gould IC, Shepherd AM, Laurens KR, Cairns MJ, Carr VJ, Green MJ. Multivariate neuroanatomical classification of cognitive subtypes in schizophrenia: a support vector machine learning approach. NeuroImage Clin. 2014;6:229–36.
Woodward ND, Heckers S. Brain structure in neuropsychologically defined subgroups of schizophrenia and psychotic bipolar disorder. Schizophr Bull. 2015;41:1349–59.
Lewandowski KE, McCarthy JM, Öngür D, Norris LA, Liu GZ, Juelich RJ, et al. Functional connectivity in distinct cognitive subtypes in psychosis. Schizophr Res. 2019;204:120–6.
Yang X, Qi S, Wang M, Calhoun VD, Sui J, Li T, et al. Subtypes of depression characterized by different cognitive decline and brain activity alterations. J Psychiatr Res. 2021;138:413–9.
Kambeitz J, Kambeitz-Ilankovic L, Leucht S, Wood S, Davatzikos C, Malchow B, et al. Detecting neuroimaging biomarkers for schizophrenia: a meta-analysis of multivariate pattern recognition studies. Neuropsychopharmacology. 2015;40:1742–51.
Koutsouleris N, Kambeitz-Ilankovic L, Ruhrmann S, Rosen M, Ruef A, Dwyer DB, et al. Prediction models of functional outcomes for individuals in the clinical high-risk state for psychosis or with recent-onset depression: a multimodal, multisite machine learning analysis. JAMA Psychiatry. 2018;75:1156–72.
Miller TJ, McGlashan TH, Rosen JL, Cadenhead K, Cannon T, Ventura J, et al. Prodromal assessment with the structuredinterview for prodromal syndromesand the scale of prodromal symptoms:predictive validity, interrater reliability,and training to reliability. Schizophr Bull. 2003;29:703–16.
Schultze-Lutter, F, Addington, J, Ruhrmann, S, Klosterkötter J. Schizophrenia proneness instrument, adult version (SPI-A). Rome: Rome: Giovanni Fioriti; 2007.
Hall RCW. Global assessment of functioning: a modified scale. Psychosomatics. 1995;36:267–75.
Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.
Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–71.
Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, et al. The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008;165:203–13.
Kern RS, Nuechterlein KH, Green MF, Baade LE, Fenton WS, Gold JM, et al. The MATRICS consensus cognitive battery, Part 2: Co-norming and standardization. Am J Psychiatry. 2008;165:214–20.
Rey A. L’examin psychologique dans les casd’escephalopathie traumatique. Arch Psychol (Geneve). 1941;28:286–340.
Osterrieth PA. Le test de copie d’unefigurecomplexe. Arch Psychol (Geneve). 1944;30:206–356.
Nowicki S, Duke MP. Individual differences in the nonverbal communication of affect: the diagnostic analysis of nonverbal accuracy scale. J Nonverbal Behav. 1994;18:9–35.
Wechsler D. Manual for the Wechsler Adult Intelligence Scale. Oxford, England: Psychological Corp.; 1955.
Petrides M, Milner B. Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man. Neuropsychologia. 1982;20:249–62.
Ruff RM, Light RH, Parker SB, Levin HS. Benton controlled Oral Word Association Test: reliability and updated norms. Arch Clin Neuropsychol. 1996;11:329–38.
Tombaugh TN. Trail making Test A and B: normative data stratified by age and education. Arch Clin Neuropsychol. 2004;19:203–14.
Schmidt M. Rey auditory verbal learning test: a handbook (Vol. 17). Los Angeles, CA: Western Psychological Services; 1996.
Eliason MJ, Richman LC. The continuous performance test in learning disabled and nondisabled children. J Learn Disabil. 1987;20:614–9.
Kapur S. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry. 2003;160:13–23.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B 1995;57:289–300.
Hennig C. Cluster-wise assessment of cluster stability. Comput Stat Data Anal. 2007;52:258–71.
Hennig C. fpc: flexible procedures for clustering (Version 2.2-9). 2020.
Haas SS, Antonucci LA, Wenzel J, Ruef A, Biagianti B, Paolini M, et al. A multivariate neuromonitoring approach to neuroplasticity-based computerized cognitive training in recent onset psychosis. Neuropsychopharmacology. 2020;0:1–8.
Dosenbach NUF. Prediction of Individual Brain. Science (80-). 2010;329:1358–61.
Millan MJ, Agid Y, Brüne M, Bullmore ET, Carter CS, Clayton NS, et al. Cognitive dysfunction in psychiatric disorders: characteristics, causes and the quest for improved therapy. Nat Rev Drug Discov. 2012;11:141–68.
Cannon TD, Yu C, Addington J, Bearden CE, Cadenhead KS, Cornblatt BA, et al. An individualized risk calculator for research in prodromal psychosis. Am J Psychiatry. 2016;173:980–8.
Zanelli J, Reichenberg A, Sandin S, Morgan C, Dazzan P, Pilecka I, et al. Dynamic and static cognitive deficits in schizophrenia and bipolar disorder after the first episode. Schizophr Bull. 2022;48:590–8.
Dickinson D, Zaidman SR, Giangrande EJ, Eisenberg DP, Gregory MD, Berman KF. Distinct polygenic score profiles in schizophrenia subgroups with different trajectories of cognitive development. Am J Psychiatry. 2020;177:298–307.
Green MJ, Cairns MJ, Wu J, Dragovic M, Jablensky A, Tooney PA, et al. Genome-wide supported variant MIR137 and severe negative symptoms predict membership of an impaired cognitive subtype of schizophrenia. Mol Psychiatry. 2013;18:774–80.
Wells R, Swaminathan V, Sundram S, Weinberg D, Bruggemann J, Jacomb I, et al. The impact of premorbid and current intellect in schizophrenia: cognitive, symptom, and functional outcomes. Npj Schizophr. 2015;1:1–8.
Lewandowski KE, Sperry SH, Cohen BM, Öngür D. Cognitive variability in psychotic disorders: a cross-diagnostic cluster analysis. Psychol Med. 2014;44:3239–48.
Velthorst E, Meyer EC, Giuliano AJ, Addington J, Cadenhead KS, Cannon TD, et al. Neurocognitive profiles in the prodrome to psychosis in NAPLS-1. Schizophr Res. 2019;204:311–9.
Carruthers SP, Van Rheenen TE, Karantonis JA, Rossell SL. Characterising demographic, clinical and functional features of cognitive subgroups in schizophrenia spectrum disorders: a systematic review. Neuropsychol Rev. 2021. https://doi.org/10.1007/s11065-021-09525-0.
Cambridge OR, Knight MJ, Mills N, Baune BT. The clinical relationship between cognitive impairment and psychosocial functioning in major depressive disorder: a systematic review. Psychiatry Res. 2018;269:157–71.
Keilp JG, Madden SP, Gorlyn M, Burke AK, Oquendo MA, Mann JJ. The lack of meaningful association between depression severity measures and neurocognitive performance. J Affect Disord. 2018;241:164–72.
McClintock SM, Husain MM, Greer TL, Cullum CM. Association between depression severity and neurocognitive function in major depressive disorder: a review and synthesis. Neuropsychology. 2010;24:9–34.
Zaninotto L, Solmi M, Veronese N, Guglielmo R, Ioime L, Camardese G, et al. A meta-analysis of cognitive performance in melancholic versus non-melancholic unipolar depression. J Affect Disord. 2016;201:15–24.
Chung BS, Cannon TD. Brain imaging during the transiation from psyhcosis prodrome t schizpohrenia. Physiol Behav. 2015;203:336–41.
Zhang FF, Peng W, Sweeney JA, Jia ZY, Gong QY. Brain structure alterations in depression: psychoradiological evidence. CNS Neurosci Ther. 2018;24:994–1003.
Wang L, Hermens DF, Hickie IB, Lagopoulos J. A systematic review of resting-state functional-MRI studies in major depression. J Affect Disord. 2012;142:6–12.
Durstewitz D, Koppe G, Meyer-Lindenberg A. Deep neural networks in psychiatry. Mol Psychiatry. 2019;24:1583–98.
McTeague LM, Huemer J, Carreon DM, Jiang Y, Eickhoff SB, Etkin A. Identification of common neural circuit disruptions in cognitive control across psychiatric disorders. Am J Psychiatry. 2017;174:676–85.
Acknowledgements
Recruitment, follow-up of the study participants/implementation of examination protocols/information technological infrastructure/data quality control: PRONIA consortium.
Funding
This work was supported in analysis and writing of the manuscript by the European Union-FP7 project PRONIA (“Personalized Prognostic Tools for Early Psychosis Management”, grant number 602152). JW was partly supported by the NARSAD Young Investigator Award of LK through the Brain & Behavior Research Foundation (grant number 28474). RU achieved grants from Medical Research Council, grants from the National Institute for Health Research, and personal fees from Sunovion. TL was supported by the Koeln Fortune Program/Faculty of Medicine, University of Cologne (No 370/2020). CP was supported by a National Health and Medical Research Council (NHMRC) Senior Principal Research Fellowship (1105825), an NHMRC L3 Investigator Grant (1196508), and NHMRC-EU grant (1075379). SSH was supported by NIH National Institute of Mental Health, grant T32MH122394. TEVR was supported by an Al and Val Rosenstrauss Fellowship from the Rebecca L. Cooper Medical Research Foundation. This paper should be linked to a future Research Highlight to be written by Dr. Kathryn Lewandowski.
Author information
Authors and Affiliations
Consortia
Contributions
Analysis/interpretation of data: JW, LK-I, JK. Concept and design: LK-I, NK, DBD, JK, RU, RKRS, EM, SJW, PB, SB. Drafting of the manuscript: JW, LK-I. Critical revision of the manuscript for important intellectual content: all authors. Acquisition of the data and technical support/data analysis/MRI support: AR, LA, CB, MP.
Corresponding author
Ethics declarations
Competing interests
NK, JK, and RKRS are currently honorary speakers for Otsuka/Lundbeck. PAL has received honoraria for talks presented at educational meetings organised by Boehringer-Ingelheim. The remaining authors including members of the PRONIA consortium have nothing to disclose.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wenzel, J., Badde, L., Haas, S.S. et al. Transdiagnostic subgroups of cognitive impairment in early affective and psychotic illness. Neuropsychopharmacol. (2023). https://doi.org/10.1038/s41386-023-01729-7
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41386-023-01729-7