Delineating and validating higher-order dimensions of psychopathology in the Adolescent Brain Cognitive Development (ABCD) study

Article metrics

Abstract

Hierarchical dimensional systems of psychopathology promise more informative descriptions for understanding risk and predicting outcome than traditional diagnostic systems, but it is unclear how many major dimensions they should include. We delineated the hierarchy of childhood and adult psychopathology and validated it against clinically relevant measures. Participants were 9987 9- and 10-year-old children and their parents from the Adolescent Brain Cognitive Development (ABCD) study. Factor analyses of items from the Child Behavior Checklist and Adult Self-Report were run to delineate hierarchies of dimensions. We examined the familial aggregation of the psychopathology dimensions, and the ability of different factor solutions to account for risk factors, real-world functioning, cognitive functioning, and physical and mental health service utilization. A hierarchical structure with a general psychopathology (‘p’) factor at the apex and five specific factors (internalizing, somatoform, detachment, neurodevelopmental, and externalizing) emerged in children. Five similar dimensions emerged also in the parents. Child and parent p-factors correlated highly (r = 0.61, p < 0.001), and smaller but significant correlations emerged for convergent dimensions between parents and children after controlling for p-factors (r = 0.09−0.21, p < 0.001). A model with child p-factor alone explained mental health service utilization (R2 = 0.23, p < 0.001), but up to five dimensions provided incremental validity to account for developmental risk and current functioning in children (R2 = 0.03−0.19, p < 0.001). In this first investigation comprehensively mapping the psychopathology hierarchy in children and adults, we delineated a hierarchy of higher-order dimensions associated with a range of clinically relevant validators. These findings hold important implications for psychiatric nosology and future research in this sample.

Introduction

Traditional psychiatric nosologies define mental disorders as distinct categories1,2, but this is at odds with extensive evidence that disorders lie on a continuum with normality and are highly comorbid3,4,5,6,7. This comorbidity reflects underlying higher-order dimensions (or spectra) of psychopathology4,7,8,9. Dimensional classifications of these spectra have been proposed as alternative approaches to better align the nosology with empirical evidence4,7,8,10. However, available models differ in the number of spectra that they specify.

Numerous studies point to a general factor (‘p’) that represents common susceptibility to psychopathology and explains why all mental disorders tend to co-occur5,9,11,12,13,14. Other research supports a separation between broad internalizing and externalizing spectra—originally identified in studies that shaped the Achenbach System of Empirically Based Assessment (ASEBA)15,16—arguing that this is an important distinction both in adults17,18 and children19,20. However, further evidence suggests that a greater number of major dimensions are needed to characterize psychopathology8,21,22,23,24,25. For instance, the recently developed Hierarchical Taxonomy of Psychopathology (HiTOP)7,8 includes six spectra (internalizing, somatoform, detachment, thought disorder, antagonism, and disinhibition), which were identified based on extensive factor analytic literature (for a review, see ref. 8). Yet, the dimensions depicted in these studies may not provide full coverage of psychopathology, especially with regard to disorders common in children. For example, a neurodevelopmental spectrum—encompassing forms of psychopathology that share common genetic vulnerabilities, are associated with salient cognitive impairments, emerge in infancy or childhood, and often persist into adulthood (e.g., speech problems, motor problems, autism)—has been proposed26, but its placement among other psychopathology spectra remains unclear due to paucity of relevant factor analytic studies27,28. Furthermore, the original notion of neurodevelopmental spectrum26 did not include problems related to inattention and hyperactivity–impulsivity, which many previous factor analytic studies placed under the externalizing spectrum29,30,31. However, other factor analytic evidence suggests that inattention and hyperactivity–impulsivity symptoms may not cluster with externalizing problems27,28,32,33,34,35,36, and accumulating validity studies indicate substantial commonality with other neurodevelopmental problems37,38,39,40,41,42. Further research examining the structure of these symptoms alongside other forms of psychopathology is therefore warranted.

Models with different numbers of dimensions remain to be reconciled in order to advance psychiatric classification and its clinical utility. Simpler and more complex architectures may be integrated as different levels of a single hierarchy: from a p-factor at the apex to progressively more specific nested factors43,44. Consequently, models with different numbers of dimensions (one, two, three, etc.) can co-exist and be studied simultaneously. Initial studies, employing Goldberg’s bass-ackwards approach43 to delineate hierarchical structures, have identified a hierarchy of higher-order dimensions22,23,44,45,46, but were largely limited to personality pathology and focused on adults. Importantly, developmental studies suggest that some psychopathology dimensions may differ with age, and additional dimensions may emerge over development14,47, which underscores the importance of studying child samples as well.

Beyond the identification of the number of dimensions, an important step for delineating a new psychopathology classification is to validate dimensions against criteria important for clinical practice and research, such as genetic/familial and psychosocial risk factors, cognitive processes, illness course, and treatment outcome48,49,50. In a hierarchical structure, validity may differ across levels, as more elaborate models tend to be more informative, but are less parsimonious, and the choice between models may depend on the purpose of inquiry. Available studies show that broader spectra are associated with familiality for psychiatric disorders, childhood adversities, brain and functional impairment11,13,49, while more specific dimensions are required to adequately account for outcomes such as educational achievement and executive functioning14,19,27. However, a systematic evaluation of validity of dimensions across hierarchical levels is lacking.

In the present study, we sought to delineate higher-order dimensions of psychopathology within a hierarchical structure, and compare the validity of different levels of specificity. Our first aim was to investigate the hierarchical structure of psychopathology in 9987 children from the Adolescent Brain Cognitive Development (ABCD) study51,52,53—as well as in their parents—by analyzing a large and diverse set of symptoms15,16. Our second aim was to compare the validity of different levels of the childhood psychopathology hierarchy in relation to clinically informative measures of familial and developmental risk factors, current social, academic, and cognitive functioning, and service utilization11,14,50,54,55.

Methods

Sample

The ABCD sample consists of over 11,000 children and their parents who took part in a major collaboration between 21 sites across the US to investigate psychological and neurobiological development from preadolescence to early adulthood. Full details of recruitment can be found elsewhere51. Briefly, the primary method for recruiting children aged 9 or 10 at the time of the baseline assessments (between 2016 and 2018) and their parents was probability sampling of public and private elementary schools within the catchment areas of the 21 research sites, encompassing over 20% of the entire US population of 9–10 year olds. School selection was based on gender, race and ethnicity, socioeconomic status, and urbanicity. Inclusion criteria were age and attending a public or private elementary school in the catchment area. Exclusion criteria for children were limited to not being fluent in English, having a parent not fluent in English or Spanish, major medical or neurological conditions, gestational age <28 weeks or birthweight <1200 g, contraindications to MRI scanning, a history of traumatic brain injury, a current diagnosis of schizophrenia, moderate/severe autism spectrum disorder, intellectual disability, or alcohol/substance use disorder56,57. The cohort’s representation of diverse demographic and socio-economic groups was monitored through the National Center for Education Statistics databases, containing socio-demographic characteristics of the students attending each school, to enable dynamic adjustment of the accumulating sample based on demographic targets throughout recruitment. The final sample who completed the baseline assessment approached the diversity of the US population on several socio-demographic characteristics, despite not being nationally representative58: 51% of families were White, 21.4% were Hispanic, 15.2% were African American, 2.3% were Asian, and 10.01% were multiracial or from other ethnical backgrounds; household income was <$50,000 for 30.5% of families, between $50,000 and <$100,000 for 28.1% of families, and at least $100,000 for 41.3% of families; 58.9% of children had at least one parent with a bachelor’s or postgraduate degree; 73.3% parents were married or living in the same household. No weights were applied in the current study. The sample also includes twins recruited from four sites as well as a number of siblings from the same family. However, the present study is based on 9987 unrelated children (randomly selecting one child per family when more than one participated; mean age = 9.90, SD = 0.62; 47.74% females) and 9987 parents (one per child; mean age = 39.94, SD = 6.93; 89.03% females) from the Baseline ABCD 2.0 data release (NDAR-https://doi.org/10.15154/1503209). All procedures were approved by a central Institutional Review Board (IRB) at the University of California, San Diego, and in some cases by individual site IRBs (e.g. Washington University in St. Louis)59. Parents or guardians provided written informed consent after the procedures had been fully explained and children assented before participation in the study60.

Measures

Full details on measures are presented in Supplementary Method 1. Children and parents completed assessments during an in-person visit. Psychopathology was examined in the children with the parent-reported Child Behavior Checklist (CBCL)15 and in the adults with the Adult Self-Report (ASR)16 from ASEBA, which assess problems occurring in the past 6 months on a 3-point scale.

For validation, we aimed to select a limited number of validators among those available in the ABCD dataset, based on the two criteria: (1) measures on key, clinically relevant domains, which have commonly been used for validation purposes in previous studies of the structure of psychopathology11,13,18,55,61: risk factors, real-world functioning, cognitive functioning, and service utilization; (2) measures that were maximally comprehensive and non-overlapping with each other. Validation analyses therefore focused on the following ten measures: history of developmental motor and speech delays52, conflict within the family62, social (number of friends) and academic functioning (school connectedness, average grades)63, crystalized and fluid intelligence composites from the National Institute of Health Toolbox53, utilization of physical and mental health services, and medication use52.

Statistical analysis

To investigate the hierarchical structure of psychopathology, we employed an exploratory approach, given uncertainties regarding the number of dimensions and the composition of the levels of the hierarchy. Specifically, we used exploratory factor analysis (EFA) to empirically extract (with principal component analysis) and rotate (with geomin) factor solutions with an increasing number of factors. We favored an exploratory approach over a confirmatory factor analytic approach as we did not have a-priori hypotheses about the number of factors that would emerge from these data, nor on the exact loading of each item on the factors. To avoid distorting the factor structure in EFA with items that were not analyzable due to being endorsed too infrequently or too-highly correlated with other items, we removed items for which frequency was too low (>99.5% rated 0) and aggregated items that were highly correlated (polychoric r > 0.75) into composites (see Supplementary Method 1). The maximum number of factors to extract was determined with parallel analyses64 (extraction was stopped when eigenvalues fell within the 95% confidence interval of eigenvalues from simulated data; Supplementary Fig. 1). Since parallel analysis has a tendency to over-factor, we also examined the interpretability of factor solutions65,66, defined as presence of >3 clear primary loadings (highest loading ≥0.35 and at least 0.10 greater than all other loadings) for each factor65,66. All factor structures from one to the maximum number of factors were considered. To map the hierarchical structure, we correlated factor scores on adjacent levels of the hierarchy to describe transitions between levels using Goldberg’s bass-ackwards hierarchical method43. The paths between levels in the hierarchical model reflect correlations ≥0.65 between the factor scores. The bass-ackwards approach was chosen to be consistent with previous studies that investigated the hierarchical structure of psychopathology and personality22,23,44,45,46,67,68, and because, to our knowledge, it is the only method that allows for the delineation of multiple hierarchical levels from factors derived through EFA. Unlike alternative approaches based on bifactor models for extracting a general psychopathology factor (or p-factor) alongside residual specific factors11,34,36,55, the bass-ackwards method enables the investigation of multiple levels of a hierarchical structure and the interpretation of factors as interconnected across hierarchical levels, without statistically removing the shared effects of a general factor. In order to take sex into consideration, we further compared factor scores from each hierarchical level in females and males separately in both the child and parent sample.

To compare the utility of the factor solutions, in validation analyses, we first examined the degree of familial aggregation of the dimensions by correlating the factor scores derived for each dimension in parents and children, using both zero-order correlations and partial correlations controlling for the first general psychopathology factors in both parents and children. To examine the familial aggregation due to shared genetic and environmental factors between parent and child, 473 non-biological parent–child pairs were excluded from this analysis (245 adoptive parents, 99 custodial parents, 129 other non-biological parents). Second, we entered the factor scores from each level of the childhood hierarchy as separate blocks into a hierarchical regression model, with each of the validators as the dependent variable. We examined the predictive power and the incremental validity of each level of the hierarchy over more parsimonious structures with the significance of R2 change between blocks67. We used this stringent test, rather than comparing levels in pairs, to ensure that a significant result for models with more factors reflects new information not captured by simpler factor solutions. All analyses were run in Mplus version 7 (Muthén and Muthén, Los Angeles, CA) and SPSS version 25 (IBM Corp, Armonk, NY).

Results

Hierarchical factor structure of CBCL and ASR

CBCL

Parallel analyses indicated that up to 16 factors could be extracted from CBCL items (Supplementary Fig. 1). After examining the interpretability of these factor solutions, 1- to 5-factor solutions were found to be acceptable (Table 1, Supplementary Table 1). Solutions with more than five factors were not tenable as each included at least one factor with only three or fewer primary loadings (Supplementary Table 1).

Table 1 Factor loadings (top) and factor correlations (bottom) for the 5-factor solution from the exploratory factor analysis of CBCL items

All models from 1-factor to 5-factor were interpretable and are represented as a hierarchical structure (Fig. 1), with paths showing correlations between levels. The 1-factor structure reflected a general childhood psychopathology p-factor5,14. The 2-factor solution revealed the expected broad internalizing and broad externalizing factors15,19,68. In the 3-factor structure, a neurodevelopmental factor (e.g. inattention, hyperactivity, daydreaming, clumsiness) emerged from the broad internalizing and externalizing factors. In the 4-factor solution, somatoform problems emerged from the broad internalizing factor. In the 5-factor structure, the remaining broad internalizing factor split into narrower internalizing problems (e.g. anxiety, depressive symptoms) and detachment (e.g. social withdrawal). Factors in the final 5-factor solution showed small-to-large correlations with one another (r = 0.25−0.59) (Table 1). Comparisons of factor scores across boys and girls indicated small but highly significant (all p ≤ 0.001) sex differences on all dimensions, except broad internalizing in the 2-, 3-, and 4-factor solutions (Supplementary Table 2). Boys showed slightly higher psychopathology on the p-factor, as well as externalizing, neurodevelopmental, and detachment factors in the 5-factor solution, while girls had slightly higher scores on internalizing and somatoform factors.

Fig. 1: Hierarchical models from CBCL items (top half) and ASR items (bottom half) illustrating hierarchies of child and adult psychopathology.
figure1

CBCL Childhood Behavior Checklist, ASR Adult Self Report

ASR

Parallel analyses indicated that up to 17 factors could be extracted from ASR items (Supplementary Fig. 1). The 5-factor solution was the most differentiated interpretable structure (Table 2, Supplementary Table 3), as factor solutions with more factors could not be interpreted. For example, the last factor in the 6- and 8-factor models included only two-to-three primary loadings, thus indicating no other meaningful factors beyond five (Supplementary Table 3).

Table 2 Factor loading (top) and factor correlations (bottom) for the 5-factor solution from the exploratory factor analysis on ASR items

All models from 1-factor to 5-factor are represented in Fig. 1. The 1-factor structure reflected p-factor11. The 2-factor solution showed the broad internalizing and externalizing factors17. In the 3-factor structure, a factor encompassing inattentive neurodevelopmental problems (e.g. inattention, poor planning) emerged from the broad internalizing and externalizing factors. In the 4-factor solution, the broad internalizing factor split into separate internalizing and somatoform dimensions. In the 5-factor structure, rule-breaking behaviors from the broad externalizing factor joined detachment/oddity problems from the broad internalizing factor to form a social maladjustment factor, leaving distinct antagonism and narrower internalizing dimensions. Factors in the final 5-factor solution showed small-to-large correlations with one another (r = 0.19−0.50) (Table 2). Comparisons of factor scores across women and men indicated small but highly significant (all p ≤ 0.001) sex differences on all but the inattentive neurodevelopmental factor in the 3-, 4-, and 5-factor solutions (Supplementary Table 2). Women scored higher than men on the p-factor, as well as on the internalizing, somatoform factors in the 5-factor solution, while men showed higher scores on the social maladjustment and antagonism factors.

Validation analyses

Familial aggregation

Zero-order correlations between the child and adult factor scores from the 5-factor solutions ranged between r = 0.20−0.48 (p < 0.001, two-tailed) (Table 3). The correlation between child and parent p-factor scores was r = 0.61 (p < 0.001, two-tailed). This pattern suggested substantial familial aggregation of a dimension of general psychopathology, explaining co-occurrence across psychopathology dimensions. Controlling for these two p-factors revealed a more specific pattern of familial aggregation between corresponding parent and child dimensions (i.e. convergent correlations). Convergent partial correlations ranged between r = 0.09−0.21 (p < 0.001, two-tailed) and were significantly larger than all partial correlations between non-corresponding factors (i.e. discriminant correlations), based on Fisher’s z tests (Table 3).

Table 3 Zero-order (top half) and partial correlations (bottom half) between the dimensions in the 5-factor structures from CBCL and ASR items, controlling for childhood and adult p-factors

Validity of childhood hierarchical structure

The 1-factor solution was significantly associated with all validators (Fig. 2, Supplementary Table 4). The p-factor alone explained 23.02% of the variance in utilization of mental health services, and the addition of more differentiated factors, although statistically significant, produced minimal improvement in R2 (up to 24.41%). For medication use, medical history, family conflict, and school connectedness, the p-factor alone explained 2.30–4.00% of the variance, and the addition of more complex factor structures provided a moderate increase, contributing up to 3.33–6.16% of variance. The 1-factor model accounted for a relatively small proportion of the variance compared to the more complex factor solutions for fluid intelligence (from 1.79% for p-factor to 7.24% total), crystalized intelligence (0.58% to 7.02%), average grades (6.72% to 19.34%), number of friends (0.08% to 2.67%), and history of developmental delays (0.63% to 3.05%).

Fig. 2: Cumulative explanatory power (R2) for a given factor structure (1- to 5-factor solutions) derived from CBCL data to predict validators.
figure2

Nagelkerke R2 is plotted for binary outcomes (mental health service utilization, medical history, medication history). Asterisks indicate significant change in R2 for that structure versus all simpler structures combined (*p < 0.05, **p < 0.01, ***p < 0.001, two-tailed). CBCL Childhood Behavior Checklist

In the 5-factor solution, utilization of mental health services showed the highest but generally non-specific correlations with psychopathology dimensions (r = 0.28–0.46) (Supplementary Table 4). The strongest association for medical history was with the somatoform factor (r = 0.26). Medication use was associated to the same extent with the neurodevelopmental and somatoform factors (both r = 0.22). Crystalized intelligence and school connectedness were associated to a similar extent with the externalizing (r = −0.12), neurodevelopmental, and detachment factors (both r = −0.11). The highest correlation for family conflict was with the externalizing factor (r = 0.19). Fluid intelligence and average grades showed the highest correlations with the neurodevelopmental factor (r = −0.18 and r = −0.33, respectively). Developmental delays were mostly associated with the detachment and neurodevelopmental factors (r = 0.14 and r = 0.10, respectively), while number of friends were mostly associated with detachment (r = −0.13).

Discussion

This study provides the most comprehensive examination of the hierarchy of psychopathology spectra to date—analyzing a wide range of symptoms and maladaptive behaviors, systematically explicating it across multiple hierarchical levels, considering both children and adults, and validating the structure against various clinically relevant measures. In children, we found five spectra at the lowest level of the hierarchy: internalizing, somatoform, detachment, externalizing, and neurodevelopmental. In adults, we observed similar dimensions: internalizing, somatoform, social maladjustment, inattentive neurodevelopmental, and antagonism. We further found substantial familiality of the identified psychopathology factors, largely explained by familial aggregation of the p-factor. Yet, the five childhood dimensions also showed specific links to the corresponding parental dimensions. The p-factor was sufficient to account for some clinical validators (e.g., service utilization), but all five dimensions were needed to explain other validators, such as developmental delays, and social, cognitive, and academic functioning. These findings support the value of explicating multiple higher-order dimensions of psychopathology. They further suggest that the neurodevelopmental spectrum should be considered for inclusion in dimensional models of both childhood and adult psychopathology. Overall, the identified hierarchy depicts robust and informative dimensional phenotypes for the ABCD study baseline assessment, paving the way for future research on this cohort.

In both children and adults, we observed that the p-factor at the top of the hierarchy separates into broad internalizing and broad externalizing spectra. These dimensions mirror the higher-order dimensions first identified by Achenbach and colleagues32. At lower hierarchical levels, the broad internalizing dimension differentiated into internalizing, detachment, and somatoform factors in children. The broad externalizing factor differentiated into narrower externalizing and neurodevelopmental factors in children (the latter originating from both broad externalizing and internalizing). The narrow externalizing factor included aggressive and rule-breaking behaviors, whereas the neurodevelopmental factor encompassed inattention, hyperactivity, and related problems (e.g. clumsiness, daydreaming, obsessions). In adults, instead of detachment as a distinct factor, we found a broader social maladjustment factor encompassing both detachment and antisocial behavior (from the externalizing factor). The differentiation of the externalizing spectrum in adults narrowed to one of its core components, antagonism, which emerged separately from the social maladjustment and inattentive neurodevelopmental factors (both partly originating from the broad internalizing spectrum). This is in line with research showing a separation of antagonism from other externalizing and neurodevelopmental dimensions8,69,70. All observed dimensions are consistent with prior studies, which have identified these factors among major dimensions of psychopathology8,25,32,71. Overall, similar but not identical dimensions were delineated in children and parents, which does not support the hypothesis that psychopathology becomes more differentiated with age14,47.

Our findings are largely consistent with the HiTOP model7,8,72, in that internalizing, antagonism, somatoform, and detachment dimensions were identified in children and/or adults. The adult social maladjustment dimension identified here has the HiTOP detachment spectrum at its core, along with additional content relating to antisocial behavior and a few symptoms of thought disorder (e.g. hallucinations). A thought disorder spectrum was not found either in adults or in children, likely because of the limited number of psychosis symptoms included in the CBCL and ASR, the very low scores on these symptoms in this population-based sample, and the exclusion of children with a diagnosis of schizophrenia based on ABCD recruitment procedures. We observed an additional factor in children that is currently not included in the HiTOP model: a neurodevelopmental dimension that includes inattention, hyperactivity, clumsiness, autistic-like traits, and atypical ideation (e.g. obsessions). Many of the symptoms included in this dimension have previously been proposed to be part of a neurodevelopmental spectrum26 and are consistent with initial factor analytic evidence in children27,28,49. Our results indicate that inattentive and hyperactive symptoms (common in attention-deficit/hyperactivity disorder (ADHD)) also belong to this spectrum, despite previous studies that included ADHD as part of the externalizing spectrum29,31. One explanation for this finding is that many previous EFA studies placing ADHD under the externalizing spectrum examined scale total scores or diagnoses, rather than individual symptoms, and did not include other neurodevelopmental problems—thereby not allowing the delineation of a separate dimension. The emergence of a similar, though narrower, inattentive neurodevelopmental factor in adults is novel, as most previous structural studies of adults have not considered enough attention or neurodevelopmental problems to allow the delineation of this dimension. This finding provides the strongest evidence to date for the inclusion of the neurodevelopmental spectrum in dimensional models of psychopathology. More generally, these findings delineating dimensions of psychopathology both in children and in adults in one of the largest samples available to date represent an important contribution to ongoing efforts seeking to understand the hierarchical structure of psychopathology. Future studies on this cohort and other samples may employ alternative analytic approaches (e.g. bifactor models)11,34,36,55 and instruments (e.g. diagnostic interviews) to examine the reproducibility of the identified dimensions and further advance knowledge of the structure of psychopathology.

By mapping multiple hierarchical levels, we showed that the familial aggregation of psychopathological dimensions in parents and children is largely accounted for by familial influences on the p-factor. This is consistent with the established pleiotropy in the genetic vulnerability to psychopathology19,73,74 and prior evidence of substantial heritability of the p-factor5. In children, the p-factor also accounted for the majority of psychopathology-related variance in several validators, especially utilization of mental health services, which underscores the value of this general dimension for public health and planning of clinical services. However, more specific dimensions also proved to be informative. Familial aggregation between specific dimensions remained significant, albeit reduced, when controlling for child and parent p-factors, and all levels of the hierarchy showed incremental validity, with five dimensions necessary to maximize the explanatory power of psychopathology for most criteria. This supports the importance of examining multiple levels of the psychopathology hierarchy, and is consistent with the view that fine-grained understanding of psychopathology is necessary to fully explicate its etiology75,76 and identify maximally effective treatment77. Further, different dimensions were most important for different validators. For example, the neurodevelopmental dimension had particularly strong links to intelligence and academic achievement, consistent with previous evidence78,79, and the externalizing factor with family conflict, as expected54. These results confirm previous studies showing that both a general factor and specific dimensions are necessary for characterizing youth psychopathology19, school grades, school and neighborhood deprivation14, and executive functioning27. They are inconsistent with studies linking cognitive abilities primarily to the p-factor11,55, potentially because these studies did not model the neurodevelopmental dimension, the strongest correlate of fluid intelligence in this study.

The present study had the following limitations. First, it was limited to one assessment system, thus generalizability of the findings needs to be tested with other measures. Nevertheless, the hierarchy is largely consistent with previous studies using different measures21,23,44,69, suggesting at least partial generalizability. Second, the same parent completed both the CBCL about the child and the ASR about themselves, which may have inflated the similarity between childhood and adult psychopathology structures due to rater biases. In addition, most of the ASR data were provided by mothers or female guardians, therefore the results in the adult sample may not generalize to both sexes. Although these limitation are common to much of the existing literature on parent and offspring psychopathology when children are too young to provide comprehensive self-reports, and a number of our validators were objective (e.g. cognitive testing) or child self-report (e.g. number of friends) measures, future research should replicate the current results with child self-reports and additional co-informant reports. Third, only one time point was included, as longitudinal data were not yet available from the ABCD study at the time of writing. Future waves of data in this unique sample will provide the unprecedented opportunity to examine the hierarchy of psychopathology over the course of development and the predictive validity of childhood factors on a variety of adolescent and young adult outcomes.

In conclusion, the present results clarify the hierarchy of psychopathology dimensions in children and adults using data from one of the largest initiatives to study youth development and psychopathology to date. The study replicates higher-order dimensions identified previously8, and suggests the addition of the neurodevelopmental spectrum to dimensional models of psychopathology. The identified higher-order dimensions represent valid constructs able to explain various clinically relevant risk factors and outcomes, such as developmental delays and academic achievement. Our investigation further provides a guide for future research to use these higher-order psychopathology dimensions in the ABCD sample. New data releases will allow researchers to apply the identified hierarchy to additional clinical, functional, and neuroimaging measures to study psychopathological dimensions during adolescent development.

References

  1. 1.

    American Psychiatric Assocation. Diagnostic and Statistical Manual of Mental Disorders, 5th edn (American Psychiatric Publishing, Arlington, VA, 2013).

  2. 2.

    World Health Organization. The ICD-10 Classification of Mental And Behavioural Disorders: Diagnostic Criteria for Research, 10th edn (World Health Organization, Geneva, 1992).

  3. 3.

    Plomin, R., Haworth, C. M. & Davis, O. S. Common disorders are quantitative traits. Nat. Rev. Genet. 10, 872–878 (2009).

  4. 4.

    Insel, T. et al. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167, 748–751 (2010).

  5. 5.

    Caspi, A. & Moffitt, T. E. All for one and one for all: mental disorders in one dimension. Am. J. Psychiatry 175, 831–844 (2018).

  6. 6.

    Nock, M. K., Hwang, I., Sampson, N. A. & Kessler, R. C. Mental disorders, comorbidity and suicidal behavior: results from the National Comorbidity Survey Replication. Mol. Psychiatry 15, 868–876 (2010).

  7. 7.

    Krueger, R. F. et al. Progress in achieving quantitative classification of psychopathology. World Psychiatry 17, 282–293 (2018).

  8. 8.

    Kotov, R. et al. The Hierarchical Taxonomy of Psychopathology (HiTOP): a dimensional alternative to traditional nosologies. J. Abnorm. Psychol. 126, 454–477 (2017).

  9. 9.

    Hoertel, N. et al. Mental disorders and risk of suicide attempt: a national prospective study. Mol. Psychiatry 20, 718–726 (2015).

  10. 10.

    Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D. & Zald, D. H. A hierarchical causal taxonomy of psychopathology across the life span. Psychol. Bull. 143, 142–186 (2017).

  11. 11.

    Caspi, A. et al. The p factor: one general psychopathology factor in the structure of psychiatric disorders? Clin. Psychol. Sci. 2, 119–137 (2014).

  12. 12.

    Lahey, B. B. et al. Is there a general factor of prevalent psychopathology during adulthood? J. Abnorm. Psychol. 121, 971–977 (2012).

  13. 13.

    Martel, M. M. et al. A general psychopathology factor (P factor) in children: Structural model analysis and external validation through familial risk and child global executive function. J. Abnorm. Psychol. 126, 137–148 (2017).

  14. 14.

    Patalay, P. et al. A general psychopathology factor in early adolescence. Br. J. Psychiatry 207, 15–22 (2015).

  15. 15.

    Achenbach, T. M. & Rescorla, L. A. Manual for the ASEBA School-Age Forms & Profiles (University of Vermont, Research Center for Children, Youth, and Families, Burlington, VT, 2001).

  16. 16.

    Achenbach, T. M. & Rescorla, L. A. Manual for the ASEBA Adult Forms & Profiles (University of Vermont, Research Center for Children, Youth, and Families, Burlington, VT, 2003).

  17. 17.

    Krueger, R. F. The structure of common mental disorders. Arch. Gen. Psychiatry 56, 921–926 (1999).

  18. 18.

    Farmer, R. F., Seeley, J. R., Kosty, D. B., Olino, T. M. & Lewinsohn, P. M. Hierarchical organization of axis I psychiatric disorder comorbidity through age 30. Compr. Psychiatry 54, 523–532 (2013).

  19. 19.

    Waldman, I. D., Poore, H. E., van Hulle, C., Rathouz, P. J. & Lahey, B. B. External validity of a hierarchical dimensional model of child and adolescent psychopathology: tests using confirmatory factor analyses and multivariate behavior genetic analyses. J. Abnorm. Psychol. 125, 1053–1066 (2016).

  20. 20.

    King, S. M., Iacono, W. G. & McGue, M. Childhood externalizing and internalizing psychopathology in the prediction of early substance use. Addiction 99, 1548–1559 (2004).

  21. 21.

    Kotov, R. et al. New dimensions in the quantitative classification of mental illness. Arch. Gen. Psychiatry 68, 1003–1011 (2011).

  22. 22.

    Kim, H. & Eaton, N. R. The hierarchical structure of common mental disorders: connecting multiple levels of comorbidity, bifactor models, and predictive validity. J. Abnorm. Psychol. 124, 1064–1078 (2015).

  23. 23.

    Wright, A. G. et al. The hierarchical structure of DSM-5 pathological personality traits. J. Abnorm. Psychol. 121, 951–957 (2012).

  24. 24.

    Blanco, C. et al. Mapping common psychiatric disorders: structure and predictive validity in the national epidemiologic survey on alcohol and related conditions. JAMA Psychiatry 70, 199–208 (2013).

  25. 25.

    Roysamb, E. et al. The joint structure of DSM-IV Axis I and Axis II disorders. J. Abnorm. Psychol. 120, 198–209 (2011).

  26. 26.

    Andrews, G., Pine, D. S., Hobbs, M. J., Anderson, T. M. & Sunderland, M. Neurodevelopmental disorders: cluster 2 of the proposed meta-structure for DSM-V and ICD-11. Psychol. Med. 39, 2013–2023 (2009).

  27. 27.

    Bloemen, A. J. P. et al. The association between executive functioning and psychopathology: general or specific? Psychol. Med. 48, 1787–1794 (2018).

  28. 28.

    Noordhof, A., Krueger, R. F., Ormel, J., Oldehinkel, A. J. & Hartman, C. A. Integrating autism-related symptoms into the dimensional internalizing and externalizing model of psychopathology. The TRAILS Study. J. Abnorm. Child Psychol. 43, 577–587 (2015).

  29. 29.

    Carragher, N. et al. ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Soc. Psychiatry Psychiatr. Epidemiol. 49, 1307–1317 (2014).

  30. 30.

    Tackett, J. L. et al. Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. J. Abnorm. Psychol. 122, 1142–1153 (2013).

  31. 31.

    Blanco, C. et al. The space of common psychiatric disorders in adolescents: comorbidity structure and individual latent liabilities. J. Am. Acad. Child Adolesc. Psychiatry 54, 45–52 (2015).

  32. 32.

    Achenbach, T. M. The classification of children’s psychiatric symptoms: a factor-analytic study. Psychol. Monogr. 80, 1–37 (1966).

  33. 33.

    Slobodskaya, H. R. The contribution of reinforcement sensitivity to the personality-psychopathology hierarchical structure in childhood and adolescence. J. Abnorm. Psychol. 125, 1067–1078 (2016).

  34. 34.

    Lahey, B. B. et al. Measuring the hierarchical general factor model of psychopathology in young adults. Int. J. Methods Psychiatr. Res. 27, e1593 (2018).

  35. 35.

    Snyder, H. R., Young, J. F. & Hankin, B. L. Strong homotypic continuity in common psychopathology-, internalizing-, and externalizing-specific factors over time in adolescents. Clin. Psychol. Sci. 5, 98–110 (2017).

  36. 36.

    Haltigan, J. D. et al. “P” and “DP:” examining symptom-level bifactor models of psychopathology and dysregulation in clinically referred children and adolescents. J. Am. Acad. Child Adolesc. Psychiatry 57, 384–396 (2018).

  37. 37.

    Ghirardi, L. et al. The familial co-aggregation of ASD and ADHD: a register-based cohort study. Mol. Psychiatry 23, 257–262 (2017).

  38. 38.

    Cheung, C. H., Frazier-Wood, A. C., Asherson, P., Rijsdijk, F. & Kuntsi, J. Shared cognitive impairments and aetiology in ADHD symptoms and reading difficulties. PLoS ONE 9, e98590 (2014).

  39. 39.

    Franke, B. et al. Live fast, die young? A review on the developmental trajectories of ADHD across the lifespan. Eur. Neuropsychopharmacol. 28, 1059–1088 (2018).

  40. 40.

    Kuntsi, J. et al. Co-occurrence of ADHD and low IQ has genetic origins. Am. J. Med. Genet. B Neuropsychiatr. Genet. 124B, 41–47 (2004).

  41. 41.

    Pinto, R., Rijsdijk, F., Ronald, A., Asherson, P. & Kuntsi, J. The genetic overlap of attention-deficit/hyperactivity disorder and autistic-like traits: an investigation of individual symptom scales and cognitive markers. J. Abnorm. Child Psychol. 44, 335–345 (2016).

  42. 42.

    Asherson, P., Buitelaar, J., Faraone, S. V. & Rohde, L. A. Adult attention-deficit hyperactivity disorder: key conceptual issues. Lancet Psychiatry 3, 568–578 (2016).

  43. 43.

    Goldberg, L. R. Doing it all bass-ackwards: the development of hierarchical factor structures from the top down. J. Res. Pers. 40, 347–358 (2006).

  44. 44.

    Forbes, M. K. et al. Delineating the joint hierarchical structure of clinical and personality disorders in an outpatient psychiatric sample. Compr. Psychiatry 79, 19–30 (2017).

  45. 45.

    Morey, L. C., Krueger, R. F. & Skodol, A. E. The hierarchical structure of clinician ratings of proposed DSM-5 pathological personality traits. J. Abnorm. Psychol. 122, 836–841 (2013).

  46. 46.

    Tackett, J. L., Quilty, L. C., Sellbom, M., Rector, N. A. & Bagby, R. M. Additional evidence for a quantitative hierarchical model of mood and anxiety disorders for DSM-V: the context of personality structure. J. Abnorm. Psychol. 117, 812–825 (2008).

  47. 47.

    McElroy, E., Belsky, J., Carragher, N., Fearon, P. & Patalay, P. Developmental stability of general and specific factors of psychopathology from early childhood to adolescence: dynamic mutualism or p-differentiation? J. Child Psychol. Psychiatry 59, 667–675 (2018).

  48. 48.

    Andrews, G. et al. Exploring the feasibility of a meta-structure for DSM-V and ICD-11: could it improve utility and validity? Psychol. Med. 39, 1993–2000 (2009).

  49. 49.

    Pettersson, E., Lahey, B. B., Larsson, H. & Lichtenstein, P. Criterion validity and utility of the general factor of psychopathology in childhood: predictive associations with independently measured severe adverse mental health outcomes in adolescence. J. Am. Acad. Child Adolesc. Psychiatry 57, 372–383 (2018).

  50. 50.

    Ormel, J. et al. Functional outcomes of child and adolescent mental disorders. Current disorder most important but psychiatric history matters as well. Psychol. Med. 47, 1271–1282 (2017).

  51. 51.

    Garavan, H. et al. Recruiting the ABCD sample: design considerations and procedures. Dev. Cogn. Neurosci. 32, 16–22 (2018).

  52. 52.

    Barch, D. M. et al. Demographic, physical and mental health assessments in the adolescent brain and cognitive development study: rationale and description. Dev. Cogn. Neurosci. 32, 55–66 (2018).

  53. 53.

    Luciana, M. et al. Adolescent neurocognitive development and impacts of substance use: overview of the adolescent brain cognitive development (ABCD) baseline neurocognition battery. Dev. Cogn. Neurosci. 32, 67–79 (2018).

  54. 54.

    Jarnecke, A. M. et al. The role of parental marital discord in the etiology of externalizing problems during childhood and adolescence. Dev. Psychopathol. 29, 1177–1188 (2017).

  55. 55.

    Lahey, B. B. et al. Criterion validity of the general factor of psychopathology in a prospective study of girls. J. Child Psychol. Psychiatry 56, 415–422 (2015).

  56. 56.

    Karcher, N. R., O’Brien, K. J., Kandala, S. & Barch, D. M. Resting-state functional connectivity and psychotic-like experiences in childhood: results from the adolescent brain cognitive development study. Biol. Psychiatry 86, 7–15 (2019).

  57. 57.

    Thompson, W. K. et al. The structure of cognition in 9 and 10 year-old children and associations with problem behaviors: findings from the ABCD study’s baseline neurocognitive battery. Dev. Cogn. Neurosci. 36, 100606 (2019).

  58. 58.

    Compton, W. M., Dowling, G.J. & Garavan, H. Ensuring the best use of data: the Adolescent Brain Cognitive Development Study. JAMA Pediatr. Epub ahead of print (2019).

  59. 59.

    Auchter, A. M. et al. A description of the ABCD organizational structure and communication framework. Dev. Cogn. Neurosci. 32, 8–15 (2018).

  60. 60.

    Clark, D. B. et al. Biomedical ethics and clinical oversight in multisite observational neuroimaging studies with children and adolescents: the ABCD experience. Dev. Cogn. Neurosci. 32, 143–154 (2018).

  61. 61.

    Loney, J., Carlson, G. A., Salisbury, H. & Volpe, R. J. Validation of three dimensions of childhood psychopathology in young clinic-referred boys. J. Atten. Disord. 8, 169–181 (2005).

  62. 62.

    Moos, R. H. Conceptual and empirical approaches to developing family-based assessment procedures: resolving the case of the Family Environment Scale. Fam. Process 29, 199–208 (1990).

  63. 63.

    Zucker, R. A. et al. Assessment of culture and environment in the Adolescent Brain and Cognitive Development Study: Rationale, description of measures, and early data. Dev. Cogn. Neurosci. 32, 107–120 (2018).

  64. 64.

    Floyd, F. J. & Widaman, K. F. Factor analysis in the development and refinement of clinical assessment instruments. Psychol. Assess. 7, 286 (1995).

  65. 65.

    Fabrigar, L. R., Wegener, D. T., MacCallum, R. C. & Strahan, E. J. Evaluating the use of exploratory factor analysis in psychological research. Psychol. Methods 4, 272–299 (1999).

  66. 66.

    Velicer, W. F. & Fava, J. L. Affects of variable and subject sampling on factor pattern recovery. Psychol. Methods 3, 231 (1998).

  67. 67.

    Kotov, R. et al. Validating dimensions of psychosis symptomatology: neural correlates and 20-year outcomes. J. Abnorm. Psychol. 125, 1103–1119 (2016).

  68. 68.

    Markon, K. E., Krueger, R. F. & Watson, D. Delineating the structure of normal and abnormal personality: an integrative hierarchical approach. J. Pers. Soc. Psychol. 88, 139–157 (2005).

  69. 69.

    Wright, A. G. & Simms, L. J. A metastructural model of mental disorders and pathological personality traits. Psychol. Med. 45, 2309–2319 (2015).

  70. 70.

    Patrick, C. J., Kramer, M. D., Krueger, R. F. & Markon, K. E. Optimizing efficiency of psychopathology assessment through quantitative modeling: development of a brief form of the Externalizing Spectrum Inventory. Psychol. Assess. 25, 1332–1348 (2013).

  71. 71.

    Markon, K. E. Modeling psychopathology structure: a symptom-level analysis of Axis I and II disorders. Psychol. Med. 40, 273–288 (2010).

  72. 72.

    Kotov, R., Krueger, R. F. & Watson, D. A paradigm shift in psychiatric classification: the Hierarchical Taxonomy of Psychopathology (HiTOP). World Psychiatry 17, 24–25 (2018).

  73. 73.

    Michelini, G., Eley, T. C., Gregory, A. M. & McAdams, T. A. Aetiological overlap between anxiety and attention deficit hyperactivity symptom dimensions in adolescence. J. Child Psychol. Psychiatry 56, 423–431 (2015).

  74. 74.

    Stringaris, A., Zavos, H., Leibenluft, E., Maughan, B. & Eley, T. C. Adolescent irritability: phenotypic associations and genetic links with depressed mood. Am. J. Psychiatry 169, 47–54 (2012).

  75. 75.

    Pettersson, E., Larsson, H. & Lichtenstein, P. Common psychiatric disorders share the same genetic origin: a multivariate sibling study of the Swedish population. Mol. Psychiatry 21, 717–721 (2016).

  76. 76.

    Waszczuk, M. A., Zavos, H. M., Gregory, A. M. & Eley, T. C. The phenotypic and genetic structure of depression and anxiety disorder symptoms in childhood, adolescence, and young adulthood. JAMA Psychiatry 71, 905–916 (2014).

  77. 77.

    Gershon, S., Chengappa, K. N. & Malhi, G. S. Lithium specificity in bipolar illness: a classic agent for the classic disorder. Bipolar Disord. 11, 34–44 (2009).

  78. 78.

    Michelini, G. et al. The etiological structure of cognitive-neurophysiological impairments in ADHD in adolescence and young adulthood. J. Atten. Disord. 1087054718771191 (2018).

  79. 79.

    Kim, S. H., Bal, V. H. & Lord, C. Longitudinal follow-up of academic achievement in children with autism from age 2 to 18. J. Child Psychol. Psychiatry 59, 258–267 (2018).

Download references

Acknowledgements

Drs. Michelini and Kotov are funded by National Institute of Mental Health (NIMH) award number MH117116. Data used in the preparation of this article were obtained from the Adolescent Brain Cognitive Development (ABCD) Study (https://abcdstudy.org), held in the NIMH Data Archive (NDA). The ABCD Study is supported by the National Institutes of Health (NIH) and additional federal partners under award numbers U01DA041022, U01DA041025, U01DA041028, U01DA041048, U01DA041089, U01DA041093, U01DA041106, U01DA041117, U01DA041120, U01DA041134, U01DA041148, U01DA041156, U01DA041174, U24DA041123, and U24DA041147. A full list of federal partners is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/principal-investigators.html. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in analysis or writing of this report. The authors would like to thank Avshalom Caspi, PhD (Duke University; King’s College London) and Terrie Moffitt, PhD (Duke University; King’s College London) for their helpful comments on an earlier draft of this manuscript.

Author information

Correspondence to Giorgia Michelini.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Michelini, G., Barch, D.M., Tian, Y. et al. Delineating and validating higher-order dimensions of psychopathology in the Adolescent Brain Cognitive Development (ABCD) study. Transl Psychiatry 9, 261 (2019) doi:10.1038/s41398-019-0593-4

Download citation