Abstract
Adverse childhood experiences are linked to poor attentive behaviors during adolescence, as well as increased risk for mental health disorders in adults. However, no study has yet tested targeted interventions to optimize neurocognitive processes in this population. Here, we investigated closed-loop digital interventions in a double-blind randomized controlled study in adolescents with childhood neglect, and evaluated the outcomes using multimodal assessments of neuroimaging, cognitive, behavioral, and academic evaluations. In the primary neuroimaging results, we demonstrate that a closed-loop digital meditation intervention can strengthen functional connectivity of the dorsal anterior cingulate cortex (dACC) in the cingulo-opercular network, which is critically developing during the adolescent period. Second, this intervention enhanced sustained attention and interference-resolution abilities, and also reduced behavioral hyperactivity at a 1-year follow-up. Superior academic performance was additionally observed in adolescents who underwent the digital meditation intervention. Finally, changes in dACC functional connectivity significantly correlated with improvements in sustained attention, hyperactivity, and academic performance. This first study demonstrates that closed-loop digital meditation practice can facilitate development of important aspects of neurocognition and real-life behaviors in adolescents with early childhood neglect.
Similar content being viewed by others
Introduction
Early childhood adversity is associated with a sequelae of cognitive deficits1,2,3. More recent research demonstrates that adversity specifically in the form of neglect, but not abuse, is related to cognitive dysfunction4,5,6. During the adolescent years, such adverse experiences even manifest as attention-deficit hyperactivity disorder (ADHD)7,8.
Indeed, adolescence is a critical time for the development of functional brain networks that control attention and related cognition9,10. Two important cognitive networks, the cingulo-opercular network and the frontoparietal network, implicated in sustained attentional control vs. moment-to-moment flexible control, are developing during this time11,12,13,14. Adolescence typically marks the time period for segregation of these networks. In this context, the dorsal anterior cingulate (dACC) has been evidenced as a key cortical region for segregation of networks during adolescence. During this time, the dACC develops stronger functional associations within the cingulo-opercular network, specifically with the anterior insula/frontal operculum region (aI/FO), and weakens its associations to the frontoparietal network11,12,13,14,15,16. The dACC has also been shown to be structurally impacted in children with a history of maltreatment17. Yet, the developing functional connections of the dACC in adolescents with childhood neglect are not well-understood. Furthermore, no study has tested targeted interventions that may optimize attention-related neurocognitive processes in this population.
In this collaborative international research, our goal was to evaluate digital closed-loop interventions in adolescents with childhood neglect. Closed-loop interventions delivered in a digital format have two key features—they provide instantaneous feedback on the performance of the individual and they use psychometric functions to continuously adapt to individual performance in order to maximize learning18,19. Here, we used multimodal outcomes to evaluate the closed-loop interventions, including functional neuroimaging, complemented with objective assessments of sustained attention and interference resolution, and caregiver-reported inattention/hyperactivity behaviors. Teacher-reported academic performance outcomes were also obtained at post intervention. Study participants were adolescents at a childcare center in India that provides shelter, nurturing, and education access to children who have suffered early life adversity. Notably, the prevalence of childhood maltreatment in India is similar to that observed in the United States20, and Indian studies also report similar prevalence for diagnoses of ADHD21.
In prior international research in India, we have demonstrated that closed-loop digital interventions that adaptively train attention to goal-relevant information while suppressing sensory distractions, can benefit children with ADHD in this setting22. We have further shown that such an intervention has a neural basis in recovering deficient distractor processing23. Yet, all such prior work has focused on children living within their biological family homes and with no reported history of early life adversity. Moreover, meta-analyses of game-based digital interventions in children with ADHD do not support a consensus on behavioral outcome benefits24. Hence, in order test what may benefit adolescents with neglected childhoods, here, we contrasted two very different digital attention-based interventions, one that targets internal attention to one’s own breath akin to meditation vs. an externally focused approach.
Internal attention refers to selective processing of internally generated signals, while external attention refers to the ability to select and modulate incoming sensory information25. Extant digital interventions train external attention, as individuals learn to adaptively focus on goal-relevant visual and auditory targets, and suppress irrelevant sensory distractions in game-based environments. In contrast, internal attention is traditionally trained as teacher-guided mindfulness/meditation practices that are nondigital. In one of its basic forms, meditation encourages focus on an internal stimulus anchor such as the breath, while becoming aware and then letting go of interfering thought distractions. Notably, Ziegler et al.26 recently implemented this approach in a closed-loop mobile digital meditation program and showed improvements in sustained attention abilities in young adults. Here, we adopted this novel and easily implementable digital strategy to train internal attention in adolescents with childhood neglect. Hence, in this study, we compared an internal attention intervention (IAI) akin to meditation, with an external attention intervention (EAI) that trains attention to sensory visual and auditory stimuli amidst sensory distractions. Our study also included a no-intervention (NI) control. The study followed a double-blind randomized controlled design27 (Fig. 1), and both IAI and EAI interventions were delivered in digital closed-loop format on mobile devices in order to match intervention implementation across study arms. Of note, the use of mobile devices for intervention delivery is of great significance for a global mental health setting with limited resources for in-person interventions, as well as for facilitating future scalability28.
Many studies that have investigated the neural correlates of mindfulness meditation in adults show plasticity of the dACC29, a key brain region for sustained attentional control30,31. Given this, here we hypothesized that particularly the IAI digital meditation training will result in functional plasticity of the dACC. Specifically, we hypothesized that dACC functional connectivity to the anterior insula/frontal opercular region, aI/FO, may be modulated, as dACC is expected to connect to aI/FO during adolescent development11,12,13,14,15,16, and this region is also important for both sustained attentional control and self-regulation9,10,11,30,31,32,33,34. Second, we hypothesized that the digital meditation intervention would impart positive changes in objective measures of sustained attention and interference resolution, and improvement in ADHD behaviors. We also hypothesized that intervention group differences would be observed in academic performance.
Materials and methods
This study has been registered on the International Standard Randomized Controlled Trial Number Registry (ISRCTN94097629)27.
Participants
We recruited 45 adolescents (10–18 years of age, mean age 13.9 ± 1.8 years, 30 males) from a stable childcare center in New Delhi, India to participate in this research; the Udayan Care stable care center provides shelter, nurturing, and education access to children who have suffered early life adversity. Ethical approvals for this international study were obtained from the institutional review boards at the University of California San Francisco, the All India Institute for Medical Sciences (AIIMS) New Delhi, the ethical considerations for research committee at Udayan Care, as well as the Indian Health Ministry’s Screening Committee, which is the ethical body of the Indian Council of Medical Research that oversees all international collaborative research in India. Participants’ caregivers provided signed informed consent for the research, and all enrolled adolescents provided verbal assent.
Screening
All study participants completed self-reports on the childhood trauma questionnaire (CTQ35) that scores trauma in the domains of emotional and physical neglect and/or emotional, physical, and sexual abuse. We calculated individual CTQ scores as the mean scores across all five abuse/neglect subdomains that are measured on this scale (score across 45 participants, mean 2.08 ± 0.58, range 1.21–3.89). Individual subdomain scores are typically calculated as sum scores across five questions in each subdomain, each question rated on a 1–5 Likert scale; hence, sum scores range from 5 to 25, and mean subdomain sum scores range from 1 to 5. Mean scores in each subdomain were 1.72 (±0.12) for emotional abuse, 1.75 (±0.12) for physical abuse, 1.25 (±0.08) for sexual abuse, 2.70 (±0.13) for emotional neglect, and 2.32 (±0.12) for physical neglect. These scores were “low to moderate” with respect to trauma severity based on validated threshold cutoffs in each subdomain (mean cutoff, emotional abuse ≥ 1.8, physical abuse ≥ 1.6, sexual abuse ≥ 1.2, emotional neglect ≥ 2, and physical neglect ≥ 1.6)36. Subdomain mean scores were highly correlated within each domain for abuse (emotional vs. physical r = 0.64, p < 0.0001, emotional vs. sexual r = 0.34, p = 0.02, and physical vs. sexual, r = 0.36, p = 0.02) and for neglect (emotional vs. physical r = 0.5, p < 0.0001), as well as across abuse and neglect domains (r = 0.65, p < 0.0001). However, the severity of neglect was significantly greater than severity of abuse (p < 0.0001) in our sample. Henceforth, we use childhood neglect as the specific subdomain variable of interest. Participants did not have any comorbid psychiatric conditions or drug abuse history as assessed in clinical interviews.
Assessments
We conducted multidimensional assessments in all study participants, including neuroimaging as the primary assessment, and complementary secondary assessments, i.e., computerized objective cognitive assessments, caregiver-based ADHD behavioral ratings, and teacher-based academic performance ratings. Neuroimaging and cognitive assessments were performed at two time points 8 weeks apart (time 1 and time 2), interspersed by the intervention period. Behavior ratings were performed at time 1, time 2, and additionally at a 1-year follow-up, time 3. Academic performance ratings could not be obtained at time 1, but were obtained at time 2 and time 3. The overall study design is depicted in Fig. 1.
Neuroimaging
Resting-state functional magnetic resonance imaging (rs-fMRI) provides a measure of spontaneous, intrinsic brain activity that can be used to assess multiple functional brain networks37,38. We implemented rs-fMRI in this study as it is more feasible in this pediatric population, and also produces larger, more robust, and reliable brain signals of energy consumption than task-based approaches39,40,41,42. Scans were conducted at AIIMS New Delhi, on a 3.0 T MR Scanner (Phillips Ingenia) equipped with a 32-ch head coil. Scans were performed in 44 of the 45 study participants; one participant was excluded due to dental braces that produce large artifacts during scanning. Anatomical T1-weighted images were collected using a high-resolution 3D magnetization-prepared rapid gradient echo sequence with 360 1-mm-thick sagittal slices (echo time [TE] 3.7 ms; repetition time [TR] 8.1 ms; field of view [FOV] 240 mm; flip angle 8°). Rs-fMRI images were acquired at rest with eyes open, gaze at a central fixation cross, using single-shot echo-planar T2*-weighted imaging sequence. Each volume consisted of 35 contiguous 4-mm-thick slices with ascending slice order and no interslice gap (TE 30 ms; TR 2000 ms; FOV 230 mm; flip angle 90°; duration 6.83 min). The scan duration we used was optimized for obtaining a sufficient number of reliable scans in pediatric populations43,44,45, which consisted of 200 volumes plus 5 initial unscored dummy volumes acquired in 6.83 min.
Rs-fMRI data were preprocessed in SPM12 (The Wellcome Department of Cognitive Neurology, London, UK, http://www.fil.ion.ucl.ac.uk/spm/software/spm12/) using standard spatial preprocessing steps. Functional data were slice-time corrected, realigned to the first image of the resting scan, normalized in Montreal Neurological Institute (MNI) space, and smoothed with a 6-mm kernel (full width at half maximum). Functional connectivity analysis was performed using a seed-driven approach using the CONN toolbox v17 (http://www.nitrc.org/projects/conn)46.
Physiological and other spurious sources of noise were estimated and regressed out using the anatomical CompCor method (aCompCor) that has been shown to yield higher specificity and sensitivity compared with global signal regression47,48. A temporal band-pass filter of 0.008–0.09 Hz was applied simultaneously to all regressors in the model. Residual head motion parameters (three rotation and three translation parameters plus another six parameters representing their first-order temporal derivatives) were regressed out. Artifact/outlier scans (average intensity deviating more than three standard deviations from the mean intensity in the session or composite head movement exceeding 1 mm from the previous image) were also regressed out to minimize the spurious effects induced by motion artifacts49. Outlier images were modeled as nuisance covariates. Each outlier image was represented by a single regressor in the general linear model (GLM), with a 1 for the outlier timepoint and 0 elsewhere. We confirmed that head displacement for either frame-to-frame translations or rotations did not significantly differ across time 1 and 2 scans (mean ± standard error of xyz translations, time 1: 0.05 ± 0.007 mm, time 2: 0.05 ± 0.004 mm; rotations, time 1: 7 × 10−4 ± 2 × 10−4 radians, time 2: 6 × 10−4 ± 8 × 10−5 radians). The number of outliers also did not significantly differ between time 1 and 2 scans (time 1: 19 ± 3, time 2: 18 ± 3). We additionally confirmed that when participants are partitioned into intervention groups, that there are no significant differences in head displacement parameters or outlier scans between intervention groups (p > 0.5), nor any intervention group × time interaction (p > 0.25).
We analyzed the dACC seed region connectivity to both cingulo-opercular and frontoparietal network regions of interest (ROIs) as dACC is found to be functionally connected to several of these regions during development11,12,13,14,15,16. The dACC seed region was defined as a 12-mm radius sphere around peak coordinates (MNI x, y, z: −2, 7, 50); 11 ROIs were similarly specified in the frontoparietal network (right/left precuneus, mid cingulate, right/left dorsolateral prefrontal cortex, right/left frontal cortex, right/left inferior parietal lobule, and right/left intraparietal sulcus) and 6 ROIs specified in the cingulo-opercular network (right/left anterior insula/frontal operculum (aI/FO), right/left anterior thalamus, and right/left anterior prefrontal cortex) as per previously described ROI coordinates11,31. Time series of all voxels within each ROI were averaged, and first-level correlation maps were produced by extracting the residual BOLD signal time course from the dACC seed ROI and computing Pearson correlation coefficients between its time course and the time course of all other ROIs. Correlation coefficients were converted to normally distributed Z scores using the Fisher transformation to allow for second-level GLM analyses. Mean functional connectivity strengths of the dACC to the frontoparietal network and to the cingulo-opercular network were calculated as the mean functional connectivity between the dACC seed and the 11 frontoparietal network ROIs and the 6 cingulo-opercular network ROIs, respectively.
In addition, we performed seed–voxel correlations by estimating maps showing temporal correlations between the BOLD signal from the dACC seed region and the time course of all other voxels. Pearson correlation coefficients were converted to normally distributed Z scores using the Fisher transformation to allow for second-level GLM analyses. For this seed–voxel connectivity data, cluster-level threshold was set at p < 0.05 using false-discovery rate correction for multiple comparisons, with voxelwise threshold of p < 0.0150.
Objective cognitive assessments
We tested participants on two standard objective cognitive assessments that are frequently tested in children with ADHD, evaluating (a) sustained attention to goal-relevant information, modeled after the test of variables of attention51, and (b) interference resolution as per the Flanker test52. In the sustained attention test, participants detected sparse targets (black square in the visual upper field appearing on 33% of trials) and withheld responses on frequent nontargets (black square in the visual lower field appearing on 67% of trials). Accuracies on this task are typically at ceiling, and the relevant response measure is the response time variability, with lower response variability indicative of higher consistency and better performance53. In the Flanker test for interference resolution, participants viewed an array of five letters and identified the central target letter while ignoring the flanking distractor letters. The letters, a/b/c/d were used, with each serving as a target or flanking letter on an equivalent number of trials. In all, 50% of task trials were congruent with matching targets and distractors, and 50% were incongruent with different targets and distractors. The main performance measure on this task is the response time cost (i.e., RT on incongruent trials minus RT on congruent trials), with smaller response time costs indicative of better performance.
Behavior ratings
Caregivers rated inattention and hyperactivity behaviors on the standard ADHD-RS IV rating scale54 that has also been previously used in research in India21,22. The same caregiver for each child rated ADHD behaviors at time 1–3. Raw scores, clinically normed percentiles, as well as the number of adolescents that surpassed clinical 80% threshold are summarized in Table 1.
Academic performance
Teachers rated academic performance on the academic performance rating scale (APRS55) at time 2, and different teachers rated performance at time 3; these ratings could not be obtained at time 1. On the APRS, the teacher rates the child’s math, reading, writing, and oral abilities, both in terms of accuracy and consistency. These ratings had some missing data (8 of 45 participants’ missing data at time 2, and 10 of 45 participants’ missing data at time 3).
Intervention
After baseline assessment time 1, participants were cluster-randomized into either the IAI, EAI, or no Intervention (NI) arms. Cluster randomization was based on enrollment in pre-existing after-school groups. The 45 study participants were pre-enrolled in 6 separate after-school groups based on common gender and age, and common home area. Hence, we randomized two after-school groups each to the IAI (n = 15, 7 female, 8 male), EAI (n = 15, 6 female, 9 male), and NI (n = 15, 2 female, 13 male) intervention arms.
This sample size of 15 participants per study arm (IAI/EAI/NI) for a total sample of 45 participants was sufficiently powered to obtain a large effect size (η2 ≥ 0.1456) between-group (IAI/EAI/NI) effect on the primary outcome, i.e., change in functional connectivity of the dACC to the frontal opercular aI/FO region in the cingulo-opercular network, using a repeated measures analysis of variance (rm-ANOVA) with two repeated measures (baseline vs. post intervention), powered at 0.8 with alpha level of 0.05. A sample size by power plot for this calculation obtained using the G*Power tool57 is shown in supplementary figure S1.
Both IAI and EAI were self-administered as digital tablet apps for up to 30 min of practice per session (25 min of training interspersed with short 1-min breaks every 5 min), for 30 sessions over 30 nonconsecutive days (~6 weeks). Participants had no prior exposure to IAI/EAI, or interventions of this kind. To facilitate full adherence and troubleshoot any technical issues, a research staff member was present during all after-school group-training sessions; participants sat in a group, yet, performed their individual training sessions. As a result, all participants in the IAI and EAI arms had 100% intervention adherence. Participants in the NI arm were not provided any intervention, and went about their daily activities as usual between time 1 and time 2 assessments.
The intervention arms were double-blinded; both IAI and EAI arms were experimental; hence, neither the participants nor the research staff interacting with the participants had any knowledge as per the relative efficacy of one or the other arm. Also, the NI arm did not have knowledge of the other IAI/EAI arms, thereby, equating placebo effects in all study arms as much as possible. Caregivers had knowledge that their child was enrolled in a digital intervention, but were blind to the goals of the intervention. Teachers were also intervention-blind, i.e., without any knowledge if a child was participating in this intervention study. At the end of each intervention session, progress and performance data were automatically transferred to a secure study data server in de-identified format.
Participants in the IAI group practiced attending to the sensations of their breath, with monitoring guided using a digital app—Meditrain—which recently showed benefits on sustained attention in healthy young adults26. Participants were instructed to acknowledge internally distracting thoughts when they occurred during the practice, then disengage from the thought and shift their attention back to their breath. Participants practiced attention to breath in a closed loop, i.e., performance-adaptive trial durations starting as short as 10 s and progressively built up to several minutes of breath focus. Trial durations were adapted based on end-of-trial feedback from participants. At the end of each trial, participants were prompted to report, via a screen-tap, whether their attention remained on their breath throughout the trial, or if their attention was diverted by distracting thoughts. If they reported successful attention to their breath for the entire trial, the duration (in seconds) of the next trial was increased by 10%; if unsuccessful, the duration of the next trial was decreased by 20%. Using this adaptive algorithm, the intervention targeted the participants’ ability to self-regulate internal attention on an individualized basis. Intervention sessions were linked, such that the next session began at the level (i.e., trial duration) attained at the end of the previous session. The IAI participants predominantly reported successful attention to breath (reported percent success mean ± standard error 92.9 ± 0.96%; range 85.3–98.3%) with no significant differences in these percent reports in the first half (sessions 1–15) vs. second half (sessions 16–30) of the intervention (p > 0.8). Given the closed-loop nature of the program that lengthens the duration of the breath awareness period after each success, trial durations were significantly longer at the end relative to mid-intervention (mid-intervention trial duration: 93 ± 13 s, end-of-intervention: 793 ± 64 s; p < 0.0001).
Participants in the EAI group practiced attention to sensory (visual and auditory) stimuli amidst sensory distractors in the context of five different game modules, practiced 5 min each per session. All EAI modules were closed loop, i.e., performance-adaptive and adjusted task difficulty so that participants maintained ~80% performance accuracy at all times. Game modules challenged focused attention, divided selective attention, as well as working memory when a given sensory target had to be retained amidst varied distractors over several trials. The Freeze Frame, Double Decision, Mind’s Eye, and Target Tracker visual game modules, and the Hear Hear and Memory Grid auditory modules available at brainhq.com were selected for the EAI based on demonstrated efficacy of these individual training modules in prior research22,23,58,59,60. In Freeze Frame, participants practiced focused attention to visual targets, selectively withholding their response to these while non-selectively responding to all distractors. In Double Decision, participants practiced divided attention to central and peripheral visual targets. In Mind’s Eye, participants identified visual targets amidst simultaneous visual distractors as the features of the visual distractors adaptively resembled the visual target over successive trials. In Target Tracker, participants attended to moving object targets amidst moving distractors, and were adaptively challenged to retain a larger number of target objects in working memory. In Hear Hear, participants attended to target sounds within sequences of distractor sounds that adaptively resembled the target sound over successive trials. In Memory Grid, participants matched pairs of sound clips shuffled among a set of several sound clips of adaptively increasing set size.
Data analyses
Intervention effects in the primary neuroimaging and secondary cognitive assessments were analyzed in SPSS software using general linear modeling, specifically, group × time repeated measures ANOVAs with between-group factor of intervention (IAI, EAI, and NI) and within-group factor of assessment time (time 1 and 2). All rm-ANOVAs, including baseline covariates of childhood, neglect severity, age, gender, and age at which stable childcare access was obtained to control for differences in these variables across participants; rm-ANOVA group × time interactions were also verified that they did not differ in the absence of covariates. Estimates of effect size were reported as eta squared calculated as the ratio of the sum of squares for the effect relative to the corrected total sum of squares in SPSS (η2 < 0.06 is small, 0.06–0.14 are medium, and ≥0.14 are large effect sizes56). Post hoc testing used two-tailed paired t tests.
Intervention effects on ADHD behavioral ratings were analyzed using the nonparametric Kruskal–Wallis test, systematically investigating between-group (IAI, EAI, and NI) differences at time 1, time 2, and at the 1-year follow-up, time 3. Post hoc testing used two-sided Wilcoxon signed rank tests. The Kruskal–Wallis test was also used to investigate between-group (IAI, EAI, and NI) differences in teacher-based academic performance rating raw scores at time 2 and time 3.
For equivalent representation of results across the multidomain assessments (i.e., functional connectivity in rs-fMRI, cognitive performance, and behavioral and academic ratings), individual data were converted to Z scores within each domain. Z scores were calculated relative to the mean and standard deviation of the baseline (time 1) assessment data across all participants (n = 45) in each of the neuroimaging, cognitive, and behavioral domains. For academic data, Z scores were independently calculated at time 2 and 3, since baseline time 1 data were absent, and different teachers provided the ratings at time 2/3.
Results
No baseline differences between intervention arms
The IAI, EAI, and NI study arms did not differ in any of the neurocognitive and behavioral characteristics measured at baseline (Table 1), except in age at which participants accessed stable care (i.e., a secure environment in which no further childhood trauma occurred). Neither mean CTQ scores, nor abuse/neglect subdomain scores, differed significantly between the IAI, EAI, and NI groups (Table 1). Across all participants, childhood trauma severity significantly correlated with age of stable care access (r = 0.31, p = 0.04, but not actual age, p = 0.09), and girls reported greater childhood trauma than boys (F(1,43) = 5.54, p = 0.02). To control for variability in baseline age, gender, age of stable care access, and neglect severity, all intervention outcome analyses carried out below accounted for these variables as model covariates.
Intervention-related plasticity of dACC functional connectivity
At baseline, childhood neglect severity was significantly negatively associated with dACC mean functional connectivity in the cingulo-opercular network (partial regressions controlling for factors of age, gender, and age of stable care access, ß = −0.42, p = 0.006, CI: [−0.64 to 0.14]). Within this network, dACC specifically makes strong functional connections with the anterior insula/frontal opercular aI/FO region during adolescent development11,12,13,14,15,16; we found that childhood neglect was negatively associated with this dACC-aI/FO bilateral mean functional connectivity (ß = −0.39, p = 0.01, CI: [−0.59 to 0.17], Fig. 2a). The association for childhood neglect vs. dACC mean connectivity to the frontoparietal network was not significant (ß = −0.18, p = 0.26, CI: [−0.45 to 0.13]); this was as expected since dACC separates from the frontoparietal network during adolescence11,12,13,14,15,16. dACC functional connectivity in these networks also did not show any significant correlations with childhood abuse.
We analyzed baseline vs. post-intervention (i.e., time 1 vs. time 2) effects on bilateral dACC-aI/FO connectivity, and found a significant group × time interaction (F(2,37) = 4.05, p = 0.03, η2 = 0.14). Post hoc tests revealed that this interaction was driven by significantly enhanced connectivity at time 2 vs. time 1 in the IAI group (t(13) = 2.52, p = 0.025, CI: [0.02–0.20]), but no significant connectivity change in the EAI and NI groups (p > 0.05) (Fig. 2b). These results also replicated in dACC seed-to-voxel whole-brain group × time statistics in which the bilateral aI/FO clusters emerged as the only significant clusters (Fig. 2c).
Intervention-related changes in cognition
We found significant group × time intervention effects for sustained attention (F(2,38) = 5.05, p = 0.01, η2 = 0.17), as well as for interference resolution (F(2,37) = 3.70, p = 0.03, η2 = 0.16). Post hoc analyses showed that these cognitive outcomes paralleled the neuroimaging results; only the IAI group significantly improved at time 2 vs. time 1 (sustained attention: t(14) = 2.81, p = 0.01, CI: [0.21–1.59]; interference resolution: t(14) = 2.75, p = 0.015, CI: [0.21–1.71]). Changes in the EAI group did not reach significance. The NI group also did not show a significant change for interference resolution, but did show a significant decline in sustained attention at post intervention (t(14) = 2.45, p = 0.03, CI: [−0.21 to 3.13], Fig. 2d); this poor performance in NI for sustained attention was perhaps due to lack of interest/focus in a repeat assessment that is simple and boring by its very nature51.
Intervention-related changes in inattention and hyperactivity
Caregivers rated inattention and hyperactivity at time 1, time 2, and at the 1-year follow-up time 3. Inattention ratings had no significant group differences at any timepoint. Notably, group differences in hyperactivity ratings emerged at the 1-year follow-up (H(2,38) = 9.24, p = 0.01, η2 = 0.23). Post hoc testing showed significant hyperactivity improvements at time 3 relative to baseline, exclusively in the IAI group (signed rank test, Z = 75, p = 0.005). Consistent with this, hyperactivity ratings also had significantly improved at time 2 vs. time 1 only in the IAI group (Z = 19.5, p = 0.038), although between-group significance was not yet achieved at time 2.
Intervention-related academic performance
Academic performance ratings were first feasibly obtainable from teachers at post-intervention time 2; these showed significant group differences, with higher ratings for the IAI relative to EAI and NI groups (H(2,37) = 6.26, p = 0.04, η2 = 0.15). These group differences, however, did not reach significance at the 1-year follow-up time 3, when different teachers rated academic performance (Fig. 2f).
Associations between neural and cognitive/behavioral outcomes
Finally, to investigate whether neural and cognitive/behavioral changes are related, we performed Pearson’s correlations between functional connectivity and cognitive/behavioral outcomes across all participants (i.e., including all three groups). These showed that time 2 vs. time 1 changes in dACC-aI/FO functional connectivity were positively correlated with changes in sustained attention (r = 0.45, p = 0.004, CI: [0.13–0.67]). The relationship between functional connectivity changes and interference-resolution outcomes was not significant. Changes in functional connectivity also significantly related to the median change in hyperactivity outcomes at time 2/3 (r = 0.34, p = 0.03, CI: [0.07–0.60]) as well as median academic outcomes at time 2/3 (r = 0.35, p = 0.02, CI: [0.10–0.56]) (Fig. 3).
Discussion
In this study, we aimed to understand how adolescents affected by early childhood adversity, particularly neglect, may benefit from scalable digital interventions to help facilitate neurocognitive development. The research is novel in being a double-blind randomized controlled study of digital interventions using multidimensional outcomes—neuroimaging, cognition, child behaviors, and academic performance, and instantiated as a global mental health collaboration. Here, we find evidence that severity of early childhood neglect is negatively associated with the strength of functional connections from the dACC, an important cognitive control region. We, further, show that a targeted digital intervention that simulates basic meditative practice, can enhance these functional connections, along with positively impacting broader outcomes in the domains of cognition and hyperactive behaviors; higher academic performance ratings are also observed in the digital meditation group.
Adolescence is a critical time period for both structural and functional brain development, especially for frontal and parietal brain networks that underlie cognition9,10,11,12,13,14,15,16,32. Brain networks are understood to be segregating into their selective roles during this time period, together with active cross-network communication. This network segregation is likely very important as adolescents undergo their stressful transition to fully independent adults61. Analyses of several task-based fMRI studies show that the cingulo-opercular and frontoparietal networks are distinct cognitive control networks in adults, responsible for stable, sustained control vs. moment-to-moment flexible control, respectively31,32,34. Resting-state fMRI studies corroborate these results, and further demonstrate that resting-state functional connectivity is relatively better at predicting functional network maturity than task-based imaging13.
While functional network development in typical adolescence is increasingly understood, little is known about the development of cognitive control networks in adolescents with a history of childhood adversity. From a huge literature on adult retrospective studies, we understand that these individuals demonstrate scholastic underachievement, school dropout, and juvenile delinquency, are vulnerable to mental illness, and have alcohol and substance abuse problems that are all precursors to a lifetime of instability62,63. Notably, in a recent large-sample adolescent study conducted on a National Institute of Health dataset, Silveira et al.64 demonstrate that functional connectivity in distributed developing brain networks is impacted by childhood adversity; these functional networks include the important dACC region, and in turn mediate poor executive function and predict alcohol abuse in future years. This research dovetails with our neural findings in this international cohort, which also shows that dACC functional connectivity is negatively associated with the severity of childhood neglect. Of note, these are now convergent findings across developing adolescent brain networks in the United States and in India.
The dACC is a crucial cognitive control network region that has a core role in sustained attention processing, as well as in resolution of interference33,65. Frontal theta oscillations measured in human electrophysiology, localize to this region, and have been suggested as the biophysical basis of brain network communications emergent from the dACC66. That dACC functional connectivity is impacted in adolescent brains that have experienced early adversity, is concerning for the development of the fundamental abilities of selective attention and interference resolution.
Here, for the first time, we systematically test scalable, attention-targeted digital interventions in adolescents with childhood neglect. In a three-arm, double-blind, cluster-randomized study, we test internal vs. EAIs vs. a NI (life-as-usual) control. Of note, both active intervention arms demonstrated 100% adherence to their training programs, attesting to the feasibility of engaging digital interventions in these adolescents. The training focus of the IAI was akin to meditation, anchored to the individual’s own breath, while encouraging suppression of internal distractions. Uniquely, the closed loop, i.e., performance-adaptive nature of this meditative program is an important research advance that facilitated feasibility, with initial practice times as short as 10 s at a time.
Recently, Ziegler et al.26 demonstrated that the digital meditation intervention induces benefits in sustained attention abilities in healthy young adults; specifically, it reduced response variance on the sustained attention test in young adults, a finding that we replicate here in adolescents with neglect. Our studies also find complementary results in the context of interference resolution; here, we measure the relative interference cost for flanking congruent vs. incongruent distractors, and show enhanced performance after digital meditation, while Ziegler et al. showed that visual object discrimination amidst simultaneous object distractions was improved by this treatment. Notably, we did not observe these results in the EAI cohort that focused on computerized visual and auditory trainings, or in the NI cohort. These findings suggest the targeted utility of training internal attention in this vulnerable population.
Beyond immediate cognitive outcomes, we also show that the IAI is associated with significantly enhanced functional connectivity of the dACC-aI/FO brain regions. This finding is in line with studies evidencing functional gains in dACC after traditional meditative training practices29. Our finding also parallels the results obtained by Ziegler et al.26 who showed that EEG-based theta band (4–8 Hz) coherence, which localizes to mid–frontal regions that include the dACC, is enhanced by digital meditation in young adults.
With respect to developing behaviors, we found that caregivers, blind to the interventions, rated significantly reduced hyperactivity only in the IAI group. This effect showed between-group significance at the 1-year follow-up, and was also observed at the within-group level post intervention; of note, the number of adolescents in the IAI group that surpassed clinical thresholds for hyperactivity fell to zero at the 1-year follow-up. Improvement in hyperactivity is particularly important, given that meta-analyses of several prior digital cognitive trainings in ADHD have concluded null effects on hyperactivity24. In addition, behavioral gains at the follow-up timepoint are consistent with our prior results on training programs in children with ADHD, which showed that such gains usually appear subsequent to plasticity in neurocognitive outcomes22. Sustainable gains at a 1-year follow-up also compellingly suggest that the IAI group may have learned a generalized self-regulation strategy of internal focus and distractor suppression that is attributed to emerge from dACC function30,33. These individuals may continue to practice internal attention even after the formal digital intervention period (i.e., without any digital device access), a possibility that remains to be formally confirmed in future research.
Finally, we observed that teacher-rated academic performance at post intervention was differentially greater in the IAI cohort. This is a limited observation as academic outcomes could not be obtained at baseline, and ratings obtained from different teachers at the 1-year follow-up did not achieve group-level significance. Nevertheless, the significant correlative association of these academic ratings with changes in dACC functional network connectivity, suggests important linkages between these outcomes, which should be systematically pursued in future work. Plasticity of the dACC functional network also correlated with the cognitive outcomes of sustained attention and behavioral outcomes of reduced hyperactivity, further suggesting an underlying mechanism for the cognitive and behavioral findings.
Overall, this study shows that developing attentive self-focus with the breath as an anchor, in theory a simple practice inspired by ancient practices of focused meditation, can have wide-ranging positive effects on important functional brain networks, cognition, and real-life behaviors in adolescents with a history of adversity. Notably, our results show large effect sizes on the primary outcome of dACC-aI/FO functional connectivity, as well as on the secondary cognitive and behavioral outcomes. There are only a handful of studies in the literature on meditation practices in children/adolescents and even fewer with rigorous double-blind methodology67; none of them have implemented multimodal evaluations, or used closed-loop digital formats, or investigated outcomes in at-risk adolescents with a history of neglect, as in this study. Furthermore, meditation and mindfulness practices can have varied forms, from focusing on the breath as an anchor to other focused meditation strategies, complex sequences of nostril breathing as in pranayama, body scans, walking, meditation, and full-body yoga practices. Here, we employ a basic form of breath-focused meditation throughout, which allows us to gain mechanistic insights that cannot be gleaned by combining multiple meditative approaches. Notably, the dACC locus of control that we demonstrate is consistent with the prior literature on meditation, as well as neurophysiological observations showing specific functional and anatomical links between the brainstem breathing control centers and the ACC/insula68.
The limitations of this first study include the need for replication in future large-sample research. Our sample was also heterogeneous in terms of meeting clinical diagnostic criteria for ADHD; hence, the study cannot establish direct clinical relevance to this disorder. Given our specific hypothesis focused on attention-related brain networks, and emergent cognition and behaviors, we also did not track symptoms of other clinical diagnoses, such as depression/anxiety. In terms of data for the digital interventions, it was useful in confirming that all participants completed all training sessions (100% adherence was observed), yet, in exploratory analyses, session-to-session performance metrics did not significantly relate to any intervention outcome measures; hence, future digital intervention versions need to revise these session performance metrics to glean better insights on treatment mechanisms. Finally, our findings are limited to the specific digital interventions we have studied, and cannot generalize to other forms of IAIs/EAIs.
In conclusion, here we show novel utility of a closed-loop digital intervention that trains internal attention26, and demonstrates its efficacy in an initial randomized controlled study. The simplicity of the intervention approach is such that it can become integral to daily-life practice and potentially sustain mental health well beyond the initial training period. Importantly, the innovative digital implementation allows for feasible and cost-effective scaling to limited-resource settings, which can help promote well-being of children and youth in our modern digital world.
References
Lupien, S. J., McEwen, B. S., Gunnar, M. R. & Heim, C. Effects of stress throughout the lifespan on the brain, behaviour and cognition. Nat. Rev. Neurosci. 10, 434–445 (2009).
Cook, A. et al. Complex trauma in children and adolescents. Psychiatr. Ann. 35, 390–398 (2005).
Spann, M. N. et al. Childhood abuse and neglect and cognitive flexibility in adolescents. Child Neuropsychol. 18, 182–189 (2012).
Lambert, H. K., King, K. M., Monahan, K. C. & McLaughlin, K. A. Differential associations of threat and deprivation with emotion regulation and cognitive control in adolescence. Dev. Psychopathol. 29, 929–940 (2017).
Sheridan, M. A., Peverill, M., Finn, A. S. & McLaughlin, K. A. Dimensions of childhood adversity have distinct associations with neural systems underlying executive functioning. Dev. Psychopathol. 29, 1777–1794 (2017).
Gur R. E. et al. Burden of environmental adversity associated with psychopathology, maturation, and brain behavior parameters in youths. JAMA Psychiatry https://doi.org/10.1001/jamapsychiatry.2019.0943 (2019).
Brown, N. M. et al. Associations between adverse childhood experiences and ADHD diagnosis and severity. Acad. Pediatr. 17, 349–355 (2017).
Jimenez, M. E. et al. Adverse childhood experiences and ADHD diagnosis at age 9 years in a national urban sample. Acad. Pediatr. 17, 356–361 (2017).
Power, J. D., Fair, D. A., Schlaggar, B. L. & Petersen, S. E. The development of human functional brain networks. Neuron 67, 735–748 (2010).
Luna, B., Marek, S., Larsen, B., Tervo-Clemmens, B. & Chahal, R. An integrative model of the maturation of cognitive control. Annu. Rev. Neurosci. 38, 151–170 (2015).
Fair, D. A. et al. Development of distinct control networks through segregation and integration. Proc. Natl Acad. Sci. USA 104, 13507–13512 (2007).
Fair, D. A. et al. Functional brain networks develop from a “Local to Distributed” organization. PLoS Comput. Biol. 5, e1000381 (2009).
Dosenbach, N. U. F. et al. Prediction of individual brain maturity using fMRI. Science 329, 1358–1361 (2010).
Marek, S., Hwang, K., Foran, W., Hallquist, M. N. & Luna, B. The contribution of network organization and integration to the development of cognitive control. PLOS Biol. 13, e1002328 (2015).
Kelly, A. M. C. et al. Development oF Anterior Cingulate Functional Connectivity from Late Childhood to Early Adulthood. Cereb. Cortex 19, 640–657 (2009).
Ordaz, S. J., Foran, W., Velanova, K. & Luna, B. Longitudinal growth curves of brain function underlying inhibitory control through adolescence. J. Neurosci. 33, 18109–18124 (2013).
Teicher, M. H., Samson, J. A., Anderson, C. M. & Ohashi, K. The effects of childhood maltreatment on brain structure, function and connectivity. Nat. Rev. Neurosci. 17, 652–666 (2016).
Mishra, J. & Gazzaley, A. Closed-loop cognition: the next frontier arrives. Trends Cogn. Sci. 19, 242–243 (2015).
Mishra, J., Anguera, J. A. & Gazzaley, A. Video games for neuro-cognitive optimization. Neuron 90, 214–218 (2016).
Kacker L., Varadan S., Kumar P. Study on Child Abuse: India. (Ministry of Women and Child Development, Government of India, 2007).
National Consultation Meeting for Developing IAP Guidelines on Neuro Developmental Disorders under the aegis of IAP Childhood Disability Group and the Committee on Child Development and, Disorders. et al. Consensus statement of the Indian Academy of Pediatrics on evaluation and management of attention deficit hyperactivity disorder. Indian Pediatr. 54, 481–488 (2017).
Mishra, J., Sagar, R., Joseph, A. A., Gazzaley, A. & Merzenich, M. M. Training sensory signal-to-noise resolution in children with ADHD in a global mental health setting. Transl. Psychiatry 6, e781 (2016).
Mishra, J., de Villers-Sidani, E., Merzenich, M. & Gazzaley, A. Adaptive training diminishes distractibility in aging across species. Neuron 84, 1091–1103 (2014).
Cortese, S. et al. Cognitive training for attention-deficit/hyperactivity disorder: meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. J. Am. Acad. Child Adolesc. Psychiatry 54, 164–174 (2015).
Chun, M. M., Golomb, J. D. & Turk-Browne, N. B. A taxonomy of external and internal attention. Annu. Rev. Psychol. 62, 73–101 (2011).
Ziegler, D. A. et al. Closed-loop digital meditation improves sustained attention in young adults. Nat. Hum. Behav. 3, 746–757 (2019).
ISRCTN - ISRCTN94097629: Assessing the effects of digital meditation on the cognitive function of adolescents with childhood trauma. http://www.isrctn.com/ISRCTN94097629.
Patel, V. et al. Treatment and prevention of mental disorders in low-income and middle-income countries. Lancet 370, 991–1005 (2007).
Tang, Y.-Y., Hölzel, B. K. & Posner, M. I. The neuroscience of mindfulness meditation. Nat. Rev. Neurosci. 16, 213–225 (2015).
Posner, M. I., Rothbart, M. K. & Voelker, P. Developing brain networks of attention. Curr. Opin. Pediatr. 28, 720–724 (2016).
Dosenbach, N. U. F. et al. A core system for the implementation of task sets. Neuron 50, 799–812 (2006).
Dosenbach, N. U. F. et al. Distinct brain networks for adaptive and stable task control in humans. Proc. Natl Acad. Sci. USA 104, 11073–11078 (2007).
Posner, M. I. & Rothbart, M. K. Toward a physical basis of attention and self regulation. Phys. Life Rev. 6, 103–120 (2009).
Menon, V. & Uddin, L. Q. Saliency, switching, attention and control: a network model of insula function. Brain Struct. Funct. 214, 655–667 (2010).
Bernstein, D. P. et al. Development and validation of a brief screening version of the Childhood Trauma Questionnaire. Child Abus. Negl. 27, 169–190 (2003).
Scher, C. D., Stein, M. B., Asmundson, G. J. G., Mccreary, D. R. & Forde, D. R. The Childhood Trauma Questionnaire in a community sample: psychometric properties and normative data. J. Trauma Stress 14, 843–857 (2001).
Fox, M. D. & Greicius, M. D. Clinical applications of resting state functional connectivity. Front. Syst. Neurosci. 4, 19 (2010).
Seeley, W. W. et al. Dissociable intrinsic connectivity networks for salience processing and executive control. J. Neurosci. 27, 2349–2356 (2007).
Raichle, M. E. & Mintun, M. A. Brain work and brain imaging. Annu Rev. Neurosci. 29, 449–476 (2006).
Zuo, X.-N. et al. Reliable intrinsic connectivity networks: test-retest evaluation using ICA and dual regression approach. Neuroimage 49, 2163–2177 (2010).
Shehzad, Z. et al. The resting brain: unconstrained yet reliable. Cereb. Cortex 19, 2209–2229 (2009).
Van Dijk, K. R. A. et al. Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. J. Neurophysiol. 103, 297–321 (2010).
Yin, D. et al. Dissociable changes of frontal and parietal cortices in inherent functional flexibility across the human life span. J. Neurosci. 36, 10060–10074 (2016).
Oldehinkel, M. et al. Functional connectivity in cortico-subcortical brain networks underlying reward processing in attention-deficit/hyperactivity disorder. NeuroImage Clin. 12, 796–805 (2016).
Zhao, Y. et al. Altered brain network topology in left-behind children: a resting-state functional magnetic resonance imaging study. Child Abus. Negl. 62, 89–99 (2016).
Whitfield-Gabrieli, S. & Nieto-Castanon, A. Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connect. 2, 125–141 (2012).
Behzadi, Y., Restom, K., Liau, J. & Liu, T. T. A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. Neuroimage 37, 90–101 (2007).
Chai, X. J., Castañón, A. N., Öngür, D. & Whitfield-Gabrieli, S. Anticorrelations in resting state networks without global signal regression. Neuroimage 59, 1420–1428 (2012).
Power, J. D. et al. Methods to detect, characterize, and remove motion artifact in resting state fMRI. Neuroimage 84, 320–341 (2014).
Genovese, C. R., Lazar, N. A. & Nichols, T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15, 870–878 (2002).
Greenberg L. M. TOVA Continuous Performance Test Manual. (Universal Attention Disorders, Los Alamitos, CA, 1996).
Mullane, J. C., Corkum, P. V., Klein, R. M. & McLaughlin, E. Interference control in children with and without ADHD: a systematic review of Flanker and Simon task performance. Child Neuropsychol. 15, 321–342 (2009).
Levy, F., Pipingas, A., Harris, E. V., Farrow, M. & Silberstein, R. B. Continuous performance task in ADHD: is reaction time variability a key measure? Neuropsychiatr. Dis. Treat. 14, 781–786 (2018).
DuPaul, G., Power, T., Anastopoulos, A. & Reid, R. ADHD Rating Scale IV: Checklists, Norms, and Clinical Interpretation. (Guilford Press, New York, 1998).
DuPaul, G. J. & Rapport, M. D. Teacher ratings of academic skills: the development of the academic performance rating scale. Sch. Psych. Rev. 20, 284–300 (1991).
Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. (Routledge, Hillsdale, NJ, 1988).
Faul, F., Erdfelder, E., Buchner, A. & Lang, A. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160 (2009).
Degutis, J. M. & Van Vleet, T. M. Tonic and phasic alertness training: a novel behavioral therapy to improve spatial and non-spatial attention in patients with hemispatial neglect. Front. Hum. Neurosci. 4, 1–17 (2010).
Smith, G. E. et al. A cognitive training program based on principles of brain plasticity: results from the Improvement in Memory with Plasticity-based Adaptive Cognitive Training (IMPACT) study. J. Am. Geriatr. Soc. 57, 594–603 (2009).
Edwards, J. D., Fausto, B. A., Tetlow, A. M., Corona, R. T. & Valdés, E. G. Systematic review and meta-analyses of useful field of view cognitive training. Neurosci. Biobehav. Rev. 84, 72–91 (2018).
Casey, B. J. et al. The storm and stress of adolescence: insights from human imaging and mouse genetics. Dev. Psychobiol. 52, 225–235 (2010).
Arnow, B. A. Relationships between childhood maltreatment, adult health and psychiatric outcomes, and medical utilization. J. Clin. Psychiatry 65(Suppl 1), 10–15 (2004).
Dube, S. R. et al. Childhood abuse, neglect, and household dysfunction and the risk of illicit drug use: the adverse childhood experiences study. Pediatrics 111, 564–572 (2003).
Silveira S. et al. Impact of childhood trauma on executive function in adolescence—mediating functional brain networks and prediction of high-risk drinking. Biol. Psychiatry Cogn. Neurosci. Neuroimaging https://doi.org/10.1016/j.bpsc.2020.01.011 (2020).
Dosenbach, N. U. F., Fair, D. A., Cohen, A. L., Schlaggar, B. L. & Petersen, S. E. A dual-networks architecture of top-down control. Trends Cogn. Sci. 12, 99–105 (2008).
Cavanagh, J. F. & Frank, M. J. Frontal theta as a mechanism for cognitive control. Trends Cogn. Sci. 18, 414–421 (2014).
Zhang, J., Díaz-Román, A. & Cortese, S. Meditation-based therapies for attention-deficit/hyperactivity disorder in children, adolescents and adults: a systematic review and meta-analysis. Evid. Based Ment. Health 21, 87–94 (2018).
Maric, V., Ramanathan, D. & Mishra, J. Respiratory regulation & interactions with neuro-cognitive circuitry. Neurosci. Biobehav. Rev. 112, 95–106 (2020).
Acknowledgements
This work was supported by a University of California Global Health Basic Science Award (J.M.), Global Brain Health Institute award (J.M. and A.G.), and University of California San Diego lab start-up funds (J.M.). We thank Shyna Bhattacharjee and Angela Joseph for their assistance with data collection.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
A.G. is the co-founder, shareholder, BOD member, and advisor for Akili Interactive, a company that produces therapeutic video games. Meditrain and the other apps used in the study are not currently associated with Akili. The authors declare that they have no conflict of interest.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mishra, J., Sagar, R., Parveen, S. et al. Closed-loop digital meditation for neurocognitive and behavioral development in adolescents with childhood neglect. Transl Psychiatry 10, 153 (2020). https://doi.org/10.1038/s41398-020-0820-z
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41398-020-0820-z
This article is cited by
-
Enhancing attention in children using an integrated cognitive-physical videogame: A pilot study
npj Digital Medicine (2023)
-
Leveraging technology to personalize cognitive enhancement methods in aging
Nature Aging (2022)
-
Personalized machine learning of depressed mood using wearables
Translational Psychiatry (2021)