Abstract
Biomarkers predicting treatment outcome in major depressive disorder could enhance clinical improvement. Here this observational and prospective accuracy study investigates whether an age- and sex-normalized electroencephalography biomarker, based on the individual alpha frequency (iAF), can successfully stratify patients to different interventions such as repetitive transcranial magnetic stimulation (rTMS) and electroconvulsive therapy (ECT). Differential iAF directions were explored for sertraline, as well as rTMS (N = 196) and ECT (N = 41). A blinded out-of-sample validation (EMBARC; N = 240) replicated the previously found association between low iAF and better sertraline response. The subgroup of patients with an iAF around 10 Hz had a higher remission rate following 10 Hz rTMS compared with the group level, while the high-iAF subgroup had highest remission to 1 Hz rTMS and the low-iAF subgroup to ECT. Blinded out-of-sample validations for 1 Hz (N = 39) and ECT (N = 51) corroborated these findings. The present study suggests a clinically actionable electroencephalography biomarker that can successfully stratify between various antidepressant treatments.
Similar content being viewed by others
Main
Major depressive disorder (MDD) is one of the most common and debilitating disorders worldwide1. The disorder’s high level of heterogeneity (in both symptoms and neurophysiology) complicates adequate treatment prescription, which may limit treatment response2,3,4. For instance, both antidepressant medication and cognitive-behavioral therapy led to insufficient symptom relief at the group level when treatment was assigned in an arbitrary fashion5, with response rates around 40–50% and remission rates around 30–40% (ref. 6).
While targeting the patient’s individual neurophysiology (for example, precision psychiatry) seems to be infeasible at present, an implementable alternative is treatment stratification (for a discussion, see ref. 6), which reduces heterogeneity within a disorder by identifying subgroups of patients that preferentially respond to a certain treatment, using so-called biomarkers7,8. A nonrandomized, open-label study, based on resting-state electroencephalography (EEG) biomarkers, prospectively stratified between three antidepressants in MDD that resulted in better clinical outcomes relative to treatment-as-usual7. Importantly, due to its relatively low cost and ease of usage, EEG-biomarker stratification is especially suited for widespread implementation in clinical practice.
Several EEG biomarkers for treatment outcome in MDD have been proposed8,9. However, few markers could successfully be replicated. In fact, a recent meta-analysis examining EEG markers of treatment response in MDD raised doubts about their clinical applicability due to publication bias and a lack of cross- and out-of-sample validations10.
One EEG pattern that has shown potential as stratification biomarker is the individual alpha peak frequency (iAF), which denotes the modal frequency of an individual’s alpha oscillations (7–13 Hz). The iAF has been shown to be associated with cognitive performance and to be aberrant in various mental disorders. For instance, faster iAF has been related to better cognitive performance11,12,13,14, while slower iAF has been associated with higher symptom severity15,16 and less favorable treatment outcome17,18,19 and has been observed across many disorders such as Alzheimer’s disease20, burnout syndrome21, mild cognitive impairment22, psychosis23, schizophrenia23,24 and attention-deficit hyperactivity disorder (ADHD)25, with this slowing potentially reflecting reduced thalamocortical information transfer.
In patients with ADHD, slower iAF has been related to worse treatment outcome to methylphenidate26 and better treatment outcome to multimodal neurofeedback27. Based on these findings, our group recently developed Brainmarker-I, which is based on the iAF measured during the resting-state EEG. We showed that this biomarker can successfully assign patients with ADHD to the individual best out of several treatment options, with findings confirmed in blinded-out-of-sample validations28. For antidepressant medication (amitriptyline and pirlindole), a slow iAF was shown to be predictive of nonresponse29. However, this finding does not generalize across antidepressants, as was shown by subsequent studies reporting an association between slow iAF and better response to the selective sertraline reuptake inhibitor sertraline30. For repetitive transcranial magnetic stimulation (rTMS), a different association has been observed. Specifically, an iAF closer to 10 Hz (that is, the rTMS stimulation frequency) was associated with better improvement to 10-Hz left-dorsolateral prefrontal cortex (L-DLPFC) rTMS31, which was independently replicated, while no association emerged between iAF and outcome of 1-Hz right-DLPFC (R-DLPFC) rTMS32. For electroconvulsive therapy (ECT), to our knowledge, iAF prediction of treatment outcome is unknown.
In this Article, following these promising findings, we aimed to extend Brainmarker-I, developed for ADHD treatment stratification28, to treatments for MDD. We decided a priori to conduct statistical analyses in line with Voetterl et al.28 and the hypotheses outlined below, focusing only on remission as our primary outcome, given its higher clinical relevance and to avoid multiple testing. We first conducted a blinded out-of-sample validation in the double-blind placebo-controlled Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care (EMBARC) dataset33,34, aiming to replicate the previously mentioned sertraline finding and to demonstrate specificity of iAF-based prediction for sertraline but not placebo. Next, biomarker directions were tested for brain stimulation treatments, focusing on potential treatment stratification of patients with a difficult-to-treat depression. An iAF close to 10 Hz was a priori considered an indication for 10 Hz L-DLPFC rTMS, based on the above-mentioned replicated research31,32. For both 1 Hz and ECT treatment, discovery analyses were conducted and all possible directions of effect were examined. A potential finding was subsequently validated through blinded biomarker-informed prediction of patients’ remission status in unseen datasets. Finally, exploratory analyses testing predictive value of iAF for psychotherapy, ketamine and bupropion treatment were conducted.
Resting-state eyes-closed EEG data were preprocessed for all datasets, in line with previous preprocessing35. The iAF was calculated in accordance with Voetterl et al.28, and each patient was assigned a decile score, with low scores reflecting a slow iAF. Additionally, a synchronization indicator, denoting an iAF between 9.6 Hz and 10.4 Hz at the F3 location was implemented (Fig. 1) to mark close proximity to 10 Hz, resulting in three distinct biomarker subgroups that were compared for the different treatments: synchronization, low deciles (decile score 1–5 without synchronization range) and high deciles (decile score 6–10 without synchronization range). Positive predictive values (PPVs) indicated the remission rate within each Brainmarker-I subgroup. A normalized PPV (nPPV) was calculated to be able to compare remission rates that differed between datasets. In short, the respective remission rate of each dataset was set to 100% and the increase or decrease after stratification in relation to these 100% was calculated.
Finally, number-needed-to-treat (NNT) was calculated, which demonstrates how many patients need to be treated with the treatment recommended by the biomarker to get one more patient to remit compared with treating patients with the same active treatments but in a random fashion (not informed by the biomarker).
Results
Basic information about the different datasets is provided in Table 1 and Table 2. Remission rates of each dataset and treatment group are summarized in Supplementary Table 1.
Blinded sertraline replication
Results for the EMBARC dataset are visualized in Fig. 2.
Since the aim was to replicate previous findings of low iAF and remission to sertraline, the directed hypothesis was that the remission rate would be higher in the low-decile subgroup.
At 8 weeks treatment, the low-decile subgroup showed a slightly higher remission to sertraline treatment compared with group remission (nPPV +9%, PPV 45%, NNT 28), which increased to +15% (PPV 83%, NNT 9) at 16 weeks. For placebo, no direction of effect was found (nPPV +3%) after 8 weeks, or after prolonged treatment at 16 weeks (nPPV −3%).
Brain Stimulation Treatments
Stratification results of the rTMS and ECT analyses are visualized in Fig. 3. Full results of analyses in all three biomarker subgroups can be found in Supplementary Table 2.
In line with previous evidence31,32, the remission rate in the synchronization subgroup (iAF between 9.6 Hz and 10.4 Hz) in Dataset-2 for patients who had received 10 Hz rTMS was increased (nPPV +29%, PPV 77%, NNT 6) compared with the total group remission rate. Therefore, 10 Hz rTMS was regarded as first treatment choice for patients with a 10-Hz synchronous iAF.
Of the different subgroups tested in Dataset-2 in patients who had received 1 Hz rTMS treatment, the high-decile group showed the highest remission rate with an nPPV of +14% (PPV 60%, NNT 14). A blinded out-of-sample validation in the unseen rTMS Dataset-3 confirmed this direction of effect with an nPPV of +16% (PPV 50%, NNT 15).
For ECT, the low-decile subgroup in Dataset-4 presented with an increased remission rate of +38% (nPPV; PPV 36%, NNT 10) compared with the total group remission rate. A blinded out-of-sample validation in Dataset-5 corroborated the direction of effect with an nPPV of +18% (PPV 72%, NNT 9).
Brain stimulation treatment stratification
Based on prior findings, we conducted a simulation for stratification between brain stimulation interventions, calculating the weighted average of the PPVs that had previously been determined for each treatment.
The percentage of patients falling into the three different subgroups across all included rTMS and ECT datasets differed (Discussion). For low-decile, synchronization and high-decile subgroup, these were 47%, 30% and 23%, respectively.
Weighing each PPV in the biomarker-allocated subgroups by these percentages, and merging the different treatment samples into one dataset led to an increase in remission rate from 53% to 65% (NNT 9), an increase of normalized remission rate of +24% over the nonstratified remission rate.
Exploratory analyses
For psychotherapy Dataset-6, patients in the low-decile subgroup were more likely to remit, with an nPPV of +19% (PPV 35%, NNT 15). In the ketamine Dataset-7 and in patients of Dataset-1 who received buproprion for 8 weeks, neither low- nor high-decile scores were associated with remission (nPPV −2% and nPPV +1% for low deciles, respectively). Results are visualized in Supplementary Fig. 1.
Confounding factors analyses
To ascertain the presented findings were not related to differences in depression severity, we conducted one-way analyses of variance between the three biomarker subgroups (low decile without synchronization range, synchronization range, high decile without synchronization range) and baseline depression scores for all main datasets separately. There were no significant differences between groups in any of the datasets (P > .147).
Discussion
The present study successfully extends the previously introduced Brainmarker-I for ADHD to MDD treatment, thereby presenting a transdiagnostic and clinically actionable EEG biomarker. Following the previous finding of better treatment response to sertraline in patients with a low iAF30, we aimed to replicate this direction of effect in the randomized, placebo-controlled EMBARC dataset, expecting no effect for placebo. In addition to replicating the previously shown sertraline effect30 for remission after 8 weeks and 16 weeks of sertraline treatment, we demonstrated that this effect is specific to sertraline and does not hold for placebo at either of the two timepoints of outcome. The increase of remission rate to sertraline at week 8 was small (nPPV +9%), probably due to the high placebo remission rate of 29% that did not differ from the week-8 sertraline remission rate of 32%. It is known that placebo response can be substantial in antidepressant trials36,37 and a diminished response to the active antidepressant treatment has been reported in studies that include a placebo arm38. It is perceivable that the sertraline effect at week 8 was diminished by the possibility of receiving the inactive compound.
For 10 Hz rTMS treatment, the effect of better clinical response to 10 Hz rTMS in patients with an iAF closer to 10 Hz had already previously been demonstrated31 and replicated32. We quantified this finding by determining the Brainmarker-I synchronization subgroup in Dataset-2, which showed an increased normalized remission rate of +29% to 10 Hz rTMS compared with the group remission rate. This finding has been linked to the theory of 10 Hz stimulation entraining the endogenous oscillations to the stimulation frequency, with the Arnold tongue model predicting better entrainment the closer the stimulation frequency is to the endogenous frequency31,39.
For 1 Hz rTMS we explored linear effects in both directions, with either low or high decile scores corresponding to remission. Only high decile scores were associated with increased remission to 1 Hz rTMS (nPPV +14%). This association was successfully replicated in a blinded-out-of-sample validation in rTMS Dataset-3 with a 16% higher normalized remission rate in the biomarker-identified subgroup. The same discovery analyses were repeated for ECT treatment. In ECT Dataset-4, the low-decile subgroup presented with a higher normalized remission rate of +38% (PPV 36%) compared to the overall group remission rate. We subsequently replicated this direction of effect in a blinded, out-of-sample validation in ECT Dataset-5, with an increased remission rate of +18% (PPV 72%) in the low-decile subgroup.
Given that a slow iAF might be considered an abnormality in the EEG21,22,23,24,40,41, this finding is in line with previous results, showing that patients with EEG abnormalities not only responded better to bilateral than to unilateral ECT, they also responded better to bilateral ECT than the group without abnormalities (77% response versus 67%, respectively)42. Although the publication did not specifically mention slow iAF as one of the assessed abnormalities, our findings support the conclusion of better treatment response to bilateral ECT in patients with EEG abnormalities since most patients in Dataset-4 (74%) and all patients in Dataset-5 received bilateral ECT. Future research is needed to examine whether our finding only holds for bilateral ECT as suggested by the findings by Malaspina et al.42. Interestingly, in a secondary analysis (Supplementary Discussion 1) examining the association between side effects to ECT and iAF in replication Dataset-5, we found that those patients that Brainmarker-I classified as ECT remitters also experienced fewer side effects of any kind (mainly memory impairment) with an nPPV of +23% (PPV 44%). This is a particularly intriguing finding since ECT side effects are the main concern of patients.
Remission rate is generally lower in patients with a lower iAF, and this was also the case in our samples which led to lower PPVs (as reported in the results). In traditional biomarker research where one biomarker predicts treatment success or failure, one might consider these rather low PPVs insufficiently strong for use in clinical practice. However, when considering the idea behind stratification, we see how even small improvements can be clinically meaningful and valuable6. Instead of denying someone a treatment based on an unfavorable prediction, the stratification approach assigns individuals to one of several evidence-based and commonly prescribed treatments based on their worst or best chances to remit. This means that, compared with the alternative one-size-fits-all approach, no harm is done by using stratification (for a more in-depth explanation, see ref. 6).
In this manuscript, we present a stratification solution for difficult-to-treat depression, based partially on previous findings (for example, for 10 Hz) but enhanced by additional recommendations for the best treatment option (of several common interventions) for the low- and high-decile subgroups.
We, moreover, suggest that Brainmarker-I might have potential to inform matched stepped care by suggesting a better chance to remit to sertraline as a first-line treatment for patients in the low-decile subgroup, and to ECT for the same group after sertraline treatment has failed.
When combining all brain stimulation findings and following the tested and validated stratification scheme, the already high remission rate of 53% improved to 65%, an effective increase of 12%, with an NNT of 9, which means that nine patients need to be treated with the biomarker-recommended treatment to have one more patient remit compared with active treatment prescribed in an arbitrary way. This NNT is close to the effect of tricyclic antidepressant and SSRI monotherapy (minimum NNT 7)43 compared with placebo. This is rather impressive, considering that the simulated stratified remission rate was not compared with a non-active control treatment but rather to active treatment, meaning it reflects the added effect of biomarker-based stratification.
Since the focus of the present article is treatment stratification, associations between iAF and outcomes outside the context of stratification were not tested and the presented biomarker was not developed in the classical sense, validated on specificity and sensitivity. Instead the aim was to determine correlates that help decide between several evidence-based treatments, enriching treatment decision with a brain-based parameter to be considered in the context of other determining factors, such as treatment history or contraindications. We acknowledge that treatment prescription is often bound by health care policies. The biomarker presented here is therefore only meant as a tool for the treating physician that aids to inform treatment prescription with the final prescription lying with the physician in consultation with the patient.
The present manuscript is subject to some limitations. Remission was evaluated by different depression scales across different datasets. However, all remission cutoff criteria used, except for the 17-item Hamilton Rating Scale for Depression (HRSD-17), were in line with the criteria proposed by Riedel et al.44. Similarly, EEG parameters and amplifiers differed across collection locations, resulting in a total of six different EEG systems included. During preprocessing, all data were matched to our own datasets as closely as possible. For the purpose of detecting the alpha peak in frontal electrodes, all EEG data complied with our requirements. Moreover, consistent findings in spite of heterogeneity in acquisition systems highlight the robustness of the biomarker.
The original ECT dataset was small (N = 19) and had an unusually low remission rate (26%) compared with standard ECT remission due to a highly heterogeneous, comorbid patient profile. However, since we successfully replicated our ECT finding in a larger unseen dataset with a remission rate considered normal for ECT, we assume that the small sample size and low remission rate did not affect our finding.
One noticeable feature of Brainmarker-I is that iAFs are not evenly distributed across the three stratification subgroups (Supplementary Table 3). Approximately 40–50% of the patients fall into the asynchronous decile 1–5 subgroup while the 10-Hz synchronous and asynchronous higher-decile (6–10) subgroup make up the remaining 50–60%. One reason is that an iAF of 9.8 Hz is already considered to fall in the upper alpha range, that is, fast alpha45, making the synchronization marker (9.6–10.4 Hz) overlap more with the higher-decile subgroup.
One limitation linked to the use of an nPPV is that it depends on the prevalence of the biomarker in the total group, since a high remission rate in the biomarker subgroup will contribute more to the total remission rate, the more prevalent that biomarker is in the total group.
On the other hand, due to the rather prominent differences in remission rate between datasets, mentioning only the PPV in itself would also be biased, with a higher remission rate almost automatically resulting in a higher PPV.
Lastly, the high heterogeneity between datasets and their clinical nature complicated assessing other clinical or cognitive variables. Brainmarker-I per definition controls for age and sex, additional analyses showed no differences in baseline severity between subgroups in all datasets, and the results were validated in heterogeneous clinical, previously unseen datasets, thereby confirming the robustness of the biomarker across changing variables. Nonetheless, it cannot be ruled out that other factors could have influenced or mediated the presented findings. More systematic research is required in the future to examine the link between the introduced biomarker and other cognitive and clinical factors, and to examine whether adding such variables to the biomarker recommendation could potentially improve treatment stratification.
Conclusions
We hereby present a clinically actionable transdiagnostic treatment stratification EEG biomarker that can successfully assign patient subgroups to various ADHD and MDD treatments, and is ready to be implemented in clinical practice.
Methods
Data collection and preprocessing
EEGs for Dataset-2, Dataset-3, Dataset-4 and Dataset-6 were recorded in a standardized manner in accordance with Brain Resource Ltd.35. In short, brain activity was measured from 26 channels of the 10–20 electrode international system (Fp1, Fp2, F7, F3, Fz, F4, F8, FC3, FCz, FC4, T7, C3, Cz, C4, T8, CP3, CPz, CP4, P7, P3, Pz, P4, P8, O1, Oz, O2; Quikcap, NuAmps) with a ground at AFz. Measurements consisted of 4-min resting-state recordings (2 min eyes open, 2 min eyes closed). Sampling frequency (FS) was 500 Hz, and a low-pass filter with an attenuation of 40 dB per decade above 100 Hz was applied before digitization. Horizontal and vertical eye movements were recorded with electrooculography (EOG) electrodes (VEOG upper and lower, HEOG left and right) and skin resistance was kept <10 kΩ for all electrodes.
Artifact rejection was performed with a fully automated, custom Python package46,47,48,49.
In short, bipolar EOG was removed from the EEG signal using Gratton50. A band-pass filter between 0.5 Hz and 100 Hz was applied, and the notch frequency of 50 Hz was removed. The following artifacts were detected and removed: electromyography, sharp channel-jumps (up and down), kurtosis, extreme voltage swing, residual eyeblinks, electrode bridging and extreme correlations. If more than 66% of a channel’s signal was artifactual, it was repaired using a Euclidian distance weighted average of at least three neighboring channels. If neighboring channels were not available due to artifactual data, the channel was removed. Very artifactual data were excluded on the basis of visual inspection.
For full details on preprocessing, see van Dijk et al.51. The Python code used for processing the EEG and calculating the iAPF is freely available for download at https://brainclinics.com/resources/.
Data cleaning and artifact rejection for Datasets-1, -5 and -7 were performed in Brain Vision Analyzer version 2.2.0 (Brain Products GmbH) by semi-automatic removal of epochs with signal amplitudes >150 mV.
For Dataset-1 (EMBARC)33 different EEG acquisition systems were used across different sites, leading to different numbers of electrodes (60–128) and FS (250/256). EEGs from all EMBARC locations were downsampled to the lowest FS (250 Hz), and electrodes were adjusted to match the 26 locations listed above.
ECT Dataset-5 (ref. 52) was treated accordingly, resulting in an FS of 200 Hz and 19 channel locations (FC3, FCz, FC4, CP3, CPz, CP4 and Oz missing).
Similarly, the ketamine Dataset-7 (ref. 53) combined three different studies with different FS and channel locations. Matching them to our data resulted in an FS of 500 Hz in two of the studies and 250 Hz in one study (25 patients), and either 18 or 19 channel locations (FC3, FCz, FC4, CP3, CP4, CPz and either Cz or Oz or both missing).
In line with Voetterl et al.28, the primary outcome measure for all datasets was remission—defined as a score of ≤12 on the Beck Depression Inventory-II (BDI-II; for Dataset-2, Dataset-3 and Dataset-6), ≤7 on the HRSD-17 (for Dataset-1 and Dataset-4), ≤2 on the Clinical Global Impression ratings (Dataset-5), and ≤7 on the Montgomery–Asberg Depression Rating Scale (MADRS, Dataset-7). These were in line with remission as defined by Riedel et al.44, except for the HRSD-17 cutoff, which was based on the original sertraline study30, as the aim was to replicate this finding.
Biomarker development
Brainmarker-I for MDD is based on the same previously reported EEG-biomarker for ADHD28. The biomarker was developed in a large heterogeneous clinical dataset (TDBRAIN+; N = 4,249). A subset of the data, the open-access TDBRAIN dataset (N = 1,274; two decades brainclinics research archive for insights in neurophysiology), is freely available at http://www.brainclinics.com/resources ref. 53 after login, with all data recorded at Research Institute Brainclinics (Brainclinics Foundation, Nijmegen, the Netherlands). In addition, the data are available on the data repository Synapse at ref. 54.
EEG (pre-)processing, as well as conditions and montages employed, often differ considerably across studies which can hinder replication of findings and thereby implementation of biomarkers in clinical practice. In Voetterl et al.28, a standardized processing pipeline was developed by making use of a biological ground truth, the maturation (speeding-up) of the iAF during childhood and adolescence.
In short, EEGs without measurable alpha oscillations, so-called low-voltage alpha (LVA) EEGs, were identified and excluded from further processing since an alpha peak cannot be determined in these data. Subsequently, 108 processing parameter permutations, comparing reference montage, condition, segmentation and topographical location, were tested against iAF maturation in 1,671 children and adolescents aged <18 years. Curve fitting was performed for males and females separately to find the mathematical model that most closely represented the brain-maturation effect. The permutation resulting in the highest correlation between iAF and age was used for the subsequent analyses.
Divergence values were calculated for each individual by subtracting from the individual’s iAF the model-predicted iAF for the individual’s sex and age, with a negative divergence score reflecting an iAF that is slower than the mean at that age and sex. The divergence values of the full dataset of >4,000 individuals were sorted and divided into ten equal-sized bins that denote the deciles used for assignment to the different subgroups later. For a more detailed description of the LVA and biomarker discovery, see Supplementary Discussion 2 and 3.
The iAF for all treatment datasets was determined by calculating the Fast Fourier Transform of the preprocessed resting-state eyes-closed EEG data, segmented into 5 s and re-referenced to an average reference, based on previous literature28,31.
The highest peak within the frequency range of 7–13 Hz was identified at the 10–20 EEG system locations F3 and Fz, in line with previous predictions28,31,32. Participants with missing clinical data, insufficiently clean EEG data and EEGs with LVA were excluded. The resulting values were divided into decile scores, according to the cutoff values determined in the large TDBRAIN+ dataset. Treatment predictions were made on the basis of low (decile 1–5) or high deciles (decile 6–10) in the Fz electrode. For an example, see Fig. 1.
Additionally, to account for the association between an iAF close to 10 Hz and 10 Hz rTMS, a synchronization indicator was introduced, which denotes an iAF around the stimulation frequency of 10 Hz at the F3 location (Fig. 1). To determine the optimal range for this third biomarker subgroup, we tested different cutoff values that were equidistant from the 10 Hz frequency. Due to the frequency resolution of 0.2 Hz, a result of data segmentation, the possible options were restricted.
Ranges tested were 9.4–10.6 (49% of individuals), 9.8–10.2 (22% of individuals) and 9.6–10.4 (30% of individuals). The range of 9.6–10.4 Hz encompasses approximately a third of the individuals in the dataset and therefore resulted in the best ratio of patients falling into this range and prediction accuracy.
Since this range overlaps with the low- and high-decile subgroups, patients falling into the synchronization range were excluded from the low- and high-decile subgroups, to obtain three distinct subgroups.
The automated algorithm described in Voetterl et al.28 was used to calculate iAF and decile scores for individuals of all datasets (Fig. 1).
Statistics
PPVs indicate the remission rate within the subsample of patients that Brainmarker-I would have stratified to the respective treatment. An nPPV was calculated to be able to compare predicted remission rates of different datasets, using the formula \(\left(\tfrac{m}{w}-1\right)\times 100\) (m, PPV; w, observed sample remission rate). In short, the respective remission rate of each dataset was set to 100%, and the increase or decrease after stratification in relation to these 100% was calculated.
In addition, NNT was calculated, which determined how many patients need to be treated according to Brainmarker-I stratification to get one more remitter compared to treating patients with the same active treatments but in an arbitrary fashion.
To test whether potential findings could be explained by differences in depression severity, we conducted one-way analysis of variance analyses between the 3 biomarker subgroups (low decile without synchronization range, synchronization range, high decile without synchronization range) and baseline depression scores for all main datasets separately. Biomarker calculation was conducted in Python, using modules numpy55, pandas49 and scipy47. All other statistical analyses were performed in IBM SPSS Statistics for Macintosh, Version 27.0.
Datasets
Datasets used in this study are shortly described below. Full details of the samples can be found in their respective published primary papers. Basic information about the different datasets is summarized in Table 1 and Table 2. All studies were approved by their respective institutional review boards (with ethical approval numbers available in the primary publications of the studies).
Dataset-1: EMBARC Sertraline
The EMBARC data were precollected data that were specifically requested for secondary analyses (for information on ethical approval, CONSORT diagrams, study protocol and participant inclusion, we refer the reader to the relevant references)33,34. The study was approved by the institutional review boards of all study sites (University of Texas Southwestern Medical Center, Columbia University/Stony Brook, Massachusetts General Hospital, University of Michigan, University of Pittsburgh, and McLean Hospital). All participants provided written consent for the original study from which the data has been used and received financial compensation. Between 29 July 2011 and 15 December 2015, outpatients were recruited at four sites: Columbia University, New York; Massachusetts General Hospital, Boston; University of Michigan, Ann Arbor; and University of Texas Southwestern Medical Center, Dallas. A total of 296 participants were randomized to sertraline or placebo, administered for 8 weeks, and then assessed for treatment response (defined as ≥50% reduction in HRSD-17 scores). The study design stipulated responders to remain on the same drug regimen, and to switch nonresponders to a different medication (sertraline for placebo nonresponders and bupropion for sertraline nonresponders) for the next 8 weeks.
We used these data to conduct a blinded out-of-sample validation analysis, with the directed hypothesis that patients with a low decile score would be more likely to achieve remission to sertraline but not placebo. We first inspected the nPPV for sertraline and placebo at the primary endpoint (week 8), respectively. As a secondary outcome, we calculated nPPVs after prolonged sertraline or placebo administration (week 16).
Dataset-2 and Dataset-3: rTMS
Dataset-2 and Dataset-3 are open-label, clinical datasets composed of patient data collected at multiple outpatient mental health care clinics in the Netherlands (Brainclinics Treatment, neurocare clinic Nijmegen, neurocare clinic The Hague, and Psychologenpraktijk Timmers Oosterhout) between May 2007 and November 2016 (Dataset-2) and December 2016 and June 2022 (Dataset-3). These studies were not reviewed by an independent ethics committee. Each patient provided written informed consent for data use before collection of the EEG data. In rTMS Dataset-2, 196 patients with MDD received 10 Hz rTMS over the L-DLPFC or 1 Hz rTMS over the R-DLPFC (at 120% resting motor threshold, 1,500 or 1,200 pulses, respectively) concurrent with psychotherapy32. In rTMS Dataset-3, 39 patients received only 1 Hz R-DLPFC stimulation and psychotherapy. All other parameters were the same as in rTMS Dataset-2.
Dataset-4 and Dataset-5: ECT
ECT Dataset-4 comprises data from the Study on Neuroimaging predictors of Outcome in ECT Patients (SNOEP), which was approved by Rijnstate Hospital and the medisch-ethische toetsingscommissies (METC) Arnhem/Nijmegen. Patients who were referred for ECT treatment at Rijnstate hospital between August 2016 and June 2022 were included. All patients provided written consent for the original study from which the data have been used before study start. Since these data were collected as part of a clinical trajectory, participants did not receive financial compensation. Thirty-nine outpatients with MDD were treated with ECT, 19 of whom had complete EEG and outcome data. Fourteen received bifrontotemporal (BL) stimulation and 5 right unilateral (RUL; according to d’Elia56) stimulation with stimulus dose relative to seizure threshold (SDRST; that is, 6 times seizure threshold (ST) in RUL and 2.5 times ST in BL ECT) and using 0.5 ms pulse width. Resting-state EEG data and HRSD-17-score were collected before ECT and 2 weeks post-ECT course.
ECT Dataset-5 comprised data of 60 patients who underwent ECT treatment at University Hospital Zurich between 2006 and 2015. This study was not reviewed by an independent ethics committee. All participants provided written consent for the original study from which the data have been used. Since these data were collected as part of clinical treatment, participants received no financial compensation. As part of clinical treatment, patients were treated with 6–12 sessions of bifrontal ECT (pulse width 0.5 ms, SDRST 1.5 of ST)52, with outcome analyzed by Clinical Global Impression ratings.
Stratification between brain stimulation techniques
Discovery analyses were conducted for brain stimulation techniques except for the 10 Hz rTMS prediction since the direction of effect was informed on previous findings. Since this finding has already been independently replicated32, no blinded out-of-sample validation was conducted. Instead, in Dataset-2, remission was predicted in patients with an iAF in the synchronization range (iAF between 9.6 and 10.4) who had received 10 Hz rTMS.
For 1 Hz and ECT datasets, all possible directions of effect were tested, that is, low decile score (1–5) excluding synchronization range, synchronization range, and high decile score (6–10) excluding synchronization range. Potential findings were subsequently evaluated in blinded, out-of-sample validations in rTMS Dataset-3 and ECT Dataset-5.
Lastly, we conducted a simulation for stratification between brain stimulation interventions.
Since patients were not evenly distributed across the different subgroups (low decile, synchronization and high decile), we first determined the percentage of patients that can be expected to be stratified to each subgroup based on all our rTMS and ECT datasets. Subsequently, we used these percentages to calculate the weighted average of the PPVs that were previously determined for each treatment. The resulting PPV and nPPV were the expected remission rate and normalized remission rate following stratification to rTMS and ECT with Brainmarker-I.
Dataset-6 and Dataset-7: exploratory analyses—psychotherapy, ketamine and bupropion
Dataset-6 comprised patient data from three outpatient mental health care clinics (Synaeda Leeuwaarden Fonteinland, Synaeda Drachten, Synaeda Heerenveen), and was therefore not reviewed by an independent ethics committee. Each patient provided written informed consent for data use before EEG and treatment start. Since these data were collected as part of clinical treatment, participants received no financial compensation.
Approval for all three ketamine studies used in Dataset-7 was obtained from the Ethical committee of Prague Psychiatric Centre/National Institute of Mental Health, Czech Republic before patient enrollment. Outpatients were recruited for study participation at Prague Psychiatric Centre, Czech Republic between 2010 and 2022. All patients provided written informed consent. No financial compensation was offered (for more information on ethical approval, study protocol and participant inclusion, we refer the reader to the relevant trial registration and reference53).
Exploratory analyses were performed in Dataset-6 for psychotherapy57, in Dataset-7 for ketamine treatment and in Dataset-1 for the subgroup of sertraline nonresponders, switched to bupropion (N = 54) in accordance with the previous analyses, however, without a guided hypothesis. Datasets are described in more detail in Supplementary Discussion 4.
Clinical trials
Data from the following trials were used in this study: Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care for Depression (EMBARC58, identifier NCT01407094), QEEG Cordance and EEG Connectivity Changes after Administration of Subanesthetic Ketamine Doses in Patients with Depressive Disorder59, The Role of mTOR (Mammalian Target of Rapamycin) Signaling Pathway in the Antidepressive Effect of Ketamine in Patients with Depressive Disorder60 and Clinical and Neurobiological Predictors of Response to Ketamine: towards Personalized Treatment of Depression61.
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
The TDBRAIN EEG data are freely available for download at https://brainclinics.com/resources/. The EMBARC dataset is available from the National Institute of Mental Health Data Archive (https://nda.nih.gov/edit_collection.html?id=2199). Other data are available from the corresponding author on reasonable request. Since these data were kindly shared with us by collaborators and due to the provided consent by participants of the respective studies, we are not at liberty to make these accessible in a repository.
Code availability
The Python code used for processing the EEG and calculating the iAPF was custom-made for this study and is freely available for download at https://brainclinics.com/resources/.
References
WHO. The Global Burden of Disease: 2004 Update (WHO Press, 2008).
Drysdale, A. T. et al. Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat. Med. 23, 28–38 (2017).
GOLDBERG, D. The heterogeneity of ‘major depression’. World Psychiatry 10, 226–228 (2011).
Luo, Y., Weibman, D., Halperin, J. M. & Li, X. A review of heterogeneity in attention deficit/hyperactivity disorder (ADHD). Front. Hum. Neurosci. 13, 42 (2019).
Rush, A. J. et al. Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am. J. Psychiat. 163, 1905–1917 (2006).
Arns, M., Dijk, H., van, Luykx, J. J., Wingen, Gvan & Olbrich, S. Stratified psychiatry: tomorrow’s precision psychiatry? Eur. Neuropsychopharm. 55, 14–19 (2022).
Vinne, N. et al. EEG biomarker informed prescription of antidepressants in MDD: a feasibility trial. Eur. Neuropsychopharm. 44, 14–22 (2021).
Olbrich, S., Dinteren, Rvan & Arns, M. Personalized medicine: review and perspectives of promising baseline EEG biomarkers in major depressive disorder and attention deficit hyperactivity disorder. Neuropsychobiology 72, 229–240 (2015).
Olbrich, S. & Arns, M. EEG biomarkers in major depressive disorder: discriminative power and prediction of treatment response. Int. Rev. Psychiatr. 25, 604–618 (2013).
Widge, A. S. et al. Electroencephalographic biomarkers for treatment response prediction in major depressive illness: a meta-analysis. Am. J. Psychiatry 176, 44–56 (2019).
Clark, C. R. et al. Spontaneous alpha peak frequency predicts working memory performance across the age span. Int. J. Psychophysiol. 53, 1–9 (2004).
Pahor, A. & Jaušovec, N. Making brains run faster: are they becoming smarter? Span. J. Psychol. 19, E88 (2016).
Grandy, T. H. et al. Individual alpha peak frequency is related to latent factors of general cognitive abilities. NeuroImage 79, 10–18 (2013).
Klimesch, W. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Rev. 29, 169–195 (1999).
Struve, F. A. & Boutros, N. N. Somatic implications of generalized and/or focal EEG slowing in psychiatric patients. Clin. EEG Neurosci. 36, 171–175 (2005).
Boutros, N. N. Diffuse electroencephalogram slowing in psychiatric patients: a preliminary report. J. Psychiatry Neurosci. Jpn 21, 259–263 (1996).
Arns, M., Gunkelman, J., Breteler, M. & Spronk, D. EEG phenotypes predict treatment outcome to stimulants in children with ADHD. J. Integr. Neurosci. 07, 421–438 (2008).
Martijn, A., Desirée, S. & Fitzgerald, P. B. Potential differential effects of 9 Hz rTMS and 10 Hz rTMS in the treatment of depression. Brain Stimul. 3, 124–126 (2010).
Arns, M. EEG-based personalized medicine in ADHD: individual alpha peak frequency as an endophenotype associated with nonresponse. J. Neurother. 16, 123–141 (2012).
Rodriguez, G., Copello, F., Vitali, P., Perego, G. & Nobili, F. EEG spectral profile to stage Alzheimer’s disease. Clin. Neurophysiol. 110, 1831–1837 (1999).
Luijtelaar, G., van, Verbraak, M., Bunt, M., van den, Keijsers, G. & Arns, M. EEG findings in Burnout patients. J. Neuropsychiatry Clin. Neurosci. 22, 208–217 (2010).
Garcés, P. et al. Brain-wide slowing of spontaneous alpha rhythms in mild cognitive impairment. Front. Aging Neurosci. 5, 100–100 (2013).
Murphy, M. & Öngür, D. Decreased peak alpha frequency and impaired visual evoked potentials in first episode psychosis. NeuroImage Clin. 22, 101693 (2019).
Yeum, T.-S. & Kang, U. G. Reduction in alpha peak frequency and coherence on quantitative electroencephalography in patients with schizophrenia. J. Korean Med. Sci. 33, e179 (2018).
Bazanova, O. M., Auer, T. & Sapina, E. A. On the efficiency of individualized Theta/Beta ratio neurofeedback combined with forehead EMG training in ADHD children. Front. Hum. Neurosci. 12, 3 (2018).
Arns, M. et al. Electroencephalographic biomarkers as predictors of methylphenidate response in attention-deficit/hyperactivity disorder. Eur. Neuropsychopharm. 28, 881–891 (2018).
Krepel, N. et al. A multicenter effectiveness trial of QEEG-informed neurofeedback in ADHD: replication and treatment prediction. NeuroImage Clin. https://doi.org/10.1016/j.nicl.2020.102399 (2020).
Voetterl, H. et al. Brainmarker-I differentially predicts remission to various attention-deficit/hyperactivity disorder treatments: a blinded discovery, transfer and validation study. Biol. Psychiatry Cogn. Neurosci. Neuroimaging https://doi.org/10.1016/j.bpsc.2022.02.007 (2022).
Ulrich, G., Renfordt, E., Zeller, G. & Frick, K. Interrelation between changes in the EEG and psychopathology under pharmacotherapy for endogenous depression. A contribution to the predictor question. Pharmacopsychiatry 17, 178–183 (1984).
Arns, M., Gordon, E. & Boutros, N. N. EEG abnormalities are associated with poorer depressive symptom outcomes with escitalopram and venlafaxine-XR, but not sertraline. Clin. EEG Neurosci. 48, 33–40 (2016).
Corlier, J. et al. The relationship between individual alpha peak frequency and clinical outcome with repetitive transcranial magnetic stimulation (rTMS) treatment of major depressive disorder (MDD). Brain Stimul. https://doi.org/10.1016/j.brs.2019.07.018 (2019).
Roelofs, C. et al. Individual alpha frequency proximity associated with repetitive transcranial magnetic stimulation outcome: An independent replication study from the ICON-DB consortium. Clin. Neurophysiol. https://doi.org/10.1016/j.clinph.2020.10.017 (2020).
Pizzagalli, D. A. et al. Pretreatment rostral anterior cingulate cortex theta activity in relation to symptom improvement in depression: a randomized clinical trial. JAMA Psychiatry 75, 547 (2018).
Trivedi, M. H. et al. Establishing moderators and biosignatures of antidepressant response in clinical care (EMBARC): rationale and design. J. Psychiatr. Res. 78, 11–23 (2016).
Arns, M. et al. EEG alpha asymmetry as a gender-specific predictor of outcome to acute treatment with different antidepressant medications in the randomized iSPOT-D study. Clin. Neurophysiol. 127, 509–519 (2016).
Walsh, B. T., Seidman, S. N., Sysko, R. & Gould, M. Placebo response in studies of major depression: variable, substantial, and growing. JAMA 287, 1840–1847 (2002).
Brunoni, A. R., Lopes, M., Kaptchuk, T. J. & Fregni, F. Placebo response of non-pharmacological and pharmacological trials in major depression: a systematic review and meta-analysis. PLoS ONE 4, e4824 (2009).
Sinyor, M. et al. Does inclusion of a placebo arm influence response to active antidepressant treatment in randomized controlled trials?: Results from pooled and meta-analyses. J. Clin. Psychiatry 71, 270–279 (2010).
Huang, W. A. et al. Transcranial alternating current stimulation entrains alpha oscillations by preferential phase synchronization of fast-spiking cortical neurons to stimulation waveform. Nat. Commun. 12, 3151 (2021).
Ramsay, I. S., Lynn, P. A., Schermitzler, B. & Sponheim, S. R. Individual alpha peak frequency is slower in schizophrenia and related to deficits in visual perception and cognition. Sci Rep. 11, 17852 (2021).
Dickinson, A., DiStefano, C., Senturk, D. & Jeste, S. S. Peak alpha frequency is a neural marker of cognitive function across the autism spectrum. Eur. J. Neurosci. 47, 643–651 (2018).
Malaspina, D., Devanand, D. P., Krueger, R. B., Prudic, J. & Sackeim, H. A. The significance of clinical EEG abnormalities in depressed patients treated with ECT. Convulsive Ther. 10, 259–266 (1994).
Arroll, B. et al. Antidepressants versus placebo for depression in primary care. Cochrane Database Syst. Rev. https://doi.org/10.1002/14651858.cd007954 (2009).
Riedel, M. et al. Response and remission criteria in major depression—a validation of current practice. J. Psychiatr. Res. 44, 1063–1068 (2010).
Sauseng, P. et al. EEG alpha synchronization and functional coupling during top‐down processing in a working memory task. Hum. Brain Mapp. 26, 148–155 (2005).
Hunter, J. D. Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9, 90–95 (2007).
Virtanen, P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods 17, 261–272 (2020).
Harris, C. R. et al. Array programming with NumPy. Nature 585, 357–362 (2020).
pandas-dev/pandas: Pandas 1.0.3. Zenodo https://doi.org/10.5281/zenodo.3715232 (2020).
Gratton, G., Coles, M. G. H. & Donchin, E. A new method for off-line removal of ocular artifact. Electroencephalogr. Clin. Neurophysiol. 55, 468–484 (1983).
Dijk, H. et al. The two decades brainclinics research archive for insights in neurophysiology (TDBRAIN) database. Sci. Data 9, 333 (2022).
Kirsten, A., Seifritz, E. & Olbrich, S. Electroencephalogram source connectivity in the prediction of electroconvulsive therapy outcome in major depressive disorder. Clin. EEG Neurosci. 51, 10–18 (2019).
Meyer, T. et al. Predictive value of heart rate in treatment of major depression with ketamine in two controlled trials. Clin. Neurophysiol. 132, 1339–1346 (2021).
Two-Decades Brainclinics Archive for Insights in Neurophysiology (TD-BRAIN). SYNAPSE https://www.synapse.org/TDBRAIN (2022).
Gramfort, A. et al. MEG and EEG data analysis with MNE-Python. Front. Neurosci. 7, 267 (2013).
D’Elia, G. in Psychobiology of Convulsive Therapy (ed. Fink, M., Kety, S., McGaugh, J. and Williams, T.) (VH Winston, 1974) pp.21–34.
Meijs, H. et al. A polygenic-informed approach to a predictive EEG signature empowers antidepressant treatment prediction: a proof-of-concept study. Eur. Neuropsychopharm. 62, 49–60 (2022).
EMBARC clinical trial. National Library of Medicine http://clinicaltrials.gov/show/NCT01407094 (2011).
QEEG Cordance and EEG Connectivity Changes after Administration of Subanesthetic Ketamine Doses in Patients with Depressive Disorder. EU Clinical Trials Register https://www.clinicaltrialsregister.eu/ctr-search/trial/2009-010625-39/CZ (2010).
The Role of mTOR (Mammalian Target of Rapamycin) Signaling Pathway in the Antidepressive Effect of Ketamine in Patients with Depressive Disorder. EU Clinical Trials Register https://www.clinicaltrialsregister.eu/ctr-search/trial/2013-000952-17/CZ (2013).
Clinical and Neurobiological Predictors of Response to Ketamine: towards Personalized Treatment of Depression. EU Clinical Trials Register https://www.clinicaltrialsregister.eu/ctr-search/trial/2018-001539-39/CZ (2018).
Acknowledgements
We thank M. Koppenberg for the design of figures and tables and acknowledge the contributors to the TDBRAIN+ dataset: K. R. Griffiths, R. DeBeus, M. S. Korgaonkar, R. Breteler, J. Fekkes, B. Reitsma, P. du Jour, R. van Ruth and J. Jansen. Some data presented in this work (Dataset-7) were supported by Czech Science Foundation (projects 21-32608S and 21-14727K). We thank the EMBARC National Coordinating Center at UT Southwestern Medical Center, M. H. Trivedi, MD, Coordinating PI, and the Data Center at Columbia University. Data and/or research tools used in the preparation of this manuscript were obtained from the National Institute of Mental Health (NIMH) Data Archive (NDA). NDA is a collaborative informatics system created by the National Institutes of Health to provide a national resource to support and accelerate research in mental health. Dataset identifier(s): 10.15154/1528638. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or of the Submitters submitting original data to NDA.
Author information
Authors and Affiliations
Contributions
H.T.S.V. conceptualized the study, performed all statistical analyses, participated in developing the EEG processing pipelines and code, and drafted the manuscript. A.T.S. provided supervision, and substantively revised the manuscript. S.O., S.S., R.R., A.P., D.A.P., N.v.V., J.A.v.W., M.B., B.R. and J.F. were involved in collecting the data and reviewing the manuscript. I.v.O. was involved in conceptualizing the study and revised the manuscript. H.v.D. took part in conceptualizing the study, developed the EEG processing pipelines, substantively reviewed the manuscript, and provided supervision. M.A. conceptualized the study, participated in analyzing the data, substantively reviewed the manuscript and supervised all phases of the study.
Corresponding authors
Ethics declarations
Competing interests
The authors declare the following competing interests: A.T.S. is Chief Scientific Advisor of PlatoScience and Alphasys, Founder of Neurowear Medical B.V., received equipment support from MagVenture, Deymed, and MagStim Company, and is Scientific Director of the International Clinical TMS Certification Course (www.tmscourse.eu). S.O. is cofounder of DeepPsy, a company for EEG-biomarker report systems. Over the past 3 years, D.A.P. has received consulting fees from Albright Stonebridge Group, Boehringer Ingelheim, Compass Pathways, Engrail Therapeutics, Neumora Therapeutics (formerly BlackThorn Therapeutics), Neurocrine Biosciences, Neuroscience Software, Otsuka, Sage Therapeutics, Sunovion and Takeda; he has received honoraria from the Psychonomic Society and the American Psychological Association (for editorial work) and Alkermes; he has received research funding from the Bird Foundation, Brain and Behavior Research Foundation, the Dana Foundation, Millennium Pharmaceuticals, National Institute of Mental Health (NIMH), and Wellcome Leap; he has received stock options from Compass Pathways, Engrail Therapeutics, Neumora Therapeutics, and Neuroscience Software. No funding from these entities was used to support the current work, and all views expressed are solely those of the authors. M.B. declares to have shares in ‘Psyon s.r.o’ and is involved in Compass Pathways trials with psilocybin and MAPS clinical trial with MDMA outside the submitted work. He has founded ‘PSYRES - Psychedelic Research Foundation’ and has shares in ‘Společnost pro podporu neurovědního výzkumu s.r.o’. M.A. holds equity/stock in neurocare and Sama Therapeutics, serves as consultant to Synaeda and Sama Therapeutics, and is named inventor on neurocare owned patent, but receives no royalties; Research Institute Brainclinics received research and consultancy support from neurocare and equipment support from neuroconn and Deymed. Brainmarker-I as described in this manuscript is offered by the non-profit mental health clinic Synaeda PMC (Leeuwarden, the Netherlands), where it is also used in practice. Authors H.T.S.V., S.S., R.R., A.P., N.v.V., J.A.v.W., M.B., I.v.O., B.R., J.F. and H.v.D. report no conflicts of interest.
Peer review
Peer review information
Nature Mental Health thanks Aron Hill, Albino Oliveira-Maia and the other, anonymous, reviewers for their contribution to the peer review of this work.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information
Supplementary Fig. 1, Discussion 1–4 and Tables 1–3.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Voetterl, H.T.S., Sack, A.T., Olbrich, S. et al. Alpha peak frequency-based Brainmarker-I as a method to stratify to pharmacotherapy and brain stimulation treatments in depression. Nat. Mental Health 1, 1023–1032 (2023). https://doi.org/10.1038/s44220-023-00160-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s44220-023-00160-7
This article is cited by
-
Biomarker-driven stratified psychiatry: from stepped-care to matched-care in mental health
Nature Mental Health (2023)