Low-intensity transcranial electrical stimulation (tES), including alternating or direct current stimulation, applies weak electrical stimulation to modulate the activity of brain circuits. Integration of tES with concurrent functional MRI (fMRI) allows for the mapping of neural activity during neuromodulation, supporting causal studies of both brain function and tES effects. Methodological aspects of tES-fMRI studies underpin the results, and reporting them in appropriate detail is required for reproducibility and interpretability. Despite the growing number of published reports, there are no consensus-based checklists for disclosing methodological details of concurrent tES-fMRI studies. The objective of this work was to develop a consensus-based checklist of reporting standards for concurrent tES-fMRI studies to support methodological rigor, transparency and reproducibility (ContES checklist). A two-phase Delphi consensus process was conducted by a steering committee (SC) of 13 members and 49 expert panelists through the International Network of the tES-fMRI Consortium. The process began with a circulation of a preliminary checklist of essential items and additional recommendations, developed by the SC on the basis of a systematic review of 57 concurrent tES-fMRI studies. Contributors were then invited to suggest revisions or additions to the initial checklist. After the revision phase, contributors rated the importance of the 17 essential items and 42 additional recommendations in the final checklist. The state of methodological transparency within the 57 reviewed concurrent tES-fMRI studies was then assessed by using the checklist. Experts refined the checklist through the revision and rating phases, leading to a checklist with three categories of essential items and additional recommendations: (i) technological factors, (ii) safety and noise tests and (iii) methodological factors. The level of reporting of checklist items varied among the 57 concurrent tES-fMRI papers, ranging from 24% to 76%. On average, 53% of checklist items were reported in a given article. In conclusion, use of the ContES checklist is expected to enhance the methodological reporting quality of future concurrent tES-fMRI studies and increase methodological transparency and reproducibility.
The advent of functional neuroimaging techniques allows one to investigate the neural correlates of behavior and underlying processes. However, functional neuroimaging techniques cannot by themselves establish causal evidence for brain-behavior relationships. Non-invasive brain stimulation techniques, including low-intensity transcranial electrical stimulation (tES), can be used in combination with functional neuroimaging, such as functional MRI (fMRI), to directly modulate patterns of neuronal activity and to establish causal evidence for the involvement of particular neural regions or networks in a specific behavior and cognitive process1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18. Over the last 20 years, low-intensity tES has been used extensively to study and modulate the neural mechanisms underlying basic physiological and cognitive processes19,20,21,22,23,24,25,26,27. Initial studies combining tES with fMRI were limited to sequential tES-fMRI recording, which primarily provides an avenue to investigate the neural mechanisms underlying tES offline (after) effects28,29,30,31,32,33,34.
Over the last decade, advances in tES technology have made concurrent tES-fMRI (i.e., simultaneous acquisition of fMRI data during tES) in principle technically feasible, thus enabling monitoring of immediate (online) tES effects. Concurrent tES-fMRI recording poses specific technical challenges35; however, these issues can be minimized when standard protocols are followed29,36,37,38,39. As a ‘perturb-and-measure’ approach40, applications are rapidly diversifying such that concurrent tES-fMRI is being used increasingly as a proxy measure for local and global neuro-metabolic activity to address causal mechanistic25,41,42,43,44 and predictive45,46 questions about underlying physiology and therapeutic effects.
Online integration of tES with fMRI recordings is, however, associated with technical and theoretical challenges, which include the risk of electrode heating due to the radio frequency (RF) pulses of the scanner47,48 and susceptibility-related echo-planar imaging (EPI) artifacts under the electrodes36,49. Furthermore, evidence is increasing for the significant impact of different methodological procedures on online fMRI responses to tES, including the localization of electrodes49,50,51, MRI-conditional stimulator setup29,37,38, the amount/type of contact medium35 and the timing of concurrent tES within the fMRI paradigm52,53. Given the variability in fMRI responses to tES, as well as tolerability/safety/noise concerns and methodological variations, there is an urgent need to clearly and systematically plan, measure, report and control as many of these methodological factors as possible. To ensure a robust interpretation of the data and to increase the potential for future replication, a reporting guideline and checklist is required. Methodological checklists not only improve the transparent reporting of study methodology and quality of data collection analysis, but also reduce design and reporting biases, factors with clear implications for future interpretation and use of the data. These checklists could also assist peer review and critical appraisal of research methodology54,55,56.
A limited number of methodological checklists are available in the field of human brain mapping for transcranial magnetic stimulation (TMS) studies55, transcranial direct current stimulation (tDCS) studies56 and MRI/fMRI studies57,58. One of the most well-known checklists in the field of human brain mapping is the COBIDAS (Committee on Best Practices in Data Analysis and Sharing) statement, which was developed to provide an evidence-based minimum set of recommendations to prepare best practices for data analysis, result reporting, algorithms and data sharing in neuroimaging research, to promote transparency, reliability and collaboration57. Given the potential for variability of the neural responses elicited by tES and the growing number of concurrent tES-fMRI studies, guidelines on factors that should be reported and/or controlled in concurrent tES-fMRI studies are essential to ensure that research findings are correctly interpreted and reproducible59. In addition, to facilitate meta-analyses, studies should be consistent in both methodology and reporting practice. Hence, we aimed to address these issues by conducting a Delphi study to reach a consensus on the essential items that are mandatory to be reported or recommendations that should be considered when reporting a concurrent tES-fMRI study (ContES checklist).
The Delphi method is a questionnaire-based approach designed to facilitate reaching a consensus, based on the fundamental principles of purposive sampling of experts in the field of interest, panelist anonymity, iterative questionnaire presentation and feedback of statistical analysis60,61,62. Like other expert consensus methods, the Delphi method is sensitive to expert sampling and opinion aggregation choices and is reliant on subjective expert judgement inherently, necessitating the use of other complementary empirical evidence62,63. However, rigorously collected and synthesized expert opinion constitutes an important source of information when empirical data are scarce and issues of interest are complex and multifaceted64,65.
This study was designed, implemented and coordinated within the International Network of tES-fMRI (INTF) and a steering committee (SC) that supervised the process of checklist development, data analysis and determining the initial criteria for item consensus and survey termination. The flowchart of the Delphi method adapted for this study is illustrated in Fig. 1. The development of the ContES checklist by using the Delphi technique involved the following steps: (i) formation of the SC, (ii) selection of the expert panel (EP), (iii) checklist development and revision and (iv) data collection and analysis. The protocol of this study is pre-registered in OSF66, and its questionnaires and databases are publicly available in the study’s Open Science Framework (OSF) page (https://osf.io/f9j8z/).
The role of the SC—Jorge Almeida, Andrea Antal, Marom Bikson, Hamed Ekhtiari, Lucia M. Li, Marcus Meinzer, Michael Nitsche, Duke Shereen, Hartwig Siebner, Charlotte Stagg, Axel Thielscher, Ines Violante and Adam Woods—was to determine the aim of the research, produce items and select additional experts for the Delphi process. Peyman Ghobadi-Azbari served as the Delphi facilitator to implement the preregistered methods within and between the SC and EP. The SC grew out of the INTF collaborative group after a series of webinars (28 March 2019, 27 June 2019 and 26 September 2019; recorded videos of the webinars are available on the INTF YouTube channel at https://youtube.com/channel/UCKcEYDmyqTipDW7OzuoVSlg), in which considerable heterogeneities of technical/methodological aspects in studies combining tES with fMRI were discussed along with strategies to help to bridge respective knowledge gaps and reduce heterogeneity.
The project involved the recruitment of a group of experts on the basis of a systematic review of 57 concurrent tES-fMRI studies (published before 1 January 2020). We reviewed the concurrent tES-fMRI literature in the PubMed research database from inception up to 1 January 1 2020 to select evidence-based concurrent tES-fMRI studies and experts who conducted those studies. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)67 flow diagram for the systematic review is provided in Extended Data Fig. 1. The search included the terms (tDCS OR transcranial direct current stimulation OR tACS OR transcranial alternating current stimulation) AND (functional magnetic resonance imaging OR fMRI OR functional MRI OR fcMRI OR functional connectivity MRI OR rsfMRI OR resting-state fMRI). 57 articles were selected on the basis of the PRISMA. The inclusion criteria used to invite the experts included being the first, last or corresponding author in ≥1 of 57 published studies in the field. In addition, the members of the SC were asked to nominate additional experts in the field of concurrent tES-fMRI to join the EP. All SC members agreed on the list of experts before the invitation process was started. Potential candidates for the EP based on the above-mentioned inclusion criteria (n = 54) were invited to participate in the Delphi study by using the contact information provided in each publication (the e-mail address of the respective contributor). Furthermore, the committee invited 21 additional experts to join the EP. The final list of EP invitees included 75 potential candidates with expertise across a range of backgrounds (i.e., medicine, neuroscience and biomedical and electrical engineering) and geographical areas (United States, United Kingdom, Germany, Denmark, Iran and Canada). Over 65% of the invitees (49 experts) accepted to join the EP.
Checklist development phase
The checklist aimed to facilitate an in-depth consensus among the tES-fMRI experts regarding the technical/methodological aspects necessary to be followed and reported to safely and successfully perform acquisition of fMRI during tES delivery and to enable critical appraisal and systematic reporting of concurrent tES-fMRI studies. The initial draft of the checklist was developed on the basis of currently available evidence in the field. The concurrent tES-fMRI studies were operationally defined as ‘studies that apply tES in the bore of the magnet while acquiring fMRI data during stimulation’. Studies using tES-fMRI in offline or sequential approaches (i.e., imaging only before and after stimulation) to evaluate the short- and long-term after-effects of brain stimulation were not included.
As the first step of the Delphi process, an initial email circulation started within the SC by asking each SC member to suggest a list of the specific technical/methodological aspects of the interaction between fMRI and tES that they considered very likely to influence a concurrent tES-fMRI study and its report. Repeated responses were merged, and the remaining items were thematically categorized into technological factors, safety and noise tests and methodological factors. The SC also suggested additional recommendations for each main item that should be considered to increase the quality of reporting. After agreement on the checklist format by the SC, the initial draft of the checklist was tested by rating five sample concurrent tES-fMRI articles with Yes/No ratings on whether the item was reported in the article or not, to ensure the checklist’s objectivity and clarity. After the pilot test, the SC reworded and/or combined items that were deemed unclear for inclusion in the revision phase. The results of each phase were summarized and displayed on the study’s OSF page (https://osf.io/f9j8z/).
Data collection and analysis
Checklist revision phase
The consensus-based checklist was distributed among the EP and SC members. For the revision phase, contributors were sent the initial checklist email. Two consecutive follow-up reminders were emailed if a response was not received after 7 and 14 d after the initial email circulation. Contributors who completed the revision phase before the deadline were recruited in the subsequent rating phase.
The revision phase included a section on self-reporting the demographics gleaned from the EP and SC members and questions about their previous experiences as concurrent tES-fMRI researchers. A second section requested that contributors comment on any ambiguity in the wording of the existing checklist. The revision phase included a definition of the purpose of the consensus study and an operational definition of a prescriptive standard protocol for concurrent tES-fMRI trials, the presentation of the initial checklist, followed by the opportunity to modify and remove items/recommendations, revise the current language of the checklist, merge selected items/recommendations and propose new items/recommendations for each subsection. Any item that was judged by the SC as an original idea was included as a new item/recommendation in the rating phase. Data obtained from the revision phase informed the SC in developing the final checklist.
Checklist rating phase
In the rating phase, the EP and SC members were sent a feedback document, which summarized the results of the checklist modifications. It included the clarification and correction of terminology, as well as a summary of comments. The participants were asked to rate each item in terms of importance in the methodology of concurrent tES fMRI studies, from 1 to 5. The exact question was as follows: ‘To facilitate visibility, replication and data sharing, how important is it to report this item?’. In addition, for each additional recommendation, we asked the following: ‘Do you support the inclusion of this additional note as a recommendation to be considered in concurrent tES fMRI studies?’.
To avoid a non-neutral center rating and encourage deliberation, ratings were termed ‘not important’, ‘slightly important’, ‘moderately important’, ‘highly important’ and ‘extremely important’. The participants were also allowed not to rate an item if they chose not to do so. The inclusion of each additional recommendation for each item could be rated ‘Yes’ or ‘No’.
In the rating phase, the average rating and the number of responses were calculated. For the main items, the tally of scores of ‘extremely important’, ‘highly important’ and ‘moderately important’ represented ‘essential’, whereas the tally of the scores of ‘slightly important’ and ‘not important’ represented ‘non-essential’. We defined consensus as ≥70% of respondent scorings of an item as essential, with a second, preferred level of consensus at ≥80% agreement. In addition, for additional recommendations, all respondents rated the 42 recommendations with the scores of ‘Yes’ or ‘No’, as previously described. The recommendation items receiving a response of ‘Yes’ from ≥50% of EP and SC members were defined as achieving consensus.
Assessing the state of reproducibility and transparency in concurrent tES-fMRI studies with the ContES Checklist
To retrospectively assess the state of reproducibility and transparency in reporting via adherence to the ContES checklist in published concurrent tES-fMRI studies, we evaluated 57 studies by using the ContES checklist. Three independent raters (H.T., N.M. and H.M.A.) rated adherence to the reporting checklist within these articles by using the 17-item checklist. An inter-rater reliability analysis using the Fleiss’ Kappa statistic was performed to assess the consistency of the raters’ evaluations of concurrent tES-fMRI research in the context of the ContES checklist68. If Fleiss’ Kappa is >0.8, the accuracy of the inter-rater reliability indicates ‘Almost Perfect Agreement’69. The relationship of reporting score with publication year, journal word limit, article word count and journal impact factor were also analyzed to assess whether articles with a better reporting status appear in journals with higher impact factors, whether the reporting status has improved across the recent years and whether word count limitations have an impact on reporting status. None of these relationships was significant. In addition, the number of example articles reporting each item is presented in Supplementary Table 1. To support the potential utility of the checklist, this table also provides a list of papers that demonstrates how each checklist item might affect the results of a concurrent tES-fMRI study as well as their importance for interpretability and generalizability. A summary of these 57 concurrent tES-fMRI studies is provided in Supplementary Table 2.
No ethics board approval was required for this expert panel activity. This consensus-seeking activity involved neither novel experimental work nor novel analyses of existing experimental data, but relied entirely on mutual exchange of expertise and opinions within the panel, taking into account all existing peer-reviewed scientific studies on concurrent tES-fMRI. Potential contributors were informed that by responding to the invitation letter, they were deemed to have consented to take part in the Delphi study and that their de-identified responses are included in all analyses. All named contributors also provided consent to be acknowledged in this paper.
Characteristics of the SC and EP and response rates
The characteristics of the SC and EP are presented in Supplementary Table 3. The SC and EP had a mean (s.d.) of 8.67 (5.4) and 5.54 (2.7) years of experience in tES-fMRI research, respectively. They represented a range of professions and academic disciplines, including neuroscientists (49% EP and 85% SC), cognitive scientists (16% EP and 8% SC), psychiatrists (10% EP and 0% SC) and psychologists (10% EP and 0% SC). Their professional settings were primarily universities (59% EP and 69% SC), hospitals (18% EP and 8% SC), university hospitals (0% EP and 8% SC), independent research institutes (6% EP and 15% SC) and businesses/industries (6% EP and 0% SC), and the most commonly held academic degrees were PhD (76% EP and 69% SC), MD-PhD (6% EP and 15% SC) and MD (4% EP and 15% SC). 49 EP members, along with 13 SC members completed the revision phase of the Delphi questionnaire, and 45 EP members and 9 SC members completed the rating phase. Retention was very high, with 54 (87.1%) revision phase contributors also completing the rating phase.
Results of the Delphi process
Checklist development phase
Four members of the SC (A.D.S., I.R.V., J.A. and H.E.) produced an initial list of items for the overall structure of the checklist on the basis of suggestions derived from the concurrent tES-fMRI study literature. After the discussions within the SC, the checklist was expanded from 14 items to 16 items. Thus, for the revision phase, nine items in the Technological Factors category, four items in the Safety and Noise Tests category and three items in the Methodological Factors category were provided within the checklist. Furthermore, an ‘Additional Recommendations’ column was added to the ContES checklist by the SC with 28 additional recommendations for experimental parameters and practices. These additional recommendations provide guidance to the requirements for adequate and appropriately documented simultaneous conduction of fMRI and tES.
Checklist revision phase
In the revision phase, one item was added to the ContES checklist (tES-fMRI Setting Test—Subjective Intolerance Reporting). The additional recommendations were expanded by the contributors from 28 items to 42 items. The final checklist includes 9 items and 19 recommendations in the Technological Factors category, 5 items and 12 recommendations in the Safety and Noise Tests category, 3 items and 9 recommendations in the Methodological Factors category and 2 general recommendations. Different versions of the checklist in its development process are provided by the study’s OSF page (https://osf.io/f9j8z/).
Checklist rating phase
The collected responses of the rating phase are shown in Figs. 2,3 Tables 1–3. Respondents had a high rate of agreement about most of the checklist items. However, three items (marked with † in Fig. 2), Amount of Contact Medium (Paste/Gel/Electrolyte), Electrode Placement Visualization and Wire Routing Pattern, did not reach the 80% consensus threshold (rated as moderately, highly or extremely important by >80% of the respondents). Of these, one item, Amount of Contact Medium (Paste/Gel/Electrolyte), did not reach the ≥70% consensus (marked with ‡ in Fig. 2 and Supplementary Table 4). However, the draft ContES checklist met the consensus level for all 17 items with a 65% threshold. The rating phase also included scoring of each of the additional recommended items by the scoring choices of Yes and No. The results showed that 38 (90%) of the recommendations reached the 50% threshold (rated as Yes by >50% of the contributors), but the following four recommendations did not (10%) (Fig. 3): Control of Amount of Contact Medium, Attenuation Characteristic of RF Filter, Restrictions/Regulations for RF Filtering Method and Restrictions/Regulations for Wire Routing Pattern.
The ratings of the items and recommendations of the ContES checklist are outlined in Tables 1–3. The full version of the ContES checklist that includes 17 essential items and 42 additional recommendations and a short version that includes essential items only are provided in Supplementary Tables 4–7 to be used by authors and reviewers. The reporting items that did not meet the 70% and 80% thresholds and additional recommendations that did not meet the 50% thresholds are marked in the final checklist. On the basis of this information, researchers can decide to choose more stringent or more liberal thresholds when using the checklist.
The state of reproducibility and transparency in concurrent tES-fMRI studies with the ContES checklist
Three independent raters evaluated the adherence of the concurrent tES-fMRI articles to the finalized reporting checklist items. The consistency of the raters’ responses resulted in a Fleiss’ Kappa of 0.85, indicating that the consistency is Almost Perfect Agreement69.
Inclusion of information about the main items of the ContES checklist varied widely, ranging from fully reported (100%; Manufacturer of MR Conditional Stimulator, Concurrent tES-fMRI Timing and Imaging Session Timing) to rarely reported (5.3%; Magnetic Resonance Conditionality Specifics for tES Setting and Amount of Contact Medium). The pattern of adherence to the checklist items varied relevantly between articles, ranging from 24% to 76%, averaging 53% of checklist items reported in a given article (Fig. 4).
All studies (100%) reported the Manufacturer of MR Conditional Stimulator (Item 1), and the Electrode Positioning (Item 3) was described clearly in 89% of articles, but details on the MR Conditional Electrode (Item 2) were included in only 56% of the reviewed articles. A relatively high number of papers (84%) reported the MR Conditional Skin-Electrode Interface (Item 4), but the Amount of Contact Medium (Item 5) was mentioned less frequently (5%). The Electrode Placement Visualization (Item 6) was shown in only 25% of the articles, and the RF Filter (Item 7) was included in 35% of the articles. The Wire Routing Pattern (Item 8) was described clearly in only 32% of the articles, and the tES-fMRI Machine Synchronization/Communication (Item 9) was rarely described (23%).
Only 5% of the articles reported information regarding MR Conditionality Specifics for tES Setting (Item 10). Few articles described details on the tES-fMRI setting test, ranging between 28% and 33% in Items 11–13 (33% Safety Testing, 33% Subjective Intolerance Reporting and 28% Noise/Artifact). Impedance Testing (Item14) information was included in only 28% of the articles. Concurrent tES-fMRI Timing (Item 15) and the Imaging Session Timing (Item 16) were reported in all 57 articles; however, tES Experience was reported less frequently (Item 17; 63%).
The highest reporting score was 76%, and six articles had a score >70%. One article reported >75% of the checklist items70. The lowest reporting score was 24%; 28 studies failed to meet a reporting threshold of 50%. The correlations of study reporting status with journal word limit, article word count and journal impact factor were not significant, and relevant graphs are presented in Extended Data Fig. 2.
The goal of this study was to develop a consensus-based checklist of methodological details to facilitate the evaluation of concurrent tES-fMRI studies in terms of methodological transparency and reproducibility (ContES checklist). We successfully developed the ContES checklist to guide authors in reporting the minimum information necessary to ensure reproducibility by using the 17 essential items. The 42 additional recommendations should be considered to further enhance the quality of future research in this field. This checklist can be used by editors and reviewers for critical appraisal of future studies. The checklist will also be helpful for researchers who are in the process of setting up a concurrent tES-fMRI study. Indeed, our systematic literature review and appraisal of 57 published concurrent tES-fMRI studies revealed a general lack of sufficient information to fully reproduce critical methodological details of these studies. Overall, this checklist offers a methodological framework for understanding and replicating previous studies and provides journal reviewers and editors with an efficient tool to gauge and promote concurrent tES-fMRI reproducibility. Figure 5 summarizes the items that are deemed important to be considered when conducting and reporting a concurrent tES-fMRI study.
The technical features of the stimulator and accessories, including setup on the subject´s head and configuration inside the scanner, underpin rigor and reproducibility—which in turn informs how these elements should be reported (Table 1). Manufacturer make and model should be reported, but the degree to which this satisfies items on the checklist varies. For example, although the material composition of an electrode may not always be explicitly specified, indicating a unique electrode part number would allow reproduction and referencing to other documentation. For other items, the amount of detail given beyond the part number can vary depending on the specific approach. For example, the thickness of paste or amount of other electrolytes is determined by the operator (setup) for large pad electrodes but controlled by the electrode holder for high-definition (HD) electrodes. The item number does, however, not explain setup details such as cable arrangements or ad-hoc steps to support electrode positioning. These aspects are important to state. The degree to which prior papers can be referenced for these methodological details (e.g., ‘we applied tES-fMRI used methods as reported in these other references’) should be qualified. Our analysis suggests that, to date, only a limited number of papers documented these details in sufficient detail. To the extent that these technical factors underpin reproducibility, expanding on them in any given publication supports rigor.
Electrodes used for stimulation inside the MR environment need to be at minimum MR conditional. Manufacturer and model details, electrode size and shape and materials and conductive properties of electrodes (conductive polymer, Ag/AgCl, etc.), connectors (often residually ferromagnetic), cables and other conductive materials (e.g., a specific brand of electrode paste and NaCl concentration) need to be provided. The relevant item in the checklist was considered highly important (item 1.2, average rating score: 4.06), and the inclusion of the additional recommendation was recommended by 85% of the contributors (recommendation 1.2.1). In addition, the position of the connector on the electrode should be reported, because it can significantly influence the homogeneity of current distribution within the electrode71. As revealed by concurrent tDCS-magnetoencephalography (MEG) experiments72, some conductive polymer (rubber) electrodes are magnetized, possibly during the production process, whereas others from the same brand are not. It remains to be determined whether this property is related to MR imaging artifacts.
Electrode positions and size are crucial parameters that determine the distribution of current flow in the brain tissue. It is therefore recommended unanimously by the experts to report this information (item 1.3, average rating score: 4.83) as precisely as possible. It should be distinguished between how the intended montage is determined and how this is practically implemented. The former may be based on the literature, theoretical considerations or dedicated E-field modeling in generic or personalized head models, whereas the latter may involve TMS hotspot-search (for M1), 10-20 electroencephalography (EEG) system head measurements or MR-based neuronavigation. The reported details should include the method of electrode positioning (e.g., with or without an EEG cap), the position of the electrode center and, if applicable, its orientation in case of non-circularly shaped electrodes. Instead of ‘the electrode was positioned on the left M1’, one would preferably state, for example, that ‘the electrode was centered on the first dorsal interosseous (FDI) motor hotspot as determined by TMS, with the longer sides of the 7 × 5 cm2 rectangular electrode pointing in anteromedial and posterolateral directions, respectively, and the connector inserted at the center of the electrode pointing toward one shorter side in the anteromedial direction’. If MRI-based head modeling was used, it should be stated whether electrode position had been determined on the basis of individual anatomy or a group template and how electrode positioning was performed (e.g., by using a neuronavigation system or EEG 10-20 coordinates). For MR-based neuronavigation, Montreal Neurological Institute (MNI) coordinates may be reported for electrode centers and/or corners. In the case of multi-session experiments, measures taken to ensure consistency of electrode placement across sessions have to be described, such as co-registration of stimulation electrodes with the individual MRI by using neuronavigation or the use of EEG caps and/or the 10-20 system73. The accuracy of the stimulation montage can be judged only if this information is provided, and the detailed information further allows post-hoc current modeling and replication studies.
It is also recommended to report the position of electrodes and, in particular, how the cables are directed (intertwined or separated) relative to the MR head coil, as well as information on how electrodes were affixed to the head in the MR and how the head was stabilized to prevent movement of electrodes relative to either the head or MR coil during recordings to prevent discomfort, impedance issues and imaging artifacts, respectively. A post-hoc validation of electrode positions can also be achieved by the acquisition of anatomical images with the stimulation electrodes in place, even though such images might not be easy to use for E-field modeling itself (because of the challenges of segmentation between the electrodes and skin), for which anatomical images without electrodes (and related artifacts) are preferred.
For the sake of reproducibility, it is also important to provide proper visualization of electrode position (item 1.6, average rating score: 3.56), which may be a photo, a sufficiently detailed schematic figure or, preferably, the precisely modeled representations on a 3D-rendered head surface as provided by E-field modeling software, such as simulation of noninvasive brain stimulation (SimNIBS)74 or realistic volumetric approach to simulate transcranial electric stimulation (ROAST)75. Besides the electrode position itself, it is also considered highly important to provide visual information (a photo or sufficiently detailed schematic figure) regarding the skin-electrode interface (item 1.4, average rating score: 4.09), that is, which conducting medium was used (e.g., gel/paste or saline solution with sponges), how contact with the skin was ensured if the hair was in between and measures taken to restrict the location of the contact medium to control the effective size of the stimulation surface and prevent short circuits. Although the amount of conductive medium (volume of saline solution or thickness of the layer of electrode paste) was rated of medium importance (item 1.5, average rating score: 2.91), this information, together with the evenness of its distribution across the electrode surface, is relevant for the impedance as well as the current distribution in the skin (and potentially the brain). It can, however, be very difficult in practice to control this variable, given that gel is squeezed between the electrode and the head and that saline solution flows away or evaporates, and it is thus helpful to also report potential countermeasures taken to control or measure this influence. In any case, electrode impedances should be measured directly before and after the experiment and be reported.
The introduction of any electrical wire into the MRI magnet bore may result in undesired artifacts and/or noise. Whereas the magnetic fields induced by the current in wires and electrodes during tDCS have been known to lead to false-positive activation in blood oxygenation level–dependent (BOLD) fMRI, tACS is far less prone to this artifact because the AC induces relatively rapid polarity-switching magnetic fields that time-average to zero net effect36. However, any electrical cabling used in tES-MRI experiments may act as a transmitter of RF energy from outside the MRI shielded environment and therefore may potentially increase electromagnetic RF interference with the MRI signal—even with the stimulator switched off. It is therefore extremely important to use an RF filtering method to suppress any external electromagnetic noise that may find its way into the scanner room by using the stimulator’s cabling as a tunnel. Currently, there are two hardware configurations for addressing this issue29: (i) the RF waveguide setup, which includes two filter boxes positioned outside and inside of the scanner room and cables running from the MRI control room through the RF waveguide tube37,38 and (ii) the RF penetration panel setup, which includes an RF filter adapter connected directly to the RF penetration panel and MRI ground, positioned outside of the scanner room with cables running from the stimulator in the MRI control room through the filter and RF penetration panel and to the electrode leads in the scanner room76.
It is therefore recommended unanimously by the contributors to report this information, which was rated to be moderately important (item 1.7, average rating score: 3.50), as precisely as possible. In addition, it is recommended that the authors provide details regarding the attenuation characteristic of RF filtering (recommendation 1.7.1, recommended by 50% of the contributors)49,51. For instance, ‘in the case of concurrent tDCS-fMRI, the characteristic bandwidth of the stop band of the filters on the DC path have been chosen to provide an approximate attenuation of 60 dB within a frequency range of 20–200 MHz to mitigate the RF noise, protecting common strength MRI scanners such as 1.5T and 3T, which operate at Larmor frequencies of ~64 MHz and ~128 MHz during fMRI (proton imaging)49’.
The wire routing pattern is also an important methodological detail when using transcranial stimulation simultaneously with fMRI measurement to increase replicability and validity of a study. However, this factor was rated as moderately important overall (item 1.8, average rating score: 3.43). It is important to make sure that the wires/cables do not create loops and run parallel to the bore axis as they approach and exit the scanner. It is also recommended by 58% of the contributors to ensure that after the subject enters the scanner, no loop can be created subsequent to entry because of wire movements, and practical measures to avoid them should be stated explicitly (recommendation 1.8.1). An example is a protocol reported by Williams and colleagues in which they emphasize that regarding stimulator setup, they ensured that no loop was made by the wire and that it was placed along the wall of the room38. It might be of importance (recommendation 1.8.2, recommended by 61% of the contributors) to include a figure illustrating the wiring details, such as the length of the cables required to connect inner and outer filter boxes, how the cables are connected to the electrodes, in which direction the cables leave the head, how multiple connecting cables are managed together and depending on the geometry of the head coil, how the cables enter the coil. Researchers are also encouraged (recommendation 1.8.3, recommended by 59% of the contributors) to report how they controlled cable motion inside the scanner (e.g., via sandbag, tape, etc.). One reason for doing so is to make sure that no loop is created by movements37. The contributors stress the importance of reporting if there were any deviations from the device manufacturers’ recommendations due to study purposes (recommendation 1.8.4, recommended by 78% of the contributors). There are different institutional policies in various countries regarding the use of electrical stimulators during MR imaging (e.g., permission to transfer electrical current through the penetration panel); however, only 29% of responders recommended reporting limitations at the levels of institutions/countries based on regulations or policies (recommendation 1.8.5). This information might not be required, because it does not affect the results of the study if the methods are transparent.
The full potential of simultaneous tES and fMRI acquisition, such as dynamic monitoring of the brain during tES, can be explored only if the data of both systems are temporally synchronized. Because the analysis depends critically on properly timed stimulation, it is crucial to synchronize imaging and stimulation. It is therefore recommended by the contributors to report this information, which was rated to be moderately important (item 1.9, average rating score: 3.70), as precisely as possible. In general, to address this issue, the presentation computer receives a volume trigger transistor–transistor logic (TTL) output from the MRI scanner and also sends output TTL triggers to the stimulator at desired stimulation times through a stimulus presentation software77. In addition, because synchronization protocols vary from center to center, it is recommended to clearly specify which method was used when sending the trigger pulse (recommendation 1.9.1, recommended by 96% of the contributors). There are several methods for addressing this issue, e.g., (i) universal serial bus (USB), (ii) parallel port or (iii) other additional devices. Two devices most commonly used for sending the trigger pulse include a USB data acquisition (DAQ) device, which works well for the Psychtoolbox software package78, and a USB-to-Serial port device, which works well for the E-Prime software package79.
Safety and noise tests
Reporting technical parameters that can be safety relevant was considered highly important (item 2.1, average rating score: 4.37). Ensuring the safety of the equipment for all possible MR environments and applications is usually not possible. Rather, most equipment is demonstrated to be MR conditional, i.e., safe under specific usage conditions in specific MR environments80. This implies that the same equipment might still pose safety risks when used in untested scenarios, requiring a re-evaluation of its safety.
Manufacturers of tES equipment should clearly document the safety-relevant technical parameters and settings used for their testing to ensure that users can replicate those appropriately. Although it was less frequently recommended to repeat these parameters in the paper (recommendation 2.1.2, recommended by 51% of the contributors), deviations should be clearly reported, including the measures that were taken to ensure that safety was not compromised. To provide some guidance, the following paragraph gives a brief overview of aspects that can be safety relevant and thus warrant consideration. Generally, external equipment brought inside the MR scanner might cause harmful effects via interaction with the static magnetic field, the magnetic gradient fields and the transmitted RF field81:
The static magnetic field exerts strong accelerating forces on ferromagnetic materials. In the case of tES-fMRI, using only non-magnetic materials for the cables and electrodes is a straightforward way that should be taken by the equipment manufacturer to prevent safety risks.
The time-varying magnetic gradient fields can create eddy currents in a conductive material that in turn result in mechanical forces via their interaction with the static field. This effect seems less relevant in the case of tES-fMRI for which the cables are the only high conductive parts. Because they do not form closed high-conductive loops at the low-electromagnetic frequencies corresponding to the time-varying gradient fields and are interrupted by the head, the electrodes, the stimulator and often also the safety resistors, the currents induced by gradient field switching are weak. This effect might, however, cause vibrations of the cables and might contribute to local nerve stimulation underneath the electrodes, although serious adverse effects such as burns due to tissue heating are unlikely81.
Interactions of cables and electrodes with the transmitted RF field can potentially lead to local tissue heating and burns, which has been described, for example, for electrocardiogram equipment82,83. The MR scanner controls the transmit power to ensure that the specific absorption rate (SAR) (i.e., the mean power deposition per unit of tissue weight) stays within safe limits everywhere in the body. When cables are brought into the scanner, they can absorb and redistribute RF energy. By that, they might heat up and additionally locally focus RF energy in close-by body tissue. Both mechanisms can cause burns. They can occur for wire loops, but also for more-or-less straight cables that act as antennas, depending on several parameters including wire length and path, the terminal conditions at the electrodes, the frequency of the RF transmit field (linearly scaling with the MR field strength as long as only hydrogen nuclei are imaged), the spatial extent of the RF transmit field and the head and body position inside the field. Some of these parameters are difficult to standardize in practice, so it is worth noting that the absence of heating in a test scan might not necessarily generalize. The safety of cables can be relevantly improved by adding resistors or cable traps or using lower conductive carbon instead of copper wires to systematically reduce or fully prevent the occurrence of standing waves. Although these measures can be very effective, expert knowledge is required when implementing them to ensure that they work as intended and in a wide range of practical scenarios84. When space allows, a simple measure to reduce the risk of burns is to ensure a physical distance between the cables and the skin. However, this does not help to prevent burns around points of high resistance, for example, at the connection to the electrode, which is generally more likely.
The electrodes and gel are far less conductive than metal so that their interaction with the RF transmit field is relevantly smaller. However, because the rubber electrodes still have better ohmic conductance than body tissue (e.g., ~30 S/m for the silicon rubber), they can cause a redistribution of the electric field that is created by the RF transmit field inside the head85. This effect can change the local SAR distribution and potentially cause local skin heating. Its strength depends on the size, shape and position of the electrodes, with the tendency that heating will be stronger for larger and thicker rubber electrodes.
The strength and duty cycle of the RF transmit field depends on the MR sequence type, which translates to the amount of local SAR increases that might occur due to electrodes or cables. Standard gradient-echo EPI used for functional brain imaging has comparatively low SAR. The SAR of newer multiband EPI and, in particular, turbo spin echo sequences (rapid acquisition with relaxation enhancement (RARE), turbo spin echo (TSE), fast spin echo (FSE), fluid-attenuated inversion recovery (FLAIR), T2-weighted sampling perfection with application-optimized contrasts using different flip angle evolutions (SPACE)) for T2-weighted structural imaging can be close to the allowed limits and might exceed these limits locally when cables and electrodes are present.
To summarize, interactions of the tES cables and electrodes with the RF transmit field depend on several parameters, which can make it difficult to generally ensure that local heating of the skin is kept within safe limits. Measures such as resistors added to the cables can reduce the risk of inducing adverse effects, but it remains important that the tES equipment is used within the technical parameter ranges that are cleared by the manufacturer. These parameters include the MR field strength, the type of transmit coil (body coil versus birdcage coil or transmit array), the MR sequence type and settings, the cable paths, the electrode sizes and their shape, position and material.
According to our knowledge, with the concurrent application methods, no higher number of reported adverse events compared to conventional tES applications and no serious adverse events have been reported86. Nevertheless, the study protocol must always comply with the safety standards for both tES and MRI, and these parameters should be carefully documented in the protocol/paper. More detailed suggestions and recommendations of experts can be found in Table 2.
Experiments should always start with safety testing when a new protocol is applied. These safety tests should include, but are not limited to, impedance testing, temperature testing (any temperature change under electrodes)87 and electric current tolerance testing (recommendation 2.2.1, recommended by 71% of the contributors). As suggested by ≥45 respondents (Figs. 2, 3), it is highly recommended to report impedance changes before and during the course of scanning and use a gel under the electrode (and not saline-soaked sponges) to avoid impedance increase (recommendation 2.5.1, recommended by 88% of the contributors).
The measurement of signal-to-noise ratio (SNR) was rated 3.91 (item 2.4), reflecting an important aspect in tES-fMRI studies. A small number of papers reported SNRs during the concurrent application of tES and fMRI, although it is well known that electrical equipment can compromise image SNR via several mechanisms, resulting in distorted images and false-positive changes87. The stimulator is connected to the MR-compatible electrodes by specially designed leads. In some devices, the stimulating leads are passed through a waveguide tube in the MR cabin wall and through an RF filter module consisting of two filter boxes. In other stimulators, there is only one filter attached to the patch (penetration) panel of the MRI (to ensure that the Faraday cage of the MRI room is not opened), and there is no noise induced during the normal MRI image acquisition. In spite of these safeguards, a small amount of noise is frequently present.
At least two papers reported susceptibility artifacts underneath the electrodes restricted to the skull layer with no visual evidence of any distortion in brain EPI images39,49. Another study using fMRI measurements during tES in cadavers observed significant BOLD signal changes36. Therefore, careful inspection of the SNR in different conditions during data acquisition is of critical importance to diminish errors and issues related to false-positive results. However, sometimes it is very difficult to deal with tES-fMRI artifacts because they might emerge sporadically, can be stimulation protocol and montage specific (e.g., tDCS seems to induce more noise than tACS) and often are not reproducible. Artifacts can be caused by many factors, by the noise of the stimulator itself, by the electrode/cable positions relative to the direction of the magnetic field or by individual anatomical differences. Artifact removal is not trivial and may depend on the applied task in the scanner and processing methods. Beyond manual inspection, in a recent study, independent component analysis was used to automatically remove noise in concurrent tDCS-fMRI88. Manual inspection suggested that by applying this method, noise was successfully removed from the voxel’s time series.
As suggested in Table 2, our recommendations are as follows:
tES manufacturers should state in the manual to what degree SNR changes during stimulation. Because SNR will depend on the local settings, the type of scanner (e.g., its shimming performance) and the MR sequences, several tests are suggested at different locations. This scan can be achieved by using phantoms and in human subjects by targeting different ROIs, tES doses and electrode positions49. Basing the tests on the spherical agar phantom and the procedures outlined in the Function Biomedical Informatics Research Network protocol would be a good starting point to ensure that the results of the quality tests are comparable between different MR sites and tES equipment89. They should be complemented by measurements of the RF noise spectrum using the standard test sequences provided by scanner manufacturers and by field mapping sequences to quantify the distortion of the static magnetic field induced by tES equipment90.
When a new stimulator or protocol is tested, pilot in-scanner investigations, first using phantoms and later healthy human participants, are necessary, and any incident or the absence of incidents should be reported.
SNR testing should always be done before the study starts (pilot measurements).
Later, during the study phase, when artifacts/SNR changes occur, it should be reported how many participants or runs were excluded from the analysis because of artifacts. Visualization of the artifacts is suggested.
If other devices are involved during the tES-fMRI session, it should be tested whether these devices or the interactions modify the SNR. In the protocol, it should be clearly stated how tES-induced noise can be or was separated from other types of noise.
Subjective tolerance was reported in only 33% of the concurrent tES-fMRI articles in our systematic review. A gradual change in intolerance/side effects (itching sensation, burning and pain) may be the source of non-tES-induced BOLD changes. This is particularly important for online tES studies but may also have an impact on offline tES. Subjective intolerance that leads to study discontinuation should always be reported. In addition, it is recommended that gradual subjective intolerance is reported (recommendation 2.3.1, recommended by 98% of the contributors). The Comfort Rating Questionnaire offers a good way to do this91. It measures sensations such as pain, tingling, burning, fatigue, nervousness, concentration, vision, sleep disturbances, headaches and flashes of light before, during and after stimulation, wherever possible as a visual analog scale between 1 (not at all) and 10 (extreme). Subjective intolerance reporting (item 2.3) was rated 4.33 by the contributors. This indicates consensus that it is important to report this item in publications.
It is crucial for studies to be precise about the timing of tES application relative to fMRI acquisition and also relative to any behavioral task performed, for both technical and experimental reasons. The checklist contains two items related to this specific point: items 3.1 (‘Concurrent tES-fMRI Timing’) and 3.2 (‘Imaging Session Timing’). It is the committee’s position that these items should be reported with precise details (Table 3).
This is to address three issues in particular. First, tES-fMRI studies targeting the sensorimotor cortex have clearly shown that acute stimulation effects during tDCS are not the same as its post-stimulation effects6,7. Therefore, knowledge about fMRI effects during stimulation cannot be simply extrapolated. Second, it is also increasingly recognized that brain state is an important determinant of the BOLD response to tES77,88. This is not surprising, given that tES is thought to modulate spontaneous neuronal activity via subthreshold changes of membrane polarization without directly eliciting action potentials. Thus, it is vital that studies report exactly when stimulation was applied during the task, so that findings can be interpreted with knowledge of the underlying brain state. One final issue is that there is still relatively little known about the duration and nature of after-effects of tES. Early tDCS studies used the classical bipolar montage to stimulate the motor hand area and measured the motor-evoked potential, rather than fMRI, as the physiological outcome. These seminal studies suggest that ≥3 min of continuous stimulation are needed to produce after-effects on corticomotor excitability21 and that prolongation of stimulation within specific windows can prolong after-effects92,93. However, these dose–response relationships have been less frequently studied for other brain areas94,95 and have yielded somewhat divergent results. This also applies to the concurrent tES-fMRI approach27.
We recommend that the timeline of experimentation is reported in detail together with other design-related information, such as counterbalancing of scans for within-subject studies, and whether subjects are repositioned in between scan runs should also be reported. This level of detail helps the reader to evaluate the results in the appropriate context and will enable the replication of techniques by other researchers.
For concurrent tES/fMRI studies, besides the importance of reporting the timing of tES relative to the timing of fMRI, it is also important to report the precise timing of tES within a particular fMRI imaging sequence (item 3.2, average rating score: 4.09). This is critical for assessing the temporal relationship between tES and physiological activity acquired from fMRI, particularly in scenarios in which the stimulation itself is dynamic (e.g., tACS, or during the ramping up/down of tDCS), which may then lead to different dynamics in fMRI-recorded physiological activity. For example, in a tDCS–functional near-IR spectroscopy study on a small sample of stroke patients, anodal tDCS resulted in non-stationary changes in blood oxygenation at the start of stimulation, possibly because of stimulation-induced changes in blood vessel dilation or neurovascular coupling96,97. This issue deserves additional consideration in block designs in which stimulation is applied in an on-off-on sequence. Here, physiological effects obtained by fMRI could possibly further be confounded by carryover or homeostatic effects due to repeated stimulation98,99. Researchers interested in using such a block design or repeated-stimulation approach may want to consider assessing the temporal stability of their stimulation protocol on the fMRI signal of interest. In all cases, the experts advise that care should be taken to report the precise stimulation start time in relation to the start of the imaging sequence and that a diagram or schematic be included along with the methodological description to provide maximum clarity to readers.
Reporting tES-associated sensations is crucial when using tES in any experimental or clinical setting, both for safety and methodological reasons. This item was rated at 4.06, which shows a high agreement within the panel regarding its relevance when reporting the methods in tES-fMRI studies. Different stimulation protocols can induce different sensory experiences and associated brain activity changes, which can in principle be confounded with true direct tES effects. Experimenters should consider this as a possible confound, e.g., when comparing between stimulation protocols and/or montages. For example, in the case of tACS, cutaneous sensation and phosphene perception (i.e., perceiving an illusionary flash-like light evoked by electric or magnetic pulses) are frequency specific100 and differ between brain states (e.g., lighting conditions and eyes open versus eyes closed53,101). Moreover, phosphene intensities have been shown to correlate with tACS-induced BOLD signal changes in the insular cortex, during 10-Hz stimulation53. In addition to phosphenes or cutaneous sensations, different tES montages can potentially induce different levels of discomfort, especially while participants are lying in the MRI (e.g., depending on the distance between the electrodes and the RF coil and on electrode location (e.g., if located on the back of the head)). When interpreting tES effects, it is important to carefully evaluate associated experiences to separate secondary from direct tES effects.
Reporting tES-associated sensory experiences is also crucial for safety reasons (see also section 4.2, subjective intolerance item). Asking participants to report on several factors such as electric current tolerance, headache, nausea, burning sensation and pain can help experimenters to better monitor unwanted tES side effects, which will help to guarantee the safety of concurrent tES-fMRI protocols. Therefore, we recommend assessing and reporting tES-associated experiences before, during and/or after tES (as appropriate). As stated in Table 3, we specifically offer three recommendations. First, tES-associated sensory experience (e.g., tactile sensation, phosphene perception, burning sensation and others) should be reported by using rating scales or questionnaires (e.g., refs. 91,102); in addition, participants should report whether they can differentiate between active and sham stimulation conditions (to assess the effectiveness of blinding whenever appropriate). The latter could be done by asking the participants to assign conditions in a forced-choice manner. This would allow testing whether they perform above chance level in detecting real stimulation, even when consciously not being able to state a difference. Second, electric current tolerance should be reported before entering the scanner room (if technically possible), inside the scanner and/or before/during scanning (as appropriate). Third, experimenters should report any instructions or additional training/tests that were conducted before the tES-fMRI session to make the experiment more suitable for the participant.
The ContES checklist is a consensus-based product that aims to promote best practices in reporting the relevant methodological details of concurrent tES-fMRI studies. We hope that the ContES checklist will encourage researchers to consider the scientific reasoning behind each methodological choice more thoroughly and report detailed methodological parameters of their studies more completely. This will improve the technical and scientific standard of concurrent tES-fMRI studies and help with the interpretability of the results and the reproduction of experiments. This checklist could also be useful when concurrent tES-fMRI study protocols are being designed and methodological parameters decided upon. Addressing the checklist in pre-registered protocols will enhance the scientific rigor and increase the replicability of protocols. As technological and methodological aspects of concurrent tES-fMRI studies diversify and the field advances over time, the SC of the checklist will work on future versions of the checklist to keep its details up to date. To ensure the feasibility of checklist application, we suggest considering reporting the ‘items’ (Supplementary Table 6) as a ‘routine’ requirement in concurrent tES-fMRI studies and considering ‘additional recommendations’ as ‘suggestions’ to improve the methodological design and reporting of concurrent tES-fMRI studies (Supplementary Table 7). As with any checklist, the exact importance of each item will ultimately differ for each study, and it is the responsibility of the investigator, with support from regulatory and supervising bodies, to adapt the standards appropriately. It is impossible to anticipate every possible experimental setup, equipment or subject characteristic and how these factors interact to influence important methodological and reporting considerations. Nonetheless, the development of generalized checklists provides standards and references for the research field and a common language to discuss methodological and reporting concerns with a baseline framework. Ultimately, the impact of this checklist will depend on its use by authors, reviewers and editors in the reporting, editing and peer-review processes.
The data presented and discussed in this paper are available on the study’s OSF page (https://osf.io/f9j8z/). We provide different versions of the checklist produced during the data-collection process on the OSF repository (https://osf.io/f9j8z/) to allow readers to follow the Delphi procedure on which the checklist is based.
Ligneul, R., Obeso, I., Ruff, C. C. & Dreher, J.-C. Dynamical representation of dominance relationships in the human rostromedial prefrontal cortex. Curr. Biol. 26, 3107–3115 (2016).
Zhang, Y., Yu, H., Yin, Y. & Zhou, X. Intention modulates the effect of punishment threat in norm enforcement via the lateral orbitofrontal cortex. J. Neurosci. 36, 9217–9226 (2016).
Baker, J. M., Rorden, C. & Fridriksson, J. Using transcranial direct-current stimulation to treat stroke patients with aphasia. Stroke 41, 1229–1236 (2010).
Wang, Y. et al. Neural substrates of updating the prediction through prediction error during decision making. Neuroimage 157, 1–12 (2017).
Frangou, P., Correia, M. & Kourtzi, Z. GABA, not BOLD, reveals dissociable learning-dependent plasticity mechanisms in the human brain. eLife 7, e35854 (2018).
Sehm, B., Kipping, J., Schäfer, A., Villringer, A. & Ragert, P. A comparison between uni-and bilateral tDCS effects on functional connectivity of the human motor cortex. Front. Hum. Neurosci. 7, 183 (2013).
Sehm, B. et al. Dynamic modulation of intrinsic functional connectivity by transcranial direct current stimulation. J. Neurophysiol. 108, 3253–3263 (2012).
Barron, H. C. et al. Unmasking latent inhibitory connections in human cortex to reveal dormant cortical memories. Neuron 90, 191–203 (2016).
Koolschijn, R. S. et al. The hippocampus and neocortical inhibitory engrams protect against memory interference. Neuron 101, 528–541.e6 (2019).
Yang, L.-Z. et al. Electrical stimulation reduces smokers’ craving by modulating the coupling between dorsal lateral prefrontal cortex and parahippocampal gyrus. Soc. Cogn. Affect. Neurosci. 12, 1296–1302 (2017).
Mizuguchi, N., Uehara, S., Hirose, S., Yamamoto, S. & Naito, E. Neuronal substrates underlying performance variability in well-trained skillful motor task in humans. Neural Plast. 2016, 1245259 (2016).
Hu, J. et al. How do self-interest and other-need interact in the brain to determine altruistic behavior? Neuroimage 157, 598–611 (2017).
Wu, Q. et al. A critical role of temporoparietal junction in the integration of top‐down and bottom‐up attentional control. Hum. Brain Mapp. 36, 4317–4333 (2015).
Nihonsugi, T., Ihara, A. & Haruno, M. Selective increase of intention-based economic decisions by noninvasive brain stimulation to the dorsolateral prefrontal cortex. J. Neurosci. 35, 3412–3419 (2015).
Ashizuka, A. et al. Functional relevance of the precuneus in verbal politeness. Neurosci. Res. 91, 48–56 (2015).
Woods, A. J. et al. Space, time, and causality in the human brain. Neuroimage 92, 285–297 (2014).
Xue, G., Juan, C.-H., Chang, C.-F., Lu, Z.-L. & Dong, Q. Lateral prefrontal cortex contributes to maladaptive decisions. Proc. Natl Acad. Sci. USA. 109, 4401–4406 (2012).
Clark, V. P. et al. TDCS guided using fMRI significantly accelerates learning to identify concealed objects. Neuroimage 59, 117–128 (2012).
Stagg, C. J. & Nitsche, M. A. Physiological basis of transcranial direct current stimulation. Neuroscientist 17, 37–53 (2011).
Kuo, M.-F., Polanía, R. & Nitsche, M. Physiology of transcranial direct and alternating current stimulation. In Transcranial Direct Current Stimulation in Neuropsychiatric Disorders 29–46 (Springer, 2016).
Nitsche, M. A. & Paulus, W. Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. J. Physiol. 527, 633–639 (2000).
Minhas, P. et al. Electrodes for high-definition transcutaneous DC stimulation for applications in drug delivery and electrotherapy, including tDCS. J. Neurosci. Methods 190, 188–197 (2010).
Bachtiar, V., Near, J., Johansen-Berg, H. & Stagg, C. J. Modulation of GABA and resting state functional connectivity by transcranial direct current stimulation. eLife 4, e08789 (2015).
Keeser, D. et al. Prefrontal transcranial direct current stimulation changes connectivity of resting-state networks during fMRI. J. Neurosci. 31, 15284–15293 (2011).
Zoefel, B., Archer-Boyd, A. & Davis, M. H. Phase entrainment of brain oscillations causally modulates neural responses to intelligible speech. Curr. Biol. 28, 401–408.e5 (2018).
Bikson, M. & Rahman, A. Origins of specificity during tDCS: anatomical, activity-selective, and input-bias mechanisms. Front. Hum. Neurosci. 7, 688 (2013).
Jamil, A. et al. Current intensity- and polarity-specific online and aftereffects of transcranial direct current stimulation: an fMRI study. Hum. Brain Mapp. 41, 1644–1666 (2020).
Ghobadi-Azbari, P. et al. fMRI and transcranial electrical stimulation (tES): a systematic review of parameter space and outcomes. Prog. Neuropsychopharmacol. Biol. Psychiatry 107, 110149 (2021).
Esmaeilpour, Z. et al. Methodology for tDCS integration with fMRI. Hum. Brain Mapp. 41, 1950–1967 (2019).
Almeida, J. et al. Polarity-specific transcranial direct current stimulation effects on object-selective neural responses in the inferior parietal lobe. Cortex 94, 176–181 (2017).
Lee, D., Mahon, B. Z. & Almeida, J. Action at a distance on object-related ventral temporal representations. Cortex 117, 157–167 (2019).
Antal, A. et al. Transcranial electrical stimulation modifies the neuronal response to psychosocial stress exposure. Hum. Brain Mapp. 35, 3750–3759 (2014).
Meeker, T. J. et al. Non-invasive motor cortex neuromodulation reduces secondary hyperalgesia and enhances activation of the descending pain modulatory network. Front. Neurosci. 13, 467 (2019).
Ruttorf, M., Kristensen, S., Schad, L. R. & Almeida, J. Transcranial direct current stimulation alters functional network structure in humans: a graph theoretical analysis. IEEE Trans. Med. Imaging 38, 2829–2837 (2019).
Woods, A. J. et al. A technical guide to tDCS, and related non-invasive brain stimulation tools. Clin. Neurophysiol. 127, 1031–1048 (2016).
Antal, A. et al. Imaging artifacts induced by electrical stimulation during conventional fMRI of the brain. Neuroimage 85, 1040–1047 (2014).
Meinzer, M. et al. Transcranial direct current stimulation and simultaneous functional magnetic resonance imaging. J. Vis. Exp. 2014, 51730 (2014).
Williams, K. A. et al. Simultaneous transcranial alternating current stimulation and functional magnetic resonance imaging. J. Vis. Exp. 2017, 55866 (2017).
Gbadeyan, O., Steinhauser, M., McMahon, K. & Meinzer, M. Safety, tolerability, blinding efficacy and behavioural effects of a novel MRI-compatible, high-definition tDCS set-up. Brain Stimul. 9, 545–552 (2016).
Paus, T. Inferring causality in brain images: a perturbation approach. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 1109–1114 (2005).
Bachinger, M. et al. Concurrent tACS-fMRI reveals causal influence of power synchronized neural activity on resting state fMRI connectivity. J. Neurosci. 37, 4766–4777 (2017).
Gilam, G. et al. Attenuating anger and aggression with neuromodulation of the vmPFC: a simultaneous tDCS-fMRI study. Cortex 109, 156–170 (2018).
Weinrich, C. A. et al. Modulation of Long-Range Connectivity Patterns via Frequency-Specific Stimulation of Human Cortex. Curr. Biol. 27, 3061–3068.e3 (2017).
Orlov, N. D. et al. Stimulating thought: a functional MRI study of transcranial direct current stimulation in schizophrenia. Brain 140, 2490–2497 (2017).
Lin, R. L. et al. Structural connectivity variances underlie functional and behavioral changes during pain relief induced by neuromodulation. Sci. Rep. 7, 41603 (2017).
Abend, R. et al. Modulating emotional experience using electrical stimulation of the medial-prefrontal cortex: a preliminary tDCS-fMRI study. Neuromodulation 22, 884–893 (2018).
Lemieux, L., Allen, P. J., Franconi, F., Symms, M. R. & Fish, D. R. Recording of EEG during fMRI experiments: patient safety. Magn. Reson. Med. 38, 943–952 (1997).
Saiote, C., Turi, Z., Paulus, W. & Antal, A. Combining functional magnetic resonance imaging with transcranial electrical stimulation. Front. Hum. Neurosci. 7, 435 (2013).
Antal, A., Polania, R., Schmidt-Samoa, C., Dechent, P. & Paulus, W. Transcranial direct current stimulation over the primary motor cortex during fMRI. Neuroimage 55, 590–596 (2011).
Meinzer, M., Lindenberg, R., Antonenko, D., Flaisch, T. & Floel, A. Anodal transcranial direct current stimulation temporarily reverses age-associated cognitive decline and functional brain activity changes. J. Neurosci. 33, 12470–12478 (2013).
Vosskuhl, J., Huster, R. J. & Herrmann, C. S. BOLD signal effects of transcranial alternating current stimulation (tACS) in the alpha range: a concurrent tACS-fMRI study. Neuroimage 140, 118–125 (2016).
Li, L. M. et al. Cognitive enhancement with Salience Network electrical stimulation is influenced by network structural connectivity. Neuroimage 185, 425–433 (2019).
Cabral-Calderin, Y. et al. Transcranial alternating current stimulation affects the BOLD signal in a frequency and task-dependent manner. Hum. Brain Mapp. 37, 94–121 (2016).
Baker, M. Fostering reproducible fMRI research. Nat. Neurosci. 20, 298 (2017).
Chipchase, L. et al. A checklist for assessing the methodological quality of studies using transcranial magnetic stimulation to study the motor system: an international consensus study. Clin. Neurophysiol. 123, 1698–1704 (2012).
Buch, E. R. et al. Effects of tDCS on motor learning and memory formation: a consensus and critical position paper. Clin. Neurophysiol. 128, 589–603 (2017).
Nichols, T. E. et al. Best practices in data analysis and sharing in neuroimaging using MRI. Nat. Neurosci. 20, 299–303 (2017).
Poldrack, R. A. et al. Guidelines for reporting an fMRI study. Neuroimage 40, 409–414 (2008).
Baker, M. Reproducibility crisis: blame it on the antibodies. Nature 521, 274–276 (2015).
Vernon, W. & Vernon, W. The Delphi technique: a review. Int. J. Ther. Rehabil. 16, 69–76 (2009).
Hsu, C.-C. & Sandford, B. A. The Delphi technique: making sense of consensus. Practical Assessment, Research, and Evaluation vol. 12 (2007).
Keeney, S., Hasson, F. & McKenna, H. P. A critical review of the Delphi technique as a research methodology for nursing. Int. J. Nurs. Stud. 38, 195–200 (2001).
Kennedy, H. P. Enhancing Delphi research: methods and results. J. Adv. Nurs. 45, 504–511 (2004).
Bojke, L. et al. Developing a reference protocol for structured expert elicitation in health-care decision-making: a mixed-methods study. Health Technol. Assess. 25, 1–124 (2021).
Lund, B. D. Review of the Delphi method in library and information science research. J. Doc. 76, 929–960 (2020).
Ekhtiari, H. & International Network of tES-fMRI. Developing a Checklist for Assessing the Methodological Quality of Concurrent tES-fMRI (CTF) Studies: A Consensus Study. https://osf.io/f9j8z/ (2020).
Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int. J. Surg. 8, 336–341 (2010).
Fleiss, J. L. Measuring nominal scale agreement among many raters. Psychol. Bull. 76, 378–382 (1971).
Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977).
Sotnikova, A., Soff, C., Tagliazucchi, E., Becker, K. & Siniatchkin, M. Transcranial direct current stimulation modulates neuronal networks in attention deficit hyperactivity disorder. Brain Topogr. 30, 656–672 (2017).
Saturnino, G. B., Antunes, A. & Thielscher, A. On the importance of electrode parameters for shaping electric field patterns generated by tDCS. Neuroimage 120, 25–35 (2015).
Marshall, T. R., Esterer, S., Herring, J. D., Bergmann, T. O. & Jensen, O. On the relationship between cortical excitability and visual oscillatory responses—a concurrent tDCS–MEG study. Neuroimage 140, 41–49 (2016).
Padberg, F. et al. Prefrontal transcranial direct current stimulation (tDCS) as treatment for major depression: study design and methodology of a multicenter triple blind randomized placebo controlled trial (DepressionDC). Eur. Arch. Psychiatry Clin. Neurosci. 267, 751–766 (2017).
Thielscher, A., Antunes, A. & Saturnino, G. B. Field modeling for transcranial magnetic stimulation: a useful tool to understand the physiological effects of TMS? In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 222–225 (Institute of Electrical and Electronics Engineers Inc., 2015).
Huang, Y., Datta, A., Bikson, M. & Parra, L. C. Realistic volumetric-approach to simulate transcranial electric stimulation—ROAST—a fully automated open-source pipeline. J. Neural Eng. 16, 056006 (2019).
Lefebvre, S. et al. Differences in high-definition transcranial direct current stimulation over the motor hotspot versus the premotor cortex on motor network excitability. Sci. Rep. 9, 17605 (2019).
Violante, I. R. et al. Externally induced frontoparietal synchronization modulates network dynamics and enhances working memory performance. eLife 6, e22001 (2017).
Kleiner, M. et al. What’s new in Psychtoolbox-3? A free cross-platform toolkit for Psychophysics with Matlab & GNU/Octave. Available at http://www.psychtoolbox.org (2007).
Schneider, W., Eschman, A. & Zuccolotto, A. E-Prime Reference Guide http://psy.swan.ac.uk/staff/lucignoli/E-Prime/ReferenceGuideV2_2012.pdf (2002).
Shellock, F. G., Woods, T. O. & Crues, J. V. MR labeling information for implants and devices: explanation of terminology. Radiology 253, 26–30 (2009).
Panych, L. P. & Madore, B. The physics of MRI safety. J. Magn. Reson. Imaging 47, 28–43 (2018).
Dempsey, M. F., Condon, B. & Hadley, D. M. Investigation of the factors responsible for burns during MRI. J. Magn. Reson. Imaging 13, 627–631 (2001).
Dempsey, M. F. & Condon, B. Thermal injuries associated with MRI. Clin. Radiol. 56, 457–465 (2001).
Kozlov, M. et al. RF Safety of Transcranial Direct Current Stimulation Equipment During MRI http://indexsmart.mirasmart.com/ISMRM2018/PDFfiles/4061.html (2018).
Kozlov, M., Horner, M., Kainz, W., Weiskopf, N. & Möller, H. E. Modeling radio-frequency energy-induced heating due to the presence of transcranial electric stimulation setup at 3T. Magn. Reson. Mater. Phy. 33, 793–807 (2020).
Antal, A. et al. Low intensity transcranial electric stimulation: safety, ethical, legal regulatory and application guidelines. Clin. Neurophysiol. 128, 1774–1809 (2017).
Moisa, M., Polania, R., Grueschow, M. & Ruff, C. C. Brain network mechanisms underlying motor enhancement by transcranial entrainment of gamma oscillations. J. Neurosci. 36, 12053–12065 (2016).
Li, L. M. et al. Brain state and polarity dependent modulation of brain networks by transcranial direct current stimulation. Hum. Brain Mapp. 40, 904–915 (2019).
Friedman, L. & Glover, G. H. Report on a multicenter fMRI quality assurance protocol. J. Magn. Reson. Imaging 23, 827–839 (2006).
Moisa, M., Pohmann, R., Ewald, L. & Thielscher, A. New coil positioning method for interleaved transcranial magnetic stimulation (TMS)/functional MRI (fMRI) and its validation in a motor cortex study. J. Magn. Reson. Imaging 29, 189–197 (2009).
Palm, U. et al. The role of contact media at the skin-electrode interface during transcranial direct current stimulation (tDCS). Brain Stimul. 7, 762–764 (2014).
Nitsche, M. A. & Paulus, W. Sustained excitability elevations induced by transcranial DC motor cortex stimulation in humans. Neurology 57, 1899–1901 (2001).
Nitsche, M. A. et al. Modulation of cortical excitability by weak direct current stimulation—technical, safety and functional aspects. Suppl. Clin. Neurophysiol. 56, 255–276 (2003).
Antal, A., Kincses, T. Z., Nitsche, M. A., Bartfai, O. & Paulus, W. Excitability changes induced in the human primary visual cortex by transcranial direct current stimulation: direct electrophysiological evidence. Investig. Ophthalmol. Vis. Sci. 45, 702–707 (2004).
Matsunaga, K., Nitsche, M. A., Tsuji, S. & Rothwell, J. C. Effect of transcranial DC sensorimotor cortex stimulation on somatosensory evoked potentials in humans. Clin. Neurophysiol. 115, 456–460 (2004).
Dutta, A., Jacob, A., Chowdhury, S. R., Das, A. & Nitsche, M. A. EEG-NIRS based assessment of neurovascular coupling during anodal transcranial direct current stimulation—a stroke case series. J. Med. Syst. 39, 205 (2015).
Durand, S., Fromy, B., Bouyé, P., Saumet, J. L. & Abraham, P. Vasodilatation in response to repeated anodal current application in the human skin relies on aspirin-sensitive mechanisms. J. Physiol. 540, 261–269 (2002).
Fricke, K. et al. Time course of the induction of homeostatic plasticity generated by repeated transcranial direct current stimulation of the human motor cortex. J. Neurophysiol. 105, 1141–1149 (2011).
Monte-Silva, K. et al. Induction of late LTP-like plasticity in the human motor cortex by repeated non-invasive brain stimulation. Brain Stimul. 6, 424–432 (2013).
Turi, Z. et al. Both the cutaneous sensation and phosphene perception are modulated in a frequency-specific manner during transcranial alternating current stimulation. Restor. Neurol. Neurosci. 31, 275–285 (2013).
Kanai, R., Chaieb, L., Antal, A., Walsh, V. & Paulus, W. Frequency-dependent electrical stimulation of the visual cortex. Curr. Biol. 18, 1839–1843 (2008).
Misselhorn, J., Schwab, B. C., Schneider, T. R. & Engel, A. K. Synchronization of sensory gamma oscillations promotes multisensory communication. eNeuro 6, ENEURO.0101-19.2019 (2019).
Göksu, C. et al. Human in-vivo brain magnetic resonance current density imaging (MRCDI). Neuroimage 171, 26–39 (2018).
Grainger, D. Safety Guidelines for Magnetic Resonance Imaging Equipment in Clinical Use https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/958486/MRI_guidance_2021-4-03c.pdf (2014).
R.A. is partially supported by the National Institute of Mental Health Intramural Research Program. J.A. is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement no. 802553 – ‘ContentMAP’) and by grant PTDC/PSI-GER/30745/2017 from Fundação para a Ciência e a Tecnologia Portugal and Programa COMPETE. A.A. is supported by the Ministry for Science and Culture of Lower Saxony Germany (76251-12-7/19 ZN 3456) and by the BMBF (STIMCODE 01GP2124B). D.A. is supported by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation (AN 1103/3-1)). C.B. is supported by the Research Foundation–Flanders (FWO) and the Queen Elisabeth Medical Foundation for Neurosciences. H.C.B. is supported by the Medical Research Council (MRC) UK (MC_UU_00003/4 and MC_UU_12024/3). T.O.B. is supported by the Boehringer Ingelheim Foundation and the DFG (Grant 362546008). M.B. is supported by grants from Harold Shames and the National Institutes of Health: NIH-NIDA UG3DA048502, NIH-NIGMS T34GM137858, NIH-NINDS 1R01NS112996, NIH-NINDS 1R01NS101362, NIH-NIMH 1R01MH111896 and NIH-NINDS 1R01NS095123. J.C. is supported by a Wellcome Trust Senior Clinical Fellowship (106161/Z/14/Z). M.H.D. is supported by the UK MRC (SUAG044/G101400). H.E. is supported by the Laureate Institute for Brain Research (LIBR), Warren K. Family Foundation, Oklahoma Center for Advancement of Science and Technologies (OCAST, #HR18-139) and Brain and Behavior Foundation (NARSAD Young Investigator Award #27305). V.F. is supported by the Italian Ministry of Health (grant GR-2018-12365991). P.G.-A. is supported by the Cognitive Science and Technologies Council (grant CSTC-7761). I.G. is supported (grant number: 2013/07375-0) by Innovation and Diffusion of Mathematical Sciences Center Applied to Industry (CEPID-CeMEAI) of Sao Paulo Research Foundation (FAPESP), the University of Sao Paulo. G. Gilam is supported by the Redlich Pain Research Endowment and the Feldman Family Foundation Pain Research Fund. G.H. is supported by the Max Planck Society and by the DFG (HA 6314/3-1, HA 6314/4-1 and HA 6314/9-1). T.U.H. is supported by a Sir Henry Dale Fellowship (211155/Z/18/Z) from Wellcome Trust and the Royal Society, an ERC Starting Grant, a grant from the Jacobs Foundation (2017-1261-04), the Medical Research Foundation and a 2018 NARSAD Young Investigator grant (27023) from the Brain & Behavior Research Foundation. C.S.H. is supported by the German Federal Ministry of Education and Research (BMBF, grant nos. 16SV7787 and 13GW0273D) as well as the DFG under Germany’s Excellence Strategy (grant no. EXC 2177/1 – Project ID 390895286). C.-H.J. is supported by the Ministry of Science and Technology, Taiwan (grant nos.108-2639-H-008-001-ASP and 108-2321-B-075 -004 -MY2) and sponsored by a Taiwan Ministry of Education’s ‘Academic Strategic Alliance: Taiwan and Oxford University’ project grant. D.K. is supported by the German Center for Brain Stimulation (GCBS) research consortium (Work Package 5, grant no. 01EE1403E), funded by the BMBF. B.K. is supported by the National Institute of Neurological Disorders and Stroke and the National Institute of Mental Health under awards R01MH111766 and R21MH113917. L.M.L. is supported by an NIHR Clinical Lectureship, Academy of Medical Sciences Starter Grant and the NIHR Brain Injury MedTech Cooperative. S.-L.L. is supported by the National Institutes of Health (K01 HD091283 and R01 NS115845). T.J.M. is supported by a Postdoctoral Scholarship from the Neurosurgery Pain Research Institute at the Johns Hopkins Medical Institute and National Institutes of Health (R01 NS107602). M. Meinzer is supported by the DFG (ME 3161/3-1). M.A.N. is supported by DFG Projektnummer 316803389 – SFB 1280, the German Federal Ministry of Education and Research (BMBF, GCBS grant 01EE1501) and the EU (NEUROTWIN, grant 101017716). A.O. is supported by RF1MH117428 and RF1MH124909. C.C.R. is supported by an ERC Consolidator grant (BRAINCODES, grant #725355) and by the Swiss National Science Foundation (grant #100019L_173248). M.R. was supported by Deutscher Akademischer Austauschdienst (DAAD - Project-ID 57212180). G. Schlaug acknowledges support by U01NS102353 and R01MH111874. A.D.S. is supported by National Institute of Neurological Disorders and Stroke under award R21NS115018. H.R.S. holds a 5-year professorship in precision medicine at the Faculty of Health Sciences and Medicine, University of Copenhagen, which is sponsored by the Lundbeck Foundation (grant no. R186-2015-2138). H.R.S. has received a Lundbeckfonden ‘Collaborative Alliance’ grant (grant no. R336-2020-1035). H.R.S. and A.T. are supported by Innovationfund Denmark grant agreement number 9068-00025B. C.J.S. holds a Sir Henry Dale Fellowship, funded by the Wellcome Trust and the Royal Society (102584/Z/13/Z). B.T. is supported by CIHR grant 390283, CFI grant 34095 and NSERC grants RPIN-05394 and RGPAS-477166. A. Thielscher was supported by the Lundbeck foundation (R244-2017-196 and R313-2019-622). D.T. is supported by the DFG - Projektnummer 316803389 - SFB 1280. I.R.V. and T.A. are supported by the BBSRC (BB/S008314/1). B.Z. is supported by the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement number 743482. The views presented in this manuscript represent those of the authors and not necessarily those of the funding agencies.
The City University of New York holds patents on brain stimulation with M.B. as inventor. M.B. has equity in Soterix Medical Inc. M.B. consults for, received grants from, assigned inventions to and/or serves on the Scientific Advisory Board of Boston Scientific, GlaxoSmithKline, Mecta and Halo Neuroscience. C.S.H. holds a patent for tES. M.A.N. is on the Scientific Advisory Boards of Neuroelectrics and Neurodevice. G.R. is a co-founder and works for Neuroelectrics, a company dedicated to providing noninvasive stimulation solutions for patients. K.S. is managing director of neuroConn GmbH and a shareholder in neurocare group AG. H.R.S. has received honoraria as a speaker from Sanofi Genzyme, Denmark, and Novartis, Denmark; as a consultant from Sanofi Genzyme, Denmark, and Lundbeck AS, Denmark; and as an editor-in-chief (NeuroImage: Clinical) and senior editor (NeuroImage) from Elsevier Publishers, Amsterdam, the Netherlands. He has received royalties as a book editor from Springer Publishers, Stuttgart, Germany, and from Gyldendal Publishers, Copenhagen, Denmark.
Peer review information
Nature Protocols thanks Kathleen Williams and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Chipchase, L. et al. Clin. Neurophysiol. 123, 1698–1704 (2012): https://doi.org/10.1016/j.clinph.2012.05.003
Moher, D. et al. Int. J. Surg. 8, 336–341 (2010): https://doi.org/10.1016/j.ijsu.2010.02.007
Buch, E. R. et al. Clin. Neurophysiol. 128, 589–603 (2017): https://doi.org/10.1016/j.clinph.2017.01.004
Nichols, T. E. et al. Nat. Neurosci. 20, 299–303 (2017): https://doi.org/10.1038/nn.4500
Poldrack, R. A. et al. Neuroimage 40, 409–414 (2008): https://doi.org/10.1016/j.neuroimage.2007.11.048
Antal, A. et al. Neuroimage 55, 590–596 (2011): https://doi.org/10.1016/j.neuroimage.2010.11.085
Weinrich, C. A. et al. Curr. Biol. 27, 3061–3068.e3 (2017): https://doi.org/10.1016/j.cub.2017.08.075
Orlov, N. D. et al. Brain 140, 2490–2497 (2017): https://doi.org/10.1093/brain/awx170
Violante, I. R. et al. eLife 6, e22001 (2017): https://doi.org/10.7554/eLife.22001
Zoefel, B. et al. Curr. Biol. 28, 401–408.e5 (2018): https://doi.org/10.1016/j.cub.2017.11.071
Extended Data Fig. 1 PRISMA flow diagram for concurrent tES-fMRI studies.
Diagram of the literature search (identification) and selection process (screening, eligibility and inclusion). NIBS, non-invasive brain stimulation; tPCS, transcranial pulsed current stimulation; tRNS, transcranial random noise stimulation.
Extended Data Fig. 2 Relationships between reporting score and publication context.
a, Relationship between the reporting score of each article and its word count. (Note that the article word count is not exactly accurate, because it is measured by counting the words from the beginning of the introduction to the end of the discussion part; thus, it might include the running title of each page, footnotes and the captions of figures and tables.) b, Relationship between the reporting score of each article and its journal word limit (note: the word limitation for journals with no word limitation is counted as 15,000). c, Relationship between the reporting score of each article with journal impact factor. d, Article reporting scores across the years. The relationships in a–c were assessed by using linear regressions, whereas a Kruskal-Wallis test was performed for d.
Supplementary Tables 1–5.
Supplementary Tables 6 and 7
Concurrent tES-fMRI (ContES 2021) checklist, short and long forms.
Rights and permissions
About this article
Cite this article
Ekhtiari, H., Ghobadi-Azbari, P., Thielscher, A. et al. A checklist for assessing the methodological quality of concurrent tES-fMRI studies (ContES checklist): a consensus study and statement. Nat Protoc 17, 596–617 (2022). https://doi.org/10.1038/s41596-021-00664-5
This article is cited by
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.