Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Preliminary evidence of altered neural response during intertemporal choice of losses in adult attention-deficit hyperactivity disorder

Introduction

Attention-deficit hyperactivity disorder (ADHD) is characterized by inattention, impulsivity, and hyperactivity and affects 3.4% of children1, with approximately 65% of children with ADHD continuing to have some symptoms in adulthood2. One indication of impulsive behaviour is ‘impulsive choice’, that is, choosing a smaller but immediate reward over a larger but delayed reward from the intertemporal choices presented. The intertemporal choice paradigm has been widely used to evaluate an individual’s temporal preference in economic surveys3,4,5,6,7,8 and neuroimaging studies9,10,11,12,13,14,15,16,17,18,19,20, as well as in clinical studies involving individuals with ADHD21,22,23,24,25,26,27,28,29,30. A recent meta-analysis of studies on impulsive choice in individuals with ADHD provided robust evidence that choice behaviour is more impulsive in individuals with ADHD than in control participants31. Some studies on impulsive choice in ADHD have indicated that individuals with ADHD show a strong negative affect when delay is imposed and, in light of this, ‘choosing immediate gains to avoid the slightest delay’ is the cause of the impulsive choice observed in ADHD24,25,26,27,32.

The delay aversion model, however, is concerned with gains alone and omits the factor of losses. Previous findings indicated that individuals with ADHD exhibit a dysfunctional response to losses. For example, children with ADHD require a larger response cost (monetary loss) to inhibit their reactions in the Go/no-go task or Stop task compared with control children33,34,35. A clinical study found that children with ADHD are prone to drug, alcohol, and gambling addictions as adults36. Another model of impulsive choice in ADHD that does take into account the specific features of both gains and losses37,38 proposes that individuals with ADHD cannot resist the temptation of immediate gains because of a reduced sensitivity to future negative outcomes caused by choosing immediate gains. This means that not only delay aversion to gains, but also reduced sensitivity to future negative outcomes, can cause impulsive choice behaviour.

Previous studies have shown differences in brain activity between adults with ADHD and healthy adults. For example, adults with ADHD show abnormalities in the corticostriatal loops, which are involved in delay discounting39, and in the dopamine system, leading to aberrant sensitivity to the size of both gains and losses40. Given these previous findings on brain function, we hypothesized that the brain areas (including the striatum) receiving projections from dopaminergic neurons, as well as the frontal areas (prefrontal, orbitofrontal, and medial prefrontal cortices, and insula) that have connections to the striatum, are involved in the delay discounting of gains and losses and that the brain activity associated with size sensitivity in these areas shows a difference specifically in loss prediction between ADHD and healthy individuals.

Thus, to understand the mechanism of the impulsive behaviour observed in ADHD, it is necessary to evaluate the effects of both ‘delay’ and ‘gain/loss’ factors. In our previous study, we developed an intertemporal choice task that can estimate an individual’s temporal preference for both gains and losses10. Here, by measuring brain activity using functional magnetic resonance imaging (fMRI) during an intertemporal choice task with gain/loss, we investigated the effects of the ‘delay’ and ‘gain/loss’ factors on behavioural and neural levels in patients with ADHD.

Results

Behavioural results

Fifteen adults with ADHD and 19 normal control (NC) participants (see Table 1 for participants’ demographic characteristics) performed repeated intertemporal choice tasks10 for future gains (GAIN condition) and losses (LOSS condition) (Fig. 1; see Methods), selecting either a white or yellow square corresponding to a smaller (+10/−10 yen) or larger (+40/−40 yen) reward/punishment option, respectively. We estimated the inverse discount rate of each participant based on his or her individual choice pattern in the GAIN and LOSS conditions.

In economic theory, intertemporal choice is explained by the delay discounting model44; the value of a delayed outcome is discounted temporally, discounted value = u(outcome) × g(delay), where u is the utility function and g is the discount function, which decreases with an increasing length of the delay. The ‘indifference point’ method was used to calculated each participant’s degree of discounting based on his or her individual choice patterns45. The delay length of the larger-later option (D L ) was plotted against the delay length of the smaller-sooner option (D S ) for each choice. Logistic regression analysis was used to fit the probability of choosing the larger-later option (P L ) as follows9,11:

$${P}_{L}=1/(1+{\rm{e}}{\rm{x}}{\rm{p}}[-({\beta }_{L}{D}_{L}+{\beta }_{S}{D}_{S}+{\beta }_{0})]).$$
(1)

when P L  = 0.5, this equation is transformed to

$${D}_{L}=-\,{\beta }_{{S}}/{\beta }_{{L}}{D}_{{S}}-{\beta }_{{0}}/{\beta }_{{L}}.$$
(2)

Logistic regression analysis provides the coefficients (β L , β S , and β0). Figure 2a and b show examples of indifference lines in the GAIN and LOSS conditions, respectively. For any point on this ‘indifference line’, the discounted values of the smaller-sooner and larger-later options were equal.

By applying the method of indifference points to the specific discount model, we can compute an individual discount rate from the estimated intercept. The theoretical model of hyperbolic discounting g(D) = 1/(1 + k h D) can be transformed to the same form as the indifference line equation in the following way:

$$\begin{array}{c}1/(1+{k}_{h}{D}_{L})\times u(40)=1/(1+{k}_{h}{D}_{S})\times u(10)\\ {D}_{L}=b{D}_{S}+c/{k}_{h}\,{\rm{in}}\,{\rm{the}}\,{\rm{hyperbolic}}\,{\rm{model}},\\ b=u(40)/u(10),c=(u(40)-u(10))/u(10)\end{array}$$
(3)

Here, u(40) and u(10) are the utility for 40 yen and 10 yen, respectively. We adopted a linear utility function here; thus, u(40) = 40 and u(10) = 10. k h is the discount rate and is included in the intercept. The intercept in Equation (2) −β0/β L reflects the ‘inverse discount rate’ c/k h in Equation (3).

Multiple comparison analysis also revealed a significant difference between the GAIN and LOSS conditions in NCs (P < 0.05, Tukey–Kramer method): NCs showed a larger inverse discount rate (i.e., less impulsivity) in the LOSS condition than in the GAIN condition. No such significant difference was seen in adults with ADHD (P > 0.1, Tukey–Kramer method). This result suggests that NCs exhibited asymmetry in the discounting of gains and losses, whereas adults with ADHD did not.

Imaging results

We evaluated the effect of condition (gain/loss) at the neural level. We subtracted event-related blood-oxygen-level dependent (BOLD) signals for choosing smaller-sooner options from event-related BOLD signals for choosing larger-later options, where a small difference between the BOLD signals would indicate weak gain/loss size sensitivity at the neural level. First, we simply performed a group comparison using a two-sample t-test in the GAIN and LOSS condition separately. In the LOSS condition, we found a significantly lower activation in adults with ADHD than in NCs in the caudate (P < 0.05, corrected; Fig. 3 and Supplementary Table S1). In the GAIN condition, on the other hand, no significant difference was observed (with P < 0.01, uncorrected). In the BOLD signal representing size sensitivity in the caudate, we observed a significant condition effect (Fig. 3b; F1,29 = 4.98, P = 0.033, η p 2 = 0.147; NC/GAIN: mean = −0.17, s.d. = 0.82, n = 17; NC/LOSS: mean = 0.84, s.d. = 0.80, n = 17; ADHD/GAIN: mean = −0.11, s.d. = 0.75, n = 14; ADHD/LOSS: mean = −0.0067, s.d. = 1.29, n = 14). On multiple comparison, BOLD signals representing size sensitivity were significantly weaker in adults with ADHD than in NCs in the LOSS condition only (Fig. 3b; P < 0.05, Tukey–Kramer method). These results suggest that neural activity representing size sensitivity is reduced in adults with ADHD and that this reduction occurs only in the LOSS condition. We also found significantly greater activity representing size sensitivity in the LOSS condition than in the GAIN condition in NCs alone (Fig. 3b; P < 0.001, Tukey–Kramer method). This result suggests that the NCs exhibited asymmetry in the size sensitivity in gains and losses, whereas adults with ADHD did not, as observed in discounting behaviour.

Next, to evaluate an interactive effect between gain/loss and group, we employed a factorial analysis with condition and group factors. A significant interaction was found in temporal areas, including the amygdala (P < 0.05, small-volume corrected; Fig. 4a and Supplementary Table S2). On multiple comparison, BOLD signals representing size sensitivity in the amygdala were significantly greater in adults with ADHD than in NCs in the LOSS condition (Fig. 4bP < 0.01, Tukey–Kramer method; NC/GAIN: mean = −0.33, s.d. = 0.74, n = 17; NC/LOSS: mean = −0.30, s.d. = 0.83, n = 17; ADHD/GAIN: mean = −0.92, s.d. = 1.20, n = 14; ADHD/LOSS: mean = 0.65, s.d. = 0.97, n = 14). This result was the opposite of the behavioural and activity in the caudate.

We also evaluated the effect of delay at the neural level. We defined the correlation between the event-related BOLD signals and the delay length of the chosen options as delay-related activity. A group comparison using a two-sample t-test for the GAIN and LOSS conditions separately found no significant difference between ADHD and NCs (P > 0.001, uncorrected). Factorial analysis revealed no significant interaction (P > 0.001, uncorrected). This suggests that brain activity representing delay length did not differ significantly between the two groups in either the GAIN or LOSS condition.

Discussion

A recent meta-analysis revealed that the striatum, including the nucleus accumbens and caudate, is involved in delay discounting54. We performed ROI analysis of the nucleus accumbens (Supplementary Fig. S1). Although we did not find a main effect of the condition (P = 0.063) and interaction (P > 0.1) in the size sensitivity of the nucleus accumbens, the activation pattern was similar to that of the caudate. We found a significant difference between the GAIN and LOSS conditions in NCs (P = 0.0055), but not in the participants with ADHD (P > 0.1). This result also supports our finding that ADHD patients did not exhibit the sign effect in the neural level in the caudate and nucleus accumbens. However, we did not observe a significant difference between groups in the LOSS condition (P > 0.1). This result suggests that the caudate is more sensitive to the LOSS in NCs than the nucleus accumbens and that a significant difference between groups in the LOSS was observed.

Here, the control participants discounted future losses less than future gains. In behavioural economics, this observed asymmetry in discounting between gains and losses is called the ‘sign effect’3,4,5. Our finding is that adults with ADHD, in contrast to the controls, did not exhibit the sign effect. Also, loss size insensitivity in the caudate in our adult participants with ADHD indicates that they had weaker ‘loss aversion’6 compared with healthy adults, because loss aversion is suggested to be the main cause of the sign effect7. Along these lines, because healthy individuals show loss aversion, future losses are predicted to be larger than the actual losses, which lowers apparent discount rates and inhibits impulsive behaviour. This would mean that our adult participants with ADHD did not predict future losses to be larger than the actual losses because of weaker loss aversion.

In the theoretical model of temporal discounting, not only ‘reduced loss size sensitivity’, but also ‘enhanced loss delay sensitivity’ may be causal factors for the sign effect or seemingly high discount rates for losses. If a future loss is perceived as a more distant event than it is in actuality, its discounted value at the time of decision-making becomes smaller, leading to the larger apparent discount rate. The analytical method used in this study to reveal the brain activity associated with size sensitivity and delay allowed us to investigate the two causal factors separately for seemingly high discount rates for future losses. Indeed, in our previous study, we observed ‘reduced loss size sensitivity’ in the insula and ‘enhanced loss delay sensitivity’ in the striatum in the individuals who did not exhibit the sign effect10. The present results showed no difference in delay-related activity in the loss condition, thereby eliminating the possibility of ‘enhanced loss delay sensitivity’ and allowing us to identify ‘reduced loss size sensitivity’ in the ADHD group. However, because we used only two different sizes in each condition, we could evaluate only one type of size sensitivity in this study. To understand to what extent size sensitivity is reduced or whether the absolute reward values influence the intensity of size sensitivity, it is necessary to use an experimental paradigm that allows for assessment of size-related and delay-related systems separately by manipulating size and delay independently, as seen in studies using rats61.

In conclusion, we used a neuroeconomics approach with an intertemporal choice task for gains and losses to demonstrate that altered loss size sensitivity results in apparent impulsive choice behaviour in adults with ADHD. Our findings shed light on the multifaceted impulsivity underlying ADHD. A limitation of this study was the modest sample size; thus, larger studies are required to evaluate the present findings and reveal the detailed mechanism of impulsive behaviour in ADHD and other psychiatric disorders.

Methods

Participants

The presence of psychopathological co-morbidity was screened using MINI and six patients had dysthymia, three had generalized anxiety disorder, and one had obsessive-compulsive disorder [one was suspected to have alcohol dependence upon screening with the MINI, but this was later ruled out by a trained psychiatrist (A.T.) upon interview]. The following exclusion criteria were applied: (1) comorbid current major depressive disorder; (2) history of manic episode; (3) schizophrenia; (4) any sign of neurological disorder; (5) history of electroconvulsive therapy; (6) alcohol or substance abuse or dependence as defined by DSM-IV; (7) use of a psychotropic drug within 4 weeks of MRI data acquisition, and (8) a full-scale IQ < 85 on the Wechsler Adult Intelligence Scale–Revised (WAIS-R)67 or 3rd Edition (WAIS-III)68. We also excluded one participant with ADHD due to a young age (16 years old).

Twenty-two Japanese age-, sex-, dominant handed-, and IQ-matched healthy NCs participated as the control group. The presence of ADHD symptoms and other psychopathological symptoms and diseases was evaluated in a manner similar to the patient group evaluation. The NCs were interviewed by a trained psychiatrist (A.T.) to screen for neuropsychiatric disorders. The exclusion criteria applied to the control group were: (1) ADHD symptom scale scores exceeding the cutoff value; (2) neurological illness; (3) traumatic brain injury with any known cognitive consequences or loss of consciousness for more than 5 min; (4) alcohol/substance abuse or addiction; and (5) history of psychiatric disease. We also excluded one NC who chose only the larger-later option in the GAIN condition because we could not estimate any discount parameter.

We excluded one adult with ADHD and two NCs from the fMRI data analysis because there was a problem with the synchronization between the fMRI scanner and the PC running the experimental task. As a result, behavioural data were acquired from 15 medication-naïve adults with ADHD [5 men and 10 women; mean age 31.3 (s.d. = 6.5) years] and 19 NC [7 men and 12 women; mean age 32.4 (s.d. = 6.0) years] and imaging data were acquired from 14 medication-naïve adults with ADHD [5 men and 9 women; mean age 31.2 (s.d. = 6.7) years] and 17 NC [6 men and 11 women; mean age 33.0 (s.d. = 5.7) years].

All participants were right-handed, as determined by the Edinburgh Inventory69 with a laterality index of 0.8 as the cutoff for right-handedness. IQ was assessed with the full-scale WAIS-R or III for the adults with ADHD and with the Japanese version of the National Adult Reading Test46 for the NCs. Level of social functioning was evaluated using the Global Assessment of Functioning (GAF)62. The demographic characteristics of the participants are shown in Table 1. Because we recruited IQ-matched healthy NCs, the ADHD group exhibited a shorter duration of education than the control group. If we were to try to match the duration of education between the NC and ADHD groups, only high-functioning patients would be recruited. To avoid such a bias, we prioritized IQ over duration of education.

The Ethics Committee of the Faculty of Medicine, The University of Tokyo, approved this study (No. 3048). After receiving a complete explanation of the study, all participants provided written informed consent. All methods were carried out in accordance with the approved guidelines and regulations.

We used a repeated intertemporal choice with monetary gains and losses10. In economic studies, the ‘intertemporal choice task’ has been commonly used to estimate a participant’s discount rate for both gains and losses3,4,5,6,7,8. In an economic intertemporal choice task, the participant chooses a smaller-sooner monetary gain/loss or a larger-later monetary gain/loss in the form of a questionnaire. A typical questionnaire contains several choices with a fixed delay length and different monetary amounts. To measure neural activity when computing the discounted value, we conducted a repeated intertemporal choice task11 with monetary gains and losses10. In the repeated intertemporal choice task, which we have described previously10, the participants chose between a smaller-sooner and a larger-later option in each trial. At the start of each trial, a white square (smaller-sooner option) and a yellow square (larger-later option), occluded by a varying number of black patches indicating the monetary payoff delays, were shown side-by-side on a display for 2,000 ms. In the GAIN condition, the choice was between a white square indicating a small gain (10 yen) with a short delay (1–7 s) and a yellow square indicating a large gain (40 yen) with a longer delay (6–26 s). In the LOSS condition, participants chose between a small loss (−10 yen) with a short delay and a large loss (−40 yen) with a longer delay. The participant indicated their choice by pressing a button; then, the black patches were removed from that square, one-by-one, at 400-ms intervals (this interval was defined as a ‘step’). When the square was completely exposed, the monetary payoff was displayed on the screen for 1,000 ms. After a 5,000–7,000-ms interval, the next trial began. The white and yellow squares were displayed with novel mosaic patterns. The initial number of coloured patches was randomly chosen from uniform distributions (white: 352 ± 32; yellow, 200 ± 120). The number of black patches removed at each step was also randomly drawn from a uniform distribution (5 ± 2). Each GAIN and LOSS session contained six blocks, and each block was finished when a total of 180 steps was achieved. In total, each GAIN and LOSS session lasted approximately 20 min. The order of the GAIN/LOSS conditions was counterbalanced across participants. Sixteen participants (ADHD: 7; NC: 9) performed six GAIN blocks first and then performed six LOSS blocks. Fifteen participants (ADHD: 7; NC: 8) performed six LOSS sessions first and then performed six GAIN blocks.

All participants were instructed to maximize monetary gains in the GAIN condition and to minimize monetary losses within the time limitation. Thus, at the beginning of each trial, the participants were required to choose between a sooner but smaller reward/loss (white) and a later but larger reward/loss (yellow) by comparing the number of black patches on the two squares. Because the participants were required to respond within 2,000 ms, decision-making was based on the visual impression of darkness on the white and yellow squares, rather than on an explicit count of the numbers of black patches and their division by the numbers of patches filled at each step. All participants received 7,500 yen as an initial monetary reward, with the total amount varying depending on their task performance. Rewards were disbursed later by direct deposit.

In this experiment, the duration of the task was fixed as described above. In detail, each block was finished when the sum of the duration (or steps) from choice to outcome in each trial exceeded the threshold (180 steps = 180 × 0.4 = 72 s). The participants were informed of this time limitation rule. Thus, each participant tried to maximize their gain per unit time and also tried to minimize their loss per unit time. If the delay for larger loss was too long, then the loss per unit time was quite small, which was the motivation for the participants to choose a larger-later loss over a smaller-sooner one. This experimental paradigm using time limitation can prevent participants from choosing sooner options independent of the size of the outcome based on delay aversion, that is, their motivation to finish the experiment as soon as possible.

The task presentation during the scan was controlled by Presentation software (version 14.5; Neurobehavioral Systems, Albany, CA). Visual stimuli were delivered to a translucent screen by an electromagnetic noise-shielded projector located at the foot of the bed. The participants viewed this screen through a tilted reflection mirror attached to the head coil. During the scan, participants held a response box and were instructed to use their right index finger to make a choice in each trial.

Imaging acquisition and preprocessing

A 3.0-T scanner (Philips Achieva 3.0 T X-series, Amsterdam, the Netherlands) was used to acquire structural T1-weighted images and T2*-weighted echo planar images (repetition time = 2,000 ms; echo time = 50 ms; flip angle = 80°; matrix = 128 × 128; field of view = 192 mm × 192 mm; slice thickness = 4 mm; slice gap = 0 mm) with BOLD contrast. SPM12 (Wellcome Department of Imaging Neuroscience, Institute of Neurology, London, UK) was used for preprocessing and statistical analyses. We discarded the first six image volumes to avoid T1 equilibrium effects. The images were corrected for slice timing, realigned to the first image as a reference, spatially normalized with respect to the Montreal Neurological Institute (MNI) echo planar imaging (EPI) template, and spatially smoothed with a Gaussian kernel (8 mm, full width at half-maximum).

Imaging data analysis

In the fMRI data analyses (individual level analysis), three event-related regressors were included in the GAIN and LOSS condition separately: stimulus display timing, reward display timing, and timing of each step (every 400 ms from the stimulus display until the reward display). To evaluate the effect of ‘delay’ and ‘gain/loss’ factors at the neural level, we focused on delay-related activity and outcome-related activity for both GAIN and LOSS outcomes as follows. We prepared two event-related regressors at the time of stimulus presentation for choosing a smaller-sooner option or a delayed option separately, and each event-related regressor included parametric modulation of the delay length for the chosen option. In total, we included six variables (regressors) for each session: (1) an event-related regressor for the timing of stimulus presentation when the participants chose the smaller-sooner option; (2) parametric modulation of regressor 1 with delay length; (3) an event-related regressor for the timing of stimulus presentation when the participants chose the larger-later option; (4) parametric modulation of regressor 3 with delay length; (5) an event-related regressor for the timing of each step; and (6) an event-related regressor for the timing of reward presentation.

We excluded the trials in which participants failed to press the button within the effective duration (2 s) from all regressors. All explanatory variables were convolved with a canonical hemodynamic response function and entered into a general linear model. We created images of parameter estimates for the event-related activity at the timing of stimulus displays as the interest contrasts for each participant in each condition.

In the group-level analysis, we employed two types of design. First, to evaluate group differences, we simply performed a group comparison with a two-sample t-test in the GAIN and LOSS conditions separately. Second, to evaluate an interactive effect between condition (GAIN/LOSS) and group (ADHD/NC), we employed a factorial design, in which size sensitivity or delay correlation was set as observation data, and a design matrix corresponding to factorial analysis with the condition (GAIN/LOSS) and group (ADHD/NC) as a factor was created. For visualization, we show a brain activation map with a relatively moderate threshold in Figs 3a and 4a (P < 0.05).

ROI analysis and statistical analysis

To precisely evaluate the relationship between condition and group in the activation representing size sensitivity, we performed ROI analyses in the caudate and amygdala. In the ROI analysis of the caudate, we used an anatomically defined ROI of the caudate that included the results of our present work and our previous study10. We focused on the caudate because the most frequently replicated findings in neuroimaging studies in ADHD patients are structural and functional abnormalities in the caudate70,71 and a recent meta-analysis revealed that not only the nucleus accumbens, but also the caudate are involved in delay discounting54. We defined the left and right head of the caudate [left caudate head: coordinates of centre of mass = (−8.86, 13.2, 1.12), volume = 1,976 mm3; right caudate head: coordinates of centre of mass = (8.95, 13.1, 1.28), volume = 1,944 mm3] by the PickAtlas (http://fmri.wfubmc.edu/software/pickatlas). In the ROI analysis of the amygdala, we used a functionally defined ROI with a threshold of P < 0.05 uncorrected [coordinates of centre of mass = (27.7, −7.91, −25.9), volume = 528 mm3]. In both ROI analyses, we again used a general linear model with the averaged BOLD signal of all voxels within ROIs at the single-subject level and computed the value of the parameter estimates for ‘size sensitivity’ and ‘delay correlation’ averaged across participants for each GAIN and LOSS condition: ‘size sensitivity’ was defined as the subtraction of event-related activity at the timing of stimulus display for choosing smaller-sooner options from event-related activity at the timing of stimulus display for choosing delayed options, and ‘delay correlation’ was defined as a parametric modulation of delay length. We used the MarsBaR toolbox for ROI analysis. In the statistical comparisons of behavioural and ROI data analyses, we used a 2 × 2 mixed ANOVA with condition (GAIN/LOSS) as the within-subject factor and group (NC/ADHD) as the between-subject factor and also used multiple comparison analysis with the Tukey–Kramer method after ANOVA.

References

1. Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A. & Rohde, L. A. Annual research review: A metaanalysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry 56, 345–365, https://doi.org/10.1111/jcpp.12381 (2015).

2. Faraone, S. V., Biederman, J. & Mick, E. The age-dependent decline of attention deficit hyperactivity disorder: a meta-analysis of follow-up studies. Psychological medicine 36, 159–165, https://doi.org/10.1017/S003329170500471X (2006).

3. Loewenstein, G. Anticipation and the Valuation of Delayed Consumption. Economic Journal 97, 666–684, https://doi.org/10.2307/2232929 (1987).

4. Loewenstein, G. F. Frames of Mind in Intertemporal Choice. Manage Sci 34, 200–214, https://doi.org/10.1287/mnsc.34.2.200 (1988).

5. Thaler, R. Some Empirical-Evidence on Dynamic Inconsistency. Economics Letters 8, 201–207, https://doi.org/10.1016/0165-1765(81)90067-7 (1981).

6. Kahneman, D. & Tversky, A. Prospect Theory: An Analysis of Decision under Risk. Econometrica 47, 263–291 (1979).

7. Loewenstein, G. & Prelec, D. Anomalies in Intertemporal Choice - Evidence and an Interpretation. Quarterly Journal of Economics 107, 573–597, https://doi.org/10.2307/2118482 (1992).

8. Ikeda, S., Kang, M. I. & Ohtake, F. Hyperbolic discounting, the sign effect, and the body mass index. J Health Econ 29, 268–284, https://doi.org/10.1016/j.jhealeco.2010.01.002 (2010).

9. Tanaka, S. C. et al. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PloS one 2, e1333, https://doi.org/10.1371/journal.pone.0001333 (2007).

10. Tanaka, S. C., Yamada, K., Yoneda, H. & Ohtake, F. Neural mechanisms of gain-loss asymmetry in temporal discounting. The Journal of neuroscience: the official journal of the Society for Neuroscience 34, 5595–5602, https://doi.org/10.1523/JNEUROSCI.5169-12.2014 (2014).

11. Schweighofer, N. et al. Humans can adopt optimal discounting strategy under real-time constraints. PLoS computational biology 2, e152, https://doi.org/10.1371/journal.pcbi.0020152 (2006).

12. McClure, S. M., Laibson, D. I., Loewenstein, G. & Cohen, J. D. Separate neural systems value immediate and delayed monetary rewards. Science 306, 503–507, https://doi.org/10.1126/science.1100907 (2004).

13. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G. & Cohen, J. D. Time discounting for primary rewards. The Journal of neuroscience: the official journal of the Society for Neuroscience 27, 5796–5804, https://doi.org/10.1523/JNEUROSCI.4246-06.2007 (2007).

14. Hariri, A. R. et al. Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. The Journal of neuroscience: the official journal of the Society for Neuroscience 26, 13213–13217, https://doi.org/10.1523/JNEUROSCI.3446-06.2006 (2006).

15. Kable, J. W. & Glimcher, P. W. The neural correlates of subjective value during intertemporal choice. Nature neuroscience 10, 1625–1633, https://doi.org/10.1038/nn2007 (2007).

16. Wittmann, M., Leland, D. S. & Paulus, M. P. Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale 179, 643–653, https://doi.org/10.1007/s00221-006-0822-y (2007).

17. Ballard, K. & Knutson, B. Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45, 143–150, https://doi.org/10.1016/j.neuroimage.2008.11.004 (2009).

18. Gregorios-Pippas, L., Tobler, P. N. & Schultz, W. Short-term temporal discounting of reward value in human ventral striatum. Journal of neurophysiology 101, 1507–1523, https://doi.org/10.1152/jn.90730.2008 (2009).

19. Pine, A. et al. Encoding of marginal utility across time in the human brain. The Journal of neuroscience: the official journal of the Society for Neuroscience 29, 9575–9581, https://doi.org/10.1523/JNEUROSCI.1126-09.2009 (2009).

20. Pine, A., Shiner, T., Seymour, B. & Dolan, R. J. Dopamine, time, and impulsivity in humans. The Journal of neuroscience: the official journal of the Society for Neuroscience 30, 8888–8896, https://doi.org/10.1523/JNEUROSCI.6028-09.2010 (2010).

21. Sonuga-Barke, E. J. Interval length and time-use by children with AD/HD: a comparison of four models. Journal of abnormal child psychology 30, 257–264, https://doi.org/10.1023/A:1015154829796 (2002).

22. Sonuga-Barke, E. J., Dalen, L. & Remington, B. Do executive deficits and delay aversion make independent contributions to preschool attention-deficit/hyperactivity disorder symptoms? Journal of the American Academy of Child and Adolescent Psychiatry 42, 1335–1342, https://doi.org/10.1097/01.chi.0000087564.34977.21 (2003).

23. Plichta, M. M. et al. Neural hyporesponsiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/hyperactivity disorder. Biol Psychiatry 65, 7–14, https://doi.org/10.1016/j.biopsych.2008.07.008 (2009).

24. Marco, R. et al. Delay and reward choice in ADHD: an experimental test of the role of delay aversion. Neuropsychology 23, 367–380, https://doi.org/10.1037/a0014914 (2009).

25. Schweitzer, J. B. & Sulzer-Azaroff, B. Self-control in boys with attention deficit hyperactivity disorder: effects of added stimulation and time. J Child Psychol Psychiatry 36, 671–686, https://doi.org/10.1111/j.1469-7610.1995.tb02321.x (1995).

26. Solanto, M. V. et al. The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. Journal of abnormal child psychology 29, 215–228, https://doi.org/10.1023/A:1010329714819 (2001).

27. Sonuga-Barke, E. J., Taylor, E., Sembi, S. & Smith, J. Hyperactivity and delay aversion–I. The effect of delay on choice. J Child Psychol Psychiatry 33, 387–398, https://doi.org/10.1111/j.1469-7610.1992.tb00874.x (1992).

28. Rapport, M. D. & DuPaul, G. J. Hyperactivity and methylphenidate: rate-dependent effects on attention. International clinical psychopharmacology 1, 45–52, https://doi.org/10.1097/00004850-198601000-00006 (1986).

29. Barkley, R. A., Edwards, G., Laneri, M., Fletcher, K. & Metevia, L. Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). Journal of abnormal child psychology 29, 541–556, https://doi.org/10.1023/A:1012233310098 (2001).

30. Rapport, M. D., Tucker, S. B., DuPaul, G. J., Merlo, M. & Stoner, G. Hyperactivity and frustration: the influence of control over and size of rewards in delaying gratification. Journal of abnormal child psychology 14, 191–204, https://doi.org/10.1007/BF00915440 (1986).

31. Jackson, J. N. S. & MacKillop, J. Attention-Deficit/Hyperactivity Disorder and Monetary Delay Discounting: A Meta-Analysis of Case-Control Studies. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging 1, 316–325, https://doi.org/10.1016/j.bpsc.2016.01.007 (2016).

32. Winstanley, C. A., Eagle, D. M. & Robbins, T. W. Behavioral models of impulsivity in relation to ADHD: Translation between clinical and preclinical studies. Clinical Psychology Review 26, 379–395, https://doi.org/10.1016/j.cpr.2006.01.001 (2006).

33. Crone, E. A., Jennings, J. R. & van der Molen, M. W. Sensitivity to interference and response contingencies in attention-deficit/hyperactivity disorder. J Child Psychol Psychiatry 44, 214–226, https://doi.org/10.1111/1469-7610.00115 (2003).

34. Iaboni, F., Douglas, V. I. & Baker, A. G. Effects of reward and response costs on inhibition in ADHD children. J Abnorm Psychol 104, 232–240, https://doi.org/10.1037/0021-843X.104.1.232 (1995).

35. Oosterlaan, J. & Sergeant, J. A. Effects of reward and response cost on response inhibition in AD/HD, disruptive, anxious, and normal children. Journal of abnormal child psychology 26, 161–174, https://doi.org/10.1023/A:1022650216978 (1998).

36. Biederman, J. et al. Young adult outcome of attention deficit hyperactivity disorder: a controlled 10-year followup study. Psychological medicine 36, 167–179, https://doi.org/10.1017/S0033291705006410 (2006).

37. Patterson, C. M. & Newman, J. P. Reflectivity and learning from aversive events: toward a psychological mechanism for the syndromes of disinhibition. Psychological review 100, 716–736, https://doi.org/10.1037/0033-295X.100.4.716 (1993).

38. Quay, H. C. Inhibition and attention deficit hyperactivity disorder. Journal of abnormal child psychology 25, 7–13, https://doi.org/10.1023/A:1025799122529 (1997).

39. Lemiere, J. et al. Brain activation to cues predicting inescapable delay in adolescent Attention Deficit/Hyperactivity Disorder: an fMRI pilot study. Brain research 1450, 57–66, https://doi.org/10.1016/j.brainres.2012.02.027 (2012).

40. Johansen, E. B., Aase, H., Meyer, A. & Sagvolden, T. Attention-deficit/hyperactivity disorder (ADHD) behaviour explained by dysfunctioning reinforcement and extinction processes. Behavioural brain research 130, 37–45, https://doi.org/10.1016/S0166-4328(01)00434-X (2002).

41. Beauchaine, T. P., Ben-David, I. & Sela, A. Attention-deficit/hyperactivity disorder, delay discounting, and risky financial behaviors: A preliminary analysis of self-report data. PloS one 12, e0176933, https://doi.org/10.1371/journal.pone.0176933 (2017).

42. Patros, C. H. et al. Choice-impulsivity in children and adolescents with attention-deficit/hyperactivity disorder (ADHD): A meta-analytic review. Clin Psychol Rev 43, 162–174, https://doi.org/10.1016/j.cpr.2015.11.001 (2016).

43. Barkley, R. A., Fischer, M., Smallish, L. & Fletcher, K. Young adult outcome of hyperactive children: adaptive functioning in major life activities. Journal of the American Academy of Child and Adolescent Psychiatry 45, 192–202, https://doi.org/10.1097/01.chi.0000189134.97436.e2 (2006).

44. Ainslie, G. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82, 463–496, https://doi.org/10.1037/h0076860 (1975).

45. Ho, M. Y., Mobini, S., Chiang, T. J., Bradshaw, C. M. & Szabadi, E. Theory and method in the quantitative analysis of”impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology 146, 362–372, https://doi.org/10.1007/pl00005482 (1999).

46. Seymour, B. et al. Temporal difference models describe higher-order learning in humans. Nature 429, 664–667, https://doi.org/10.1038/nature02581 (2004).

47. Seymour, B., Daw, N., Dayan, P., Singer, T. & Dolan, R. Differential encoding of losses and gains in the human striatum. The Journal of neuroscience: the official journal of the Society for Neuroscience 27, 4826–4831, https://doi.org/10.1523/JNEUROSCI.0400-07.2007 (2007).

48. Luman, M., Oosterlaan, J. & Sergeant, J. A. The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal. Clin Psychol Rev 25, 183–213, https://doi.org/10.1016/j.cpr.2004.11.001 (2005).

49. Nigg, J. T. Neuropsychologic theory and findings in attention-deficit/hyperactivity disorder: the state of the field and salient challenges for the coming decade. Biol Psychiatry 57, 1424–1435, https://doi.org/10.1016/j.biopsych.2004.11.011 (2005).

50. Firestone, P. & Douglas, V. The effects of reward and punishment on reaction times and autonomic activity in hyperactive and normal children. Journal of abnormal child psychology 3, 201–216, https://doi.org/10.1007/BF00916751 (1975).

51. Iaboni, F., Douglas, V. I. & Ditto, B. Psychophysiological response of ADHD children to reward and extinction. Psychophysiology 34, 116–123, https://doi.org/10.1111/j.1469-8986.1997.tb02422.x (1997).

52. Luman, M., Oosterlaan, J., Knol, D. L. & Sergeant, J. A. Decision-making in ADHD: sensitive to frequency but blind to the magnitude of penalty? J Child Psychol Psychiatry 49, 712–722, https://doi.org/10.1111/j.1469-7610.2008.01910.x (2008).

53. Sonuga-Barke, E. J. S. & Fairchild, G. Neuroeconomics of Attention-Deficit/Hyperactivity Disorder: Differential Influences of Medial, Dorsal, and Ventral Prefrontal Brain Networks on Suboptimal Decision Making? Biological Psychiatry 72, 126–133, https://doi.org/10.1016/j.biopsych.2012.04.004 (2012).

54. Wesley, M. J. & Bickel, W. K. Remember the future II: meta-analyses and functional overlap of working memory and delay discounting. Biol Psychiatry 75, 435–448, https://doi.org/10.1016/j.biopsych.2013.08.008 (2014).

55. Shaw, P., Stringaris, A., Nigg, J. & Leibenluft, E. Emotion dysregulation in attention deficit hyperactivity disorder. The American journal of psychiatry 171, 276–293, https://doi.org/10.1176/appi.ajp.2013.13070966 (2014).

56. Kahn, I. et al. The role of the amygdala in signaling prospective outcome of choice. Neuron 33, 983–994, https://doi.org/10.1016/S0896-6273(02)00626-8 (2002).

57. De Martino, B., Camerer, C. F. & Adolphs, R. Amygdala damage eliminates monetary loss aversion. Proceedings of the National Academy of Sciences of the United States of America 107, 3788–3792, https://doi.org/10.1073/pnas.0910230107 (2010).

58. Strohle, A. et al. Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage 39, 966–972, https://doi.org/10.1016/j.neuroimage.2007.09.044 (2008).

59. Scheres, A., Milham, M. P., Knutson, B. & Castellanos, F. X. Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol Psychiatry 61, 720–724, https://doi.org/10.1016/j.biopsych.2006.04.042 (2007).

60. Stoy, M. et al. Reward processing in male adults with childhood ADHD–a comparison between drug-naive and methylphenidate-treated subjects. Psychopharmacology 215, 467–481, https://doi.org/10.1007/s00213-011-2166-y (2011).

61. Roesch, M. R., Taylor, A. R. & Schoenbaum, G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51, 509–520, https://doi.org/10.1016/j.neuron.2006.06.027 (2006).

62. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. (American Psychiatric Publishing, Inc., 2000).

63. Sheehan, D. V. et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 59(20), 22–33; quiz 34–57 (1998).

64. Adler, L., Kessler, R. & Spencer, T. Adult self report scale, ASRS-V1. 1 screener., (World Health Organization, 2003).

65. Ward, M. F., Wender, P. H. & Reimherr, F. W. The Wender Utah Rating Scale: an aid in the retrospective diagnosis of childhood attention deficit hyperactivity disorder. The American journal of psychiatry 150, 885–890 (1993).

66. Matsumoto, T., Kamijo, A., Okada, T. & Yoshikawa, K. A Preliminary Study on Childhood Attentiondeficit/ hyperactivity Disorders Among Methamphetamine Abusers: An evaluation using the Wender Utah Rating Scale. Clinical Psychiatry 46, 1289–1297, https://doi.org/10.11477/mf.1405100600 (2004).

67. Wechsler, D. WAIS-R manual: Wechsler adult intelligence scale-revised. (Psychological Corporation, 1981).

68. Wechsler, D. WAIS-III: Wechsler adult intelligence scale. (Psychological Corporation, 1997).

69. Oldfield, R. C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113, https://doi.org/10.1016/0028-3932(71)90067-4 (1971).

70. Gatzke-Kopp, L. M. et al. Neurological correlates of reward responding in adolescents with and without externalizing behavior disorders. J Abnorm Psychol 118, 203–213, https://doi.org/10.1037/a0014378 (2009).

71. Hart, H., Radua, J., Nakao, T., Mataix-Cols, D. & Rubia, K. Meta-analysis of functional magnetic resonance imaging studies of inhibition and attention in attention-deficit/hyperactivity disorder: exploring task-specific, stimulant medication, and age effects. JAMA Psychiatry 70, 185–198, https://doi.org/10.1001/jamapsychiatry.2013.277 (2013).

Acknowledgements

This study is the result of the project ‘Development of biomarker candidates for social behaviour’ (to F.O., S.C.T., & K.K.) carried out under the Strategic Research Program for Brain Sciences of the Ministry of Education, Culture, Sports, Science and Technology (MEXT) of Japan. This work was also supported in part by the project ‘Science of personalized value development through adolescence: integration of brain, real-world, and life-course approaches’ (16H06396, 16H06399), Grants-in-Aid for Scientific Research on Innovative Areas (23118001 & 23118004; Adolescent Mind & Self-Regulation; Comprehensive Brain Science Network to K.K.), and Grant-in-Aid for Scientific Research A(26245041 to F.O.) from the Japan Society for the Promotion of Science. Part of this study was the result of the project ‘Brain Machine Interface Development’ carried out under the Japan Agency for Medical Research and Development. This work was also supported in part by UTokyo Center for Integrative Science of Human Behavior (CiSHuB) and by the International Research Center for Neurointelligence (WPI-IRCN) at The University of Tokyo Institutes for Advanced Study (UTIAS).

Author information

Authors

Contributions

S.C.T., N.Y., A.T., Y. Kan., Y. Kaw., Y.N., A.I.T., F.O., and K.K. designed the research study. S.C.T., N.Y., A.T., and K.K. designed the fMRI experiments. S.C.T., N.Y., A.T., Y. Kan., Y. Kaw., Y.N., and A.I.T. performed the experiments. S.C.T. and A.T. analysed the behavioural data with support from Y. Kan., Y. Kaw., Y.N., A.I.T., and K.K. S.C.T. and N.Y. analysed the fMRI data with support from A.T., Y. Kan., Y. Kaw., Y.N., A.I.T., and K.K. S.C.T., N.Y., A.T., Y. Kan., Y. Kaw., Y.N., A.I.T., F.O., and K.K. wrote the paper.

Corresponding author

Correspondence to Saori C. Tanaka.

Ethics declarations

Competing Interests

The authors declare no competing interests.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

Tanaka, S.C., Yahata, N., Todokoro, A. et al. Preliminary evidence of altered neural response during intertemporal choice of losses in adult attention-deficit hyperactivity disorder. Sci Rep 8, 6703 (2018). https://doi.org/10.1038/s41598-018-24944-5

• Accepted:

• Published:

• DOI: https://doi.org/10.1038/s41598-018-24944-5

• Targeting working memory to modify emotional reactivity in adult attention deficit hyperactivity disorder: a functional magnetic resonance imaging study

• Antonia Kaiser
• Liesbeth Reneman
• Anne Marije Kaag

Brain Imaging and Behavior (2022)