Exposure to stress during adolescence exerts a long-term impact on behavior and might contribute to the development of several neuropsychiatric disorders. In adults, control over stress has been found to protect from the negative consequences of stress, but the influence of controllability at early ages has not been extensively studied. Here, we evaluated in a rodent model the effects of repeated exposure in adolescent male rats to controllable versus uncontrollable foot-shock stress (CST or UST, respectively). Rats were assigned to three groups: non-stress (stress-naïve), CST (exposed to 8 sessions of a two-way shuttle active avoidance task over a period of 22 days) and UST (receiving the same amount of shocks as CST, regardless of their actual behavior). During adulthood, different cohorts were tested in several tasks evaluating inhibitory control and cognitive flexibility: 5-choice serial reaction time, delay-discounting, gambling test and probabilistic reversal learning. Results showed that the hypothalamic-pituitary-adrenal response to the first shock session was similar in CST and UST animals, but the response to the 8th session was lower in CST animals. In adulthood, the UST animals presented impaired motor (but not cognitive) impulsivity and more perseverative behavior. The behavioral effects of UST were associated with increased number of D2 dopamine receptors in dorsomedial striatum, but not in other striatal regions. In summary, UST exposure during adolescence induced long-term impairments in impulsivity and compulsivity, whereas CST had only minor effects. These data support a critical role of stress uncontrollability on the long-lasting consequences of stress, as a risk factor for mental illnesses.
In humans, exposure to stress during adolescence increases in adulthood the vulnerability to neuropsychiatric disorders, including drug addiction, mood, anxiety, gambling and attention deficit hyperactivity disorders1,2,3. One of the factors that modulates the acute and long-term consequences of stress is controllability4,5,6. Perceived or actual behavioral control over adversity is involved in resilience to stress mediated by individual differences in coping styles, and it may have a profound impact on disease susceptibility7. In humans, laboratory uncontrollable stress (UST) (but not controllable: CST) impairs fear extinction8 and executive functioning9. Moreover, the subjective feelings of helplessness, depression or anger are higher after UST than CST10,11. The hypothalamic-pituitary-adrenal (HPA) axis response to stress may also be influenced by controllability, although human data are scarce. Perceived control negatively correlates with cortisol response to a laboratory task12,13 and cortisol levels are lower after laboratory CST than UST11.
In animal models, the importance of stressor controllability is well recognized since the works of Seligman-Maier and Weiss14 using the triadic design including: (i) a “CST” group that can escape from the stressor (originally tail-shock); (ii) a “UST” group that receives the same shock but has no control over it; and (iii) a stress-naive group not receiving shock. The consequences of UST include increased anxiety, decreased social exploration, potentiated fear conditioning and delayed fear extinction5. Interestingly, CST does not induce these effects. However, previous studies in rodents indicate that the HPA response is not sensitive to controllability, at least under acute exposure15,16. The protective effects of stressor controllability appear to be mediated by a circuit involving the prefrontal cortex (PFC) and the posterior dorsomedial striatum (DMS), which receives important projections from the PFC5.
Despite the great attention paid to the influence of control over stress, most studies are focused on adulthood. The acute effects of adolescent CST/UST were studied previously17, without important differences in the effects on an escape task. To our knowledge, the long-term effect (adulthood) of stress controllability during adolescence in rodents has only been addressed by Kubala et al.18 The former study found that a single episode of CST (tail-shock) induces in adulthood an increase in social exploration, in comparison to UST or no stress, suggesting reduced anxiety. These results indicate that adolescent subjects are also sensitive to the long-term effects of controllability. The study of the influence of controllability over stress during adolescence appears to be particularly relevant as this is a period characterized by dramatic changes in PFC circuits that affect both emotional and cognitive functions19. Moreover, diminished self-control is a prominent feature of adolescence and during the transition from adolescence to adulthood there is a progressive improvement in executive functioning that parallels PFC maturation20. Both human and animal studies indicate that the adolescent brain is markedly sensitive to stress1,21,22, especially the PFC2,23. Therefore, those PFC-dependent executive abilities may be especially sensitive to the long-term impact of adolescent stress. Previous studies in rodents found that adolescent stress increases adult impulsivity24 and decreases behavioral flexibility25,26,27,28, but the importance of controllability has not been addressed yet.
Several studies indicate that adolescents are more prone than adults to risk-taking/impulsivity behavior29. Among other structures, dorsal striatum may be involved in the regulation of behavioral inhibition and risk-taking behavior. Lower availability of dopamine D2 receptors (D2R) in dorsal striatum has been found with positron emission tomography in patients with substance use disorders30,31 that negatively correlates with subjective (positive) effects of gambling and impulsivity32. In rats, D2R expression in the dorsal striatum showed a U-shaped response relationship with risky decision-making33. Dorsal striatum is still under maturation during adolescence in humans34. Adolescent rats, but not adults, have a large proportion of neurons in the dorsal striatum activated in anticipation of reward35. Within the several subdivisions of the dorsal striatum, the DMS is involved in goal-directed behavior and receives projections preferentially from PFC, whereas the dorsolateral (DLS) is related to habit formation and receives projections preferentially from sensorimotor cortices36. DMS may be an area especially sensitive to adolescent adverse experiences as it has been considered important in the development toward the adolescent behavioral phenotype and psychopathology vulnerability37. The progressive development of brain circuits involved in impulsivity, behavioral flexibility and risk-taking during adolescence suggests that they may be especially vulnerable to stressor uncontrollability. However, we are not aware of previous studies about the role of controllability/uncontrollability to stress during adolescence and adult vulnerability to impulsivity and compulsivity behaviors, neither in humans nor in rodents.
We then reasoned that repeated exposure to adolescent CST versus UST could permanently shape brain circuits, particularly those related to PFC and dorsal striatum, thereby altering adult behavior. We chose a two-way active avoidance (TWAA) task in which CST rats can control the appearance/duration of foot-shocks, whereas in UST rats’ foot-shocks are independent on their behavior. Avoidance instead of escape was chosen because jumping after receiving foot-shocks is a much more reflexive behavior than jumping during the signal preceding foot-shocks. Our main hypothesis was that exposure to UST (but not to CST) causes long-term impairments in cognitive function in different PFC-dependent tasks: 5-choice serial reaction time (5CSRTT), delay-discounting, gambling and probabilistic reversal learning (PRL). As we observed a more marked impairment in inhibitory control and flexibility in animals exposed to UST, we performed an additional study to measure the short and long-term changes on D2R expression in different subdivisions of the dorsal striatum, including the DMS that is involved in compulsivity/impulsivity-like behavior38,39 and is sensitive to stressor controllability40.
Materials and Methods
Subjects and general procedure
Male Sprague-Dawley rats maintained in standard conditions were used. All protocols were in accordance with the European Communities Council Directive 2010/63/EU and the Spanish legislation (RD53/2013). The experimental protocol was approved by the Ethics Committee at the Universitat Autònoma de Barcelona and the Generalitat de Catalunya. Adolescent stress rats remained undisturbed until tested at adulthood (PND 72) and food-restricted during cognitive tasks. Different cohorts were used for: (i) 5CSRTT, (ii) delay-discounting, (iii) gambling, and (iv) PRL. Two additional cohorts were used to study D2R expression in striatum. Detailed Methods are provided in the Supplementary information.
Adolescent stress and blood sampling
Rats were randomly assigned to stress-naive (no foot-shocks), CST and UST groups. As our aim was to cover all the adolescent period, the stress (PND 33–55) consisted of 8 sessions (1 daily) given in an unpredictable way throughout a 22-day period. CST rats were exposed to a signaled TWAA session, where they were exposed to a 5 min habituation and then to 50 trials of 10 s of a light-tone conditioned stimulus (CS) immediately followed by foot-shock (unconditioned stimulus, US). Crossing from one side to the other terminated the CS (avoidance) or US (escape) presentation, and was followed by an inter-trial-interval (ITI). UST rats received the same shock, but their behavior had no consequences. Stress-naïve rats were exposed to the shuttle-box without shock. Freezing during habituation was measured in sessions 1, 2 and 8. To study HPA axis activity, blood samples were obtained by tail-nick, 1–3 days before stress (basal levels) and in sessions 1 and 8 (immediately after and 45 min later).
Plasma ACTH and corticosterone were determined by double-antibody radioimmunoassays that has been extensively validated and used in our laboratory and others41.
5-choice serial reaction time task
The 5CSRTT evaluates attention, motor impulsivity and perseverative-like behavior42. We followed our previous procedure43 using 9 rats/group. Briefly, animals were trained during a limited-hold time to nose-poke inside one of five holes after a brief light appeared inside one of them, and then received a pellet. If they failed to respond during this period (omission) or made an incorrect response, the program entered in time-out (TO). The animals were progressively trained across different sessions in which the duration of the hole-light and the hold-time period were progressively decreased44. Rats were moved to target conditions of 1 s of stimulus-light duration, 5 s of ITI and 5 s of limited-hold. After two days in those conditions they were trained with ITI = 7 s (17 days), and with ITI = 9 s (8 days) to facilitate the appearance of impulsive responses. The variables measured included: correct, incorrect (errors of “commission”), premature (motor impulsivity), TO (another measure of inhibitory control) and perseverative (additional responses in any hole after a correct response and before collecting the reward) responses and errors of omission. The level of accuracy was: number of correct responses/(number of correct + number of incorrect responses), as a percentage.
This task evaluates cognitive impulsivity as the preference for immediate/smaller over postponed/larger rewards45. We used a modification of our previous procedure43, with 9–10 rats/group. After pre-training, the proper delay-discounting started. One lever (A, “immediate”) gave 1 pellet after 1 lever press, whereas the other (B, “delayed”) gave 4 pellets. Over days, the reinforcement-delay after pressing B lever was progressively increased (0 s for 10 days, 10 s for 3 days, 20 s for 2 days and 40 s for 2 days). Finally, for 3 additional days the delay was again 0 s to evaluate stability of performance. Each session was divided into five identical blocks of 12 trials, the first six of forced choice, and the last six of “free” choice. The measures in the “free” trials were number of B lever responses and omissions.
The task assesses decision-making as the rat has to choose between different options differing in the associated reward and penalty (TO)46. We used a modification of the procedure of Rivalan et al.46, with 27–30 animals/group. After pre-training, animals were run in the test. Two consecutive nose-pokes in the same hole were required to get a reinforcer. The contingencies for each hole were: (i) hole A provided 2 pellets (100% trials) with a penalty of 222 s (50% trials); (ii) hole B provided 2 pellets (100% trials) with a penalty of 444 s (25% trials); (iii) hole C provided 1 pellet (100% trials) with a penalty of 12 s (25% trials); (iv) hole D provided 1 pellet (100% trials) with a penalty of 6 s (50% trials). During the TO the hole-light where the response was made remained illuminated and the responses had no consequences. After that, the 4 holes were again illuminated. An identical retest was done one week after. The measures were number of times animals performed two consecutive nose-pokes in a hole to get a reward (“valid” responses) and number of nose-pokes and reinforcers/hole.
Probabilistic reversal learning
The task evaluates behavioral flexibility in a probabilistic setting, making it more similar to human testing47. In this cohort, 8–10 animals/group were used. A modification of the procedure of Dalton et al.48 was used with the main difference that the final probabilities associated with the “correct” and “incorrect” levers were 95% and 25% respectively. After pre-training, two levers were available at the same time. Once the rat pressed the “correct” lever in 8 consecutive trials, the contingencies were reversed (“reversal”) and the “correct” lever became the “incorrect”. If a rat performed an “incorrect” response or an omission, the rat had to start a new series of 8 “correct” consecutive trials. The TO after an omission lasted 10 s and the ITI lasted 15 s. The experiment finished when the rat performed at least 4 reversals in two consecutive sessions. The measures of cognitive flexibility were the mean number of reversals/session and the number of perseverative errors in the last reversal (number of consecutive incorrect choices after reversal).
Brain processing and in situ hybridization (ISH)
Different sub-sets of animals were perfused 3 days (short-term) or 33 days (long-term) after the end of stress (10 rats/group and period). The protocol for the chromogenic ISH used a D2R riboprobe and was adapted from Simmons et al.49 Following Paxinos and Watson50, the same coordinates were used for each area: Dorsomedial (DMS), Dorsolateral (DLS), Ventromedial (VMS) and Ventrolateral (VLS) striatum. ImageJ public domain image processing software (FIJI v1.47f) was used for quantification.
Data were analyzed with the Statistical Program for Social Sciences, SPSS-IBM (version 24) using a general linear model (GLM) with one between-subjects’ factor (GROUP, three levels: stress-naive, CST and UST). For some variables, within-subject factors were added. To achieve homogeneity of variance, log-transformations were made. If such homogeneity was not achieved, a generalized linear model (GzLM) or a generalized estimating equations model (GEE) was performed. Groups were compared by means of Sequential Bonferroni post-hoc comparisons. All biochemical and ISH samples to be statistically compared were processed in the same assay to avoid inter-assay variability. Alpha level used was p < 0.05 but trends for significance between 0.06–0.05 were also mentioned.
Adolescent rats learn the TWAA task across days and freezing behavior did not differ between controllable and uncontrollable stress
The statistical analysis of TWAA indicated that performance was equivalent in the different cohorts. Final sample was n = 54–58/group. Adolescent stress did not modify body weight gain during treatment (stress-naive group: 260.0 ± 7.1 g; CST: 242.4 ± 7.4 g; UST: 244.0 ± 6.7 g; F(2, 164) = 1.87, NS).
The number of avoidances and escapes during the 8 sessions of stress in CST subjects is shown in Fig. 1A. The GLM analysis showed that the number of avoidances increased, as expected, across days [SESSION: F(7,385) = 79.53, p < 0.001]. The number of avoidances increased by session 5 and kept stable thereafter. The number of inter-crossings during habituation was evaluated as a measure of activity in CST and UST groups (Fig. 1B). The GLM showed a significant effect of SESSION [F(7,770) = 128.1, p < 0.001], GROUP [F(1,110) = 6.46, p < 0.05] and SESSION × GROUP [F(7,770) = 5.51, p < 0.001]. Activity in session 1 (no prior experience with shocks) was similar in the two groups, but differences appeared in sessions 5–8 (between p < 0.01–p < 0.001), with UST rats showing less inter-crossings than CST. More detailed shuttle-box two-way active avoidance behavior in CST rats is provided in the Supplementary information (Suppl. Fig. 1).
As a measure of contextual fear memory, freezing was measured during habituation in sessions 1, 2 and 8. Freezing in stress-naive animals was very low and was not included in the analysis. Freezing was not detected in session 1 as the rats had not experience with shocks, but increased from session 2 to 8 [SESSION: [F(1,91) = 6.32, p < 0.05], without differences between groups (Fig. 1C).
The endocrine response to adolescent stress was higher after repeated exposure to uncontrollable than controllable stress
As prior statistical analysis revealed that the interaction COHORT × GROUP was not significant, the endocrine response was studied globally. The GEE of plasma ACTH and corticosterone responses to the shuttle included GROUP as between-subjects factor and SESSION and SAMPLING TIME as within-subjects factors. The GEE showed significant effects of all factors and their interactions for both ACTH (Fig. 2A) and corticosterone (Fig. 2B). The GEE analysis of ACTH showed significant effects of GROUP: Χ2(2) = 452.26, p < 0.001; SESSION: Χ2(1) = 345.45, p < 0.001; SAMPLING TIME: Χ2(1) = 708.99, p < 0.001; GROUP × SESSION: Χ2(2) = 222.14, p < 0.001; GROUP X SAMPLING TIME: Χ2(2) = 654.49, p < 0.001; SESSION × SAMPLING TIME: Χ2(1) = 289.11, p < 0.001; GROUP × SESSION × SAMPLING TIME: Χ2(2) = 249.08, p < 0.001. The decomposition of the triple interaction indicated that UST rats showed higher ACTH levels than CST rats in the 8th session both immediately after shocks (p < 0.01) and 45 min after (p < 0.05). The GEE analysis of corticosterone showed significant effect of GROUP: Χ2(2) = 291.41, p < 0.001; SESSION: Χ2(1) = 191.76, p < 0.001; SAMPLING TIME: Χ2(1) = 602.27, p < 0.001; GROUP × SESSION: Χ2(2) = 51.94, p < 0.001; GROUP X SAMPLING TIME: Χ2(2) = 428.39, p < 0.001; SESSION × SAMPLING TIME: Χ2(1) = 29.69, p < 0.001; GROUP × SESSION × SAMPLING TIME: Χ2(2) = 11.07, p < 0.01. The difference between CST and UST rats in corticosterone levels immediately after the 8th session was marginally significant (p = 0.053). No differences between CST and UST animals were detected during session 1. As expected, both CST and UST rats presented higher ACTH and corticosterone levels than stress-naive at all time periods analyzed (always between p < 0.01–p < 0.001).
Hormonal response to sessions 1 and 8 was correlated with corresponding total shock time. ACTH (but not corticosterone) levels immediately after the 8th but not the first session correlated with shock time in UST rats [r(28) = +0.51, p < 0.01], whereas the correlation did not achieve statistical significance in CST rats [r(27) =+0.36, NS].
Uncontrollable, but not controllable, adolescent stress increases adult impulsive action in the 5-choice serial reaction time task
The number of sessions needed to achieve appropriate performance did not differ among groups (data not shown). Once in the target conditions (1 s of stimulus-light duration, 5 s of limited hold), accuracy, number of omissions and premature responding with the 5 or 7 s ITI was not different between groups (Fig. 3A–C). In contrast, when the animals were moved to an ITI = 9 s to increase the number of premature responses, differences emerged (Fig. 3C), and a statistically significant GROUP effect was observed [F(2,24) = 4.03, p < 0.05], with the UST animals performing more premature responses than stress-naive (p < 0.05), whereas the CST animals performed similarly to stress-naive. The duration of the session in this stage (stress-naive: 2,114 ± 62 s; CST: 2,193 ± 75 s; UST: 2,553 ± 187 s) was longer in UST than stress-naive rats [GROUP: F(2,24) = 3.72, p < 0.05; comparison between UST and stress-naive: p < 0.05]. No other variable differed among groups.
Adolescent stress did not affect adult cognitive impulsivity in the delay-discounting test
No group differences during pre-training were found (data not shown). The preference for the “delayed” lever decreased with longer delays, but no group differences emerged (Fig. 4A) [DELAY: F(4, 104) = 136.82, p < 0.001; GROUP and GROUP × DELAY: NS]. No differences were found in any other variable.
Uncontrollable, but not controllable, adolescent stress increases preference for the options with lower time-outs in the gambling task
The number of “valid” responses to each hole (that provided reward) during test and retest is shown in Fig. 4B. The GEE showed significant effects of GROUP [Χ2(2) = 8.87, p < 0.05], SESSION [Χ2(1) = 10.29, p = 0.001], HOLE [Χ2(3) = 20.61, p < 0.001], GROUP × HOLE [Χ2(6) = 16.34, p < 0.05] and SESSION × HOLE [Χ2(3) = 14.81, p < 0.01], but not GROUP × SESSION and GROUP × SESSION × HOLE. UST rats performed more valid responses in holes C and D (the ones with lower TOs) in comparison to stress-naive, regardless of the session (p < 0.05 in both holes). However, CST rats did not differ from stress-naïve or from UST rats. No other statistically significant differences were found.
The exposure to uncontrollable adolescent stress has a stronger impact in adult behavioral flexibility in the probabilistic reversal learning
In the mean reversals/session (Fig. 4C) the GROUP factor was significant [F(2,25) = 3.65, p < 0.05] and both CST and UST rats performed less reversals than control ones (p < 0.05 in both cases). Perseverative errors (Fig. 4D) made in the last reversal of the last session showed significant GROUP differences [X2(2) = 6.21, p < 0.05], with UST rats making more perseverative errors than controls (p < 0.05), whereas CST animals did not differ from stress-naive. No other statistically significant differences were found.
Dopamine D2 receptors expression in the dorsomedial striatum was higher after uncontrollable adolescent stress
Short-term and long-term effects of stress on the number of D2R+ cells were studied in the different subdivisions of the striatum (Fig. 5). In the DMS, but not in the other subdivisions (DLS, VMS, VLS), the GROUP [X2(2) = 6.06, p < 0.05] and AGE [X2(2) = 17.05, p < 0.001] factors were significant, the number of D2R+ cells being greater in UST animals than stress-naive (p < 0.05).
In the present study, rats were exposed during adolescence to repeated controllable foot-shock (TWAA) stress (CST group) or to uncontrollable stress (UST), whereas the stress-naive did not receive shock. In the last stress session, UST rats showed higher ACTH levels than CST rats, indicating that repeated experience with controllability is eventually buffering the impact of shocks on the HPA axis. On the contrary, the development of contextual fear conditioning was not affected by controllability. In adulthood, animals exposed to UST displayed increased impulsive action, a preference for options with shorter TO and several signs of behavioral inflexibility. Those responses were accompanied by an increase in D2R expression in DMS. The impact of UST was not due to a generalized impairment, since other cognitive measures were not affected. The long-term effects of exposure to CST were very mild and restricted to a decrease in reversals without impact in the number of perseverative errors. Globally, our data support the importance of the psychological component of stressors (and not only their physical properties) and indicate that controllability mitigates the long-lasting negative impact of stressors in adolescent rats.
Response of adolescent rats to controllable and uncontrollable stress
Repeated exposure to CST/UST during adolescence neither reduced body weight gain (present data) nor altered relative adrenal weight (unpublished), parameters altered by chronic severe stressors51. This suggests that the procedures were not particularly severe. The response of HPA hormones was studied during the first and last sessions. A clearly reduced HPA response was found in both CST and UST animals in the last session compared with the first one, likely reflecting the lower number/duration of shocks because of learning to avoid. More importantly, no differences between CST and UST rats were observed in ACTH and corticosterone responses to the first session, whereas in the last session ACTH levels were lower in CST than UST rats and the same trend was found for corticosterone. Therefore, the influence of control was not evident during the first session but appeared when animals had repeated experience with the procedure. The existence of HPA differences in the present study between CST and UST rats with several days of experience with the task and not in the first session gives support to the proposal that the “experience of controllability” develops across time52. Interestingly, the correlation between ACTH and total time of shock during session 8 was significant in UST but not in CST rats. As ACTH response appears to be a good marker of stressor intensity53, the lack of a significant correlation in CST rats suggests that controllability adds complexity to the expected relationship between the intensity of stressors and HPA response.
These results are consistent with rodent literature. Using procedures in which shock was not preceded by any signal and only escape from shocks was possible, HPA response did not differ between CST and UST groups. This has been observed after a single session of tail-shocks in rats14,15 or after repeated foot-shock in mice and rats54,55. In contrast, using procedures in which a signal preceded foot-shocks, thereby allowing the animals to impede the appearance of the aversive stimulus (avoidance), UST rats showed higher resting corticosterone on the day after the 6th session than CST rats that not differed from stress-naive rats56, suggesting a lower impact of CST after repeated experience of control. Human data about HPA response and objective or perceived control over stress11,12,13 have been obtained after acute conditions and future studies are needed in other conditions.
The freezing response to the shuttle-box during habituation, a measure of contextual fear memory, was assessed during sessions 2 and 8. As expected, freezing was undetectable in stress-naive rats, whereas both CST and UST rats developed freezing, which was similar in both conditions. However, between sessions 5 and 8, inter-crossings during habituation were greater in CST than UST rats. Whether this reflects lower levels of fear to the context in CST rats (this parameter being more sensitive to minor differences in fear than freezing) or a reinforced response to move to the other compartment even in the absence of signals announcing shocks is unclear. The finding that intercrossings during the habituation was essentially similar between sessions 2 and 8 whereas intercrossings during the ITIs progressively increased favors the hypothesis of lower levels of fear in CST rats, in accordance with prior reports in adult rats using a CST-UST design also involving a TWAA task in which fear conditioning to the context was evaluated several days after the procedure52,56. The development of fear conditioning after CST/UST has also been evaluated by Liu et al.57 and Pryce et al.58, who studied in adult mice freezing across different sessions of escape from foot-shocks, obtaining surprisingly that CST subjects presented similar or more contextual fear memory than UST subjects. Taken together, results strongly suggest that differences in the controllability paradigm (escape versus avoidance/escape) may be critical.
Long-lasting effects of uncontrollable adolescent stress
Exposure to uncontrollable (but not controllable) stress during adolescence induced a long-lasting impairment of inhibitory control as evidenced by an increase in premature responding in the 5CSRTT when the task implied longer ITIs. These data agree with previous studies using chronic unpredictable stress during adolescence24. This increase in impulsive action was dissociated from impulsive choice, as performance in delay-discounting was not affected, in accordance with previous reports using another model of stress59. Similarly, social isolation during adolescence also increases premature responding in the 5CSRTT without affecting delay-discounting in adulthood60. The dissociation between both types of impulsivity has been previously described as indicative of the multidimensional nature of impulsivity45. The increase in premature responding observed in UST rats was accompanied by a preference for the options associated with shorter TO (C and D) in the gambling task, supporting an impairment of inhibitory control. Unexpectedly, stress-naive rats in our current conditions did not prefer overtly the “advantageous” options (C and D), which opens the possibility that with other versions of the task61 or other experimental conditions the long-term impact of UST will be different. To our knowledge, no previous reports have addressed the impact of adolescent stress in gambling tasks during adulthood, and more research is needed in this area.
The impairment of inhibitory control in UST rats was accompanied by perseverative-like behavior. In the PRL, the UST rats performed less reversals and more perseverative errors. This impairment in behavioral flexibility is in line with results obtained after foot-shock25, adolescent social defeat26,27, and chronic unpredictable stress28, although the impact may be dependent on genotype25 and the specific period of exposure during adolescence27.
In contrast to the effects of UST, the impact of CST was only restricted to some impairment in the PRL, without effects in other tasks. These data agree with Lucas et al.56, who using a repeated exposure to a similar TWAA in adult animals observed that controllability ameliorated the impact of UST in the forced swim test and olfactory discrimination. Globally, these results support that controllability may buffer the negative impact of UST5 and extend previous data in adult animals with models of acute stressors to adolescent repeated stressors.
The impairment of executive functioning observed in UST rats (impulsive/compulsive-like behavior) was accompanied by an increase in the number of D2R+ neurons in the DMS, but not in other striatal subdivisions. The effect was observed shortly after stress and maintained in the long-term. To our knowledge, this is the first work addressing the specific contribution of CST/UST to changes in D2R+ neuronal populations in the dorsal striatum. Striatal projection neurons (medium-sized spiny neurons or MSNs) are subdivided in two types in function of their axonal projections and neurochemical expression patterns62. Those MSNs expressing D1R form the direct pathway that project to the substantia nigra pars reticulata and internal globus pallidus, whereas those expressing D2R form the indirect pathway that project indirectly to the substantia nigra by way of the external globus pallidus and the subthalamic nucleus. D1R are positively coupled to adenylate cyclase and causes electrophysiological activation of neurons thus activating the direct pathway, whereas D2R exerts opposite effects thus inhibiting the indirect pathway.
The results with the DMS are particularly interesting because this nucleus takes part in a circuit essential for inhibitory control38. Within the DMS, local injection of D2R agonists increases premature and perseverative responding in the 5CSRTT, without affecting accuracy63. In contrast, the activation of D1R increased premature responses only at doses that impaired accuracy/omissions, without affecting perseverative responses63,64. The effects of both, D1R and D2R ligands, could be task-dependent and play different roles in the stop-signal reaction time procedure65. The increase in premature/perseverative responses after D2R activation63 is consistent with the present observation of increased expression of D2R in UST rats and also with electrophysiological data indicating that putative MSNs of the indirect pathway tend to fire more strongly during “no-go” trials66. Enhanced inhibition of D2R+ neurons might reduce their capability to engage the “no-go” process thus increasing impulsivity and perhaps compulsivity. In any case, the role of dopamine and its receptors appears to be complex and can be dependent on the specific area of the brain targeted and the characteristics of the tasks39,67.
As mentioned, in the present study the exposure to adolescent UST increased D2R+ in DMS but not in DLS, at the same time that increased motor impulsivity but not cognitive impulsivity. Previous data indicate that DMS lesions increase impulsive and compulsive-like behavior in the 5CSRTT whereas DLS lesions were ineffective68. In contrast DLS lesions increase cognitive impulsivity in a delay-discounting procedure69, task not affected in our present data. To our knowledge there are no previous studies about the effects of DMS lesions in cognitive impulsivity tasks.
Maier’s laboratory has demonstrated that the protective effects of behavioral control towards a stressor seem to require DMS but not DLS functioning40. Our results are also compatible with the hypothesis that in adults repeated stress favors habitual over goal-directed actions70, at least in part by reducing dendritic complexity of PFC and DMS neurons and increasing dendritic arborization of DLS neurons71. Globally present data suggest that the MSNs of the indirect pathway (expressing D2 receptors) arising from DMS are specifically affected, in a long-lasting way, by exposure to uncontrollable (but not controllable) stress during the adolescent period. Results support also that DMS is of particular importance in the disorders that involve a transition from goal-directed actions to habitual responding, such as drug addiction, pathological gambling and other impulsivity/compulsivity related disorders.
Although the present data support an influence of adolescent stress on PFC-dependent tasks, the impact of UST is mild and restricted to specific measures of executive functioning, highlighting the possibility that the plasticity of the adolescent brain may partially overcome the possible negative impact of stress. Future studies are needed to address whether adult exposure to the same stressors regime would induce equivalent long-term impact in the studied parameters. A recent work72 has directly compared long-term effects of adolescent and adult sensitivity to chronic stress, but the results do not allow to achieve any general conclusion on a putative differential vulnerability because the various dependent variables did not follow the same pattern. To definitively study whether the effects of the observed study are independent or not of adolescence we need additional works comparing in the same conditions the impact of adult versus adolescent stress.
A limitation of the present study is that only male rats were studied, and recent data indicate that the protective effects of controllability are not detected in females73,74. Another question that needs to be addressed is whether only one single stress exposure would exert the same effect as our paradigm (eight exposures across the entire adolescent period), as it has been studied that a single session of tail-shocks during this stage may induce long-term effects18. Finally, only D2R in dorsal striatum were analyzed and not in the PFC, as in our present conditions the expression of D2R in the PFC was very low and could not be evaluated, and other markers in addition to D2R should be also explored.
In conclusion, our results support human data indicating that adolescent (uncontrollable) stress is a risk factor for neuropsychiatric disorders in adulthood1,2,3. Interestingly, although the HPA axis response did not differ initially between UST/CST, after repeated exposure a lower response was observed in those animals having control over stress. A stronger impact of UST (and not CST) was observed in the long-term in impulsivity/compulsivity-related measures, thus suggesting a protective long-lasting effect of control over stress. Although the neural circuits and neurochemical processes underlying this differential effect remain to be studied, the ability to control threats in our environment appears to be critical for behavioral resilience, and this is particularly relevant during adolescence, a critical developmental window of heightened sensitivity to stressors. Preventive approaches in humans should aim at increasing perception of control as a way to decrease vulnerability to some psychopathologies with impulsivity/compulsivity-related symptoms.
Björkenstam, E., Burström, B., Vinnerljung, B. & Kosidou, K. Childhood adversity and psychiatric disorder in young adulthood: An analysis of 107,704 Swedes. J Psychiatr Res. 77, 67–75 (2016).
Casement, M. D., Shaw, D. S., Sitnick, S. L., Musselman, S. C. & Forbes, E. E. Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence. Soc Cogn Affect Neurosci. 10, 416–423 (2015).
Roberts, A. et al. Gambling and negative life events in a nationally representative sample of UK men. Addict Behav. 75, 95–102 (2017).
Mineka, S. & Hendersen, R. W. Controllability and predictability in acquired motivation. Annu Rev Psychol. 36, 495–529 (1985).
Maier, S. F. Behavioral control blunts reactions to contemporaneous and future adverse events: medial prefrontal cortex plasticity and a corticostriatal network. Neurobiol Stress. 1, 12–22 (2015).
Moscarello, J. M. & Hartley, C. A. Agency and the calibration of motivated behavior. Trends Cogn Sci. 21, 725–735 (2017).
de Boer, S. F., Buwalda, B. & Koolhaas, J. M. Untangling the neurobiology of coping styles in rodents: Towards neural mechanisms underlying individual differences in disease susceptibility. Neurosci Biobehav Rev. 74, 401–422 (2017).
Hartley, C. A., Gorun, A., Reddan, M. C., Ramirez, F. & Phelps, E. A. Stressor controllability modulates fear extinction in humans. Neurobiol Learn Mem. 113, 149–156 (2014).
Henderson, R. K., Snyder, H. R., Gupta, T. & Banich, M. T. When does stress help or harm? The effects of stress controllability and subjective stress response on Stroop performance. Front Psychol. 3, 179 (2012).
Markus, R., Panhuysen, G., Tuiten, A. & Koppeschaar, H. Effects of food on cortisol and mood in vulnerable subjects under controllable and uncontrollable stress. Physiol Behav. 70, 333–342 (2000).
Müller, M. J. Helplessness and perceived pain intensity: relations to cortisol concentrations after electrocutaneous stimulation in healthy young men. Biopsychosoc Med. 5, 8 (2011).
Kern, S. et al. Glucose metabolic changes in the prefrontal cortex are associated with HPA axis response to a psychosocial stressor. Psychoneuroendocrinology. 33, 517–529 (2008).
Sugaya, N. et al. Adrenal hormone response and psychophysiological correlates under psychosocial stress in individuals with irritable bowel syndrome. Int J Psychophysiol. 84, 39–44 (2012).
Maier, S. F. & Seligman, M. E. Learned helplessness at fifty: Insights from Neuroscience. Psychol Rev. 123, 349–367 (2016).
Maier, S. F., Ryan, S. M., Barksdale, C. M. & Kalin, N. H. Stressor controllability and the pituitary-adrenal system. Behav Neurosci. 100, 669–674 (1986).
Helmreich, D. L. et al. The effect of stressor controllability on stress-induced neuropeptide mRNA expression within the paraventricular nucleus of the hypothalamus. J Neuroendocrinol. 11, 121–128 (1999).
Leussis, M. P., Freund, N., Brenhouse, H. C., Thompson, B. S. & Andersen, S. L. Depressive-like behavior in adolescents after maternal separation: Sex differences, controllability, and GABA. Dev Neurosci. 34, 210–217 (2012).
Kubala, K. H., Christianson, J. P., Kaufman, R. D., Watkins, L. R. & Maier, S. F. Short- and long-term consequences of stressor controllability in adolescent rats. Behav Brain Res. 234, 278–284 (2012).
Spear, L. P. The adolescent brain and age-related behavioral manifestations. Neurosci Biobehav Rev. 24, 417–463 (2000).
Casey, B. J. Beyond simple models of self-control to circuit-based accounts of adolescent behavior. Annu Rev Psychol. 66, 295–319 (2015).
Romeo, R. D. The impact of stress on the structure of the adolescent brain: Implications for adolescent mental health. Brain Res. 1654, 185–91 (2017).
Tzanoulinou, S. & Sandi, C. The programming of the social brain by stress during childhood and adolescence: from rodents to humans. Curr Top Behav Neurosci. 30, 411–429 (2017).
Caballero, A., Granberg, R. & Tseng, K. Y. Mechanisms contributing to prefrontal cortex maturation during adolescence. Neurosci Biobehav Rev. 70, 4–12 (2016).
Comeau, W. L., Winstanley, C. A. & Weinberg, J. Prenatal alcohol exposure and adolescent stress - unmasking persistent attentional deficits in rats. Eur J Neurosci. 40, 3078–3095 (2014).
Spinelli, S. et al. Effects of repeated adolescent stress and serotonin transporter gene partial knockout in mice on behaviors and brain structures relevant to major depression. Front Behav Neurosci. 7, 215 (2013).
Xu, H. et al. Effects of adolescent social stress and antidepressant treatment on cognitive inflexibility and Bdnf epigenetic modifications in the mPFC of adult mice. Psychoneuroendocrinology. 88, 92–101 (2018).
Zhang, F., Yuan, S., Shao, F. & Wang, W. Adolescent social defeat induced alterations in social behavior and cognitive flexibility in adult mice: effects of developmental stage and social condition. Front Behav Neurosci. 10, 149 (2016).
Zhang, Y., Shao, F., Wang, Q. & Wang, W. Neuroplastic correlates in the mPFC underlying the impairment of stress-coping ability and cognitive flexibility in adult rats exposed to chronic mild stress during adolescence. Neural Plast. 9382797 (2017).
Burnett, S., Bault, N., Coricelli, G. & Blakemore, S. J. Adolescents’ heightened risk-seeking in a probabilistic gambling task. Cogn Dev. 25, 183–196 (2010).
Fehr, C. et al. Association of low striatal dopamine d2 receptor availability with nicotine dependence similar to that seen with other drugs of abuse. Am J Psychiatry. 165, 507–514 (2008).
Lee, B. et al. Striatal dopamine D2/D3 receptor availability is reduced in methamphetamine dependence and is linked to impulsivity. J Neurosci. 29, 14734–14740 (2009).
Boileau, I. et al. Higher binding of the dopamine D3 receptor-preferring ligand [11 C]-(+)-PHNO in methamphetamine polydrug users: a positron emission tomography study. J Neurosci. 32, 1353–1359 (2012).
Simon, N. W. et al. Dopaminergic modulation of risky decision-making. J Neurosci. 31, 17460–17470 (2011).
Larser, B. & Luna, B. In vivo evidence of neurophysiological maturation of the human adolescent striatum. Dev Cogn Neurosci. 12, 74–85 (2015).
Sturman, D. A. & Moghaddam, B. Striatum processes reward differently in adolescents versus adults. PNAS. 109, 1719–1724 (2012).
Balleine, B. W. & O’Doherty, J. P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology. 35, 48–69 (2010).
Simon, N. W. & Moghaddam, B. Reward processing in adolescent rodents. Dev Cogn Neurosci. 11, 145–154 (2015).
Eagle, D. M. & Baunez, C. Is there an inhibitory-response-control system in the rat? Evidence from anatomical and pharmacological studies of behavioral inhibition. Neurosci Biobehav Rev. 34, 50–72 (2010).
Carli, M. & Invernizzi, R. W. Serotoninergic and dopaminergic modulation of cortico-striatal circuit in executive and attention deficits induced by NMDA receptor hypofunction in the 5-choice serial reaction time task. Front Neural Circuits. 8, 58 (2014).
Amat, J. et al. Control over a stressor involves the posterior dorsal striatum and the act/outcome circuit. Eur J Neurosci. 40, 2352–8 (2014).
Muñoz-Abellán, C., Rabasa, C., Daviu, N., Nadal, R. & Armario, A. Behavioral and endocrine consequences of simultaneous exposure to two different stressors in rats: interaction or independence? PLoS One. 6, e21426 (2011).
Robbins, T. W. The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology. 163, 362–380 (2002).
Fuentes, S. et al. Sex-dependent effects of an early life treatment in rats that increases maternal care: vulnerability or resilience? Front Behav Neurosci. 8, 56 (2014).
Bari, A., Dalley, J. W. & Robbins, T. W. The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nat Protoc. 3, 759–767 (2008).
Dalley, J. W. & Robbins, T. W. Fractionating impulsivity: neuropsychiatric implications. Nat Rev Neurosci. 18, 158–171 (2017).
Rivalan, M., Ahmed, S. H. & Dellu-Hagedorn, F. Risk-prone individuals prefer the wrong options on a rat version of the Iowa Gambling Task. Biol Psychiatry. 66, 743–749 (2009).
Bari, A. et al. Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology. 35, 1290–1301 (2010).
Dalton, G. L., Wang, N. Y., Phillips, A. G. & Floresco, S. B. Multifaceted contributions by different regions of the orbitofrontal and medial prefrontal cortex to probabilistic reversal learning. J Neurosci. 36, 1996–2006 (2016).
Simmons, D. M., Arriza, J. L. & Swanson, L. W. A complete protocol for in situ hybridization of messenger RNAs in brain and other tissues with radio-labeled single-stranded RNA probes. J Histotechnol. 12, 169–181 (1989).
Paxinos, G. & Watson, C. The Rat Brain in Stereotaxic Coordinates. (Academic Press, 2007).
Armario, A. Studying chronic stress in animals: purposes, models and consequences. (eds Russell, J. A & Shipston, M. J.) Neuroendocrinology of Stress. 143–67 (John Wiley & Sons Ltd, 2015).
Ilin, Y. & Richter-Levin, G. ERK2 and CREB activation in the amygdala when an event is remembered as “Fearful” and not when it is remembered as “Instructive”. J Neurosci Res. 87, 1823–1831 (2009).
Armario, A. et al. What can we know from pituitary-adrenal hormones about the nature and consequences of exposure to emotional stressors? Cell Mol Neurobiol. 32, 749–758 (2012).
Mormède, P., Dantzer, R., Michaud, B., Kelley, K. W. & Le Moal, M. Influence of stressor predictability and behavioral control on lymphocyte reactivity, antibody responses and neuroendocrine activation in rats. Physiol Behav. 43, 577–583 (1988).
Prince, C. R. & Anisman, H. Situation specific effects of stressor controllability on plasma corticosterone changes in mice. Pharmacol Biochem Behav. 37, 613–621 (1990).
Lucas, M. et al. Long-term effects of controllability or the lack of it on coping abilities and stress resilience in the rat. Stress. 17, 423–30 (2014).
Liu, X., Tang, X. & Sanford, L. D. Stressor controllability and Fos expression in stress regulatory regions in mice. Physiol Behav. 97, 321–326 (2009).
Pryce, C. R. et al. Establishing a learned-helplessness effect paradigm in C57BL/6 mice: behavioral evidence for emotional, motivational and cognitive effects of aversive uncontrollability per se. Neuropharmacology. 62, 358–372 (2012).
Brydges, N. M., Holmes, M. C., Harris, A. P., Cardinal, R. N. & Hall, J. Early life stress produces compulsive-like, but not impulsive, behavior in females. Behav Neurosci. 129, 300–308 (2015).
Baarendse, P. J., Counotte, D. S., O’Donnell, P. & Vanderschuren, L. J. Early social experience is critical for the development of cognitive control and dopamine modulation of prefrontal cortex function. Neuropsychopharmacology. 38, 1485–1494 (2013).
Zeeb, F. D., Robbins, T. W. & Winstanley, C. A. Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology. 34, 2329–2343 (2009).
Dudman, J. T. & Gerfen, C. R. The basal ganglia. (ed. Paxinos, G.) The Rat Nervous System 391–440 (Academic Press, 2015).
Agnoli, L. & Carli, M. Synergistic interaction of dopamine D and glutamate N-methyl-D-aspartate receptors in the rat dorsal striatum controls attention. Neuroscience. 185, 39–49 (2011).
Agnoli, L., Mainolfi, P., Invernizzi, R. W. & Carli, M. Dopamine D1-like and D2-like receptors in the dorsal striatum control different aspects of attentional performance in the five-choice serial reaction time task under a condition of increased activity of corticostriatal inputs. Neuropsychopharmacology. 38, 701–714 (2013).
Eagle, D. M. et al. Contrasting roles for dopamine D1 and D2 receptor subtypes in the dorsomedial striatum but not the nucleus accumbens core during behavioral inhibition in the stop-signal task in rats. J Neurosci. 31, 7349–7356 (2011).
Bryden, D. W., Burton, A. C., Kashtelyan, V., Barnett, B. R. & Roesch, M. R. Response inhibition signals and miscoding of direction in dorsomedial striatum. Front Int Neurosci. 6, 1–15 (2012).
Jentsch, J. D. et al. Dissecting impulsivity and its relationships to drug addictions. Ann N Y Acad Sci. 1327, 1–26 (2014).
Rogers, R. D., Baunez, C., Everitt, B. J. & Robbins, T. W. Lesions of the medial and lateral striatum in the rat produce differential deficits in attentional performance. Behav Neurosci. 115, 799–811 (2001).
Tedford, S. E., Persons, A. L. & Napier, T. C. Dopaminergic lesions of the dorsolateral striatum in rats increase delay discounting in an impulsive choice task. PLoS One. 10, e0122063 (2015).
Schwabe, L. & Wolf, O. T. Stress-induced modulation of instrumental behavior: from goal-directed to habitual control of action. Behav Brain Res. 219, 321–328 (2011).
Dias-Ferreira, E. et al. Chronic stress causes frontostriatal reorganization and affects decision-making. Science. 325, 621–625 (2009).
Cotella, E. M. et al. Long-term impact of chronic variable stress in adolescence versus adulthood. Prog NeuroPsychopharmacology Biol Psychiatry. 88, 303–310 (2018).
Dalla, C., Edgecomb, C., Whetstone, A. S. & Shors, T. J. Females do not express learned helplessness like males do. Neuropsychopharmacology. 33, 1559–1569 (2008).
Baratta, M. V. et al. Behavioural and neural sequelae of stressor exposure are not modulated by controllability in females. Eur J Neurosci. 47, 959–967 (2018).
The laboratory was supported by Spanish grants to AA and/or RN from Plan Nacional sobre Drogas (2011/021), Ministerio de Economía y Competitividad (SAF2014-53876-R), Instituto de Salud Carlos III (RD12/0028/0014, Redes Temáticas de Investigación Cooperativa en Salud, Ministerio de Sanidad y Consumo) and Generalitat de Catalunya (SGR2014-1020). MSO was a recipient of a predoctoral fellowship from the Universitat Autònoma de Barcelona (UAB). RN is a recipient of an ICREA Academia award (Generalitat de Catalunya) (2015–19). JFL was supported by a grant from the Spanish Ministry of Economy (MINECO) and European Social Fund (PEJ-2014-A-51463). JUC was the recipient of predoctoral fellowship from MINECO (BES-2015-071464).The UAB Animal Facility received funding from 2015 FEDER7S-20IU16-0019. The authors appreciate the generous gift of 2 shuttle-boxes from Dr Rosa M Escorihuela (Institut de Neurociències, UAB).
The authors declare no competing interests.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Sanchís-Ollé, M., Fuentes, S., Úbeda-Contreras, J. et al. Controllability affects endocrine response of adolescent male rats to stress as well as impulsivity and behavioral flexibility during adulthood. Sci Rep 9, 3180 (2019). https://doi.org/10.1038/s41598-019-40061-3
Striatal dopamine D2 binding correlates with locus of control: Preliminary evidence from [11C]raclopride Positron Emission Tomography
International Journal of Psychophysiology (2019)