The relief from an aversive event is rewarding. Since organisms are able to learn which environmental cues can cease an aversive event, relief learning helps to better cope with future aversive events. Literature data suggest that relief learning is affected in various psychopathological conditions, such as anxiety disorders. Here, we investigated the role of the mesolimbic dopamine system in relief learning. Using a relief learning procedure in Sprague Dawley rats, we applied a combination of behavioral experiments with anatomical tracing, c-Fos immunohistochemistry, and local chemogenetic and pharmacological interventions to broadly characterize the role of the mesolimbic dopamine system. The present study shows that a specific part of the mesolimbic dopamine system, the projection from the posterior medial ventral tegmental area (pmVTA) to the nucleus accumbens shell (AcbSh), is activated by aversive electric stimuli. 6-OHDA lesions of the pmVTA blocked relief learning but fear learning and safety learning were not affected. Chemogenetic silencing of the pmVTA-AcbSh projection using the DREADD approach, as well as intra-AcbSh injections of the dopamine D2/3 receptor antagonist raclopride inhibited relief learning. Taken together, the present data demonstrate that the dopaminergic pmVTA-AcbSh projection is critical for relief learning but not for similar learning phenomena. This novel finding may have clinical implications since the processing of signals predicting relief and safety is often impaired in patients suffering from anxiety disorders. Furthermore, it may help to better understand psychological conditions like non-suicidal self-injury, which are associated with pain offset relief.
The motivational opponent-process theory suggests that an emotionally relevant event induces two opponent emotions [1, 2]. In the case of an aversive event, initially the fear emotion is triggered. However, after the offset of the aversive event, fear disappears and is followed by its opponent emotion, namely relief.
Both of these emotions, fear and relief, can be associated with environmental cues [3, 4]. These learning phenomena are called fear learning [5, 6] and relief learning [7, 8], respectively. Thereby, humans and animals can learn what made aversive events happen and cease, which help them to better cope with future aversive events . Another type of learning is safety learning, which also can be observed during the experience of an aversive event. Safety learning is the association of a reoccurring environmental cue with the absence of the aversive event [9, 10]. In typical safety learning protocols, the cue and the aversive event are presented in an explicitly unpaired manner. Furthermore, in contrast to relief learning, the inter-stimulus interval is often pseudo-randomized (see also below). Nonetheless, some authors consider relief learning as a specific form of safety learning .
There is a debate in literature whether these three types of learning contribute to the development of anxiety disorders by causing or supporting some of the symptoms [12,13,14,15]. Because increasing evidence suggests that safety learning is impaired in anxiety disorders [11, 16, 17], the behavioral and neural characterization of safety and relief learning gained more and more interest in basic and applied neurosciences during the last decade [9, 10, 18,19,20].
Regarding relief learning, there is already a good deal of information available : Human imaging studies found the nucleus accumbens to be activated during both acute relief [21, 22] and learned relief [23, 24]. Studies in laboratory rodents confirmed the crucial role of the nucleus accumbens in relief learning [25, 26] and showed that relief learning is mediated and modulated by glutamatergic and dopaminergic transmission within the nucleus accumbens [26,27,28,29].
Relief from an aversive event is rewarding [22, 24, 30] and the mesolimbic dopamine system is an established mediator of natural reward . In rats, Brischoux et al.  identified dopaminergic neurons in the posterior medial region of the ventral tegmental area (pmVTA) that are activated by the offset of an aversive event (an electric footshock), i.e. in the moment of relief. Based on these findings, we hypothesized that the dopaminergic projection from the pmVTA to the nucleus accumbens shell (AcbSh) mediates relief learning.
The aim of the present study was to investigate this hypothesis. Therefore, we used a combination of anatomical tracing, c-Fos immunohistochemistry, neurotoxic lesions, and chemogenetic and pharmacological approaches. We report that dopaminergic pmVTA neurons projecting to the AcbSh were activated by foot shocks and that lesions of these neurons prevented relief learning but not fear or safety learning. Furthermore, chemogenetic inactivation of the pmVTA-AcbSh projection as well as local blockade of dopamine D2/3 receptors within the AcbSh inhibited the acquisition of conditioned relief. Notably, we previously published an important role of accumbal dopamine D1 receptors in the acquisition and expression of conditioned relief . Taken together, these findings indicate that the dopaminergic pmVTA-AcbSh projection and accumbal dopamine receptors are crucially involved in relief learning.
Materials and methods
One hundred and thirty-two male Sprague Dawley rats aged between 2 and 3 months were used. They were bred in our animal facility (original breeding stock; Taconic Biosciences, Denmark), group-housed under standard conditions, and all experiments were performed during the light phase. Our study was carried out in accordance with international guidelines for the use of animals in experiments (2010/63/EU) and was approved by the local ethical committee (Landesverwaltungsamt Sachsen-Anhalt, Az. 42502-2-1309 UniMD).
For surgeries, the rats were anesthetized with 2–3% isoflurane (mixed with pure oxygen). For the different injections and implantations, a stereotaxic apparatus and coordinates from a rat brain atlas were used . Post-surgical analgesia was provided by carprofen (Rimadyl, Zoetis, Berlin, Germany; 5 mg/kg, s.c.).
Tracer injections (experiment 1)
The anterograde tracer Phaseolus vulgaris-leucoagglutinin (PHA-L; Vector Laboratories, Burlingame, CA, USA; 2.5% in NaPBS;) was iontophoretically (5 µA, 10 min, on–off: 7 s) injected into the pmVTA (6.3 mm caudal, 0.1 mm lateral, and 8.5 mm ventral from bregma). In another set of rats, the retrograde tracer fluorogold (FG; Fluorochrome, Denver; 4% in saline; 4 µA, 7 min, on–off: 7 s;) was injected into the AcbSh (1.6 mm rostral, 2.0 mm lateral, and 8.2 mm ventral from bregma).
Dopamine-specific lesions (experiment 2)
Rats were pretreated with desipramine (Sigma-Aldrich, Taufkirchen, Germany; 25 mg/kg, i.p.) for the protection of noradrenergic neurons . Using a 2 µl microsyringe, vehicle or the neurotoxin 6-hydroxydopamine (6-OHDA; Sigma-Aldrich, Taufkirchen, Germany; 8 µg/µl, dissolved in saline with 0.02% ascorbic acid) was injected into the pmVTA (see above for coordinates) with a volume of 1 or 2 µl and a rate of 0.2 µl/min.
Injections of the viral DREAAD construct (experiment 3)
Rats received injections of 1 µl pAAV8-CaMKIIa-hM4D(Gi)-mCherry (titer: 3.3 × 1012 vg/ml, dissolved in 350 mM NaCl + 5% d-sorbitol in phosphate-buffered saline (PBS); Virus Vector Core, University of North Carolina, Chapel Hill, NC, USA) or pAAV2-CaMKIIa-mCherry, i.e. a construct without DREADD, into the pmVTA. Then, guide cannulas aiming at the AcbSh were implanted (see the next section).
Implantations of guide cannulas (experiments 3 and 4)
To perform local injections in awake rats, guide cannulas (8 mm length, 0.7 mm diameter) aiming at the AcbSh (1.6 mm rostral, ± 2.0 mm lateral, and 8.2 mm ventral from bregma) were bilaterally implanted.
Startle apparatus and stimulus parameter
To measure the startle response (experiments 2, 3, and 4) and rats’ reactivity to electric stimuli (experiment 4), a startle system with piezoelectric motion sensors was used (SR-LAB; San Diego Instruments, CA, USA).
For the different conditioning procedures, aversive electric stimuli (unconditioned stimulus, US) and either light or tone stimuli (conditioned stimulus, CS; duration: 5 s) were used. The light CS was produced by a 10 W bulb (~1000 lux), the tone CS by a loudspeaker (intensity: 75 dB SPL). The US (footshock) was administered via a floor grid (intensity: 0.4 mA, duration: 0.5 s). A second loudspeaker was used to present a continuous background noise (55 dB SPL) and the acoustic startle stimuli (noise bursts, 96 dB SPL, 40 ms duration). For testing the reactivity to electric stimuli, stimulus intensities of 0.0, 0.1, 0.2, 0.3, and 0.4 mA were used.
PHA-L-injected rats were perfused 1 week after the injections without any behavioral tests. FG-injected rats were put into the startle system 2 weeks after the surgery. After 2 min habituation, four of them received 15 foot shocks with an inter-trial interval (ITI) of 2 min, five of them did not receive electric stimuli. One hour later they were perfused.
Ten days after injections of vehicle or 6-OHDA, rats were subjected to a relief-conditioning procedure as previously described . After 5 min acclimation time, 15 pairings of an electric stimulus with the light stimulus were presented (mean ITI: 2 min, range: 1.5–2.5 min). The stimuli were backward paired, i.e. the light CS was presented 3 s after the US onset.
On the following day, the retention test on conditioned relief was performed. After 5 min acclimation, 10 startle stimuli were presented with an ITI of 30 s to habituate the rats. Then, 20 further startle stimuli were presented, 10 of them without the light CS (startle alone trials) and 10 of them upon presentation of the light CS (CS-startle trials). The order of the trials with and without light CS was pseudo-randomized.
After a break of at least 3 days, the same rats were safety-conditioned as previously described . After 5 min acclimation, the CS (5 kHz tone) as well as the US was presented 15 times. For this procedure, in order to explicitly unpair CS with US, the US was never presented less than 12 s before or after the tone CS, otherwise presented with a random inter-stimulus interval.
On the following day, the retention test on conditioned safety was performed. The protocol was identical to the retention test on conditioned relief which is described above.
After a further break of at least 3 days, the same rats were fear-conditioned as previously described . After 5 min acclimation, 15 forward pairings of the CS (now a 10 kHz tone) and the US were presented. The electric stimuli were presented 4.5 s after the onset of the CS and both stimuli ended simultaneously.
On the following day, the retention test on conditioned fear was performed. The protocol was identical to the retention test on conditioned relief which is described above. After this test, the animals were perfused.
Two weeks after the injections of the DREAAD construct, the rats received bilateral injections of either saline or 1 mM clozapine-N-oxide (CNO; Sigma-Aldrich, Taufkirchen, Germany; dose according to mahler et al. ) into the AcbSh. A volume of 0.5 µl was injected with a speed of 0.2 µl/min.
The procedure for relief conditioning and also for the retention test on the following day (without injections) was identical to the one described above (experiment 2). After the retention test, the rats were perfused.
One week after guide cannula implantation, the rats were relief-conditioned and tested on conditioned relief as described above. However, one group of rats were injected before the conditioning and tested without treatment (pre-training injections), whereas rats in the other group were conditioned without treatment and received injections before testing (pre-testing injections). Injections of 0, 0.5, or 1.0 µg raclopride (dissolved in 0.3 µl saline; Sigma-Aldrich, Taufkirchen, Germany; doses according to Lex and Hauber ) were performed as described above. A between-subject design was used for pre-training injections (saline; 0.5 or 1.0 µg raclopride). For the pre-testing injections, a within-subject design was used, i.e. each rat was conditioned and tested three times (with a break of 1–2 days in between) and received each treatment in a pseudo-randomized order.
Eighteen randomly chosen rats of experiment 4 were used to measure potential effects of raclopride injections on the locomotor response to the foot shocks. They were injected with vehicle or 1 µg raclopride, put into the test chamber, and exposed to different shock intensities.
Immunohistochemistry and histology
After the end of the behavioral experiments, rats of experiments 1, 2, and 3 were anesthetized with 350 mg/kg chloral hydrate and transcardially perfused with PBS followed by 4.0 % paraformaldehyde and 0.2% 0.1 M picric acid. Rats from experiment 4 were euthanized by CO2 asphyxia. The rats’ brains were removed, post-fixed, and coronal sections were cut (40 µm). Sections of experiments 1 and 2 were immunostained with the following primary antibodies: rabbit anti-PHA-L (1:1000; Vector Laboratories Cat# AS-2300, RRID:AB_2313686), mouse anti-tyrosine hydroxylase (1:5000; Millipore Cat# MAB318, RRID:AB_2201528), and rabbit anti-c-Fos (1:500; Santa Cruz Biotechnology Cat# sc-253, RRID:AB_2231996). Staining was amplified as described previously . For the analysis of FG and mCherry expression, the native fluorescence of these two chromophores was used. Brain sections (AcbSh region) of experiments 3 and 4 were Nissl-stained (1% cresyl violet). Brain sections of experiment 3 (pmVTA region) were not stained. Last, all sections were mounted on glass slides, dehydrated, and coverslipped with DPX.
Slices were examined under a microscope. Photomicrographs of the regions of interest were taken and analyzed with ImageJ software (double- and triple-stained neurons; experiment 1). Injections sites (experiments 1, 3, and 4) and 6-OHDA-induced lesions (experiment 2) were analyzed under a light microscope. Only rats with confirmed injection or lesion sites in the intended target areas were included in further analysis. In sum, 23 rats had to be excluded because of missing startle responses or misplaced injection sites.
Descriptive and statistical analyses
For statistical analysis, Prism 6.0 (GraphPad Software Inc., La Jolla, CA, USA) was used. The mean startle magnitudes of the startle trials in the absence (startle alone) and in the presence of the conditioned light stimulus (CS-startle), as well as the difference between these means were calculated for each animal. Normal distribution of the data was checked with the D’Agostino-Pearson omnibus normality test. ANOVAs with the factors (within-subject if appropriate) startle trial type, shock reactivity or/and treatment were calculated. C-Fos data were analyzed with Student’s t-tests. The significance level was set at p < 0.05 for all statistical tests. The results are shown as mean ± SEM.
Foot shocks activate dopaminergic pmVTA-AcbSh projection neurons
The anterograde tracer PHA-L was iontophoretically applied into the pmVTA (for injection sites see Supplementary Figure 1), whose neurons are partly activated by the offset of foot shocks , to confirm that this brain site projects to the nucleus accumbens, a crucial brain area for relief learning (e.g. ). As shown in Fig. 1a, PHA-L-immuno-positive cells were found in the dorsomedial part of the AcbSh but not in other subregions of the nucleus accumbens.
Next, we exposed rats (n = 4; for injection sites see Supplementary Figure 2), which had received FG injections into the AcbSh 1 week before, to foot shocks. Another group of rats with FG injections (n = 5) received no foot shocks and served as a control group. After the exposure, the rats were euthanized and the brain (pmVTA) slices immunostained for c-Fos, a marker of neural activity , and TH, a marker of dopaminergic neurons in the ventral midbrain . Our analyses focused on the percentage of pmVTA-AcbSh projection neurons (i.e., FG-labeled) that were activated by foot shocks (i.e. c-Fos-immunoreactive). As depicted in Fig. 1b, only a slight amount (0.8 ± 1.0 %) of pmVTA-AcbSh projection neurons were c-Fos-immunoreactive under control conditions (no exposure to foot shocks). Exposure to foot shocks significantly increased the percentage of c-Fos-immunoreactive projection neurons to 12.8 ± 4.3% (Student’s t-test: t(7) = 5.40, p = 0.001). Nearly all of these neurons were also TH-immunoreactive.
Dopaminergic pmVTA lesions block relief learning
Our first experiment showed that dopaminergic neurons projecting from the pmVTA to the AcbSh are activated by foot shocks. To see whether these dopaminergic neurons are involved in relief learning, we performed 6-OHDA lesions of the pmVTA and submitted these rats to the relief conditioning procedure.
Histological analyses of the pmVTA revealed integrity of the pmVTA after saline injections (sham lesions, n = 9, Fig. 1c and Supplementary Figure 3). Injections of both volumes of 6-OHDA successfully induced lesions of the pmVTA with very similar extensions, and the data were therefore pooled. In 16 rats, these lesions included only the pmVTA, i.e. the interfascicular, the paranigral, and the parainterfascicular nuclei of the VTA. Notably, these lesions also lead to a down-regulation of TH-immunoreactivity in the nucleus accumbens (Fig. 1c, left panels). Seven rats had misplaced lesions; not the pmVTA, but more dorsal sites of this region were lesioned (e.g., red nucleus, parabrachial pigmented nucleus). These rats built the group “misplaced”.
The rats were first subjected to a relief learning protocol, then to a safety learning protocol, and last to a fear learning protocol. An overall ANOVA with protocol, lesion group, and startle trial type as factors showed that the lesions had no general effects on startle magnitude (F(2,87) = 0.99, p = 0.37) and that—as expected—the different protocols leads to different CS effects on the startle response (F(2,87) = 23.55, p < 0.0001). Notably, this interaction was differently affected by the lesions (lesion group × protocol × trial type: F(4,87) = 2.54, p = 0.046). To evaluate the particular effects of pmVTA lesions on the different types of learning, separate ANOVAs were performed in the following.
Figure 2a depicts the data from the retention test on conditioned relief, measured by modulation of the startle response by the relief CS (for individual startle data see Supplementary Figure 4). The mean startle magnitudes (±SEM) in startle alone and CS-startle trials, as well as their difference are shown. An ANOVA using trial type as within-subject and group as between-subject factors revealed a significant main effect of trial type (F(1,29) = 15.30, p = 0.0005) indicating startle attenuation by the relief CS, i.e. successful relief conditioning. Notably, the lesions did not generally affect the startle magnitude (main lesion effect: F(2,29) = 0.38, p = 0.69). However, there was a significant interaction between trial type and group (F(2,29) = 6.74, p = 0.004), indicating that the pmVTA lesions affected relief conditioning. This was confirmed by post hoc Sidak’s tests demonstrating a significant startle attenuation by the relief CS in the sham and misplaced groups (t(9) = 3.20, p = 0.01 and t(7) = 3.36, p = 0.007, respectively) but not in the pmVTA-lesioned group (t(16) = 0.54, p = 0.93). Furthermore, a separate analysis of the difference scores showed a significant difference between sham-lesioned and pmVTA-lesioned rats (t(23) = 2.90, p = 0.01; Dunnett’s post hoc comparison after ANOVA, F(2,29) = 6.78, p = 0.004).
This pmVTA lesion effect was specific to relief learning since neither safety learning (Fig. 2b) nor fear learning (Fig. 2c) was affected by the lesions. ANOVAs revealed successful conditioning in these tests (main trial type effects: F(1,29) = 12.12, p = 0.001 and F(1,29) = 17.25, p = 0.0004, respectively) but no interactions between pmVTA lesion and CS effects on startle (F(2,29) = 0.23, p = 0.80 and F(2,29) = 0.15, p = 0.86, respectively). In addition, the startle response was not generally affected by the lesions in these tests (main lesion effect: F(2,29) = 1.58, p = 0.22 and F(2,29) = 1.04, p = 0.37, respectively).
Chemogenetic inactivation of the pmVTA-AcbSh projection blocks relief learning
Our next experiment had the aim to demonstrate that the blockade of relief learning, observed in experiment 2, is mediated by the projection from the pmVTA to the AcbSh. To specifically inactivate the pmVTA-AcbSh projection, we made use of chemogenetics , i.e. we injected a DREADD vector (pAAV8-CaMKIIa-hM4D(Gi)-mCherry) into the pmVTA (Fig. 3, inlay). Furthermore, to be able to later specifically inactivate the projection from the pmVTA to the AcbSh, we implanted intracranial cannulas targeting the AcbSh (for injection sites see Fig. 3a). Histological analysis revealed robust mCherry expression of the pmVTA neurons as well as of terminals within the AcbSh (Supplementary Figure 5).
Immediately before relief conditioning, the rats were either injected with saline (n = 10) or with CNO (n = 14) into the AcbSh. CNO is a synthetic ligand that activates the inhibitory hM4D receptors and thereby specifically inactivates the projection from the pmVTA to the AcbSh in DREADD vector-injected rats. After the behavioral experiment, expression of the DREADD construct was histologically confirmed by analyzing mCherry expression in the pmVTA and the AcbSh. Notably, a group of rats (n = 9) received pmVTA injections of a viral construct without DREADD. These rats built the group “CNO/control” and were used to control for unspecific CNO effects.
The effect of intra-AcbSh CNO injections on relief learning is depicted in Fig. 3b (for individual startle data see Supplementary Figure 6). These CNO injections had no general unspecific effects on startle (main treatment effect: F(2,19) = 0.14, p = 0.71). A significant interaction between treatment and trial type (F(2,19) = 5.42, p = 0.03) revealed that the CNO injections affect the modulation of startle by the relief CS. This is confirmed by post hoc analyses demonstrated successful startle attenuation by the relief CS in vehicle-injected rats (t(10) = 2.96, p = 0.02) but not in those rats with validated expression of the viral DREADD construct (t(11) = 0.27, p = 0.96). In addition, startle difference scores are significantly reduced after CNO injections (t-test: t(18) = 2.22, p = 0.04). Notably, CNO had no effects on relief learning (paired t-test, startle alone vs. CS-startle: t(8) = 2.39, p = 0.048) in rats which received injections of the inactive viral construct (i.e., without DREADD) indicating that the CNO effects in the rats which received injections of the active virus (with DREADD) are mediated by the DREADDs.
Accumbal dopamine D2/3 receptor blockade prevents relief learning
To evaluate the role of accumbal dopamine D2/3 receptors in the acquisition of conditioned relief, two doses of the dopamine D2/3 receptor antagonist raclopride were injected immediately before submitting the rats to the relief conditioning procedure (vehicle: n = 9; 0.5 µg raclopride: n = 8; 1.0 µg raclopride: n = 9; for injection sites see Fig. 4a). The retention test on the next day was performed without any injections. As shown in Fig. 4c (for individual startle data see Supplementary Figure 7), there were no main effects of the injections on the startle response (F(2,23) = 1.97, p = 0.16). The relief CS attenuated the startle response in vehicle-injected rats (trial type: F(2,23) = 12.66, p = 0.002). Notably, injections of raclopride into the AcbSh blocked relief learning indicated by a significant interaction between treatment and trial type (F(2,23) = 4.90, p = 0.02). Post hoc tests demonstrated significant startle attenuation after vehicle injections (t(9) = 4.68, p = 0.0003) but not after 0.5 and 1.0 µg raclopride injections (t(8) = 0.63, p = 0.90 and t(9) = 0.94, p = 0.74 respectively). This is confirmed by the separate analysis of the difference scores showing significant differences between vehicle and raclopride-injected rats (vehicle vs. 0.5 µg raclopride: t(15) = 2.73, p = 0.02; vehicle vs. 1.0 µg raclopride: t(16) = 2.64, p = 0.03; Dunnett’s post hoc comparison after ANOVA, F(2,23) = 4.87, p = 0.02).
In contrast, raclopride injections into the AcbSh before the retention test did not affect expression of conditioned relief (Fig. 4d). An ANOVA revealed main effects of trial type (F(1,15) = 22.91, p = 0.0002) but not of treatment (F(2,30) = 0.63, p = 0.54), as well as no interaction between these two factors (F(2,30) = 0.87, p = 0.43).
In a separate experiment, we also tested whether intra-accumbal raclopride injections affect the locomotor reactivity to foot shocks which would indicate impaired perception (Fig. 4b). There was only a main effect of stimulus intensity (F(4,64) = 25.93, p < 0.0001) but neither a main effect of treatment (F(1,16) = 1.80, p = 0.20) nor an interaction between treatment and footshock intensity (F(4,64) = 0.56, p = 0.69). Notably, also a focused analysis of the reactivity to 0.4 mA foot shocks alone revealed no effects of raclopride (Student's t-test: t(16) = 1.21, p = 0.24).
The goal of the present study was to explore whether the mesolimbic dopamine system, in particular the projection from the pmVTA to the AcbSh, is involved in relief learning.
We used a behavioral procedure of relief learning in rats which was previously established by our group . During conditioning, the CS is presented 3 s after the US onset, a condition that leads to the most robust attenuation of the acoustic startle response [23, 42], a bivalent and translational behavioral measure of emotional valence [43, 44]. Several control experiments of our group and of others demonstrated that this startle attenuation is based on an associative status of the CS, since the CS does not affect the startle response before conditioning or after different types of sham conditioning such as totally randomized presentations of the CS and the US [3, 23, 42, 45].
Relief and safety learning seem to be two distinct learning types . Even though our relief learning protocol has similarities with certain safety learning protocols , it has striking differences with other safety learning protocols [10, 18]. In the latter protocols, the CS and the US are presented explicitly unpaired without any fixed temporal relationship, yet our protocol relies on backward pairing of the CS with the US with a very short and fixed inter-stimulus interval (3 s). Furthermore, we previously demonstrated that the nucleus accumbens is crucial for relief learning but not for safety learning , which suggests different neural underpinnings for these learning types.
Role of the pmVTA-AcbSh projection in relief learning
The scientific question of the present study is based on findings that the nucleus accumbens is crucially involved in relief learning [23, 24, 28, 29, 47] and that some neurons of the pmVTA are activated by the offset of an aversive event , i.e. in the moment of relief. First, using retrograde and anterograde tracing, we confirmed literature data (e.g. ) demonstrating that the pmVTA projects to the AcbSh (Fig. 1). Furthermore, using immunohistochemistry for TH, a critical enzyme in dopamine synthesis, and for c-Fos, an indirect marker of neuronal activity , we showed that a decent number of the dopaminergic pmVTA-AcbSh projection neurons are activated by foot shocks (Fig. 1b). Whether this activation is triggered by the foot shocks themselves or by the relief from the foot shocks cannot be determined by the used methods. However, this finding indicates that the pmVTA neurons that are activated by the offset of foot shocks  are dopaminergic and they project to the AcbSh.
To examine whether the dopaminergic pmVTA neurons are not only activated by foot shocks but also involved in relief learning, we performed dopaminergic lesions of the pmVTA by local injections of the neurotoxin 6-OHDA. Such 6-OHDA-induced lesions of the VTA were described to impair several reward-related behaviors such as self-administration of rewarding drugs  or sucrose intake . In the present study, pmVTA lesions prevented relief learning, measured by startle attenuation of the relief CS (Fig. 2a). This strongly supports the idea that the dopaminergic projection from the pmVTA to the AcbSh is mediating relief learning. Importantly, this lesion effect seems to be specific to relief learning since startle attenuation after safety learning (Fig. 2b) and startle potentiation after fear learning (Fig. 2c) were not affected. Here, it should be noted that our animals were repeatedly tested with these three different learning protocols and a previous type of learning might affect performance in one of the consecutive types of learning. We tried to prevent such potential interferences by using different to-be-learned stimuli but generalization processes cannot be excluded. Nevertheless, the findings that our lesion affect relief but not fear or safety learning confirm previous studies demonstrating the relief learning requires a different neural network than fear learning  and safety learning . In these studies, the nucleus accumbens was temporary inactivated by local muscimol injections. Importantly, the rats were not repeatedly tested in different learning protocols but different groups of rats were used for each type of learning.
Next, we made use of chemogenetics [41, 51] to examine whether the direct projection from the pmVTA to the AcbSh is mediating relief learning. The DREADD vector, AAV8-CaMKIIa-hM4D(Gi)-mCherry, was injected into the pmVTA. During the behavioral experiment, CNO—the drug activating the inhibitory DREADD—was locally infused into the AcbSh in order to specifically silence the pmVTA-AcbSh projection. These CNO injections clearly prevented relief learning (Fig. 3b), which was intact in vehicle-injected rats. Notably, CNO had no effects on relief learning in rats which were injected with an inactive viral construct, i.e. in which DREADDs were not expressed. The latter control experiment is of importance since CNO—at least after systemic injections—is metabolized into clozapine  which has not only a high affinity to the DREADD, i.e. hM4D(Gi), but also to a number of other receptors . However, it is not known so far whether this metabolism is of significance after local CNO injections into the brain.
It should also be noted that promoter which was used for the viral DREADD construct is not very specific, i.e. most probably not only dopaminergic VTA neurons were infected. However, Melchior et al.  demonstrated in an optogenetic experiment that using the CaMKIIa promotor for an optogenetic construct was equally efficient regarding stimulation-induced dopamine release in the nucleus accumbens than using TH:Cre as a promoter. Furthermore, they found their CaMKIIa-driven construct strongly expressed in TH-positive VTA neurons.
The previous experiments showed that (a) a dopaminergic projection from the pmVTA to the nucleus accumbens shell is activated by aversive events, (b) dopaminergic lesions of the pmVTA block relief learning, and (c) chemogenetic silencing of the projection from the pmVTA to the AcbSh blocks relief learning. We further asked whether a blockade of dopamine receptors within the AcbSh would have similar effects. We recently demonstrated that accumbal injections of the selective dopamine D1 receptor antagonist SCH23390 inhibit the acquisition and expression of conditioned relief . However, an involvement of other dopamine receptor subtypes was not investigated so far. In the present study, we therefore injected raclopride, a dopamine D2/D3 receptor antagonist , into the AcbSh, either before the relief conditioning procedure or before the retention test on conditioned relief. Interestingly, only the injections before conditioning (Fig. 4c) but not the ones before the retention test (Fig. 4d) reduced relief learning. This indicates that accumbal D2/D3 receptors are selectively important for the acquisition but not the expression of relief memory. Notably, the locomotor response to the foot shocks was not impaired by the raclopride injections (Fig. 4b), suggesting that footshock perception was not impaired.
Role of dopamine in relief and safety learning
All four experiments of the present study support our working hypothesis that a dopaminergic projection from the pmVTA to the AcbSh mediates relief learning. Our data strongly support findings from a completely different procedure of pain relief learning. In this procedure [26, 56], subchronic pain in rats is induced by incision of the skin and underlying hind-paw tissue. Peripheral nerve blockade by local injections of lidocaine resulted in pain relief, which was associated with the context in which relief took place. In a following place preference test, the relief-associated context is preferred towards the context of a sham treatment. Using this behavioral procedure, it was shown that temporary inactivation of the nucleus accumbens or the VTA impairs pain relief-induced place preference learning . Furthermore, an increase of accumbal dopamine release during pain relief was measured by microdialysis, and blockade of dopamine receptors within the nucleus accumbens inhibited relief learning in this procedure .
These data and the present data strongly argue for an important role of mesolimbic dopamine system in relief learning. This nicely fits to the general concept of relief learning : Relief from an aversive event is rewarding [22, 24, 30] and the mesolimbic dopamine system is well known for its role in mediating reward (e.g. ). We here focused on the pmVTA, since some of the pmVTA neurons are activated by the relief from foot shocks , however, also other parts of the VTA might be involved in relief learning. Furthermore, we here show an crucial role of accumbal dopamine D2/3 receptors in the acquisition but not the expression of relief learning, whereas accumbal dopamine D1 receptors are important for both acquisition and expression of conditioned relief . This fits to the findings that activation of these receptors in the nucleus accumbens induce reward , whereas blockade of these receptors inhibits reward-related learning (e.g. ).
Literature data suggest that the dopaminergic brain system also plays a significant role in safety learning. Pollak et al.  showed that systemic applications of drugs acting on the dopamine D2/3 receptors strongly modulate the retention of learned safety in mice. Interestingly, the authors discussed that a VTA projection to the amygdala mediates these effects. It is not known whether D2/3 receptors are also involved in the acquisition of learned safety, and D1 receptors were not investigated so far in safety learning. Future studies should have a closer look on the role of the different dopamine receptors and the different VTA projections in safety and relief learning.
Both, relief learning as it was investigated in the present study and safety learning as investigated by Daniela Pollak and others, are very similar to classical conditioned inhibition procedures . In fact, the retention test of both procedures constitutes a type of summation test: animals are tested in the conditioning context, which induces contextual fear, and the relief or safety stimuli can be understood as conditioned inhibitors of this contextual fear which lead to an attenuation of the startle response or freezing behavior. However, the robust findings that (1) the nucleus accumbens is involved in relief learning but not safety learning (present study; ) and (2) learned relief but not learned safety is rewarding [22, 60, 61] indicates that relief and safety learning are different on a neural and conceptual level.
Potential clinical implications
What are potential implications of the present findings? For animals and humans, cues are important not only for signaling potential danger , but also for predicting the relief or the absence of danger [3, 18]. Increasing evidence during the last decade implies that psychiatric diseases such as depression or anxiety disorders are associated with an impaired processing of signals predicting relief and safety [11, 17, 18, 62]. Our findings suggest that these deficits could be caused by a hypofunction of the mesolimbic dopamine system, as it is observed in post-traumatic stress disorder . Based thereon, it would be interesting to also investigate whether relief learning is affected in diseases with a hyperfunction of the mesolimbic dopamine system such as schizophrenia  or addiction . Last, the present data may also help to better understand trichotillomania (hair pulling), excoriation (skin picking) disorder, or non-suicidal self-injury since these conditions are associated with the phenomenon of pain offset relief [66, 67].
Solomon RL. The opponent-process theory of acquired motivation—the costs of pleasure and the benefits of pain. Am Psychol. 1980;35:691–712.
Solomon RL, Corbit JD. Opponent-process theory of motivation .1. Temporal dynamics of affect. Psychol Rev. 1974;81:119–45.
Gerber B, Yarali A, Diegelmann S, Wotjak CT, Pauli P, Fendt M. Pain-relief learning in flies, rats, and man: basic research and applied perspectives. Learn Mem. 2014;21:232–52.
LeDoux J. Rethinking the emotional brain. Neuron. 2012;73:653–76.
Fendt M, Fanselow MS. The neuroanatomical and neurochemical basis of conditioned fear. Neurosci Biobehav Rev. 1999;23:743–60.
Johansen JP, Cain CK, Ostroff LE, LeDoux JE. Molecular mechanisms of fear learning and memory. Cell. 2011;147:509–24.
Denny MR. Relaxation theory and experiments. In: Brush FR editors. Aversive conditioning and learning. New York, NY: Academic Press; 1971. p. 235–95.
Navratilova E, Atcherley CW, Porreca F. Brain circuits encoding reward from pain relief. Trends Neurosci. 2015;38:741–50.
Christianson JP, Fernando ABP, Kazama AM, Jovanovic T, Ostroff LE, Sangha S. Inhibition of fear by learned safety signals: a mini-symposium review. J Neurosci. 2012;32:14118–24.
Pollak DD, Monje FJ, Lubec G. The learned safety paradigm as a mouse model for neuropsychiatric research. Nat Protoc. 2010;5:954–62.
Lohr JM, Olatunji BO, Sawchuk CN. A functional analysis of danger and safety signals in anxiety disorders. Clin Psychol Rev. 2007;27:114–26.
Lissek S, Powers AS, McClure EB, Phelps EA. Classical fear conditioning in the anxiety disorders: a meta-analysis. Behav Res Ther. 2005;43:1424.
Lissek S, Rabin S, Heller RE, Lukenbaugh D, Geraci M, Pine DS, Grillon C. Overgeneralization of conditioned fear as a pathogenic marker of panic disorder. Am J Psychiatry. 2010;167:47–55.
Öhman A, Mineka S. Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. Psychol Rev. 2001;108:483–522.
Bouton ME, Mineka S, Barlow DH. A modern learning theory perspective on the etiology of panic disorder. Psychol Rev. 2001;108:4–32.
Jovanovic T, Kazama A, Bachevalier J, Davis M. Impaired safety signal learning may be a biomarker of PTSD. Neuropharmacology. 2012;62:695–704.
Lissek S, Rabin SJ, McDowell DJ, Dvir S, Bradford DE, Geraci M, Pine DS, Grillon C. Impaired discriminative fear-conditioning resulting from elevated fear responding to learned safety cues among individuals with panic disorder. Behav Res Ther. 2009;47:111–8.
Kong E, Monje FJ, Hirsch J, Pollak DD. Learning not to fear: neural correlates of learned safety. Neuropsychopharmacology. 2014;39:515–27.
Rogan MT, Leon KS, Perez DL, Kandel ER. Distinct neural signatures for safety and danger in the amygdala and striatum of the mouse. Neuron. 2005;46:309–20.
Schiller D, Levy I, Niv Y, LeDoux JE, Phelps EA. From fear to safety and back: reversal of fear in the human brain. J Neurosci. 2008;28:11517–25.
Becerra L, Navratilova E, Porreca F, Borsook D. Analogous responses in the nucleus accumbens and cingulate cortex to pain onset (aversion) and offset (relief) in rats and humans. J Neurophysiol. 2013;110:1221–6.
Leknes S, Lee M, Berna C, Andersson J, Tracey I. Relief as a reward: hedonic and neural responses to safety from pain. PLoS ONE. 2011;6:e17870.
Andreatta M, Fendt M, Mühlberger A, Wieser MJ, Imobersteg S, Yarali A, Gerber B, Pauli P. Onset and offset of aversive events establish distinct memories requiring fear- and reward networks. Learn Mem. 2012;19:518–26.
Seymour B, O’Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, Dolan R. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci. 2005;8:1234–40.
Mohammadi M, Bergado Acosta JR, Fendt M. Relief learning is distinguished from safety learning by the requirement of the nucleus accumbens. Behav Brain Res. 2014;272:40–45.
Navratilova E, Xie JY, Okun A, Qu CL, Eyde N, Ci S, Ossipov MH, King T, Fields HL, Porreca F. Pain relief produces negative reinforcement through activation of mesolimbic reward-valuation circuitry. Proc Natl Acad Sci USA. 2012;109:20709–13.
Kahl E, Fendt M. Metabotropic glutamate receptors 7 within the nucleus accumbens are involved in relief learning in rats. Curr Neuropharmacol. 2016;14:405–12.
Bergado Acosta JR, Kahl E, Kogias G, Uzuneser TC, Fendt M. Relief learning requires a coincident activation of dopamine D1 and NMDA receptors within the nucleus accumbens. Neuropharmacology. 2017;114:58–66.
Mohammadi M, Fendt M. Relief learning is dependent on NMDA receptor activation in the nucleus accumbens. Br J Pharmacol. 2015;172:2419–26.
Leknes S, Brooks JCW, Wiech K, Tracey I. Pain relief as an opponent process: a psychophysical investigation. Eur J Neurosci. 2008;28:794–801.
Ikemoto S. Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res Rev. 2007;56:27–78.
Brischoux F, Chakraborty S, Brierley DI, Ungless MA. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci USA. 2009;106:4894–9.
Paxinos G, Watson C. The rat brain in stereotaxic coordinates. San Diego: Academic Press; 2014.
Lin HY, Yeh WL, Huang BR, Lin CJ, Lai CH, Lin H, Lu DY. Desipramine protects neuronal cell death and induces heme oxygenase-1 expression in Mes23.5 dopaminergic neurons. PLoS ONE. 2012;7:e50138.
Kahl E, Fendt M. Injections of the somatostatin receptor type 2 agonist L-054,264 into the amygdala block expression but not acquisition of conditioned fear in rats. Behav Brain Res. 2014;265:49–52.
Mahler SV, Vazey EM, Beckley JT, Keistler CR, McGlinchey EM, Kaufling J, Wilson SP, Deisseroth K, Woodward JJ, Aston-Jones G. Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking. Nat Neurosci. 2014;17:577–85.
Lex A, Hauber W. Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn Mem. 2008;15:483–91.
Schulz S, Schreff M, Koch T, Zimprich A, Gramsch C, Elde R, Höllt V. Immunolocalization of two mu-opioid receptor isoforms (MOR1 and MOR1B) in the rat central nervous system. Neuroscience. 1998;82:613–22.
Morgan JI, Curran T. Stimulus-transcription coupling in the nervous system: involvement of the inducible proto-oncogenes fos and jun. Annu Rev Neurosci. 1991;14:421–51.
Björklund A, Dunnett SB. Dopamine neuron systems in the brain: an update. Trends Neurosci. 2007;30:194–202.
Roth BL. DREADDs for neuroscientists. Neuron. 2016;89:683–94.
Bergado Acosta JR, Schneider M, Fendt M. Intra-accumbal blockade of endocannabinoid CB1 receptors impairs learning but not retention of conditioned relief. Neurobiol Learn Mem. 2017;144:48–52.
Grillon C. Models and mechanisms of anxiety: evidence from startle studies. Psychopharmacology (Berl). 2008;199:421–37.
Koch M. The neurobiology of startle. Prog Neurobiol. 1999;59:107–28.
Davis M, Astrachan DI. Conditioned fear and startle magnitude: effects of different footshock or backshock intensities used in training. J Exp Psychol: Anim Behav Proc. 1978;4:95–103.
Christianson JP, Benison AM, Jennings J, Sandsmark EK, Amat J, Kaufman RD, Baratta MV, Paul ED, Campeau S, Watkins LR, Barth DS, Maier SF. The sensory insular cortex mediates the stress-buffering effects of safety signals but not behavioral control. J Neurosci. 2008;28:13703–11.
Bruning JEA, Breitfeld T, Kahl E, Bergado-Acosta JR, Fendt M. Relief memory consolidation requires protein synthesis within the nucleus accumbens. Neuropharmacology. 2016;105:10–14.
Herdegen T, Leah JD. Inducible and constitutive transcription factors in the mammalian nervous system: control of gene expression by Jun, Fos and Krox, and CREB/ATF proteins. Brain Res Rev. 1998;28:370–490.
Roberts DCS, Koob GF. Disruption of cocaine self-administration following 6-hydroxydopamine lesions of the ventral tegmental area in rats. Pharmacol Biochem Behav. 1982;17:901–4.
Shibata R, Kameishi M, Kondoh T, Torii K. Bilateral dopaminergic lesions in the ventral tegmental area of rats influence sucrose intake, but not umami and amino acid intake. Physiol Behav. 2009;96:667–74.
Smith KS, Bucci DJ, Luikart BW, Mahler SV. DREADDs: use and application in behavioral neuroscience. Behav Neurosci. 2016;130:137–55.
Gomez JL, Bonaventura J, Lesniak W, Mathews WB, Sysa-Shah P, Rodriguez LA, Ellis RJ, Richie CT, Harvey BK, Dannals RF, Pomper MG, Bonci A, Michaelides M. Chemogenetics revealed: DREADD occupancy and activation via converted clozapine. Science. 2017;357:503.
Coward DM. General pharmacology of clozapine. Br J Pharmacol. 1992;17:5–11.
Melchior JR, Ferris MJ, Stuber GD, Riddle DR, Jones SR. Optogenetic versus electrical stimulation of dopamine terminals in the nucleus accumbens reveals local modulation of presynaptic release. J Neurochem. 2015;134:833–44.
Köhler C, Hall H, Ögren SO, Gawell L. Specific in vitro and in vivo binding of 3H-raclopride a potent substituted benzamide drug with high affinity for dopamine D-2 receptors in the rat brain. Biochem Pharmacol. 1985;34:2251–9.
Navratilova E, Porreca F. Reward and motivation in pain and pain relief. Nat Neurosci. 2014;17:1304–12.
White NM, Packard MG, Hiroi N. Place conditioning with dopamine D1 and D2 agonists injected peripherally or into nucleus accumbens. Psychopharmacol (Berl). 1991;103:271–6.
Pollak DD, Monje FJ, Zuckerman L, Denny CA, Drew MR, Kandel ER. An animal model of a behavioral intervention for depression. Neuron. 2008;60:149–61.
Rescorla RA. Pavlovian conditioned inhibition. Psychol Bull. 1969;72:77–94.
Fernando ABP, Urcelay GP, Mar AC, Dickinson A, Robbins TW. Comparison of the conditioned reinforcing properties of a safety signal and appetitive stimulus: effects of d-amphetamine and anxiolytics. Psychopharmacol (Berl). 2014;227:195–208.
Navratilova E, Xie JY, King T, Porreca F. Evaluation of reward from pain relief. Addict Rev. 2013;1282:1–11.
Jovanovic T, Norrholm SD, Blanding NQ, Davis M, Duncan E, Bradley B, Ressler KJ. Impaired fear inhibition is a biomarker of PTSD but not depression. Depress Anxiety. 2010;27:244–51.
Sailer U, Robinson S, Fischmeister FP, König D, Oppenauer C, Lueger-Schuster B, Moser E, Kryspin-Exner I, Bauer H. Altered reward processing in the nucleus accumbens and mesial prefrontal cortex of patients with posttraumatic stress disorder. Neuropsychologia. 2008;46:2836–44.
Harrison PJ, Weinberger DR. Schizophrenia genes, gene expression, and neuropathology: on the matter of their convergence. Mol Psychiatry. 2005;10:40–68.
Koob GF, Volkow ND. Neurocircuitry of addiction. Neuropsychopharmacology. 2010;35:217–38.
Franklin JC, Lee KM, Hanna EK, Prinstein MJ. Feeling worse to feel better: Pain-offset relief simultaneously stimulates positive affect and reduces negative affect. Psychol Sci. 2013;24:521–9.
Borsook D, Linnman C, Faria V, Strassman AM, Becerra L, Elman I. Reward deficiency and anti-reward in pain chronification. Neurosci Biobehav Rev. 2016;68:282–97.
The authors are grateful to Drs. Kerstin Wernecke and Jorge Bergado Acosta for various helps during the study, Dr. Michael Lippert for the gift of pAAV2-CaMKIIa-mCherry, Dr. Thomas Endres, Judith Kreutzmann, and Nadine Faesel for critical comments to the manuscript, Judith Kreutzmann for language editing, and Kathrin Freke for animal care.
This study was supported by the German Science Foundation (DFG; SFB779/B13).
Conflict of interest
The authors declare that they have no conflict of interest.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
About this article
Cite this article
Mayer, D., Kahl, E., Uzuneser, T.C. et al. Role of the mesolimbic dopamine system in relief learning. Neuropsychopharmacol 43, 1651–1659 (2018). https://doi.org/10.1038/s41386-018-0020-1
Chronic inhibition of GABA synthesis in the infralimbic cortex facilitates conditioned safety memory and reduces contextual fear
Translational Psychiatry (2020)
Infralimbic cortex activity is required for the expression but not the acquisition of conditioned safety
Sound check, stage design and screen plot – how to increase the comparability of fear conditioning and fear extinction experiments
Nature Communications (2018)