The dynamic modulation of instrumental behaviour by conditioned Pavlovian cues is an important process in decision-making. Patients with major depressive disorder (MDD) are known to exhibit mood-congruent biases in information processing, which may occur due to Pavlovian influences, but this hypothesis has never been tested directly in an unmedicated sample. To address this we tested unmedicated MDD patients and healthy volunteers on a computerized Pavlovian-Instrumental Transfer (PIT) task designed to separately examine instrumental approach and withdrawal actions in the context of Pavlovian appetitive and aversive cues. This design allowed us to directly measure the degree to which Pavlovian cues influence instrumental responding. Depressed patients were profoundly influenced by aversive Pavlovian stimuli, to a significantly greater degree than healthy volunteers. This was the case for instrumental behaviour both in the approach condition (in which aversive Pavlovian cues inhibited ‘go’ responses), and in the withdrawal condition (in which aversive Pavlovian cues facilitated ‘go’ responses). Exaggerated aversive PIT provides a potential cognitive mechanism for biased emotion processing in major depression. This finding also has wider significance for the understanding of disrupted motivational processing in neuropsychiatric disorders.
Human behaviour automatically adapts to suit rapidly-changing situational demands1. Cues predicting rewarding or aversive outcomes can facilitate adaptive behaviour; for example, water cues guide us to find and drink when thirsty2. A disruption in the mechanisms underlying adaptation to positively- or negatively-valenced environmental cues is thought to play a key role in many psychiatric symptoms3,4. As such, environmental cues do not always trigger adaptive behaviours: the same mechanism guiding us to seek water is thought to mediate the facility with which drug cues provoke drug-seeking in patients recovered from substance dependence5.
Even irrelevant environmental cues can profoundly alter goal-seeking behaviour. Pavlovian-instrumental transfer (PIT) is defined as the ability of passively-conditioned (Pavlovian) cues to automatically invigorate (and in some cases suppress) ongoing goal-directed instrumental behaviour. Importantly, Pavlovian stimuli exert influence over instrumental performance despite no formal association between Pavlovian and instrumental contingencies6.
PIT arises from the interaction between two associative learning processes. The first, a Pavlovian incentive learning system passively associates the sensory aspects of an event with its motivational outcomes7. Environmental cues accrue value (appetitive or aversive) through this passive Pavlovian process independent of any response made by the subject. These passively-conditioned cues can interact with the second associative learning process, an instrumental learning system. In contrast to the first system, the value of instrumental outcomes is contingent on the specific actions performed. For example, a rat might encode the association between a lever press and food access (instrumental) and separately learn passively that a flash of light predicts shock delivery, irrespective of any lever press (Pavlovian). Crucially, these processes are dissociable8. Even without any direct association between passively-learned Pavlovian associations and instrumental contingencies, Pavlovian cues can unconsciously invigorate or suppress concurrent instrumental responding, in both humans6 and animals7.
Animal studies have contributed a rich understanding of the neurobiology of Pavlovian influences on instrumental behaviour9,10,11. This work has largely examined PIT in the context of appetitive stimuli, linking it specifically to dopamine transmission: dopamine D1 and D2 receptors in the nucleus accumbens (NAcc) core and shell mediate the general activating effects of appetitive Pavlovian stimuli on instrumental behaviour12, while inactivation of the ventral tegmental area (VTA) decreases appetitive PIT13. Recent studies have employed comparable PIT paradigms in humans6,14,15,16, suggesting that the circuits driving this process are similar in humans and animals. These studies have also begun to explore in more detail the effects of aversive Pavlovian stimuli on instrumental behaviour, implicating the ventromedial prefrontal cortex and caudate in behavioural suppression14, as well as the serotonergic system, which may play a larger role in aversive than appetitive PIT15.
A disruption in the mechanisms that mediate PIT could drive various aspects of psychiatric symptomatology. Major depressive disorder (MDD) is characterised by mood-congruent biases in information processing: depressed patients have facilitated recall of negative over positive material17, and in a seminal study, were found to show an exaggerated influence of explicit negative feedback on performance18. The latter result is sometimes described as a ‘catastrophic response to perceived failure’18, and was later confirmed in work specifically designed to assess response to negative feedback19.
These findings support the broader theoretical proposal that depression involves maladaptive (hyper-sensitive) responses to negative stimuli, as well as an under-responsivity to positive material3. This exaggerated influence of negative stimuli likely warps patients’ expectations and interpretations of their environment, making important contributions to the cognitive processes that drive depressive symptomology20. A major unanswered question is precisely how negative biases might influence behaviour.
If behaviour in depression is disproportionately guided by negative processing, we might expect an enhancement of aversive PIT (representing a greater ability of aversive Pavlovian stimuli to automatically increase instrumental withdrawal behaviour), and a suppression of appetitive PIT (representing a lesser ability of appetitive Pavlovian stimuli to invigorate instrumental approach behaviour). If this is the case, this disrupted PIT could explain how passively-reinforced cues could encourage avoidance and discourage approach behaviour in depression.
A previous study found that Pavlovian stimuli did not exert action-specific effects on instrumental behaviours in depressed patients, but that greater action-specificity in patients was associated with recovery from depression16. However, this study did not exclude patients who were currently taking antidepressant medication, a critical issue as most antidepressants alter serotonergic processing, which could significantly affect PIT, particularly in the aversive domain15, due to serotonin’s role in affective processing21. While the authors ran an analysis covarying for medication status, the study was likely insufficiently powered for this analysis, and therefore could not address this issue.
The rationale for the study was to investigate PIT in depression without the potentially confounding effects of current medication. To do so, we recruited only unmedicated patients (minimum four weeks off-medication), an approach employed in a number of studies to investigate abnormalities in cognitive processing that are an effect of psychiatric illness itself (for example, abnormalities in decision making in bipolar depression have been found in medicated as well as unmedicated patients22) from those attributable to medication (for example, latent inhibition in schizophrenia has been reported to be disrupted only in individuals exposed to antipsychotics23).
To test this, we administered a computerized PIT paradigm to unmedicated currently depressed adults and a matched group of healthy volunteers. The PIT task we employed dissociated approach and withdrawal behaviour from behavioural activation and inhibition (i.e. go or no-go), which allowed us to examine whether Pavlovian stimuli influence the value of instrumental behaviour, or simply promote a go (or no-go) response24, and whether this interaction is altered in depression. Based on the above hypothesis, we predicted that unmedicated depressed patients would show an excessive influence of aversive Pavlovian cues, and a diminished influence of appetitive Pavlovian cues, although this was contrary to the previous study’s findings16.
Twenty-six patients with major depressive disorder (MDD) and 28 healthy volunteers group-matched for age, gender, and intelligence quotient (IQ: assessed by the Wechsler Test of Adult Reading25) were recruited to take part in the study (demographic and clinical data are displayed in Table 1). Patients were recruited via referral from the Camden and Islington NHS Foundation Trust, or following completion of an advertised online screening questionnaire. Healthy volunteers were recruited via the University College London Psychology department online subject pool. All participants were screened for current or previous neuropsychiatric disorder using the Mini International Neuropsychiatric Interview (MINI, version 5.0.026), and depressive symptoms were assessed with the Hamilton Depression Rating Scale (HAM-D)27. No participants were taking psychiatric medication at the time of the study, or had taken any recreational drugs in the six weeks leading up to the study. Current antidepressant medication use was assessed through participant report.
Exclusion criteria for healthy controls were any past or present psychiatric or neurological disorder. All patients met criteria for MDD on the MINI and were currently in a depressive episode. Exclusion criteria for patients were: recent psychotropic medication use (within four weeks of participation, or eight for fluoxetine); history of manic or hypomanic episodes; history of psychosis; or history of substance abuse/dependence (unless confined to a depressive episode). Anxiety disorders did not constitute an exclusion criterion for MDD participants; 62% of the patient sample additionally met criteria for an anxiety disorder at the time of the study.
The study was approved by the London Queen Square NHS Ethics Committee, and all methods were performed in accordance with their relevant guidelines and regulations. All participants gave written informed consent for the study and were informed that their payment was performance-dependent (though all were compensated the same amount (£10) upon completion of the experiment).
Participants were administered a computerized PIT task written using Psychtoolbox in Matlab (http://psychtoolbox.org)24. The task comprised three stages: 1) Participants learned the instrumental contingencies of various actions; 2) They passively observed Pavlovian stimuli paired with different outcomes; 3) They performed the instrumental task again, but with Pavlovian stimuli presented in the background (see Fig. 1).
Participants first performed an instrumental training task (see Fig. 1A), with the aim of maximizing their earnings. There were two conditions in this task. In the approach condition, participants were instructed to actively ‘collect’ stimuli (coloured mushrooms) associated with monetary wins by clicking the mouse, while not making any response in order to avoid those associated with losses. In the withdrawal condition, participants were instructed to actively ‘discard’ stimuli associated with losses by clicking the mouse, while not making any response in order to collect those associated with gains. The approach and withdrawal conditions were completed in different blocks, each comprising 120 trials.
This instrumental task required participants to learn the probabilistic values of six different cartoon mushrooms, half of which resulted in a monetary gain 80% of the time, and a loss 20% of the time; the other half resulted in a monetary loss 80% of the time, and a gain 20% of the time. After each choice, feedback of +£0.20 or −£0.20 was displayed on the screen either immediately after a ‘go’ action (mouse click) or 1.5 seconds after the stimulus was displayed if no response (‘no-go’) was made. The order of approach/withdrawal blocks was counterbalanced across participants, as were the associations between the mushroom stimuli and outcomes.
Participants next passively observed as one of five different fractal images were displayed on the screen in a random order, each paired with a uniquely pitched tone (Fig. 1B). One second after stimulus presentation, each image was followed by one of five outcomes: a large win ( £1), a small win (+£0.1), no win (£0), a small loss (−£0.1), or a large loss (−£1). Every fifth trial, the participants were required to choose the better of two of the fractal images. These Pavlovian choice trials served as a measure of the passive Pavlovian conditioning. Each outcome amount (£1, £0.1, £0, £-0.1, and −£1, corresponds to a Pavlovian stimulus valence (large win, small win, neutral, small loss, and large loss, respectively). This stage comprised 90 trials.
Finally, in the PIT stage, participants were again instructed to perform the instrumental mushroom gathering task (Fig. 1C). However, in this stage the instrumental stimuli were superimposed on a background of one of the Pavlovian fractal images, and performed in extinction (i.e. without any reinforcing outcomes for either Pavlovian or instrumental stimuli). There were 200 trials in each of the approach and withdrawal blocks in this stage, each lasting until the subject performed a ‘go’ action, or after 1.5 seconds if no response was made (with no inter-trial interval). Each trial randomly sampled a Pavlovian image and instrumental mushroom stimulus to randomize cue combinations across participants and control for any stimulus-specific effects.
We measured performance in Stage 1 (initial instrumental stage: percent correct go and no-go responses, in the approach and withdrawal conditions separately), Stage 2 (Pavlovian training stage: percent correct choices), and in Stage 3 (PIT stage: probability of making a go response for each Pavlovian background, in the approach and withdrawal conditions separately).
The following image used in Fig. 1A,C is reproduced under the terms of a Creative Commons CCO 1.0 Universal license (https://creativecommons.org/publicdomain/zero/1.0/deed.en) and has been adapted from its original form. The link to the original image is: (https://pixabay.com/en/mushroom-fly-agaric-green-fairytale-311045/). The following image used in Fig. 1A,C is reproduced under the terms of a Creative Commons 2.5 Generic license (https://creativecommons.org/licenses/by/2.5/deed.en) and has been adapted from its original form (Original Author: Lordalpha1; title: A vector hand cursor and cursor). The link to the original image is: https://commons.wikimedia.org/wiki/File:Mouse-cursor-hand-pointer.svg. The following image used in Fig. 1B,C was reproduced under the terms of a Creative Commons Attribution-ShareAlike 3.0 Unported License (https://creativecommons.org/licenses/by-sa/3.0/deed.en) and has been adapted from its original form (Original Author: Kh627; title: Mandelbrot fractal). The link to the original image is: https://commons.wikimedia.org/wiki/File:Mandelbrot_fractal_rendered_in_Paint.NET.jpg. The musical note (Fig. 1B) is a Unicode Character, ‘Eighth Note’ (U + 266 A) (The Unicode Standard, Version 1.1.0, (Mountain View, CA: The Unicode Consortium, 1993).
Analysis was conducted in IBM SPSS Statistics for Windows, Version 22.0 (Armonk, NY: IBM Corp). The distributions of all measures of interest were checked prior to analysis and none deviated substantially from Gaussian assumptions. We first analysed the effects of instrumental condition (approach/withdrawal) and action (go/no-go) on accuracy in the instrumental learning stage (Stage 1), using a repeated-measures analysis of variance (ANOVA), including group as a between-subjects factor. We then tested whether accuracy on the Pavlovian choice trials (in Stage 2) differed between groups with an independent samples t-test. To check that participants retained the associations from Stage 1 in Stage 3, we repeated the same repeated measures ANOVA as for Stage 1. Finally, to test our key hypothesis and specifically examine the PIT effect in Stage 3, we conducted a repeated-measures ANOVA on the probability of making a ‘go’ response, with instrumental condition (approach/withdrawal) and Pavlovian stimulus valence (large win/small win/neutral/small loss/large loss) as within-subjects factors, again including group as a between-subjects factor. Pearson’s r correlations were used to assess the relationship between depressive symptoms (HAM-D scores) and summary measures describing the aversive and appetitive PIT effect in each participant. In all analyses, we considered p < 0.05 as significant.
We computed that 52 subjects (26 per group) were needed to observe a large effect size of d = 0.8 with 80% power (statistical test: difference between two independent means (two groups) calculated using G*Power 220.127.116.11)). At the time the study was planned, no previous study had reported a difference between any patient group and controls on PIT. We considered an effect size of 0.8 to be scientifically meaningful.
There were no differences between patients and controls on demographic characteristics, but patients differed significantly from controls on depression and anhedonia scales (HAM-D, BDI, and SHAPS) (see Table 1).
Stage 1: Initial instrumental training
Participants demonstrated clear acquisition of the instrumental associations in the instrumental stage (Fig. 2A, Stage 1 - dark bars). Participants performed significantly better in approach than withdrawal blocks (main effect of condition: F(1,52) = 5.720, p = 0.020), with no main effect of action (F(1,52) = 2.849, p = 0.097) and no condition-by-action interaction (F(1,52) = 1.105, p = 0.318). There was no evidence that the groups differed in their acquisition of the contingencies in the initial instrumental training stage: all interactions with group were non-significant (group-by-condition: F(1,52) = 0.264, p = 0.609; group-by-action: F(1,52) = 3.142, p = 0.082; group-by-condition-by-action: F(1,52) = 1.805, p = 0.185), and there was no main effect of group (F(1,52) = 2.340, p = 0.132).
Stage 2: Pavlovian conditioning
Both groups performed accurately on the Pavlovian choice trials in Stage 2, demonstrating successful encoding of the Pavlovian associations. One patient and one healthy volunteer did not perform substantially above chance accuracy (56%) in this stage, and were therefore excluded from the analyses of Stages 2&3. This left N = 25 patients (mean accuracy = 86%, SD = 11%) and N = 27 healthy volunteers (mean accuracy = 90%, SD = 9%). There was no significant difference in accuracy between the groups (t(50) = 1.258, p = 0.214; Fig. 2B).
Stage 3: PIT
Both groups of participants maintained good instrumental task performance during PIT (Fig. 2A, Stage 3 - light bars). There was no main effect of approach/withdrawal condition on accuracy (F(1,50) = 1.611, p = 0.210). This is in contrast to Stage 1 - participants no longer performed worse in the withdrawal than the approach condition, due to improved performance in the withdrawal condition. We also did not observe a main effect of action (F(1,50) = 1.137, p = 0.291) or a condition-by-action interaction (F(1,50) = 0.309, p = 0.581). All interactions with group were non-significant (group-by-condition: F(1,52) = 0.167, p = 0.685; group-by-action: F(1,52) = 1.482, p = 0.229; group-by-condition-by-action: F(1,52) = 0.849, p = 0.361). Again, there was no main effect of group (F(1,52) = 1.353, p = 0.250).
As in previous studies24, the PIT effect was examined using the tendency to make a ‘go’ response, regardless of whether this response was appropriate or not. Note that perfect accuracy on the task would yield approximately 50% ‘go’ responses in both approach and withdrawal conditions, equal across all Pavlovian valences. In other words, any deviation in the probability of making a go response from 0.5 (horizontal dotted line in Fig. 3) represents a bias in responding on the task.
We found no significant main effect of approach or withdrawal condition (F(4,200) = 0.658, p = 0.421), but there was a significant main effect of Pavlovian stimulus valence (F(4,200) = 3.427, p = 0.01): overall, positive Pavlovian stimuli induced greater rates of ‘go’ responding. There was no valence-by-group interaction (F(4,200) = 0.289, p = 0.885), and the main effect of group was non-significant (F(1,52) = 0.694, p = 0.409).
We note that there was also a condition-by-Pavlovian valence interaction (F(4,200) = 5.278, p < 0.001, η2 = 0.095): overall, Pavlovian stimuli associated with rewards elicited more ‘go’ responses in the approach condition than those associated with losses (Fig. 3A), while the opposite pattern occurred in the withdrawal condition (Fig. 3B) (i.e., a PIT effect). Although this two-way interaction was significant, it is qualified by the three-way interaction below, therefore we do not analyse it further.
The PIT effect was qualified by a significant three-way interaction between group, Pavlovian valence and instrumental condition (F(4,200) = 4.511, p = 0.002, η2 = 0.083). This three-way interaction indicates that the PIT effect was exaggerated in the MDD group (Fig. 3A,B). Linear contrasts showed that this interaction was specifically driven by differences in responses to negative, but not positive, Pavlovian stimuli. In the approach condition, relative to healthy volunteers, MDD patients performed significantly fewer ‘go’ (‘click to collect’) responses in the context of Pavlovian stimuli associated with both small (t(1,50) = 2.071, p = 0.043) and large (t(1,50) = 2.025, p = 0.049) losses (Fig. 3A). By contrast, in the withdrawal condition, relative to healthy volunteers, MDD patients performed significantly more ‘go’ (‘click to discard’) responses in the context of Pavlovian stimuli associated with both small (t(1,50) = 2.177, p = 0.034) and large (t(1,50) = 2.553, p = 0.014) losses (Fig. 3B). In other words, in MDD patients negative Pavlovian stimuli enhanced responding in the withdrawal condition, but impaired responding in the approach condition. No significant group differences were detected in the context of Pavlovian stimuli associated with large gains, small gains or neutral outcomes, either in the approach or withdrawal conditions. There was no effect of anxiety or previous medication use on the group PIT effect (see Supplemental Information for full analysis of covariates).
To enable direct comparison of our results with previous work (Huys et al.16), we also fit participants’ responses (P(‘GO’)) to a line, calculating the change in their responses over the five Pavlovian stimuli (i.e., the slope of the PIT effect). This allowed us to examine action specificity: the difference between linear regression coefficients in approach and withdrawal blocks. As all action specificity measures showed a significant departure from Gaussian assumptions (p < 0.05, Kolmogorov-Smirnoff test), we employed non-parametric tests (Wilcoxon signed rank and Mann-Whitney U-tests for within- and between-subject comparisons, respectively). We found that in our sample, PIT was action specific in MDD patients (p = 0.035, signed rank) but not controls (p = 0.876, signed rank). The difference in action specificity between the groups narrowly missed significance (p = 0.056), but there were no differences in the approach and withdrawal blocks separately (withdrawal: p = 0.179, approach: p = 0.369). (See Supplemental Information for a direct comparison of our samples of controls and depressed patients with those of Huys et al.).
Correlations with depressive symptoms
To investigate the impact of depressive symptoms on aversive PIT, we calculated a summary measure describing the aversive PIT effect: the difference between the effect of negative Pavlovian stimuli (relative to neutral stimuli) in the approach block and the effect of negative Pavlovian stimuli (relative to neutral stimuli) in the withdrawal block. We also calculated a summary measure describing the appetitive PIT effect: the difference between the effect of positive Pavlovian stimuli (relative to neutral stimuli) in the approach block and the effect of positive Pavlovian stimuli (relative to neutral stimuli) in the withdrawal block. Note that since the expected PIT effect is reversed from the approach to the withdrawal condition, this summary measure can yield bigger absolute values than for a single condition (e.g., for the aversive PIT in MDD, (PITapproach = −0.15)−(PITwithdrawal = +0.15) = −0.30).
We then conducted correlational analyses between these measures and depression scores. This measure of aversive PIT correlated positively with depressive symptoms overall (both HAM-D and BDI), across both groups (which recapitulates the group effect reported above: HAM-D: r = −0.312, p = 0.024; BDI: r = −0.312, p = 0.022), but there was no significant correlation between appetitive PIT and depressive symptoms (HAM-D: r = 0.141, p = 0.308; BDI: r = 0.173, p = 0.210). The group effect was also recapitulated in correlations between aversive PIT and anhedonia scores (SHAPS: r = −0.378, p = 0.005); again, there was no correlation between appetitive PIT and anhedonia (r = 0.135, p = 0.335). However, depression did not correlate with either measure in the healthy volunteer or the MDD group separately (according to the HAMD, aversive PIT: healthy volunteers r = −0.277, p = 0.162, MDD patients r = 0.136, p = 0.515; appetitive PIT: healthy volunteers: r = 0.228, p = 0.254, MDD patients r = −0.027, p = 0.515); this was also the case for depression as measured by the BDI, and anhedonia (all p > 0.1).
We investigated how negative biases in depression might drive depressive behaviours using a PIT paradigm, which measures the degree to which previously-conditioned cues encourage or inhibit instrumental actions. We hypothesized that depressed patients would show a greater influence of loss-associated Pavlovian cues but a reduced impact of gain-associated cues on both approach and withdrawal behaviour. We found strong support for one aspect of our hypothesis: depression was associated with a greater influence of aversive Pavlovian cues on behaviour, compared to healthy controls. That is, in patients, cues associated with loss decreased the number of approach actions, but increased the number of withdrawal actions. This finding was not driven by any differences in performance on either Pavlovian or instrumental task learning, and was specific to the loss domain. We did not support the second aspect of our hypothesis: we found no strong suggestion of diminished appetitive PIT in depression.
Our findings add to the rich evidence for enhanced processing of negative information in depression, including memories for unpleasant events30 and the effect of negative feedback on behaviour18,19. Our PIT data extend this prior work, presenting a potential mechanism that could explain the influence of previous negative events on behaviour in depression: namely, that environments and stimuli associated with adverse events could exert an exaggerated and maladaptive influence on depressed patients’ behaviour. This provides a link between aberrant reward and punishment processing observed experimentally and symptoms commonly reported in depression. Previous adverse outcomes might cause a patient to excessively avoid any similar situations, leading to motivational deficits and social withdrawal.
Interestingly, the effect cannot be explained by simple action inhibition in the context of negatively-associated cues, since action was both invigorated (in the withdrawal blocks) and suppressed (in the approach blocks) by the same negative cues. The influence of cues on behaviour through PIT provides a plausible mechanism for the transfer of implicit biases in depression onto thoughts and behaviours.
In general, an exaggerated influence of past negative experiences or outcomes on current behaviour in depression could encourage both active and passive avoidance symptoms in depression (such as social withdrawal or anhedonia, a loss of pleasure derived from normally-pleasurable activities). Recent research has identified a key role for subcortical structures such as the habenula in aversive Pavlovian conditioning and passive avoidance behaviours in healthy volunteers31. Additionally, habenula function has been shown to be disrupted in MDD32,33, and smaller habenula volumes are associated with anhedonia. Therefore, future studies combining PIT and functional neuroimaging of the habenula in MDD may provide new insights in the cognitive and neural mechanisms underlying the motivational symptoms of the disorder.
Pavlovian cues may also influence cognition in depression by promoting negative ideation. However, these behavioural and cognitive patterns may not be specific to depression. Instead, it is likely that an exaggerated influence of negative Pavlovian processing contributes to depressive cognition and behaviour across several different psychiatric disorders, potentially driving similar withdrawal in social anxiety disorder, or excessive avoidance of panic-related environments, in the case of panic disorder. It would be informative to investigate PIT in these different contexts in future studies.
Pharmacology of the PIT effect
The action- and valence-specificity of our results may be underpinned by interactions between dopaminergic and serotonergic systems. Studies in animals have primarily implicated the dopamine system in PIT: phasic dopamine spikes are temporally coupled to Pavlovian cue onset, and predict instrumental lever-pressing in rats34, while inactivation of the ventral tegmental area, a dopamine-rich region, diminished appetitive PIT13. However, the majority of the animal PIT literature has focused on reward-predictive Pavlovian cues in the context of appetitive PIT.
By contrast, many studies support the involvement of the serotonin system in aversive processing21, though rarely has this been explored with PIT. In one study, depletion of tryptophan (a precursor of serotonin) dampened both Pavlovian and instrumental aversive behaviours35, suggesting that the influence of aversive Pavlovian cues on behaviour may be driven by serotonin neurotransmission. In contrast, there is also evidence that tryptophan depletion enhances the motivational influence of aversive stimuli on instrumental behaviour without affecting appetitive cues (while depletion of dopamine precursor tyrosine reduces appetitive PIT)36. Although both studies suggest the involvement of serotonin in aversive processing, their conflicting results underline the need to clarify the role of serotonin in PIT. Indeed, the interaction between the effect of depression on PIT and the separate effects of monoamine pharmacology on PIT may explain the discrepancy between our report and the only other investigation of PIT in sample of patients with depression, which included medicated patients16.
To better compare our results, we also conducted analyses of action specificity (using the calculation described in Huys et al.16). We found here that PIT was action specific in depressed patients but not controls (and the difference between the groups narrowly missed significance); in contrast, Huys et al.16 found PIT was action specific in controls but not depressed patients. In both studies, there was a marginal group difference in action-specificity (though in opposite directions in the two studies). Interestingly, Huys et al.16 also found action specificity in currently-depressed patients who recovered 4–6 months later, which was driven by effects in the withdrawal condition. It is possible that our patient sample more closely resembled the subsample of patients in the previous study who showed action-specificity. This may reflect heterogeneity in the cognitive profile of depressed patients. Moreover, as PIT was not action-specific in our sample of healthy controls, it may also imply that PIT effects are variable across healthy populations. The source of this variability is unclear and would be better addressed by experiments in larger samples, which could examine whether action specificity is associated with demographic or other cognitive measures.
This precise version of the task has been used in two previous studies16,24, which included an overlapping sample of healthy controls. The strong action-specificity reported in the control group in those studies was not apparent here, and this seems related both to a lesser PIT effect during approach, and possibly a reversal of the effect direction during withdrawal. Overall, the literature suggests relatively stable PIT effects on approach behaviour37,38,39, but somewhat weaker and more variable effects on withdrawal14,15. This general pattern is consistent across the studies, though the precise reasons for this have as yet to be elucidated. In addition, though differences in the effect of Pavlovian stimuli on approach and withdrawal behaviour have a strong conceptual basis, PIT paradigms examine modulations of ongoing behaviour by acquired Pavlovian expectations, and as such tend to yield relatively small effects. Interactions, such as the action-specificity, between different PIT effects are by nature even smaller, and should hence be interpreted cautiously.
Of note, there were also differences in patient samples between the studies: first, the previous study sample excluded patients with comorbid anxiety; second, our sample excluded patients taking psychotropic medication. With respect to the two differences between our studies, including anxiety diagnosis as a covariate in our model did not produce a significant interaction with any main or interaction effects (see Supplemental Information), nor did including patients with anxiety in the previous study weaken their reported group effect16. Therefore, it is more likely that medication status played a larger role in the differences between the two studies.
While some tryptophan depletion findings might indicate enhanced aversive PIT in depression36, where disruptions to serotonin transmission have long been implicated40, others would predict the exact opposite: an attenuated aversive PIT15. Of course, serotonin deficits are not thought to fully explain depressive symptoms41. Nonetheless, the intriguing possibility remains that while animal literature has strongly linked phasic dopamine release to appetitive PIT34, the serotonin system may be implicated in aversive PIT, linking disorders of serotonin dysfunction to aberrant aversive PIT, and modulation of this aversive PIT effect as a possible result of serotonergic medication.
Some limitations of this study merit comment. First, we must be cautious interpreting these results as specific to MDD. Fifteen patients (58% of our MDD sample) met criteria for generalized anxiety disorder (GAD), which could have augmented the difference in aversive PIT effect between groups. However, the two disorders are closely related, with some arguing that GAD ought not be viewed as independent from MDD42. Additionally, while our sample size was sufficient to detect a main effect of large size (d = 0.843), it was insufficiently powered to detect smaller effects. Most importantly, for the within-group correlation analyses (N = 27 and 25 for healthy controls and MDD, respectively), we had only 71% power to detect a medium effect size of r = 0.45 – this makes the lack of significant correlations with symptoms difficult to interpret. Similarly, our study was designed to detect a main effect of group, but not the effects of possible covariates, for example the contribution of demographic variables to the PIT effect, such as socioeconomic status, which is known to alter cognitive processing44. Our results need to be confirmed in future, larger studies, ideally with enough subjects to examine effects of mood and anxiety separately and adequate power to examine possible moderators of the effect. This would allow us to account for clinical differences, but also to detect smaller effects, and to test for correlations between behaviour and symptoms with greater confidence.
Conclusions and Future Directions
We identified an exaggerated influence of aversive Pavlovian stimuli on instrumental choice, dampening instrumental approach but enhancing instrumental withdrawal behaviour. This finding is consistent with the broader literature indicating exaggerated negative information processing in depression, and offers a plausible explanation for the automatic impact of negative biases on decision-making in depression. However, its relationship to previous PIT findings is less clear, with inconsistent observations across dietary tryptophan depletion studies15,36, and a medicated depressed sample16. In future it would be interesting to characterize the nature of disrupted PIT in depression more comprehensively, investigating whether at-risk and remitted samples show intact or abnormal PIT, and to illuminate the effects of pharmacological and psychological therapies on PIT.
The datasets generated during and/or analysed during the current study are available in the Open Science Framework repository, osf.io/3p8gr. The dataset associated with this study is available from the corresponding author on reasonable request and in accordance with local ethics rules.
Holmes, N. M., Marchand, A. R. & Coutureau, E. Pavlovian to instrumental transfer: A neurobehavioural perspective. Neurosci. Biobehav. Rev. 34, 1277–1295 (2010).
Perks, S. M. & Clifton, P. G. Reinforcer revaluation and conditioned place preference. Physiol. Behav. 61, 1–5 (1997).
Eshel, N. & Roiser, J. P. Reward and Punishment Processing in Depression. Biol. Psychiatry 68, 118–124 (2010).
Robinson, O. J., Charney, D. R., Overstreet, C., Vytal, K. & Grillon, C. The adaptive threat bias in anxiety: amygdala–dorsomedial prefrontal cortex coupling and aversive amplification. Neuroimage 60, 523–529 (2012).
O’Brien, C. P., Childress, A. R., Ehrman, R. & Robbins, S. J. Conditioning factors in drug abuse: can they explain compulsion? J. Psychopharmacol. (Oxf.) 12, 15–22 (1998).
Talmi, D., Seymour, B., Dayan, P. & Dolan, R. J. Human Pavlovian–Instrumental Transfer. J. Neurosci. 28, 360–368 (2008).
Dickinson, A. & Balleine, B. The role of learning in the operation of motivational systems. Stevens Handb. Exp. Psychol. (2002).
Wassum, K. M., Ostlund, S. B., Balleine, B. W. & Maidment, N. T. Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn. Mem. 18, 475–483 (2011).
Corbit, L. H. & Balleine, B. W. The General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer Are Differentially Mediated by the Nucleus Accumbens Core and Shell. J. Neurosci. 31, 11786–11794 (2011).
Estes, W. K. Discriminative conditiong. II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. J. Exp. Psychol. 38, 173–177 (1948).
Rescorla, R. A. & Solomon, R. L. Two-process learning theory: Relationships between Pavlovian conditiong and instrumental learning. Psychol Rev 74, 151–82 (1967).
Lex, A. & Hauber, W. Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn. Mem. 15, 483–491 (2008).
Murschall, A. & Hauber, W. Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance. Learn. Mem. 13, 123–126 (2006).
Geurts, D. E., Huys, Q. J., Den Ouden, H. E. & Cools, R. Aversive Pavlovian control of instrumental behavior in humans. J. Cogn. Neurosci. 25, 1428–1441 (2013).
Geurts, D. E., Huys, Q. J., den Ouden, H. E. & Cools, R. Serotonin and aversive pavlovian control of instrumental behavior in humans. J. Neurosci. 33, 18932–18939 (2013).
Huys, Q. et al. The specificity of Pavlovian regulation is associated with recovery from depression. Psychol. Med. 1 (2016).
Lewis, G. et al. Variation in the recall of socially rewarding information and depressive symptom severity: a prospective cohort study. Acta Psychiatr. Scand. 135, 489–498 (2017).
Elliott, R., Sahakian, B. J., Herrod, J. J., Robbins, T. W. & Paykel, E. S. Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis specific impairment. J. Neurol. Neurosurg. Psychiatry 63, 74–82 (1997).
Tavares, J. V. T. et al. Neural basis of abnormal response to negative feedback in unmedicated mood disorders. Neuroimage 42, 1118–1126 (2008).
Roiser, J. P., Elliott, R. & Sahakian, B. J. Cognitive mechanisms of treatment in depression. Neuropsychopharmacology 37, 117–136 (2012).
Dayan, P. & Huys, Q. J. Serotonin, inhibition, and negative mood. PLoS Comput Biol 4, e4 (2008).
Roiser, J. P. et al. Hot and cold cognition in unmedicated depressed subjects with bipolar disorder. Bipolar Disord. 11, 178–189 (2009).
Williams, J. H. et al. Reduced latent inhibition in people with schizophrenia: an effect of psychosis or of its treatment. Br. J. Psychiatry 172, 243–249 (1998).
Huys, Q. J. et al. Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput Biol 7, (2011).
Wechsler, D. Wechsler Test of Adult Reading: WTAR. (Psychological Corporation, 2001).
Sheehan, D. et al. The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability. Eur. Psychiatry 12, 232–241 (1997).
Hamilton, M. A rating scale for depression. J. Neurol. Neurosurg. Psychiatry 23, 56 (1960).
Beck, A. T., Steer, R. A. & Brown, G. K. Beck depression inventory-II. San Antonio TX 78204–2498 (1996).
Snaith, R. P. et al. A scale for the assessment of hedonic tone the Snaith-Hamilton Pleasure Scale. Br. J. Psychiatry 167, 99–103 (1995).
Watkins, P. C., Vache, K., Verney, S. P. & Mathews, A. Unconscious mood-congruent memory bias in depression. J. Abnorm. Psychol. 105, 34 (1996).
Lawson, R. P. et al. The habenula encodes negative motivational value associated with primary punishment in humans. Proc. Natl. Acad. Sci. 111, 11858–11863 (2014).
Lawson, R. P. et al. Disrupted habenula function in major depression. Mol Psychiatry (2016).
Liu, W., Valton, V., Wang, L., Zhu, Y. & Roiser, J. P. Association between habenula dysfunction and motivational symptoms in unmedicated major depressive disorder. Soc. Cogn. Affect. Neurosci. (2017).
Wassum, K. M., Ostlund, S. B., Loewinger, G. C. & Maidment, N. T. Phasic mesolimbic dopamine release tracks reward seeking during expression of pavlovian-to-instrumental transfer. Biol. Psychiatry 73, 747–755 (2013).
Crockett, M. J., Clark, L., Apergis-Schoute, A. M., Morein-Zamir, S. & Robbins, T. W. Serotonin modulates the effects of Pavlovian aversive predictions on response vigor. Neuropsychopharmacology 37, 2244–2252 (2012).
Hebart, M. N. & Gläscher, J. Serotonin and dopamine differentially affect appetitive and aversive general Pavlovian-to-instrumental transfer. Psychopharmacology (Berl.) 232, 437–451 (2015).
Garbusow, M. et al. Pavlovian-to-instrumental transfer in alcohol dependence: a pilot study. Neuropsychobiology 70, 111–121 (2014).
Garbusow, M. et al. Pavlovian‐to‐instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence. Addict. Biol. 21, 719–731 (2016).
Sommer, C. et al. Strong seduction: impulsivity and the impact of contextual cues on instrumental behavior in alcohol dependence. Transl. Psychiatry 7, e1183 (2017).
Risch, N. et al. Interaction between the serotonin transporter gene (5-HTTLPR), stressful life events, and risk of depression: a meta-analysis. Jama 301, 2462–2471 (2009).
Delgado, P. & Moreno, F. Role of norepinephrine in depression. J. Clin. Psychiatry 61, 5–12 (1999).
Moffitt, T. E. et al. Depression and generalized anxiety disorder: cumulative and sequential comorbidity in a birth cohort followed prospectively to age 32 years. Arch. Gen. Psychiatry 64, 651–660 (2007).
Cohen, J. Statistical power analysis for the behavioral sciences. Vol. 2. Lawrence Earlbaum Assoc. Hillsdale NJ (1988).
Hackman, D. A., Farah, M. J. & Meaney, M. J. Socioeconomic status and the brain: mechanistic insights from human and animal research. Nat. Rev. Neurosci. 11, 651–659 (2010).
This work was supported by a Medical Research Council project grant (G0901275) and supported by the National Institute for Health Research University College London Hospitals Biomedical Research Centre. We thank all the participants who gave up their time to take part in this research.
J.P.R. consults for Cambridge Cognition and Takeda Ltd. No other authors declare any competing interests.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
About this article
Cite this article
Nord, C.L., Lawson, R.P., Huys, Q.J.M. et al. Depression is associated with enhanced aversive Pavlovian control over instrumental behaviour. Sci Rep 8, 12582 (2018). https://doi.org/10.1038/s41598-018-30828-5
Science of The Total Environment (2020)
Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms
Cue‐induced effects on decision‐making distinguish subjects with gambling disorder from healthy controls
Addiction Biology (2019)