INTRODUCTION

Reward valuation is thought to have a central role at all stages of the addiction process: from initiation to compulsive use, abstinence and subsequent relapse, across species and substance classes (Hyman et al, 2006; Roesch et al, 2007; Diekhof et al, 2008). Drug addiction can be conceptualized as a maladaptive pattern of choices characterized by excessively high valuation of a reinforcer, combined with limited sensitivity to an increased cost in obtaining it (Bickel et al, 2011). Three types of cost are usually considered when analyzing choice behavior in animals: cost of time, physical or cognitive effort, and risk. Suboptimal choices on delay- (Bickel and Marsch, 2001; Mackillop et al, 2011) and risk-based (Kreek et al, 2005; Adlaf and Smart, 1983) decision-making tasks associated with drug exposure have been frequently reported.

Effort discounting has, by comparison, received less attention in animal drug addiction research. We previously reported work aversion in an effortful T-maze task following a binge dose of methamphetamine (Kosheleff et al, 2011), but found no such changes in reward choices made in the face of increasing effort after subchronic escalating methamphetamine treatment (unpublished observation). Limitations of the T-maze task include its two available options, with an effort requirement, in the form of increasing barrier height, varying incrementally as a function of time, and reward magnitudes held constant. However, individual preferences and choice behavior are affected by the number of options available and the manner in which alternatives are presented (the ‘framing effect’; Horowitz et al, 2007; Reutskaja and Hogarth, 2009; De Martino et al, 2006). To control for differences in processing cost changes, learning, and framing effects, we developed a novel effortful maze task with three possible courses of action, each associated with different effort requirements and reward magnitudes. For the present experiment, we chose a dosing regimen that produced an impairment on reversal learning even in the absence of appreciable changes in dopamine and serotonin transporter binding (Kosheleff et al, 2012).

Central immune signaling has been proposed as a mechanism of interest contributing to behavioral alterations following drug exposure (Clark et al, 2013; Sekine et al, 2008; Cadet and Bisagno, 2014; Coller and Hutchinson, 2012; Hutchinson and Watkins, 2014). Glial function has been linked to the development of rewarding properties of the drug and may have a role in the genetic predisposition to addiction (Beitner-Johnson et al, 1993; Narita et al, 2006). Peripheral inflammation has also been shown to affect effort-based decision making (Vichaya et al, 2014; Larson et al, 2002). However, little is known about neuroinflammation after repeated methamphetamine, and its effect on reward valuation in instrumental behavior. Thus, in the present investigation, we examined region-specific changes in pro- and anti-inflammatory markers in the mesocorticolimbic pathway (frontal cortex, amygdala, and striatum) after methamphetamine, and studied their relationship to animals’ reward choices.

MATERIALS AND METHODS

General

Subjects were 12 (saline=6, methamphetamine=6) adult male Long Evans rats (Charles River Laboratories), individually housed. Vivaria were maintained at 22 °C under a 12/12-h light/dark cycle with lights on from 0600 to 1800 hours. All behavioral testing took place 5–6 days per week between 0800 and 1600 hours during the rats’ inactive period, consistent with previous and ongoing studies in our lab. Rats were left undisturbed for 3 days after arrival to our facility to acclimate to the vivarium. Each rat was then handled for a minimum of 10 min once per day for 5 days. All rats were food restricted to no less than 85% of their free-feeding body weight to ensure motivation to work for food for a week prior and during the behavioral testing, whereas water was available ad libitum. On the last 2 days of food restriction prior to behavioral training, rats were fed twenty ½ froot loops in their home cage to accustom them to food rewards. Weights were monitored daily to ensure a healthy body weight. Research protocols were approved by the Chancellor’s Animal Research Committee at the University of California, Los Angeles.

Drug Treatment

Rats were given injections of methamphetamine (n=6, Sigma, St. Louis, MO; free base/kg, s.c.) starting at 0.3 mg/kg and escalating in 0.3-mg/kg increments per day, culminating in 6 mg/kg, or physiological saline solution (n=6, 1 ml/kg, s.c.) 5 days per week for 4 weeks at 1100 hours. This 4-week treatment regimen was chosen for its similarity to other escalating methamphetamine and amphetamine protocols (Featherstone et al, 2008; Fletcher et al, 2007). Food intake was measured every week on withdrawal days. Behavioral testing began 5–7 days after the last injection.

Behavioral Testing

Testing apparatus

In the present experiment, we employed a novel task that utilized a maze with three possible courses of action, each associated with different effort requirements and reward magnitudes. Behavioral training and testing were conducted in a standard eight-arm radial maze with arms extending from a central arena with a diameter of 25 cm. Arms were 50 cm long and 12 cm wide. The positions of extramaze cues remained constant throughout all phases of the experiment. The four arms nearest to the start arm were permanently blocked, leaving a start arm and three choice arms accessible to animals (Figure 1). One arm of the maze was randomly designated as a low-effort/reward (LER) arm, another as a medium-effort/reward (MER) arm, and the third as a high-effort/reward (HER) arm. The arm assignment was counterbalanced across animals, and held constant between sessions. The arm containing the low reward (LR) was unimpeded by a barrier, but to obtain the medium (MR) or high reward (HR), rats were required to climb a 20- or 30-cm barrier, respectively. ‘Froot loops’ were given as food rewards during testing: a HR consisted of four ½ froot loops (ie, two froot loops), a MR consisted of two ½ froot loops (one froot loop), and a LR consisted of one ½ froot loop. Between trials, the rat was removed from the maze and placed in Plexiglas holding chamber while the maze was wiped with 70% ethanol to eliminate residual odor cues.

Figure 1
figure 1

Novel effortful maze task. Behavioral training and testing were conducted in a standard eight-arm radial maze, with arms extending from a central arena with a diameter of 25 cm. Arms were 50 cm long and 12 cm wide. The four arms nearest to the start arm were permanently blocked, leaving a start arm and three choice arms accessible to animals. One arm of the maze was randomly designated as a low-effort/reward (LER) arm, another as a medium-effort/reward (MER) arm, and the third as a high-effort/reward (HER) arm. The arm assignment was counterbalanced across animals, and held constant between sessions. The arm containing low reward was unimpeded by a barrier, but to obtain a medium or high reward, rats were required to climb a 20- or 30-cm barrier, respectively. ‘Froot loops’ were given as food rewards during testing: a ‘high reward’ consisted of four ½ froot loops (ie, two froot loops), a ‘medium reward’ consisted of two ½ froot loops (one froot loop), and a ‘low reward’ consisted of one ½ froot loop.

PowerPoint slide

Habituation

During the acclimation phase, five ½ froot loops were placed into each arm of the maze (20 total). Each rat was individually placed into the maze and allowed to explore and eat froot loops freely. Criterion for advancement to the next phase was consumption of twenty ½ froot loops within 15 min.

Reward magnitude training: phase 1

In this phase, one goal arm was baited with four ½ froot loops (HR arm), another with two ½ froot loops (MR arm), and the third arm with one ½ froot loop (LR arm). Rats were allowed to sample freely from all arms for 10 trials. No barriers were present at this phase. Each trial lasted until the rat finished all the froot loops. Trials were separated by a 30-s inter-trial interval (ITI). The order of arm visits was recorded. Criterion for advancement to the next phase was completion of 10 trials within 30 min.

Reward magnitude training: phase 2

This phase was similar to phase 1 of reward magnitude training, except that animals were allowed to visit only one arm per trial. Rats were removed from the maze as soon as the arm was chosen and the reward was consumed. Animals were given 10 trials per day separated by a 30-s ITI. This phase marked the beginning of learning to visit only one arm, as well as continuing to learn each arm’s associated reward values. Criterion for advancement to the next phase was choice of the HR arm on 80% or more of the trials for two consecutive days.

Alternating free-/forced-choice trials with barriers

During this phase, rats were required to climb barriers to achieve higher rewards. Each day of testing consisted of 10 free- and three forced-choice (one for each arm) trials, administered at the beginning. On forced-choice trials all goal arms except one were blocked. The order of arm presentation during forced-choice trials was counterbalanced between days. Upon eating the food reward, the rat was placed in a holding chamber for a 30-s ITI, during which the maze was wiped clean with 70% ethanol to prevent the rat’s use of scent-guided choice. Rats were tested daily until stable baseline choice performance was established (choice preferences on free-choice trials did not significantly differ across three consecutive days).

Post-treatment testing

Seven days after the last injection, rats were tested again on the alternating free-/forced-choice trials with barriers to assess the effect of drug treatment on their choice preferences. After the post-treatment stable performance was established, a control task was administered in which work was equalized between the arms (identical to Reward magnitude training: phase 2).

Tissue Dissection and Detection of Cytokines

Rats were euthanized 1 day after the last day of behavioral testing (17 days after the final methamphetamine or saline treatment) with an overdose of sodium pentobarbital (250 mg/kg, i.p.) and decapitated. The brains were immediately extracted, flash frozen by immersion in isopentane over dry ice, and stored at −80 °C prior to dissections. The brains were then thawed in chilled artificial cerebrospinal fluid, and 2-mm-thick coronal sections of frontal cortex, striatum, and amygdala were further rapidly dissected, using a brain matrix, in saline with protease and phosphatase inhibitors (Halt, Thermo Scientific, Waltham, MA) at 4 °C. Frontocortical dissections included ventral (orbital) and medial sectors of the frontal cortex, but excluded most lateral, posterior (agranular insular) regions. Striatal dissections included both dorsal and ventral subregions. To prepare the tissues for the assays, 0.3 ml (frontal cortex, striatum) or 0.2 ml (amygdala) of a sonication buffer containing 50 mM Tris base and a cocktail enzyme inhibitor (100 mM amino-n-caproic acid, 10 mM EDTA, 5 mM benzamidine HCl, and 0.2 mM phenylmethyl sulfonyl fluoride) was added to each sample. Each tissue was mechanically sonicated for 20 s using an ultrasonic cell disrupter (Fisher Scientific, Pittsburgh, PA), centrifuged at 10 000 g at 4 °C for 10 min, and supernatants removed and stored at 4 °C until ELISA was performed. Bradford protein assays were also performed to determine total protein concentrations in each sample. IL-1β, IL-6, IL-10 and TNFα cytokine protein levels were determined using a commercially available multiplex ELISA kit (Rat 4-plex Cat# 114-944-1-AB; Aushon Biosystems, Billerica, MA). The assays were performed according to the manufacturer’s instructions. All samples were run at a threefold dilution. The sensitivity of the multiplex assay is 6.25 pg/ml for IL-1β, 12.5 pg/ml for IL-6, 3.125 pg/ml for IL-10, and 25 pg/ml for TNFα. The concentration of each cytokine is presented as pg/100 μg of total protein.

Data Analyses

Software package SPSS (SAS Institute, Version 16.0) was used for statistical analyses. The maze-choice data were first analyzed using multivariate ANOVA (MANOVA), with time (pre- and post treatment) and barrier height (LER, MER, HER) as within-subject and treatment group (methamphetamine vs saline) as between-subject factors to probe for differences in choice preferences. Changes in choice preferences for each goal arm were subsequently analyzed using repeated-measures ANOVA (rmANOVA), with time (pre- and post treatment) as within-subject and treatment group as between-subject factors. Arm/reward choice preferences were assessed with rmANOVA analyses, with testing session as an additional within-subject factor. When significant interactions were found, post hoc simple effects were reported. Cytokine data for each brain region were analyzed using independent samples t-tests. Pearson correlation coefficients were calculated, and multiple linear regression analyses with the treatment group and IL-1β, IL-6, IL-10 and TNFα levels as predictor variables were performed to examine the relationship between the cytokine levels and behavioral data. Statistical significance was noted when p-values <0.05 were observed. For both pre- and post-treatment testing, data from 11 animals were analyzed owing to loss of one animal in the methamphetamine group.

RESULTS

Effortful maze Performance

A significant effect of treatment group on arm choices was observed (F(5,5)=34.366, p<0.01, Wilk’s Λ=0.03, partial η2=0.972). Changes in choice preferences for each goal arm were subsequently analyzed (results provided below). There were no pre-existing group differences and no preference for any of the goal arms prior to treatment: all animals distributed their choices uniformly across the available reward options (Figure 2a). However, there was a strong post-treatment preference for the MER arm compared with the LER arm (p<0.01) in methamphetamine animals, which was not present in the saline-treated group (Figure 2b). Additional trial-by-trial analyses of choice behavior revealed no group differences in patterns of arm choices. Animals did not exhibit any first-entry arm preference. There was also no effect of forced choice on subsequent choices, and the animals were not more likely to repeat the last forced choice than they were to choose a different arm. All animals exhibited a greater preference for higher-reward/higher-effort options at the beginning of the session and decreased their willingness to exert greater effort for larger rewards with session progression, as evidenced by the greater probability of animals switching to less-effortful options on subsequent trials (main effect of choice F(1,9)=20.132, p<0.01). All animals were also more likely to alternate than repeat the arm choice on subsequent trials (main effect of choice F(1,9)=198.45, p<0.01), but drug treatment did not affect a tendency for arm choice perseveration.

Figure 2
figure 2

Methamphetamine pretreatment led to an increase in medium-effort/reward (MER) choices in preference to low-effort/reward (LER) option, leaving high-effort/reward (HER) choices unaffected. Bar graphs represent percent HER, medium effort/reward (MER), and LER pre- (a) and post-treatment (b) +SEM. (a) There were no pre-existing group differences and no preference for any of the goal arms prior to treatment; all animals distributed their choices uniformly across the reward arms. (b) There was a strong post-treatment preference for the MER arm compared with the LER arm (p<0.01) in methamphetamine animals, which was not present in the saline-treated group. Methamphetamine-treated animals chose the MER option more frequently compared with the saline group (p<0.05), and shifted away from the LER option (p<0.01). Groups were not different on HER choices. Methamphetamine-pretreated animals shift away from LER immediately, whereas MER preference increases as a result of repeated training. (c) The shift-away from LER was present from the beginning of the post-treatment testing (starting day 1, p<0.01). (d) The MER choice increases became significant on day 3 (p<0.05). *p<0.05, **p<0.01.

PowerPoint slide

Methamphetamine pretreatment led to an increase in MER choices over the LER option, leaving HER choices unaffected

Methamphetamine-induced effects were observed on LER and MER, but not HER choices. For LER choices, there was no main effect of time or treatment group, but a significant time by treatment group interaction (F(1,5)=40.262, p<0.01) was observed. Post hoc analyses revealed a simple main effect of treatment group on post-treatment choices (p<0.01), with methamphetamine-pretreated animals shifting away from the LER option (Figure 2b). For MER choices, analyses revealed no main effect of time or treatment group, but a significant time by treatment group interaction (F(1,5)=39.406, p<0.01). Post hoc comparisons showed that methamphetamine pre-treated animals chose the MER option significantly more often following methamphetamine treatment (p<0.05) (Figure 2b). No significant effects were observed on HER choices (Figure 2a and b), as further evidence that the increased preference for the MER arm in methamphetamine-pretreated animals was a result of shifting away from the LER option.

Methamphetamine-pretreated animals shift away from LER immediately, whereas MER preference increases as a result of repeated training

For LER choices, rmANOVA revealed a significant main effect of the testing day (F(9,81)=2.276, p<0.05) and significant day by treatment group interaction (F(9,81)=7.818, p<0.01), but no main effect of treatment group. For MER choices, rmANOVA resulted in no main effect of the testing day or treatment group, but a significant day by treatment group interaction (F(9,81)=8.054, p<0.01)). Post hoc analyses further showed that the shift away from LER was present from the beginning of the post-treatment testing (starting day 1, p<0.01; Figure 2c), whereas the significant increase in MER choices first emerged on day 3 (p<0.05; Figure 2d).

General

Main effect of barrier height on latencies to complete the trial was observed (F(2,32)=452.46, p<0.01); all animals took significantly longer to complete the HER compared with MER and LER, and MER compared with LER trials (all p-values<0.01). There was no effect of treatment on latencies to complete the trial for any type of reward choice. There were also no differences in the number of days that the animals required to reach stable performance. Performance on the control task was identical between groups. Methamphetamine treatment did not affect animals’ weight or food intake (Figure 3).

Figure 3
figure 3

Methamphetamine treatment did not affect animals’ food intake or body weight. Graphs represent amount of food (g) consumed in 1 day during acute withdrawal (a) or daily body weight (b) during the treatment period +SEM. No effect of the treatment group on animals’ weight or food intake was observed; the differences in reward choices were not due to differential effects on motivation resulting from food restriction.

PowerPoint slide

Frontocortical Cytokine Levels are Decreased Following Methamphetamine Treatment and are Correlated with LER and MER Choices

Significant reductions in frontocortical IL-1β (t(9)=2.2341, p<0.05), IL-6 (t(9)=2.308, p<0.05), IL-10 (t(9)=2.432, p<0.05), and TNFα (t(9)=2.454, p<0.05) in the methamphetamine group were found (Figure 4a). The increases in cytokine levels in amygdala were not significant (Figure 4b), and there were no between-group differences in striatal cytokine levels (Figure 4c). Levels of all of the cytokines within one brain region were strongly correlated with each other; this was true for both treatment groups considered independently and for all the brain regions examined (all r-values >0.9; all p-values <0.01), except IL-10 levels within striatum, which did not correlate with any other measurement within this brain region.

Figure 4
figure 4

Frontocortical cytokine levels are decreased following methamphetamine treatment. Bar graphs represent concentration levels of each cytokine in 100 μg of total protein +SEM. (a) Significant reduction in frontocortical interleukin (IL)-1β (t(9)=2.2341, p<0.05), IL-6 (t(9)=2.308, p<0.05), IL-10 (t(9)=2.432, p<0.05), and tumor necrosis factor alpha (TNFα) (t(9)=2.454, p<0.05) in the methamphetamine group was found. (b) The increases in cytokine levels in amygdala were not significant, and (c) there were no between-group differences in striatal cytokine levels. *p<0.05.

PowerPoint slide

Multiple linear regression analyses with the treatment group and frontocortical IL-1β, IL-6, IL-10, and TNFα levels as predictor variables further revealed that frontocortical cytokine levels significantly predicted post-treatment MER (F(5,10)=4.857, p<0.05, R2=0.822) choices. The levels of each of the frontocortical cytokines examined, IL-1β (Figure 5a and b), IL-6, IL-10, and TNFα, were independently associated with LER choices (all r-values >0.7; all p-values <0.01), and negatively correlated with MER choices (all r-values <−0.7; all p-values <0.05). There was a statistical trend for positive correlations between frontocortical IL-1β, IL-6, IL-10, and TNFα levels and LER choices (0.05< all p-values <0.1), and negative correlations between frontocortical cytokines and MER choices (0.06< all p-values <0.15) in the saline group considered independently. Pronounced decreases in cytokine levels and minimal variation in the methamphetamine group precluded correlational analyses. Interestingly, frontocortical cytokine levels were also negatively correlated with the change in MER choices (ie, difference between pre- and post-treatment; all r-values <−0.67; all p-values <0.05), whereas levels of cytokines in amygdala were positively correlated with this change (all r-values >0.66; all p-values <0.05). The negative correlations between frontocortical cytokines IL-10 and TNFα were significant in the saline group considered separately (all p-values <0.05; trend for IL-1β: p=0.08; IL-6: p=0.05), and there was a trend for positive correlations between cytokine levels in amygdala and the change in MER choices in the saline group (0.05< all p-values <0.1). No correlations between food intake or body weight and cytokine levels within any of the brain regions were observed.

Figure 5
figure 5

The alterations in reward valuation were associated with reductions in frontocortical cytokine levels. The figure illustrates significant strong positive correlations between frontocortical interleukin (IL)-1β and (a) low-effort/reward (LER) choices (r(11)=0.782, p<0.01), as well as significant strong negative correlations between frontocortical IL-1β and (b) medium-effort/reward (MER) choices (r(11)=−0.73, p=0.011). There was a statistical trend for positive correlations between frontocortical IL-1β, IL-6, IL-10, and tumor necrosis factor alpha (TNFα) levels and LER choices (0.05< all p-values <0.1), and negative correlations between frontocortical cytokines and MER choices (0.06< all p-values <0.15) in the saline group considered independently. The regression lines are given for the saline group only, and the methamphetamine group values are shown for comparison.

PowerPoint slide

DISCUSSION

Work aversion in a T-maze effort-discounting task at barrier heights of 25 and 30 cm (Kosheleff et al, 2011) was demonstrated after a binge regimen of methamphetamine. However, previous findings by Floresco and Whelan (2009) demonstrating comparable rates of effort discounting after repeated amphetamine treatment, and our laboratory showing no differences in choice preferences on a T-maze task after escalating methamphetamine (unpublished observation), indicate that effort-cost processing is not affected by repeated (meth)amphetamine exposure. In contrast, the results of the present investigation demonstrate an increased sensitivity to differences in reward magnitude in the methamphetamine group, making animals more likely to overcome greater effort costs to obtain larger rewards in a novel effortful maze task. In addition, we provide the first evidence for enduring region-specific neuroimmune changes as a consequence to escalating methamphetamine, which are associated with goal-directed, reward choice alterations in the long term.

Methamphetamine Pretreatment Produced Long-Lasting Alterations in Reward Valuation

Individual preferences and choice behavior are affected by the number of alternative options available and the manner in which alternatives are presented (Horowitz et al, 2007; Reutskaja and Hogarth, 2009; De Martino et al, 2006), as well as by learning and experience. To control for differences in reward learning and to better assess value-guided decision making, we trained animals on a novel effortful task with three possible courses of action, each associated with different effort requirements and reward magnitudes, until stable choice performance was established. This task, with increased option space, better mimics decision-making problems faced by animals in their natural environment. There were no pre-existing preferences for any of the goal arms: all animals distributed their choices uniformly across the available reward options. In addition, no group differences in the pattern or order of choices were observed: all animals showed greater preference for higher-effort/higher-reward options at the beginning of a session. Increased preference for MER and decreased choice of the LER option appeared during post-treatment testing in the methamphetamine, but not the saline, treatment group. Methamphetamine-pretreated animals were more likely to overcome greater effort costs to obtain larger rewards compared with the saline group, consistent with previous work by our laboratory employing an identical treatment regimen (Stolyarova et al, 2014) and others (Dezfouli et al, 2009) showing increased reward sensitivity in drug-pretreated animals. Notably, these behavioral alterations were observed outside of the acute withdrawal period, suggesting that methamphetamine exposure has long-lasting effects on reward choice preferences. The observed methamphetamine-induced shifts in choice behavior were not associated with changes in primary food motivation.

Interestingly, HER choices were unaffected by methamphetamine treatment. The choices in the task employed in the present experiment are based on the comparison of the relative differences in both reward magnitude and physical demands. The magnitude of the reinforcement associated with two ½ froot loops in food-restricted animals might be perceived as sufficiently high, and further increases in reward size may be discounted more steeply by increases in effort cost. In addition, the effort- and time-cost sensitivity, which has been shown to be affected by methamphetamine exposure (Monterosso et al, 2007; Hoffman et al, 2006), are confounded in the present task, as increases in barrier height introduce a delay to obtain the reward. Finally, climbing the high barrier, which extends 10 cm above the maze walls, may be more anxiogenic to methamphetamine-pretreated animals. Indeed, methamphetamine-induced acute and long-term increases in anxiety levels have been reported (London et al, 2004; Kitanaka et al, 2008; Darke et al, 2008; Pometlová et al, 2012; Akindipe et al, 2014). Stress and anxiety, in turn, have been implicated in alterations in cost-benefit decision making, with acute stress exposure leading to decreases in the preference for the more costly reward (Shafiei et al, 2012). Although not addressed in the present investigation, all the aforementioned factors may impose an additional demand and increase the cost associated with climbing the high compared with medium barrier, masking increases in motivation to obtain the larger reward.

The observed patterns of behavioral changes could be due to termination of drug administration and removal of the drug reinforcer, rather than a direct consequence of drug exposure. Interactions between drug and non-drug (natural) reinforcers on the establishment and maintenance of operant behavior have been previously reported. Carroll et al (1989) showed that removal of the first reinforcer led to enhanced acquisition of operant behavior for the second reinforcer (either drug or natural reward). Taken together with previous results from our laboratory demonstrating increased sensitivity to positive reward feedback (Stolyarova et al, 2014), this adds to the evidence for increased reward sensitivity as a result of drug exposure/termination.

The Alterations in Reward Valuation in the Methamphetamine Group were Associated with Reductions in Frontocortical Cytokine Levels

The methamphetamine-induced alterations in reward valuation were accompanied by pronounced decreases is frontocortical cytokine levels. The role for central immune signaling in the modulation of drug-induced neuronal and behavioral responses has been recently suggested (Coller and Hutchinson, 2012; Hutchinson and Watkins, 2014). Glial function has been linked to genetic differences in drug response, and there is demonstrated involvement of astrocyte-specific soluble factors, induced by drug exposure, in the development of the rewarding effects of methamphetamine at different doses (Narita et al, 2005; Narita et al, 2006). Systemic elevation of pro-inflammatory cytokines has been shown to affect effort-based decision making, shifting the choice behavior toward LER options and reducing the tendency to work for reinforcers (Larson et al, 2002; Nunes et al, 2014; Vichaya et al, 2014), but the involvement of centrally acting cytokines in choice behavior on effortful tasks had not been demonstrated. Here we provide novel evidence implicating cytokines within the frontal cortex in alterations in value-based decision making after methamphetamine exposure.

Although acute methamphetamine administration has been shown to induce potent increases in inflammatory cytokines (Flora et al, 2002; Gonçalves et al, 2008), the results of the present investigation demonstrate pronounced decreases in cortical cytokines 17 days after subchronic escalating methamphetamine treatment in rats, as well as non-significant increases of cytokine levels in amygdala. These results are in accordance with a previous report by Loftis et al (2011) demonstrating decreased levels of IL-1β in frontal cortex of mice pre-treated with methamphetamine (1 mg/kg for 7 days) 72 h after the last injection. However, in the investigation by Loftis et al (2011), the differences in cytokine levels were no longer present 21 days after treatment. The persistence of neuroimmune changes in the present study may be attributed to a significantly longer duration of treatment, escalating regimen, or the highest administered dose. One possible explanation for the observed decreases is that chronic methamphetamine administration may robustly dysregulate IL-1β receptor expression, causing enduring reductions of the protein. However, this possibility and its time course remain to be elucidated in a future study. Cytokine expression patterns are known to exhibit variable time courses in response to various immune challenges, conditions, and disease states (Barrientos et al, 2009; Csontos et al, 2010; Thijs and Hack, 1995). Anti-inflammatory cytokines are released as part of the homeostatic response, and often exhibit a temporal profile that overlaps with that of pro-inflammatory cytokines (Henry et al, 2009; Kamm et al, 2006; Turrin et al, 2001). Thus, if samples are collected at one of those overlapping time points, pro- and anti-inflammatory cytokines can exhibit changes in parallel, as was observed here.

Notably, protein levels of all cytokines within one brain region were strongly correlated, providing evidence for global effects of methamphetamine on glial function. The lack of changes in cytokine levels within striatum and non-significant between-group differences in amygdala may be attributed to the duration of abstinence from the drug, as the neuroinflammatory responses may subside over longer periods of abstinence (Sekine et al, 2008). Future investigations could assess larger sample sizes, sex differences, and the time course of drug-induced neuroinflammatory responses.

Frontocortical cytokine levels were positively correlated with LER and negatively correlated with MER choices. In addition, MER choices were associated with pronounced decreases in frontocortical cytokines, providing evidence that neuroinflammatory processes within frontocortical regions may contribute to alterations in reward evaluation during withdrawal, when re-experience with the drug can lead to rapid reinstatement. Importantly, our frontocortical dissections included the ventromedial region, which has been implicated in the evaluation of goals in the presence of several good options and in regret associated with comparison of the selected and the forgone choice (Blair et al, 2006; Chau et al, 2014). Interestingly, frontocortical cytokine levels were also negatively correlated with the change in MER choices (ie, difference between pre- and post-treatment), whereas levels of cytokines in amygdala were positively correlated with this change. These results show that cytokines within both amygdala and frontal cortex contribute to pre- and post-treatment changes in subjective values of reward options, whereas between-option choices following repeated training are more influenced by frontocortical neuroimmune responses. This interpretation is consistent with the idea that amygdala is critical in updating reward values, but is no longer recruited when decisions depend on stable preferences or familiar outcomes (Izquierdo and Murray, 2007).

In summary, we provide the first evidence that neuroinflammatory processes, specifically reduction of frontocortical cytokine levels, may contribute to alterations in reward valuation during protracted methamphetamine withdrawal. The mechanism by which changes in central cytokines contribute to behavioral alterations are not well understood. Previous evidence suggests that interleukins may be required for normal neuronal function, and that the effect of regional changes in cytokine concentration follows an inverted U-shape curve, with any deviation (excess or reduction) from the physiological range producing an impairment (Goshen et al, 2007). Pro-inflammatory cytokines can have a direct effect on neuronal excitability by altering GABA-ergic and glutamatergic signaling (Stellwager et al, 2005). In addition, cytokines may interact with monoamine transmission, by affecting dopamine metabolism (Song et al, 2006; Miller et al, 2013). The effect on dopaminergic transmission is particularly intriguing given that in a study by Nunes et al (2014), the IL-1β-induced changes in effortful choice behavior resembled those produced by dopamine antagonism or depletion.

FUNDING AND DISCLOSURE

This work was supported by UCLA’s Division of Life Sciences Recruitment and Retention fund (Izquierdo). Partial support for ABT was provided by the TNDA T32 DA024635 (Thompson). The authors declare no conflict of interest.