Adenosine A2A receptor and ERK-driven impulsivity potentiates hippocampal neuroblast proliferation

Dampened adenosine A2A receptor (A2AR) function has been implicated in addiction through enhancement of goal-directed behaviors. However, the contribution of the A2AR to the control of impulsive reward seeking remains unknown. Using mice that were exposed to differential reward of low rate (DRL) schedules during Pavlovian-conditioning, second-order schedule discrimination, and the 5-choice serial reaction time task (5-CSRTT), we demonstrate that deficits of A2AR function promote impulsive responses. Antagonism of the A2AR lowered ERK1 and ERK2 phosphorylation in the dorsal hippocampus (dHip) and potentiated impulsivity during Pavlovian-conditioning and the 5-CSRTT. Remarkably, inhibition of ERK1 and ERK2 phosphorylation by U0126 in the dHip prior to Pavlovian-conditioning exacerbated impulsive reward seeking. Moreover, we found decreased A2AR expression, and reduced ERK1 and ERK2 phosphorylation in the dHip of equilibrative nucleoside transporter type 1 (ENT1–/–) null mice, which displayed exacerbated impulsivity. To determine whether impulsive response behavior is associated with hippocampal neuroblast development, we investigated expression of BrdU+ and doublecortin (DCX+) following 5-CSRTT testing. These studies revealed that impulsive behavior driven by inhibition of the A2AR is accompanied by increased neuroblast proliferation in the hippocampus.


INTRODUCTION
The dorsal hippocampus (dHip) and nucleus accumbens (NAc) are constituents of a neural circuit that regulates adaptability and survival. 1 However, maladaptation of hippocampal-striatal circuits contribute to the development of impulsivity, compulsivity and addiction. 2 Differential reinforcement of low rates of behavior (DRL) schedules have revealed the hippocampus to be a regulatory neural substrate in impulsivity and reward acquisition 3,4 in both human and animal models. 5,6 Alcoholinduced impulsivity in humans 7 and rodents 8 are partially driven by contextual evocation of drug-induced euphoria to cues. These contextual associations are largely regulated by the dHip, which has an instrumental role in controlling cue-induced drug seeking and relapse in substance use disorders. 9,10 As an inhibitory neurotransmitter, adenosine has an essential role in fine-tuning hippocampal-striatal circuits that drive learning, memory, motivation and addictive behaviors. [11][12][13] The role of the adenosine A 2A receptor (A 2A R) in brain physiology and behavior has recently gained significant attention due to its involvement in synaptic plasticity and memory. [14][15][16][17] Previously, we demonstrated that deletion of the ethanol-sensitive adenosine transporter (ENT1 -/-) in mice decreases A 2A R function in the dorsomedial striatum, resulting in increased ethanol consumption and enhanced goal-directed behavior. 18,19 ENT1 has been reported to regulate neurotransmission in the hippocampus. 20 Hippocampal neurotransmission critically relies on activity of extracellular signal-regulated kinases (ERK1 and ERK2, also known as mitogenactivated protein kinase 3 (MAPK3) and MAPK1, respectively), and known to be essential components of synaptic plasticity and neurogenesis. [21][22][23] Consequently, addictive drugs dampen hippocampal neurogenesis, which in turn can profoundly affect craving, relapse and cognition. 24,25 In this report, we utilized DRL-mediated Pavlovian-conditioning (DRL-conditioning), operant second-order discrimination, and the 5-choice serial reaction time task (5-CSRTT) to examine goal-andsign-tracking impulsive behavior. 26 Our results reveal the involvement of the A 2A R and the downstream kinases ERK1/2 in impulsive reward seeking. Furthermore, we investigated a possible link between dysregulation of the A 2A R in relation to neuroblast development within the hippocampal dentate gyrus (DG). Therefore, to our knowledge, our findings are the first to demonstrate a novel role for the A 2A R in impulsivity and immature neuroblast proliferation, both of which may be factors underlying the process of neurogenesis in reward seeking behaviors. Behavior naive mice. ENT1 -/-, WT and C57BL/6J mice that were naive to behavior testing and were acutely administered ethanol, or were treated with ZM-241385 (5-days), were group housed with littermates and maintained in ventilated racks with ad libitum food and water until ready for brain extraction for subsequent western blot and immunofluorescence analysis (Supplementary Figure 1).

MATERIALS AND METHODS
Behavior-tested mice. Behavior-tested groups of WT and ENT1 -/mice, and vehicle and ZM-241385-treated C57BL/6J mice were either group housed or individually housed, and underwent food restriction to reach 85% of their ad libitum feeding target weight (Supplementary Figure 1)

Experiment 3: U0126 and DRL-conditioning
To test the effects of ERK1/2 inhibition on impulsive sign-tracking, U0126 or vehicle was bilaterally infused (4 μg μl − 1 per side) into the dHip of C57BL/6J mice 30 min prior to testing at a rate of 0.5 μl min − 1 for a total of 2 min. Injections were allowed to diffuse for an additional 2 min before removal of injectors, as described below.

5-CSRTT
Next, we explored how context predictability and A 2A R antagonism affected 5-CSRTT performance. 28 The trials of this task were modified so that the internal-trial intervals (INT-TI) immediately preceding aperture illumination had either random (rINT-TI; unpredictable context) or fixed (fINT-TI; predictable context) durations. Detailed 5-CSRTT methodology is provided in the Supplementary Information.

Cannulation and U0126 microinjection
Surgeries targeting the dHip (AP: − 2.1 mm from Bregma; lateral: ± 1.8 mm and DV: − 1.6 mm below the dural surface) 31 for microinjection with U0126 (4 μg μl − 1 per side at 0.5 μl min − 1 for 2 min.) were performed as previously described. 32 Following cannulation surgery, mice were allowed to recover for 6-7 days before starting food restriction. To ensure the health of our subjects during conditioning following cannulation surgeries, we used their pre-surgery ad libitum feeding weight to calculate their postsurgery target weight. Vehicle and U0126 microinjections were performed 30 min prior to Pavlovian-conditioning testing. Detailed methods are available in the Supplementary Information.

Western blot
Western blot analysis of the dHip and NAc of behavior-naive and behaviortested ENT1 -/mice, WT mice, and ZM-241385 or vehicle-treated C57BL/6J mice was performed according to standard methodology and as previously described. 33 Briefly, the dHip and NAc from each mouse were homogenized in a Storm 24 magnetic Bullet Blender for 4 min at a speed setting of 4 (Next Advance, Averill Park, NY, USA), with 0.5 mm zirconium oxide beads in combination with Cell-lytic MT mammalian tissue extraction buffer (Sigma-Aldrich). Protein concentration from each biological replicate was quantified and replicates were loaded at 30 μg where they were separated via SDS-PAGE on a 4-12% Nu-Page Bis-Tris gel (Invitrogen, Carlsbad, CA, USA), followed by transfer to a PVDF membrane (Invitrogen). Samples were then immunoblotted overnight at 4°C with primary antibodies specific for the A 2A R (1:500), ERK1/2 (1:500), phospho-ERK (pERK) 1 and pERK2 (Thr-202 and Tyr-204, respectively; 1:500), GAPDH (1:1000) and appropriate secondary antibodies. Detailed methods are available in the Supplementary Information.

Immunofluorescence and stereological analysis
We examined expression of markers indicative of cell and neuroblast proliferation (BrdU + , MCM2 + and DCX + ) from the whole hippocampal DG (5 sections per brain, 200 μm apart from anterior to posterior) in agematched (6-week old) behavior-naive WT and ENT1 -/mice (n = 4-5 per genotype). Similarly, we examined the process of neuroblast proliferation (BrdU + DCX + ) in 5-CSRTT-tested mice administered with ZM-241385 or vehicle (n = 5-6 per treatment). From these behavior-tested mice, we investigated the whole hippocampus (5 sections per brain, 200 μm apart from anterior to posterior) and separately the dHip (3 sections per region, 200 μm apart from anterior to posterior) and ventral hippocampus (vHip; 3 sections per region, 200 μm apart from anterior to posterior) to assess region-specific differences. Sample volumes were determined from these sections and cell density was multiplied by the total volume to yield the absolute cell numbers. 34,35 Coronal brain sections (40 μm thick) from each mouse brain were processed to label proliferating cells with primary antibodies for BrdU + (1:250), MCM2 + (BM28;1:500) and neuroblasts in the stage of maturation where doublecortin (DCX + ;1:500) is expressed. Appropriate secondary antibodies (Cy2, Cy3 and Cy5) were used to detect primary antibodies. 34,36 Images were acquired on a LSM 780 confocal system (Zeiss, Carl Zeiss Microscopy, Thornwood, NY, USA) with × 20 and × 40 objectives using a multi-tile configuration. Stereological quantification of BrdU + , BrdU + DCX + and BrdU + MCM2 + cells within the subgranular zone (SGZ), and granule cell layer of the DG were carried out using Zen Blue edition (Zeiss) as previously described. 34,35 Data and statistical analysis Detailed statistical analyses can be found in the Supplementary Information.
Pavlovian-conditioning and non-contingency testing: For behavioral analysis, we conducted repeated measures two-way ANOVA (RM two-way ANOVA), two-way ANOVA and unpaired two-tailed Student's t-test as described in detail in the Supplementary Information. Discrimination: For behavioral analysis of second-order discrimination, we used two-way ANOVA. 5-CSRTT: Behavioral comparisons were analyzed with RM two-way ANOVA and unpaired two-tailed Student's t-test. Open field: Velocity and A 2A R driven impulsivity and neuroblast proliferation A Oliveros et al distance traveled were analyzed with RM two-way ANOVA followed by Bonferroni's multiple comparisons, where appropriate. For western blot analysis, each lane represents an individual brain region biological replicate that was normalized to its respective GAPDH protein expression. We utilized an unpaired Student's t-test or one-way ANOVA for western blot comparisons which is described in detail in the Supplementary Information. Images are representative of 1-3 western blotting experiments. For all BrdU + , BrdU + MCM2 + and BrdU + DCX + statistical analyses, cell numbers derived from 3-5 coronal sections were averaged for each brain, and we utilized an unpaired Student's t-test for comparisons. Statistical significances reported for all ANOVA results were followed with Tukey's multiple comparisons where appropriate (Sigma Plot 12.0, Systat Software, San Jose, CA, USA). Results were considered statistically significant when P o0.05 and are presented as mean and ± s.e.m. (GraphPad Prism, La Jolla, CA, USA).

A 2A R Inhibition induces impulsivity when delivery of reward is unpredictable
To assess the contribution of the A 2A R to impulsivity during DRLconditioning (Figure 1a), mice were required to wait for CS+ presentations for reward delivery. 37 Inhibition of ERK1/2 in the dHip potentiates impulsivity Hippocampal A 2A R function is known to modulate ERK1/2 activity. 17 In agreement, our western blot analysis revealed that in comparison to vehicle, naive mice administered ZM-241385 had significant decreases of pERK1 (t 4 = 3.07, *P o0.05) and pERK2 (t 4 Figure 2c) were not different between treatment groups (t 5 = 2.16, P = 0.08). These results suggest that inhibition of pERK1/2 in the dHip has a role in the potentiation of impulsive goal-tracking behavior.
A 2A R inhibition potentiates 5-CSRTT sign-tracking impulsivity when reinforcement is unpredictable Next, we asked whether A 2A R inhibition and cue predictability induced sign-tracking impulsivity. Prior to 5-CSRTT testing, mice underwent magazine training and 5-hole FR-1 operant conditioning ( Supplementary Figures 3a-c). When waiting times for reinforcement-associated cues were unpredictable (random internal time interval, rINT-TI; Figure 3a) during 5-CSRTT testing, mice that were administered i.p. ZM-241385 ( Figure 3b) emitted significantly more premature nosepokes (F (1,9) = 6.60, P o0.05) during training (days 3-4, P o 0.05). Likewise, A 2A R inhibition resulted in significantly more impulsive time-out interval nosepokes (t 9 = 2.33, P o 0.05; Figure 3c). There were no differences in the proportion of correct trials (Figure 3d  Previous reports indicate that ZM-241385 increases locomotor activity in rodents, 39,40 thus we examined whether A 2A R inhibition in combination with food restriction (which can itself increase locomotion) affected ambulatory velocity and distance traveled. 41 Although both i.p. vehicle and ZM-241385-treated mice significantly decreased ambulatory velocity (F (17,306) = 4.06, P o 0.0001), we did not detect an interaction or a significant difference in velocity between treatment groups (Supplementary Figure 4a). In agreement with previous reports, our analysis detected more distance traveled in mice treated with ZM-241385 ((F (1,18) Figure 4b). Taken together, our DRL-conditioning and 5-CSRTT results provide evidence to indicate that A 2A R antagonism increases impulsivity and shortens reaction times in contexts where reward or reinforcement delivery is unpredictable, without significantly affecting locomotor velocity. ENT1 -/mice display increased impulsivity, decreased hippocampal A 2A R expression and lowered ERK phosphorylation We have previously reported that decreased functionality of ENT1 and striatal A 2A R have a critical role in goal-oriented reward seeking. 19 Given that our study and others indicate involvement of the hippocampus during reward-mediated prediction error behavior, 42 Figure 9b). We also detected a significant decrease in pERK2 (t 4 = 10.45, *Po0.001), although not pERK1 in the dHip of behavior-naive ENT1 -/mice (Figure 4b and Supplementary Figure 8c). An analysis  Figure 5a). Reaffirming ethanol's wellknown association with impulsivity 43 (Supplementary Figures 5b,c), both genotypes displayed increased impulsive goal-tracking for These results suggest that deficits in ENT1-adenosine signaling may regulate impulsivity, and further demonstrate that consumption of highly hedonic sweetened alcohol drinks can promote dangerously pathological seeking behavior. 44 This becomes evident when comparing the exacerbated impulsive goaltracking behavior for sucrose-ethanol reward relative to sucrose reward ( Supplementary Figures 6a and b), exhibited by both WT (t 22 = 3.06, P o0.01) and ENT1 -/mice (t 17 = 4.31, P o 0.001). (h) Mice administered ZM-241385 did not show differences in premature nosepokes during fINT-TI 5-CSRTT performance. (i) Mice administered ZM-241385 or vehicle did not display differences in TOI nosepokes during fINT-TI 5-CSRTT performance. (j) There were no differences between the treatment groups in the percentage of correct trials completed during fINT-TI 5-CSRTT testing. (k) There were no differences between the treatment groups in the percentage of incorrect trials completed during fINT-TI 5-CSRTT testing. (l) There were no differences between the treatment groups in the percentage of omission trials during fINT-TI 5-CSRTT testing. All data are expressed as mean ± s.e.m. (b-f n = 5-6 per treatment; h-l n = 5-6 per treatment) RM two-way ANOVA, # Po 0.05 main effect of treatment; *Po0.05 by Tukey's post hoc multiple comparisons versus vehicle-treated mice. 5-CSRTT, 5-choice serial reaction time task; DRL, differential reward of low rate; RM, repeated measures; TOI, time-out interval.
ENT1 -/mice display sign-tracking impulsivity Next, we explored whether ENT1 -/mice displayed sign-tracking impulsivity during an operant second-order discrimination task (Supplementary Figure 7a). This paradigm is used to investigate cue-induced self-administration of cocaine, 45 heroin 46 and alcohol. 47 As shown in Supplementary Figure 7b, we did not detect genotype differences in active-hole nosepokes during FR-1 pretraining. As both genotypes learned the operant, trial completions increased (F (3,54) = 3.81, P o0.05), although there was no difference in completions between WT and ENT1 -/mice (Supplementary Figure 7c). Both genotypes demonstrated an overall extinction decrease (F (3,54) = 6.88, P o0.01) of ITI nosepokes (Supplementary Figure 7d). As expected, ENT1 -/mice emitted significantly higher nosepokes (F (1,54) = 4.91, P o 0.05) during the ITI period. Overall, discrimination performance improved for both genotypes (F (3,54) = 7.02, P o0.01), although discrimination performance was worse in ENT1 -/mice compared to WT (F (1,54) = 4.67, P o 0.05), as evidenced by a significantly lower discrimination ratio (Supplementary Figure 7e). ERK1/2 phosphorylation in the dorsal hippocampus is increased following DRL-conditioning ERK activity is highly dynamic, often changing as a result of behavioral manipulations and drugs of abuse. [48][49][50] Thus, we examined the effects of repeated days of impulsive Pavlovianconditioning on phosphorylation of this kinase. In comparison to vehicle, our analysis detected significantly higher pERK1 (t 6 = 2.63, Po 0.05) and pERK2 (t 6 = 3.04, P o 0.05) in the dHip of mice administered ZM-241385 which underwent behavior conditioning (Supplementary Figure 8a), without similar changes in the NAc (Supplementary Figure 9a). Notably, pERK1 or pERK2 alterations were not detected in the dHip following non-contingency training (Supplementary Figure 10c), suggesting that unpredictability of reward during waiting impulsivity has a unique role in altered hippocampal ERK signaling. An analysis of ERK signaling in the NAc following non-contingency training detected a higher ratio of pERK1 (t 6 = 3.39, P o0.05) but not pERK2 in the NAc of mice treated with ZM-241385, likely due to lower expression of total ERK1 (Supplementary Figure 10b).
Our results indicate that ENT1 -/mice exhibit increased impulsivity. Consequently, we examined ERK1/2 signaling in the dHip and NAc. Our results show that relative to WT mice, ENT1 -/mice exhibited significantly higher pERK1 (t 4 = 6.15, P o0.01) and pERK2 (t 4 = 3.82, P o0.05) in the dHip (Supplementary Figure 8c) but not the NAc (Supplementary Figure 9c), following behavior conditioning. Although we report increased pERK1/2 following conditioning for sucrose, we were surprised to find that ENT1 -/mice, which displayed exacerbated impulsive goal-tracking for sucrose-ethanol reward, did not have a similar signature of pERK1 and pERK2 in the dHip (Supplementary Figure 11a). Therefore, we confirmed that relative to vehicle injection (F (3,11) Figure 11b). Interestingly, others studies have also shown ethanol-induced reductions in hippocampal ERK1/2 activity. 51 Ethanol injection also had a similar effect in the dHip of ENT1 -/mice (F (3,11) = 21.27, P o 0.001) as phospho-ERK1 (P o0.01) and phospho ERK2 (P o 0.01) was significantly dampened in comparison to vehicle (Supplementary Figure 11b). Thus, when compared to a natural reward (sucrose), our results potentially provide a novel explanation of how ethanol's effect on ERK phosphorylation may be associated with ethanol-induced exacerbations in impulsive behavior (Supplementary Figure 6).
Next, we examined the change of pERK1 and pERK2 signaling between behavior-naive animals in relation to mice that underwent DRL-conditioning and received ZM-241385 or vehicle. As observed in Supplementary Figures 8a and 12a, pERK1 and pERK2 in the dHip of vehicle-treated mice was not significantly different as a result of DRL-conditioning. In contrast, pERK1 (t 5 = 16.24, Po 0.0001) and pERK2 (t 5 = 12.36, Po 0.0001) in the dHip of ZM-241385-treated mice was significantly higher as a result of DRL-conditioning ( Supplementary Figures 8a and 12b). Interestingly, analysis of the NAc from vehicle-treated mice failed to detect differences in pERK1 and pERK2 resulting from DRLconditioning ( Supplementary Figures 9a and 12c). However, we did detect a significant decrease in pERK1 (t 4 = 3.79, P o 0.05) and pERK2 (t 4 = 4.27, P o0.05) in DRL-conditioned mice that were administered ZM-241385, relative to ZM-241385-treated behaviornaive mice (Supplementary Figures 9a and 12d). These results likely stem from lower total ERK1 and total ERK2 expression for these comparisons (Supplementary Figure 9a).
A similar analysis in the dHip of WT mice revealed that both pERK1 (t 5 = 5.10, P o0.01) and pERK2 (t 5 = 10.01, P o0.001) were significantly decreased as a result of DRL-conditioning ( Supplementary Figures 8c and 12e). In contrast, phospho-ERK1 (t 4 = 3.04, P o 0.05) was significantly increased in the dHip of ENT1 -/mice as a result of DRL-conditioning, but not pERK2 ( Supplementary Figures 8c and 12f). An examination of this change in the NAc did not reveal significant differences in pERK1 and pERK2 between behavior-naive WT mice and DRLconditioned WT mice ( Supplementary Figures 9c and 12g). Notably, we did detect a significant increase in pERK1 (t 7 = 2.91, P o0.05) but not pERK2, between behavior-naive ENT1 -/mice and DRL-conditioned ENT1 -/mice ( Supplementary Figures 9c and  12h). Taken together, these results again suggest that DRLmediated impulsivity has a significant effect on phosphorylation of ERK1/2 primarily in the dHip, as ERK1/2 phosphorylation in the NAc was not readily apparent based on these results ( Supplementary Figures 9a and c).
Hippocampal neuroblast proliferation is dampened in ENT1 -/mice Chronic ethanol has been shown to severely disrupt cell proliferation in the SGZ of the DG. 52 Given our reported association between ENT1 deletion and lower pERK1/2, in addition to the reported relationship between ERK and adult neurogenesis, 53,54 we investigated whether ENT1 -/mice displayed altered expression for markers of hippocampal cell proliferation and neuroblast development. As shown in Figure 5a, ENT1 − / − mice contain significantly fewer BrdU + -labeled cells within the SGZ of the DG, relative to WT (t 7 = 4.86, Po 0.01). Moreover, we detected decreased numbers of MCM2 + (t 7 = 5.48, P o0.01), an endogenous marker of cell cycle progression and MCM2 + DCX + (t 7 = 7.24, P o 0.01)-labeled cells in ENT1 -/mice, suggesting impairments in cell proliferation and neuroblast development resulting from ENT1 deletion (Figure 5b).
A 2A R inhibition-mediated impulsivity increases expression of markers for hippocampal neuroblast proliferation This report demonstrates that A 2A R inhibition can potentiate impulsivity, which has an effect of increasing ERK1/2 activity in the dHip. Given that ERK1/2 is associated with hippocampal neuroblast development, we sought to examine whether A 2A R inhibition is associated with the neuroblast proliferation. Remarkably, the number of BrdU + -labeled cells (Figure 5c; t 9 = 7.49, P o 0.001) and BrdU + DCX + co-labeled cells (Figure 5d) within the DG of ZM-241385-treated animals that exhibited increased impulsivity was significantly higher compared to vehicle (t 9 = 11.20, P o0.001). More importantly, a region-specific analysis identified that the increased neuroblast proliferation resulting from A 2A R inhibition occurs primarily in the dHip as BrdU + expression (t 9 = 3.94, P o 0.01) and BrdU + DCX + co-labeling (t 9 = 2.42, P o0.05) was significantly higher in the dHip ( Supplementary Figures 13a  and b), but not in the ventral hippocampus (vHip) ( Supplementary  Figures 13a and c).

DISCUSSION
Drugs of abuse promote maladaptive risk taking for the pursuit of immediate gratification although functionally impulsive risk taking confers an evolutionary advantage by encouraging the pursuit of unexpected opportunities. 55,56 In this study, we demonstrate that pharmacological inhibition of the adenosine A 2A R and ERK1/2 exacerbates waiting impulsivity, an essential predictor of alcohol use disorders. 57 More importantly, our results show an association of A 2A R antagonist-mediated increases in impulsivity and hippocampal neuroblast proliferation.
Although A 2A R hypofunction enhances synaptic plasticity and memory function, 16,58,59 hippocampal A 2A R activation is implicated in memory impairment and cognitive decline. 17 Our results indicate that A 2A R hypofunction in combination with heightened states of reward seeking can maladaptively exacerbate impulsive behavior in contexts, where reward gratification is unpredictable. Supporting this, A 2A R antagonism failed to induce impulsive goaltracking when reward gratification was not contingent on acquisition of conditioning. Similarly, when cue-signaled reinforcement was predictable during the 5-CSRTT, ZM-241385 did not induce impulsive sign-tracking responses. It is possible that inhibition of the A 2A R, which includes the effects of caffeine, may mediate increases in locomotion, 40,60,61 which when in combination with reward/reinforcement unpredictability, leads to compounded exploratory activity and exacerbations in impulsive reward-seeking behavior. Therefore, we posit that dysfunctional adenosinergic regulation can exacerbate the inherent cognitive dissonance between the drive for reward gratification and a reward, which may or may not be available. 62 Validating these observations, the alcohol preferring ENT1 -/mice demonstrated excessive goal-tracking impulsivity and faster reaction times in response to CS+, traits indicative of inadequate self-control reported in addiction. 6,63 Moreover, we revealed lowered A 2A R expression and decreased pERK1 (Thr-202) and pERK2 (Tyr-204) in the dHip of behavior-naive ENT1 -/mice. Interestingly, a similar decrease in pERK1/2 was observed in the dHip of behavior-naive mice following A 2A R antagonism. Several lines of evidence suggest that inhibition of ERK1/2 can increase behavioral excitement, decrease depressive-like symptomatology and produce marked hyperactivity. 22,64,65 In agreement, direct infusion of the MEK inhibitor U0126 into the dHip increased goaltracking impulsivity. The ability for ethanol to significantly dampen hippocampal pERK1 and pERK2, whereas notably exacerbating impulsivity strengthens our findings. Interestingly, the hippocampus-specific contribution of pERK1 and pERK2 to the regulation of impulsivity was underscored by the comparatively stable phosphorylation levels of these kinases within the NAc of naive and DRL-conditioned ENT1 -/mice as well as ZM-241385treated mice. This finding is surprising because patients with attention-deficit hyperactivity disorder and alcoholism have been demonstrated to exhibit hypoactivation of the ventral striatum during impulsive behavior. 7,66 Conversely, increased ventral striatal activity has been observed in normal individuals during impulsive performance. 67 Furthermore, recent in vivo electrophysiological studies examining accumbal activation of local field potentials during impulsive performance of the 5-CSRTT suggest that this brain region is activated during anticipation of cuesignaled reinforcement, movement to retrieve reinforcement, as well as during consumption of reinforcers. 68 One possibility for our inability to detect more obvious ERK1 and ERK2 phosphorylation changes in the NAc is that our results are derived from auditory CS +-controlled Pavlovian approach responses. This is in contrast to 5-CSRTT operant behavior, where visual cues control nosepoking behavior. Therefore, given the complexity of the overlapping cortical, striatal, sub-thalamic and amygdalar neural substrates, the molecular regulation of waiting versus decisional impulsivity may be differentially affected by behavioral task (that is, DRL versus delay discounting). 27,69,70 We and other investigators report that behavioral conditioning, as well as pharmacological and biochemical manipulation can alter ERK activity in a region-specific manner. [71][72][73] Interestingly, we also observed increased dHip pERK1 and pERK2 activity following repeated conditioning days for sucrose reward. Importantly, this increase in phosphorylation was not observed in mice that did not display impulsivity during non-contingency training, suggesting that pERK1 and pERK2 may have a biological rheostatic role adapting to risk taking behavior, much like CREB's reported function as an 'emotional rheostat' in response to stress, anxiety and depression. 74 Our results echo well-reported findings in cellculture studies as well as in global and conditional knockout systems indicating that although ERK1 and ERK2 are coded from different genes, each provides a redundant role for the other in terms of cell signaling and behavior. 75 However, alternative upstream and downstream effectors may also be having a role in affecting adenosine and ERK signaling (that is, PKA, CREB or ELK), and warrant further study. [76][77][78] Impairment of hippocampal neurogenesis is known to increase vulnerability for alcohol addiction and relapse. 24,52 Our results elucidate a novel regulatory role for adenosinergic signaling in the process of neuronal proliferation and maturation, as ENT1 -/mice exhibit a reduction of cells labeled with BrdU + and DCX + . Conversely, A 2A R antagonism potentiated cell proliferation and increased markers of neuroblast development in the dHip but not the vHip, suggesting a region-specific role in regulation of this process. Notably, several recent investigations have revealed a differential regulation of adult neurogenesis in terms of stressinduced depressive behavior along the dorso-ventral axis of the hippocampus. 79 In particular, rodent studies examining stressinduced depression-like behavior and antidepressant efficacy have elucidated specific involvement of the vHip, but not the dHip, in this process. 80,81 Our results yield indicate that A 2A R inhibition distinctly targets the dHip in terms of neuroblast proliferation and possibly subsequent adult neurogenesis, which Figure 5. Expression of markers for cell proliferation and neuroblast development in the hippocampal dentate gyrus (DG) is affected by ENT1 deletion and A 2A R inhibition-mediated impulsivity. (a) Representative confocal microscopy images and stereological quantification indicate that relative to WT, naive ENT1 -/mice have decreased numbers of BrdU + -labeled cells (green). DAPI (blue). Scale bar, 100 μm. (b) Relative to WT, naive ENT1 -/mice have decreased numbers of MCM2 + (green) DCX + (red)-labeled cells. DAPI (blue). Scale bar, 100 μm. All data are reported as mean ± s.e.m. (a, b) n = 5 brain sections per brain and n = 4-5 mice per genotype. *Po 0.01 by unpaired two-tailed Student's t-test. (c) Analysis of BrdU + -labeled cells (green) in 5-CSRTT-tested mice indicate overall higher numbers of BrdU + cells in mice administered ZM-241385 relative to vehicle. DAPI (blue). Scale bars, 100 μm. (d) Representative confocal microscopy images and stereological quantification indicate that in comparison to vehicle, mice administered ZM-241385 that displayed increased impulsivity during the 5-CSRTT exhibited higher numbers of BrdU + (green) DCX + (red) co-labeled cells. Thick arrows indicate representative individual BrdU + , DCX + and DAPI co-labeled cells (see insets). Thin arrows indicate the subgranular zone (SGZ) or the DG of the hippocampus. Scale bars, 100 μm. (c, d) n = 5-6 sections per brain and n = 5-6 mice per treatment. *P o0.001 by unpaired two-tailed Student's t-test. All data are reported as mean ± s.e.m. 5-CSRTT, 5choice serial reaction time task; DRL, differential reward of low rate; GCL, granular cell layer; H, hilus; ML, molecular layer; RM, repeated measures; WT, wild-type. seems to be associated with can enhanced impulsive reward seeking. Indeed, recent studies suggest that states of withdrawal induce craving for reward, which increase adult neurogenesis. 25,82 Although, we acknowledge that performance of the 5-CSRTT in this study was done while seeking a natural reward. This raises the possibility that the observed increases in cell proliferation and expression of immature neuroblasts may represent a natural process and not necessarily an aberrant process. However, we may surmise that a more potent addictive substance may aberrantly engage this process, which could lead to maladaptive drug seeking.
In summary, our results suggest that maladaptive impulsivity is potentiated by A 2A R hypofunction and pERK1/2 downregulation in the dHip. Moreover, we demonstrate that impulsivity is associated with increases in expression of markers indicative of the neuroblast proliferation specifically in the dHip. This process, which is known to be a critical precursor to adult neurogenesis, may be regulated through elevations in ERK activity. Thus, our findings suggest a novel role for the A 2A R in maladaptive impulsivity as well as potentially providing a new investigative avenue to examine the relationship between neurogenesis and reward seeking behaviors.