Abstract
In everyday life, it is often the case that in some situations we are motivated and want not only to speed up our actions but also to avoid mistakes—for example, ballgames. How our brain works at that moment to resolve the situations and react properly has created an active research field. Previous findings indicated that maintaining a balance between withholding and executing an action are highly dynamic and involve many executive control processes. This fMRI study was set up to investigate how motivation affects these balancing processes. With manipulation of prospective rewards in a stop-signal task where both the proactive and reactive control were equally emphasized, our behavioral results replicated previous findings. The fMRI findings backed up the behavioral results. We found motivation effects in the anterior caudate and pre-SMA for action inhibition. The former works to register motivation status, the latter works to transform motivation into action inhibition control. Together with the results of connectivity analysis, our study also suggests a hierarchical relationship between functional roles of pre-SMA and right inferior frontal gyrus during action inhibition. While the pre-SMA acts to accommodate higher-order factors, such as motivation, for action control, the right inferior frontal cortex acts to participate in the execution of action inhibition. This study pinned down a neural mechanism that integrates reward motivation into action inhibition control.
Similar content being viewed by others
Introduction
It is often the case that in certain circumstances, we would like not only to speed up our actions or movements but also, meanwhile, to avoid mistakes—for example, while playing ballgames. During a game, a precise, dynamic balance between speeding up actions and avoiding mistakes at the same time are key to winning. However, the question about how the motivation to win adaptively adjust our action control and subsequent behavior remains to be answered. To this end, a well-established paradigm for action control, i.e., the stop-signal task1, was exploited. In a stop-signal task, the participants are asked to make a motor response as fast as they can to a response cue (a go-trial), and occasionally, before action execution, a stop-signal appears to call for stopping the intended action (a stop-trial). For stopping, the time interval between the response cue and the stop-signal—i.e., the stop-signal delay (SSD)—is critical. The shorter the interval, the easier the stopping. Based on the go response distribution and the unsuccessful stopping rate, we can calculate the processing time of a stop-signal (i.e., the stop-signal reaction time, SSRT) according to the racing model1,2,3. Application of this task together with fMRI and motivation manipulation is feasible and which allows us to evaluate the neural mechanism underpinning balance calibration between action inhibition and activation initiated by reward motivation.
Recently, there are a series of studies conducted to investigate how motivation induced by reward prospect modulates implementation of action inhibition, which include behavioral, fMRI, and electrophysiological studies4,5,6,7,8,9,10,11. Most of these studies demonstrated that promoting inhibition-reward prospect in a reactive manner could result in SSRT reduction4,5,6,7, 10. The finding is important because, without explicit instructions of proactive strategic preparation, it discloses the fact that reward prospect can facilitate processing of stop-signals that appear in a sudden and improve subsequent cancellation efficiency to an already-planned action in a very short period (~200 ms). The studies also indicate that although the stop-signals appear in a reactive manner, inhibition-reward prospect impacts not only on reactive control but also on proactive control to enhance reward-related inhibition processing and perceptual processing in general. Evidence for the former impact includes electrophysiological (the P3 effect)4, 5 and fMRI results7, which indicates that reward prospect regulates activities of the neural substrates, such as the pre-supplementary motor area (pre-SMA), for action inhibition. fMRI data also showed higher activity in ventral striatum when comparing brain activities associated with the rewarded stop-trials to those of the unrewarded stop-trials7. On the other hand, reward prospect proactively brought about top-down, attentional effects on early visual processing component (the N1 component), associated with the go stimuli of the stop-trials and the go-trials4, 5, 8. Altogether, these studies point out that, when motivated, regulation effects from reactive and proactive control intermingle with each other, and segregation of these two effects is practically intractable.
We know well that motivation affects behavior by driving us to approach rewards and to avoid punishment12. During the course, motivation either can facilitate our cognitive processing, and then speed up our actions by energizing the operation system13, 14 or it can cause rescheduling of priorities of various action goals15. It, therefore, leads to control over behavior through its linkage with various cognitive control systems, including working memory16, task-switching17, selective attention9, and action control18, 19. For neural substrates, in a recent review, the authors concluded that the ventral striatum and the medial prefrontal cortex are the two brain areas to host integration of cognitive control and motivation driven by reward20. However, please note that in those reviewed studies motivation strength and reward value closely coupled, which seriously complicates the interpretation of motivation effects. Recent evidence has indicated that motivation and reward value are dissociable in human striatum activities21. While activities in the caudate and putamen increase with motivation, nucleus accumbens activity increases with reward value. Therefore, because of the coupling between motivation and reward value, the conclusion aforementioned is not conclusive. The question about how the linkage between motivation and cognitive control for action works awaits further elucidation.
In this study, in order to avoid the involvement of intractable segregation between reactive and proactive control and the coupling between motivation strength and reward value, two critical experimental procedures were adopted. First, because of our major interest in the relationship between motivation and implementation of action inhibition, instead of segregation, we emphasized both reactive and proactive control at the same time by including a reward manipulation. To motivated the participants, they were told that they could earn an extra bonus (NT$2,000, about US$66.70) if their averaged action speed of the go-trials reached a given criteria that was established individually in a practice session. At the same time, they needed to be careful not to commit the stop-trial errors because there was a penalty—i.e., a loss of NT$40 (about US$1.30) per error from the possible bonus. By doing so, we created a situation where both the reactive and proactive control were encouraged altogether. The processing to maintain the balance between to go and to stop would be enhanced. Second, we employed a staircase-tracking procedure for the experimental task, by which we could fix the amount of final reward to all participants. The staircase-tracking procedure dynamically adjusts the SSD to maintain the response rate of stop-trials to be 50%, based on trial-by-trial stopping performance of the individuals2. The initial intent of the procedure was to improve the precision of SSRT estimates2, 3, 22. It also provides a feasible way for the current study to fix the amount of reward value for all participants. (See Methods for more details.) Based on this control for the stop-trial response rate (~50%), we could fix the amount of the reward and, therefore, avoid the coupling between motivation and reward value. Our design was in line with a previous study11, where the authors suggested that high task motivation can modulate proactive pre-stimulus inhibition of the go response. Their simulation results indicated, when task motivation was elevated, participants calibrate their timing in order to maximize the overall chance of success, including timely responses on go-trials as well as successfully inhibited stop-trials. The process of calibration, therefore, can result in a less positively skewed distribution of the go reaction time.
Neural substrates relevant to processing action inhibition have been depicted in many neuroimaging studies, and they comprise a fronto-basal-ganglia network including the right inferior frontal gyrus, pre-SMA, striatum, and the subthalamic nucleus (STN)23, 24. Many efforts have been devoted to investigating the functions of these areas and how they interact with each other as well25,26,27,28,29. For cortical areas of the network, research indicates that when there is a stopping process commencing from detection of a stop-signal, the right inferior frontal gyrus signals and commands the basal ganglia to stop the intended action23. Activity of this area negatively correlates with the individual’s SSRT30,31,32, which points to a direct, functional role of this area in controlling action inhibition. Another cortical area of the network, i.e., the pre-SMA, has functional and structural connections to the right inferior frontal gyrus24, 28, 33 and a structural connection to the basal ganglia input nuclei—i.e. the striatum34 and STN24. Transcranial direct current stimulation (tDCS) over the pre-SMA can affect stopping performance35. Instead of direct control, the pre-SMA seems to affect stopping performance in an indirect manner. For example, there is research28 showing that, by studying a medically intractable epileptic patient with intracranial grid coverage of the pre-SMA and right inferior frontal gyrus, stimulation of the pre-SMA evoked strong local field potentials within 30 ms in the right inferior gyrus. It also showed increased high gamma amplitude in both regions for preparation for stopping, with pre-SMA preceding right inferior frontal gyrus by ~750 ms. Moreover, it can represent motivation for a specific action in nonhuman primates and encode psychological states related to motivation, such as intention in humans7, 36. The results suggested a functional hierarchy of the pre-SMA and right inferior frontal gyrus in the stopping network. However, effective connectivity analysis from another study26 with a large fMRI data set suggested hierarchy of the two areas in the opposite direction. Therefore, although there are studies discussing their functional role and relationship in action inhibition25,26,27,28, the current status of how the pre-SMA and right inferior frontal gyrus interact to contribute to stopping an intended action, especially when motivation is highly engaged, is not yet clear, and it thereby inspires the current study.
In this study, for comparison, we included a control condition in which all its procedures were the same to those applied in the target situation except for the reward manipulation. The participants’ motivation level should be higher in the target situation and relatively lower in the control situation. Here, first, in light of previous computational model11, we specifically examined the skewness of RT distribution to test whether there is any proactive modulation effect on manipulation. Second, based on previous findings7, 36, 37 that the pre-SMA can represent motivation and encode psychological states related to motivation, we expected that pre-SMA activity would be influenced by motivation—i.e., the reward manipulation—and show responses in differential amplitudes to the stop-signals under different motivation contexts. Thirdly, based on the observations23, 30,31,32 that the right inferior frontal gyrus was more intrinsically, directly related to action inhibition ability, we also expected the right inferior frontal activities underlying successful stopping should negatively correlate with the SSRTs. By administering functional connectivity analysis, we planned to examine connectivity fluctuation between conditions, which could help to elucidate functional hierarchy of the pre-SMA and right inferior frontal gyrus.
Material and Methods
Participants
Eighteen healthy college students (mean age, 22; 10 males) took part in the experiment. All participants were neurologically intact, right-handed and had normal or corrected-to-normal vision. Informed consent was obtained before MR scanning from all participants, with the protocol approved by the Institutional Review Board of National Yang-Ming University. All experiments were performed in accordance with relevant guidelines and regulations. Participants received NT$500 (about US$16.68) for their participation. One data set was excluded from further analysis because the participant could not follow the instructions for completing two scanning sessions of the task.
Stimuli and procedure
The stimuli were arranged and presented with the software E-Prime 2.0 (version 2.0.8.90, Psychology Software Tools Inc., Sharpsburg, PA, USA). Two geometric figures were used as response cues: a rhombus denoting a key press by the left index finger, and a pentagram denoting a key press by the right index finger. The mappings between response cues and effectors were counterbalanced across the participants. For stop-trials, a red cross (i.e., an X) was adopted to signal for stopping. All stimuli were centrally presented on the screen with a visual angle of about 1 degree. For any given trial, it started with a central fixation for a short period and then was replaced by a response cue—i.e. a rhombus or a pentagram—lasting for 1,000 ms for response. A stop-signal would superimpose on the response cue after a period of delay if it were arranged to be a stop-trial. Both response cues appeared equally as often in any trial type. The participants were instructed to respond to response cues as fast as they can and to stop the planned action as accurately as possible when a stop-signal appeared. Behavioral responses were recorded with an MR-compatible recording system.
There were two practice sessions before the fMRI scan. The first practice session included 60 go-trials, which allowed the participants to get familiar with the experimental setup and allowed us to collect their reaction times and set up an individual reaction-time baseline. The second session included 42 go-trials and 18 stop-trials, in which trials of the two types were randomly intermixed for practice. After practice, two fMRI scans were performed, one with and one without monetary manipulation. The sequential order of the two fMRI scans was counterbalanced across participants. Instruction of experimental condition was given at the beginning of each san. In each scan, there were 300 experimental trials, including 200 go-trials and 100 stop-trials. In order to increase efficiency and robustness for parameter estimation, there were 100 null trials included.
For stopping, we applied a one-up-one-down staircase-tracking procedure to adjust the SSDs of the stop-trials dynamically. The duration of the initial SSD was set at 200 ms. The SSD of the next stop-trial would be lengthened by 34 ms if the participants could withhold their response for the current stop-trial. If they could not, the next SSD would be shortened by 34 ms. In this way, we could control the response rate of the stop-trials at about 50%. For all participants, instructions were given at the beginning of the experiment. In the high-motivation situation, they were offered a bonus (NT$2,000, about US$66.70) if their averaged reaction time of the go-trials reached a given criterion established individually from the first practice session. In the meantime, the participants also needed to try to avoid error commitment for any stop-trials because there was a penalty for not being able to stop their action correctly—i.e., a loss of NT$40 (about US$1.30) per error from the possible bonus. In the control situation—i.e., the low-motivation situation—there was no bonus and penalty in company with their behavioral performance. However, the speed of the go-trials and accuracy of the stop-trials were still emphasized. In average, the payout was NT$28.2 (about US$0.94) in the high motivation condition.
Image acquisition
Scanning was performed using a 3 T MRI (Tim Trio, Siemens, Erlangen, Germany) with a 32-channel head coil. Participants’ heads were immobilized with a vacuum-beam pad. A T2*-weighted gradient-echo echo planar imaging (EPI) sequence was used for fMRI scanning, with slice thickness = 3.4 mm, in-plane resolution (64 × 64) = 3.4 × 3.4 mm, and TR/TE/θ = 2,000 ms/30 ms/90°. Thirty-three axial slices were acquired to cover the whole brain. For each slice, 406 images were acquired in one run, lasting for about 14 minutes. The first two volumes of each run were discarded for signal equilibrium. Each participant’s anatomical image was acquired using a standard MPRAGE sequence (repetition time/echo time/inversion time [TR/TE/TI] = 2,530/3.03/1,100 ms, flip angle = 7°, partition thickness = 1 mm, image matrix = 256 × 256, 192 partitions, field of view = 22.4 cm × 22.4 cm) for within-subject registration purposes. The total duration of the experiment was approximately 45 minutes.
Image processing and statistical analysis
Image data were preprocessed and analyzed using SPM software (http://www.fil.ion.ucl.ac.uk/spm/software/spm8). Functional images were corrected for slice timing and head motion, normalized to the MNI space, and spatially smoothed with an 8-mm FWHM Gaussian kernel. After pre-processing, the images were resliced into a resolution of 2 × 2 × 2 mm for each voxel. Statistical analysis was performed with the GLM approach and followed a two-level procedure. At the individual first-level analysis, the successful stop-trials (SST), the unsuccessful stop-trials (USST), the correct go-trials (GO), the trials of error, and the six movement parameters under the low- and high-motivation situations were included as regressors for estimation. Effects of interest were examined with the contrasts constructed by linear combination of beta estimates of the regressors. Contrast images of the SST, the USST, and the GO under high- and low-motivation situations were derived and entered into the second-level analysis for group results. At the second level, several comparisons were conducted to examine motivation effects on the SST, the USST, and the GO. For the GO, a paired-t test was used. For the SST and USST, a 2 × 2 flexible ANOVA analysis was administered. Unless stated otherwise, activations were thresholded at voxel level p < 0.005 and corrected at cluster level with an FWE p < 0.05. Therefore, inferences of the imaging results should base on the level of the entire cluster. All coordinates were reported in the MNI coordinate space.
ROI and functional connectivity analysis
To avoid the non-independence error for ROI analysis, a leave-one-subject-out (LOSO) procedure was applied to define the ROIs38. In the procedure, the ROIs used for each participant were defined by the group results from the rest of the participants. For example, here, we had seventeen participants. Coordinates of the ROIs used for the first participant were defined by the group results of the rest (another sixteen) participants. Therefore, we iteratively performed the same procedure for all participants to build their ROIs for further analysis. In this study, there were three ROIs of interest to be defined: one in the medial prefrontal cortex (i.e., the pre-SMA), one in the right inferior frontal gyrus, and one in the caudate structure. In the results, we found significantly higher activities in the pre-SMA and caudate for the SST in the high motivation condition (see the Results section). With our specific interest and its given characteristics in action inhibition, the right inferior frontal gyrus was selected as one of the ROIs. Its center coordinate was defined by looking for the intersection point of the stopping main effects (i.e., the SST and USST under both conditions) in the right inferior frontal gyrus. Regarding the pre-SMA and right inferior gyrus ROIs, a spherical volume with a radius of 6 mm was applied to cover the target areas. For the caudate ROI, because of bilateral activation, a spherical volume with a radius of 4 mm was applied to the left and right caudate areas, and centered at the coordinate of the peak activity, respectively. Beta estimates of the regressors (the SST and USST) were extracted from the three ROIs. A simple linear regression analysis was performed to test if activities of the pre-SMA and right inferior frontal ROIs correlated with individuals’ SSRT from the two motivation situations, respectively. A repeated ANOVA was performed to examine activities of the pre-SMA and caudate ROIs with motivation and stopping success as two within-subject factors.
Functional connectivity by seeding from the pre-SMA ROI was examined using the psychophysiological interaction (PPI) method39. In this study, we employed a generalized form of context-dependent PPIs (gPPIs) that has the flexibility to accommodate more than two conditions in the same PPI model40. We obtained estimates of neural activities from the seeding region by deconvolving the extracted BOLD signals. The psychological vectors used in the PPI analysis include regressors of the SST, the USST, and the GO under high- and low-motivation situations. The physiological, psychological and PPI vectors were then convolved with the canonical hemodynamic response function and entered as regressors at a first-level general linear model. For the effects of our interest, two PPI contrasts were created: 1) the SST versus the USST during the high-motivation situation, and 2) the SST versus the USST during the low-motivation situation. The contrast images from all participants were examined using a paired t-test at the second level. The results were thresholded at voxel level p < 0.005 and corrected at cluster level with an FWE p < 0.05.
Results
Behavioral data
To examine the motivation effect over action control, error rates and reaction times of the GO, reaction times of the USST, and SSRTs under the high- and low-motivation situations were calculated (see Table 1 for the details). Application of the staircase-tracking procedure for SSD adjustment yielded an action inhibition rate of about 50%. The SSRT was derived using the integration method2, 3, by which the mean SSD is subtracted from the RT of the nth go-trial, in which n is calculated by multiplying the total number of the correct go-trial with the responding rate of the stop-trials (about 50%).
For the GO, most errors were omission errors, and the error rate was higher in the low-motivation situation than in the high-motivation situation (3.21% vs. 1.59%; t(16) = 3.541, p = 0.001). Although the two averaged RTs of the two situations were not significantly different (571 ± (s.d.) 96 ms for low motivation, 559 ± 83 ms for high motivation; t(16) = 1.001, p = 0.166), the RT distribution of the GO from the high-motivation situation is less positively skewed (low-motivation skewness = 0.341, high-motivation skewness = 0.245; t(16) = 2.148, p = 0.046).
For the stop-trials, RTs of the USST from the two situations were significantly shorter than those of the GO from the two situations (low-motivation: 523 ± 76 ms vs. 571 ± 96 ms; t(16) = 7.684, p < 0.001; high –motivation: 507 ± 68 ms vs. 559 ± 83 ms; t(16) = 10.084, p < 0.001). The inhibition rates were 52.35% and 52.41%, and the estimated SSRTs were 216 ms and 222 ms for the low- and high-motivation situations, respectively. The difference between the two estimated SSRTs is not significant (t(16) = 0.946, p = 0.179).
fMRI data
The main effects
The GO resulted in activities in the precentral gyrus, premotor cortex, supplementary motor areas (SMA), superior temporal cortex, right superior parietal cortex, cerebellum, as well as subcortical regions such as the caudate, putamen, globus pallidum, and thalamus (the upper part of Fig. 1). Both the SST and USST caused activities in the precentral gyrus, medial frontal gyrus, anterior cingulate cortex, middle prefrontal gyrus, inferior frontal gyrus, inferior parietal cortex, middle occipital gyrus, cerebellum, and basal ganglia (the lower part of Fig. 1).
Main effects for the GO and stop-trials in the low-motivation situation. (the upper part) The GO resulted in activities in the precentral gyrus, premotor cortex, supplementary motor areas (SMA), superior temporal cortex, right superior parietal cortex, cerebellum, as well as subcortical regions such as the caudate, putamen, globus pallidum, and thalamus. (the lower part) Both the SST and USST caused activities in the precentral gyrus, medial frontal gyrus, anterior cingulate cortex, middle prefrontal gyrus, inferior frontal gyrus, inferior parietal cortex, middle occipital gyrus, cerebellum, and basal ganglia.
To examine whether motivation had exerted its effect over the GO, the SST, and the USST, we compared effects of the three trial types from the high- to the low-motivation situations and presented the results as follows.
Motivation modulation over the GO
Compared to the low-motivation situation, the GO activities from the high-motivation situation were greater in the right premotor, right superior parietal lobule, postcentral gyrus, and bilateral cerebellum (see Fig. 2 and Table 2). Greater activities in the fronto-parietal network suggested that the participants were more engaged and paid more attention to the response cues.
Motivation modulation over the GO. Compared to the low-motivation situation, the right PM and right SPL, parts of the fronto-parietal networks, were found to show greater activation during the GO in the high-motivation situation. Greater activities in the fronto-parietal network suggest that the participants were engaged and paid more attention to the response cues when they expected to be rewarded.
Motivation modulation over the SST and the USST
Motivation modulation over the SST and the USST were separately examined. For the former, greater activities in the anterior caudate and pre-SMA were found for the high-motivation situation (see Fig. 3a,b). However, for the latter, there was no significant motivation effect. In order to inspect activities of the caudate and pre-SMA in more details to test our hypotheses, parameter estimates of the two areas were extracted and further submitted to an ROI analysis.
Motivation effects over the stopping processing. Greater activities in the anterior caudate (a) and pre-SMA (b) were found during SSTs for the high-motivation situation. To inspect activities of the anterior caudate and pre-SMA in more detail, parameter estimates of the two areas were extracted and examined by within-factors ANOVA analysis. The anterior caudate (a) only shows the motivation main effect, indicating activities of this area were greater when motivation was high, regardless of inhibition success. For the pre-SMA (b), brain activity of the SST was higher than that of the USST in the high-motivation situation, but no difference was seen in the low-motivation situation. (HM = high motivation; LM = low motivation).
ROI and functional connectivity analysis
Figure 4 shows the results of simple regression analysis that was planned for the right inferior frontal gyrus and the pre-SMA. In the right inferior frontal gyrus, there was a negative correlation between SSRT and its activity of the SST in the low-motivation situation (r = −0.537, t = −2.463, p = 0.026), but not in the high-motivation situation (r = 0.197, t = 0.780, p = 0.447). In the pre-SMA, no correlation between SSRT and its activity of the SST was revealed in either situation (low-motivation: r = −0.055, t = −0.213, p = 0.834; high-motivation: r = −0.020, t = −0.077, p = 0.939). For the USST, neither rIFG (low-motivation: r = −0.317, t = −1.294, p = 0.215; high-motivation: r = 0.233, t = 0.927, p = 0.447) nor pre-SMA (low-motivation: r = 0.171, t = 0.671, p = 0.513; high-motivation: r = 0.090, t = 0.348, p = 0.732) showed the correlation between SSRTs and its activities.
Correlation between the SSRTs and BOLD signals extracted from the right inferior frontal gyrus (left) and pre-SMA (right). In the right inferior frontal gyrus, a negative correlation between the SSRT and its activity of the SST showed in the low-motivation situation (r = –0.504, t = –2.260, p = 0.039), but not in the high-motivation situation (r = 0.322, t = 1.320, p = 0.207). It suggested that the right inferior frontal gyrus works to direct action inhibition in regular situations. However, when motivated by reward prospect, it results in decorrelation between activity in the right inferior frontal gyrus and the SSRT. Neither the USST nor the pre-SMA, no correlation displayed with the SSRTs. (HM = high motivation; LM = low motivation).
For the anterior caudate, motivation (high and low) and inhibition success (the SST and the USST) were included as two within-subject factors for an ANOVA analysis. There was only a main effect revealed—i.e., the motivation (F(1, 16) = 13.259, p = 0.002). The activities of this area were greater when motivation was high, regardless of inhibition success (see Fig. 3a).
In respect of the pre-SMA, motivation (high and low) and inhibition success (the SST and the USST) were included for two variables for analysis as well. Both the main effects of motivation and inhibition success (motivation: F(1, 16) = 6.458, p = 0.022; inhibition success: F(1, 16) = 8.877, p = 0.009) and the interaction effect (F(1, 16) = 5.157, p = 0.037) were significant. Brain activity of the SST was higher than that of the USST in the high-motivation situation (simple main effect using paired-t test with a Bonferroni adjustment: t(16) = 3.891, p = 0.002), but no difference was seen in the low-motivation situation (see Fig. 3b).
Given that the pre-SMA is a part of the stopping network and plays an important role in action control25,26,27,28, functional connectivity of the pre-SMA with other brain areas was examined using a generalized context-dependent psychological interaction analysis method40. When applying the psychological contrast of SST versus USST, the results indicate that positive coupling between pre-SMA activity and activities of the right posterior IFG (BA45), anterior caudate and right posterior superior temporal sulcus (pSTS) was stronger in the high-motivation situation than in the low-motivation situation (see Fig. 5 and Table 3).
Brain areas showing strengthened coupling with the pre-SMA between motivation levels. In comparison to the task when participants were not motivated, the right pIFG, anterior caudate and pSTS showed strengthened coupling with the pre-SMA in the psychological contrast of SST versus USST when participants were motivated. Activations were thresholded at voxel level p < 0.005 and corrected at cluster level with a FWE p < 0.05. (pIFG = posterior inferior frontal gyrus; AC = anterior caudate; pSTS = posterior superior temporal sulcus.
Discussion
The aim of this study was to investigate the linkage between motivation and action inhibition control by incorporating a reward manipulation with a stop-signal task and to examine its neural underpinnings by using fMRI. We learned from previous studies that segregation between reactive and proactive control is intractable and coupling between motivation strength and reward value can be dissociable. In the current study, first, instead of segregation, we emphasized reactive and proactive control at the same time during the task. Secondly, we fixed the amount of final monetary reward to all participants to avoid this coupling by applying a staircase-tracking procedure. Our results could help elaborate how reward motivation regulates the implementation of action inhibition.
Behavioral data
With the emphasis on both proactive and reactive control during the task, we found two motivational effects. First, missing rate of the GO was lower in the high-motivation situation, suggesting that the participants were motivated and became more alert to the response cues. Second, the GO RT distribution of the high motivation condition was less positively skewed, which corroborated the expectation suggested by a previous computational model11. The less positive skewness means that the participants apply a strategy to better balance their wobbling between fast going and accurate stopping. In the high motivation condition, both attempts of the participants to respond quickly and to stop accurately should compete much harder. The participants would develop a strategy to balance fast response and accurate stopping to maximize reward availability, through calibrating their timing for response. Balancing the two competing forces, therefore, result in a shift of the GO RT distribution to become more symmetric, but not reduction in the GO RT and SSRT. On the other hand, motivation may also exert its influence at the pre-stimulus stage11 or proactively promote the efficiency of subsequent perceptual processing in general4, 5, 8, instead of direct impact on the stopping itself.
We are aware that there have been studies showing that SSRT can be either shortened or lengthened by manipulations to bias the participants’ response strategy4,5,6,7, 9, 10. The SSRT becomes shorter when the SST is rewarded. On the other hand, the SSRT becomes longer when the GO is going to be rewarded. In other words, relative to a proactive relevance as shown in ours and Liddle et al.’s11 study, when there is a reward selectively offered to a particular response, it results in a response bias and a subsequent reactive SSRT change. However, when a more thorough inspection was administered, although there were SSRT changes, both effects of reactive and proactive control evolved and mingled along the course4,5,6,7, 9, 10. Segregation of the two effects is intractable. Therefore, in our study, we paved a way in a more natural sense to examine how reward motivation regulates implementation of action inhibition in a stop-signal task. Although the newly established balance was invisible in behavioral data, fMRI data could help delineate how we calibrated the balance from its neural aspect.
fMRI data
The fMRI results brought us fruitful information to scrutinize effects of reward motivation over action inhibition and relevant processes. There were two main motivation effects, i.e., the reactive inhibition and proactive facilitation. We examined the former by looking at motivation modulation over the SST and the latter by taking a close look at motivation modulation over the GO. Results of functional connectivity provided grounding information to address functional hierarchy of the pre-SMA and right inferior frontal gyrus in inhibition control.
Motivation modulation over the GO
For the GO, the fronto-parietal networks revealed greater activation in the high-motivation situation. Since the GO was randomly presented and occupied a large proportion of the experimental trials (66.67%), this finding suggested that the reward motivation caused higher engagement of cognitive control of the participants. It lays a neural foundation for the observations that the participants are more alert to the response cues and, therefore, commit fewer missing errors during the task. This finding is consistent with a recent study that was conducted to describe the function of the dorsal fronto-parietal networks while performing goal-directed actions41. In our case, in order to better balance rapid response and accurate stopping, the dorsal fronto-parietal networks for controlling and monitoring the participants’ behaviors were more engaged. This finding soundly agrees with the inference of setting a balance to maximize the reward prospect11. It also concurs with the electrophysiological findings that indicate the involvement of attentional/proactive control in a stop-rewarded situation5, 8.
Motivation modulation over the SST
We found stopping-related activities in a wide range of brain areas distributed in the frontal and parietal cortices, and subcortical structures, which replicated a number of previous findings about action inhibition7, 9, 24, 26, 28, 30, 42,43,44. However, only the pre-SMA and anterior caudate were disclosed as showing a motivation effect. Regarding the anterior caudate, its activity is shown to be sensitive to motivation, but indifferent to inhibition success (see Fig. 3a). Higher motivation resulted in higher activity for both the SST and the USST, suggesting that this area registers motivation status and subsequently forwards this message to the motor/action control systems. There is evidence supporting this idea. In nonhuman primates, the caudate incorporates reward anticipation in oculomotor control45,46,47,48. Human functional imaging studies reveal that the caudate activities can represent reward information in goal-directed actions49,50,51. Therefore, the function manifested here for the anterior caudate is to register motivation status, which is also consistent with observations of functional segregation in the human striatum21.
The pre-SMA is another area surviving from the contrast as the anterior caudate does, suggesting a functional relevance between these two areas. This relevance confirms previous observations that the pre-SMA has structural and functional connections to the anterior caudate34, 50, 52, 53. Together with co-activation of the anterior caudate, we propose that the anterior caudate prospectively transforms its motivation effect into influence over the pre-SMA. Indeed, there is supportive evidence for this proposal. Neurophysiological recording of rhesus monkeys shows that a class of pre-SMA neurons can represent motivation for a specific action37. In humans, pre-SMA activity is found to be able to encode psychological states related to motivation, such as intention36. In this current study (see Fig. 3b), the pre-SMA activity was higher for the SST than for the USST only when motivation was high. It points to a possibility that, when motivated (receiving reward message from anterior caudate), the pre-SMA will strengthen its communication with downstream action-inhibition circuits to improve stopping efficiency to an intended action. Activity fluctuations of this area, thus, give a substantial influence on inhibition success.
Regression analysis to test correlations between the individuals’ SSRT and both their pre-SMA and right inferior frontal activities provides information from another perspective to examine how the stopping processes proceed. The results only showed a significant negative correlation between the SSRT and right inferior frontal activity in the low-motivation situation (see Fig. 4). This finding replicated the results of several previous studies30,31,32, revealing that the right inferior frontal gyrus works to direct action inhibition. It is interesting and noteworthy that this correlation becomes weaker when the participants were motivated, implying that the motivation here‒i.e., winning more money‒will perturb action inhibition directed by the right inferior frontal control. This perturbation can be more easily realized and explained when taking into account the pre-SMA seeded PPI results.
Connectivity among areas
The PPI analysis indicated that the pre-SMA shows a stronger coupling with the right inferior frontal cortex in the high-motivation situation. That is, motivation gives its influence to action inhibition by modulating the connectivity between the pre-SMA and the right inferior frontal gyrus. Taken together with the regression results, the indication is that the inferior frontal control over action inhibition holds in regular situations. However, when motivated by reward prospect, in order to establish a new balance11, the pre-SMA seems to inform the right inferior frontal gyrus and reshape its control over action inhibition, which results in decorrelation between its activity and the SSRT. Our findings, in general, are consistent with a recent study that describes the indirect role of the pre-SMA in stopping action27 and other studies that show structural and functional connections between the pre-SMA and the prefrontal cortex24, 28, 33, 36, 52, 54.
The PPI results indicated the pre-SMA activity also coupled with activities of the pSTS and the anterior caudate. The finding of the anterior caudate replicates the relevance demonstrated in the contrast of the SSTs under high- and low-motivation situations. However, the findings on the pSTS, although unexpected, are understandable. We know that the pSTS is crucial for understanding and coding our actions55,56,57,58,59. In this study, our participants might have been more concerned with and, therefore, more aware of their action status when there was a prospective reward expected. This finding suggests the existence of this awareness. However, further investigation is needed to confirm this conjecture.
Conclusion
Understanding the neural underpinnings of the linkage between motivation and action control has attracted much attention and invited many studies for research. In this fMRI study, rather than segregation, we emphasized reactive and proactive control at the same time to pave a more natural way to inspect motivational effects on action inhibition. To do this, we adopted a stop-signal task together with manipulation of prospective rewards. With avoidance to the coupling between motivation strength and reward value, our behavioral data support the concept that motivation introduces establishment of a new balance between fast response and accurate stopping11. The fMRI findings back up the behavioral results. Establishment of a new balance draws on involvement of the fronto-parietal networks. For processing stop-signals, the motivation effect takes place in the anterior caudate and pre-SMA. The former works to register motivation status, whereas the latter works to transform motivation into action inhibition control. The results of our correlation and connectivity analysis suggest a hierarchical relationship between functional roles of the pre-SMA and right inferior frontal gyrus during action inhibition. While the pre-SMA acts to accommodate higher-order factors—such as motivation—for action control, the right inferior frontal cortex acts to participate in execution of action inhibition directly.
References
Logan, G. D. & Cowan, W. B. On the ability to inhibit thought and action: A theory of an act of control. Psychological review 91, 295 (1984).
Band, G. P., van der Molen, M. W. & Logan, G. D. Horse-race model simulations of the stop-signal procedure. Acta Psychol (Amst) 112, 105–142 (2003).
Verbruggen, F., Chambers, C. D. & Logan, G. D. Fictitious inhibitory differences how skewness and slowing distort the estimation of stopping latencies. Psychol Sci 24, 352–362 (2013).
Greenhouse, I. & Wessel, J. R. EEG signatures associated with stopping are sensitive to preparation. Psychophysiology 50, 900–908 (2013).
Schevernels, H. et al. Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task. NeuroImage 121, 115–125 (2015).
Boehler, C. N., Hopf, J. M., Stoppel, C. M. & Krebs, R. M. Motivating inhibition - reward prospect speeds up response cancellation. Cognition 125, 498–503, doi:10.1016/j.cognition.2012.07.018 (2012).
Boehler, C. N., Schevernels, H., Hopf, J. M., Stoppel, C. M. & Krebs, R. M. Reward prospect rapidly speeds up response inhibition via reactive control. Cognitive, affective & behavioral neuroscience 14, 593–609, doi:10.3758/s13415-014-0251-5 (2014).
Langford, Z. D., Schevernels, H. & Boehler, C. N. Motivational context for response inhibition influences proactive involvement of attention. Scientific reports 6 (2016).
Padmala, S. & Pessoa, L. Interactions between cognition and motivation during response inhibition. Neuropsychologia 48, 558–565, doi:10.1016/j.neuropsychologia.2009.10.017 (2010).
Leotti, L. A. & Wager, T. D. Motivational influences on response inhibition measures. Journal of experimental psychology. Human perception and performance 36, 430–447, doi:10.1037/a0016802 (2009).
Liddle, E. B. et al. Looking before you leap: a theory of motivated control of action. Cognition 112, 141–158, doi:10.1016/j.cognition.2009.03.006 (2009).
Pessoa, L. How do emotion and motivation direct executive control? Trends in cognitive sciences 13, 160–166 (2009).
Duffy, E. Activation and behavior (Wiley, 1962).
Hull, C. L. A behavior system; an introduction to behavior theory concerning the individual organism (Yale University Press, 1952).
Simon, H. A. Motivational and emotional controls of cognition. Psychological review 74, 29–39 (1967).
Pochon, J. B. et al. The neural system that bridges reward and cognition in humans: an fMRI study. Proc Natl Acad Sci USA 99, 5669–5674 (2002).
Etzel, J. A., Cole, M. W., Zacks, J. M., Kay, K. N. & Braver, T. S. Reward Motivation Enhances Task Coding in Frontoparietal Cortex. Cerebral cortex 26, 1647–1659, doi:10.1093/cercor/bhu327 (2016).
Isoda, M. & Hikosaka, O. Switching from automatic to controlled action by monkey medial frontal cortex. Nature neuroscience 10, 240–248, doi:10.1038/nn1830 (2007).
Shima, K. & Tanji, J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282, 1335–1338 (1998).
Botvinick, M. & Braver, T. Motivation and cognitive control: from behavior to neural mechanism. Annual review of psychology 66, 83–113, doi:10.1146/annurev-psych-010814-015044 (2015).
Miller, E. M., Shankar, M. U., Knutson, B. & McClure, S. M. Dissociating motivation from reward in human striatal activity. Journal of cognitive neuroscience 26, 1075–1084, doi:10.1162/jocn_a_00535 (2014).
Congdon, E. et al. Measurement and reliability of response inhibition. Frontiers in psychology 3, 37, doi:10.3389/fpsyg.2012.00037 (2012).
Aron, A. R., Robbins, T. W. & Poldrack, R. A. Inhibition and the right inferior frontal cortex: one decade on. Trends in cognitive sciences 18, 177–185, doi:10.1016/j.tics.2013.12.003 (2014).
Aron, A. R., Behrens, T. E., Smith, S., Frank, M. J. & Poldrack, R. A. Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI. The Journal of neuroscience: the official journal of the Society for Neuroscience 27, 3743–3752, doi:10.1523/JNEUROSCI.0519-07.2007 (2007).
Cai, W., George, J. S., Verbruggen, F., Chambers, C. D. & Aron, A. R. The role of the right presupplementary motor area in stopping action: two studies with event-related transcranial magnetic stimulation. Journal of neurophysiology 108, 380–389, doi:10.1152/jn.00132.2012 (2012).
Duann, J. R., Ide, J. S., Luo, X. & Li, C. S. Functional connectivity delineates distinct roles of the inferior frontal cortex and presupplementary motor area in stop signal inhibition. The Journal of neuroscience: the official journal of the Society for Neuroscience 29, 10171–10179, doi:10.1523/JNEUROSCI.1300-09.2009 (2009).
Neubert, F. X., Mars, R. B., Buch, E. R., Olivier, E. & Rushworth, M. F. Cortical and subcortical interactions during action reprogramming and their related white matter pathways. Proc Natl Acad Sci USA 107, 13240–13245, doi:10.1073/pnas.1000674107 (2010).
Swann, N. C. et al. Roles for the pre-supplementary motor area and the right inferior frontal gyrus in stopping action: electrophysiological responses and functional and structural connectivity. NeuroImage 59, 2860–2870, doi:10.1016/j.neuroimage.2011.09.049 (2012).
Jahfari, S. et al. Effective connectivity reveals important roles for both the hyperdirect (fronto-subthalamic) and the indirect (fronto-striatal-pallidal) fronto-basal ganglia pathways during response inhibition. The Journal of neuroscience: the official journal of the Society for Neuroscience 31, 6891–6899, doi:10.1523/JNEUROSCI.5253-10.2011 (2011).
Aron, A. R. & Poldrack, R. A. Cortical and subcortical contributions to Stop signal response inhibition: role of the subthalamic nucleus. The Journal of neuroscience: the official journal of the Society for Neuroscience 26, 2424–2433, doi:10.1523/JNEUROSCI.4682-05.2006 (2006).
Galvan, A., Poldrack, R. A., Baker, C. M., McGlennen, K. M. & London, E. D. Neural correlates of response inhibition and cigarette smoking in late adolescence. Neuropsychopharmacology 36, 970–978, doi:10.1038/npp.2010.235 (2011).
Whelan, R. et al. Adolescent impulsivity phenotypes characterized by distinct brain networks. Nature neuroscience 15, 920–925, doi:10.1038/nn.3092 (2012).
Johansen-Berg, H. et al. Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. Proc Natl Acad Sci USA 101, 13335–13340, doi:10.1073/pnas.0403743101 (2004).
Lehericy, S. et al. 3-D diffusion tensor axonal tracking shows distinct SMA and pre-SMA projections to the human striatum. Cerebral cortex 14, 1302–1309 (2004).
Hsu, T. Y. et al. Modulating inhibitory control with direct current stimulation of the superior medial frontal cortex. NeuroImage 56, 2249–2257, doi:10.1016/j.neuroimage.2011.03.059 (2011).
Lau, H. C., Rogers, R. D., Haggard, P. & Passingham, R. E. Attention to intention. Science 303, 1208–1210, doi:10.1126/science.1090973 (2004).
Scangos, K. W. & Stuphorn, V. Medial frontal cortex motivates but does not control movement initiation in the countermanding task. The Journal of neuroscience: the official journal of the Society for Neuroscience 30, 1968–1982, doi:10.1523/JNEUROSCI.4509-09.2010 (2010).
Esterman, M., Tamber-Rosenau, B. J., Chiu, Y. C. & Yantis, S. Avoiding non-independence in fMRI data analysis: leave one subject out. NeuroImage 50, 572–576, doi:10.1016/j.neuroimage.2009.10.092 (2010).
Friston, K. J. et al. Psychophysiological and modulatory interactions in neuroimaging. NeuroImage 6, 218–229, doi:10.1006/nimg.1997.0291 (1997).
McLaren, D. G., Ries, M. L., Xu, G. & Johnson, S. C. A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. NeuroImage 61, 1277–1286, doi:10.1016/j.neuroimage.2012.03.068 (2012).
Asplund, C. L., Todd, J. J., Snyder, A. P. & Marois, R. A central role for the lateral prefrontal cortex in goal-directed and stimulus-driven attention. Nature neuroscience 13, 507–512, doi:10.1038/nn.2509 (2010).
Chikazoe, J. et al. Preparation to inhibit a response complements response inhibition during performance of a stop-signal task. The Journal of neuroscience: the official journal of the Society for Neuroscience 29, 15870–15877, doi:10.1523/JNEUROSCI.3645-09.2009 (2009).
Jahfari, S. et al. How preparation changes the need for top-down control of the basal ganglia when inhibiting premature actions. The Journal of neuroscience: the official journal of the Society for Neuroscience 32, 10870–10878, doi:10.1523/JNEUROSCI.0902-12.2012 (2012).
Sharp, D. J. et al. Distinct frontal systems for response inhibition, attentional capture, and error processing. Proc Natl Acad Sci USA 107, 6106–6111, doi:10.1073/pnas.1000175107 (2010).
Kawagoe, R., Takikawa, Y. & Hikosaka, O. Reward-predicting activity of dopamine and caudate neurons–a possible mechanism of motivational control of saccadic eye movement. Journal of neurophysiology 91, 1013–1024, doi:10.1152/jn.00721.2003 (2004).
Lauwereyns, J. et al. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33, 463–473 (2002).
Nakamura, K. & Hikosaka, O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. The Journal of neuroscience: the official journal of the Society for Neuroscience 26, 5360–5369 (2006).
Takikawa, Y., Kawagoe, R. & Hikosaka, O. Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. Journal of neurophysiology 87, 508–515 (2002).
Balleine, B. W. & O’Doherty, J. P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48–69, doi:10.1038/npp.2009.131 (2010).
Harsay, H. A. et al. Functional connectivity of the striatum links motivation to action control in humans. The Journal of neuroscience: the official journal of the Society for Neuroscience 31, 10701–10711, doi:10.1523/JNEUROSCI.5415-10.2011 (2011).
Redgrave, P. et al. Goal-directed and habitual control in the basal ganglia: implications for Parkinson’s disease. Nature reviews. Neuroscience 11, 760–772, doi:10.1038/nrn2915 (2010).
Kim, J. H. et al. Defining functional SMA and pre-SMA subregions in human MFC using resting state fMRI: functional connectivity-based parcellation method. NeuroImage 49, 2375–2386 (2010).
Postuma, R. B. & Dagher, A. Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. Cerebral cortex 16, 1508–1521, doi:10.1093/cercor/bhj088 (2006).
Ikeda, A. et al. Cognitive motor control in human pre-supplementary motor area studied by subdural recording of discrimination/selection-related potentials. Brain 122(Pt 5), 915–931 (1999).
Carr, L., Iacoboni, M., Dubeau, M. C., Mazziotta, J. C. & Lenzi, G. L. Neural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas. Proc Natl Acad Sci USA 100, 5497–5502, doi:10.1073/pnas.0935845100 (2003).
Jellema, T., Maassen, G. & Perrett, D. I. Single cell integration of animate form, motion and location in the superior temporal cortex of the macaque monkey. Cerebral cortex 14, 781–790, doi:10.1093/cercor/bhh038 (2004).
Perrett, D. I. & Emery, N. J. Understanding the intentions of others from visual signals: Neurophysiological evidence. Cahiers de Psychologie Cognitive/Current Psychology of Cognition 13, 683–694 (1994).
Puce, A. & Perrett, D. Electrophysiology and brain imaging of biological motion. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 358, 435–445, doi:10.1098/rstb.2002.1221 (2003).
Rizzolatti, G. & Sinigaglia, C. The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nature reviews. Neuroscience 11, 264–274, doi:10.1038/nrn2805 (2010).
Acknowledgements
This work was supported by Grant 102-2410-H-010-004-MY2 and 104-2410-H-010-003-MY2 from Ministry of Science and Technology, Taiwan.
Author information
Authors and Affiliations
Contributions
H.J.L. and W.J.K. planned the studies. W.J.K. and H.J.L. collected the data. H.J.L., F.H.L., and W.J.K. analyzed the data. All authors contributed to writing of the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare that they have no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lee, HJ., Lin, FH. & Kuo, WJ. The neural mechanism underpinning balance calibration between action inhibition and activation initiated by reward motivation. Sci Rep 7, 9722 (2017). https://doi.org/10.1038/s41598-017-10539-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-017-10539-z
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
