Fluctuations in attention behind the wheel poses a significant risk for driver safety. During transient periods of inattention, drivers may shift their attention towards internally-directed thoughts or feelings at the expense of staying focused on the road. This study examined whether increasing task difficulty by manipulating involved sensory modalities as the driver detected the lane-departure in a simulated driving task would promote a shift of brain activity between different modes of processing, reflected by brain network dynamics on electroencephalographic sources. Results showed that depriving the driver of salient sensory information imposes a relatively more perceptually-demanding task, leading to a stronger activation in the task-positive network. When the vehicle motion feedback is available, the drivers may rely on vehicle motion to perceive the perturbations, which frees attentional capacity and tends to activate the default mode network. Such brain network dynamics could have major implications for understanding fluctuations in driver attention and designing advance driver assistance systems.
Safe driving requires that drivers sustain attention and alertness behind the wheel. Policy-makers and researchers have focused on reducing external driver distraction (e.g., laws requiring hands-free use of cell phones) as well as on minimizing the probability that a driver will fall asleep at the wheel. However, even when a driver is alert and in the absence of external distractions fluctuations in attention are inevitable1. Such fluctuations, often referred to as mind-wandering2,3, impair drivers’ ability to maintain consistent speed and lane integrity and respond to emergency situations4,5 and is likely a contributing factor in more than half of all car crashes6. Hence, a comprehensive understanding of brain networks underlying changes in alertness may lead to new insights for augmenting human performance and lowering the risk of accidents.
Given that humans have a limited global workspace or attentional capacity7,8, the degree to which we prioritize, weigh, or bias our attention toward the immediate internal or external environment varies depending on current goals, motivation, levels of alertness, the complexity of the task and the context under which it is being performed. Thus, the brain’s large-scale networks may interrelate in a dynamic, flexible and adaptive manner to function either cooperatively or competitively depending on circumstances or context8,9,10. The default mode network11 is predominantly activated and functionally coherent when one is in a resting state and no explicit task is being performed, when attention is directed toward internal states, thought processes, memories, or feelings and during performance of a highly over-learned or low-demand task (e.g., driving down a highway under low traffic conditions in a familiar or monotonous environment). Conversely, the task-positive12 or frontal-parietal attention network13,14 is predominantly activated and functionally coherent during performance of tasks requiring attention to sensory-perceptual information from the external environment, especially during performance of a novel or high-demand task (e.g., driving under high traffic conditions in an unfamiliar environment). Therefore, we posit that changes in driving task demand may promote a shift of brain activity between these two modes of processing. Furthermore, fluctuations in performance during driving may be related to fluctuations in internal and external attentional states associated with dynamic changes in functional coupling between the brain’s default and task-positive networks.
To test this prediction, we altered perceptual demands by manipulating sensory inputs provided to participants in an event-related lane-departure paradigm15 in a driving simulator using a six degree-of-freedom vehicle motion simulator (see Fig. 1a,b and Supplementary Information for more details). In one condition (K+) both visual and vehicle motion feedbacks were provided to drivers and in a comparative condition (K−) only visual feedback was provided. This is because vehicle motion provides kinesthetic and vestibular sensory inputs, which are the most relevant sources of sensory input used by humans for control purposes during driving following visual input16. Previously, we17 have shown that simulated driving in the absence of vehicle motion feedback imposes a relatively more perceptually-demanding task than driving with such feedback, as evidenced by event-related theta activity (an indicator of cognitive demand18).
In the present study, we recorded electroencephalographic (EEG) signals while ten participants performed the sustained-attention driving task for 60 min. Participants were required to maintain their attention, detect any lane-departure and promptly steer the vehicle back to the center of the cruising lane. The reaction time (RT) to the perturbation was determined as a measure of the subjects’ task performance in the simulated task. Using a repeated-measures design, the participants completed two driving sessions on different days in a counterbalanced order (see Methods).
We explored the differences in brain network dynamics during the pre-stimulus period (Fig. 1c) between the K+ and K− sessions by applying independent component analysis19 and Granger causality analysis20 to model directed information transfer, or effective connectivity21 (see Methods), between sources of EEG activity (see Supplementary Fig. 5) localized to the anterior cingulate cortex (ACC), midcingulate cortex (MCC), posterior cingulate cortex (PCC), sensorimotor cortex (SMC) and extrastriate cortex (ESC) which were selected based on their central roles in the functional brain networks22,23.
Analysis of effective connectivity of the K+ session (Fig. 2a) revealed that a dominant causal hub was located in PCC, which received information from ACC and MCC, while sending information to MCC, bilateral SMC and ESC. The minor hubs were located in ACC, with unidirectional information transfer to left SMC and PCC and in MCC, with bidirectional information transfer to PCC and ESC. In the K− session (Fig. 2b), the dominant causal hub shifted to MCC with bidirectional information exchange with all other brain regions. Compared to the result under the K+condition, the causal influence of MCC and PCC on other regions significantly increased (MCC → lSMC) and decreased (PCC → ACC and PCC → rSMC) respectively while the influence of ACC on remaining brain regions remained unchanged under the K− condition (McNemar’s test, FDR-adjusted p < 0.05, see Supplementary Table 4). Additionally, under both K+ and K− conditions, bilateral SMC and ESC contributed weakly to the causal network, exchanging information unidirectionally with PCC under the K+ condition (PCC → SMCs and PCC → ESC) and bidirectionally with MCC under the K− condition (MCC ↔ SMCs and MCC ↔ ESC). Taken together, depriving participants of crucial information regarding the imminent lane departure promoted this alteration of pre-stimulus EEG activity.
Brain networks are hypothesized to be affected to a varying extent depending on the current level of engagement in the driving task. To estimate the extent of the network change throughout the driving tasks, single-trial Granger causality analysis was performed on each pre-stimulus EEG trial of the K+ and K− sessions (see Methods). All trials were sorted by the causal hub, i.e., the region with the highest number of causal outflow connections (i.e., out-degree). The results showed that, across conditions, there was a mixture of MCC-dominated and PCC-dominated trials (Fig. 3a). The mean percentages of MCC-dominated trials and PCC-dominated trials were 25.5% and 31.9%, respectively, under the K+ condition and 34.9% and 23.1%, respectively, under the K− condition. A repeated measures ANOVA analysis further revealed that the interaction effect of sensory feedback and out-degree of brain networks was significant (p = 0.015).
Next, we collapsed across feedback conditions and sorted trials by PCC- and MCC-dominant network outflow and examined RTs associated with each network (see Methods). The results revealed that RTs were significantly longer for trials dominated by PCC outflow (Fig. 3b). The difference of RTs between networks reached 286 ms (see Supplementary Table 5). This evidence suggested that the brain causal activity driven by MCC is positively correlated with task performance. Conversely, the brain causal activity driven by PCC is negatively correlated with task performance. Then we examined RTs sorted by PCC- and MCC-dominated network outflow in each condition and compared RTs between feedback conditions. An interaction was observed such that RTs were longer for trials dominated by PCC in the K− condition but did not differ in the K+ condition (Fig. 3c).
Finally, we sorted trials by RTs within each feedback condition and examined changes in network dynamics (out-degree of PCC- and MCC-dominant networks) as a function of transient changes in performance (see Methods). The out-degrees of PCC were fairly stable across different RTs at 0.18 under K+ and 0.16 under K− condition (Fig. 4), respectively. However, the out-degrees of MCC increased from fast RT to intermediate RT and then decreased from intermediate RT to slow RT under both K+ and K− conditions. This inverted U-shaped change of MCC outflow specifically occurred in the connectivity of MCC → ACC under both K+ and K− conditions, but occurred in the connectivity of MCC → bilateral SMC only under the K− condition (see Supplementary Fig. 6). In most trials under the K+ condition, the out-degrees of PCC were higher than those of MCC when RT < 0.8 s, 1 s < RT < 1.1 s and RT > 6 s (Fig. 4a), leading to the overall PCC-dominant network shown in Fig. 2a. Conversely, most trials of the K− condition showed that the out-degrees of MCC were higher than those of PCC when 1 s < RT < 2 s (Fig. 4b), leading to the overall MCC-dominant network shown in Fig. 2b.
One hypothesis to account for these findings is the perceptual decoupling hypothesis2,24, which posits that attention to sensory information in the environment is down-weighted to enable internal thought processes to proceed without interference from external stimuli. Driving is essentially a complex continuous tracking task requiring bottom-up processes for the multisensory integration of information from the external environment as well as top-down modulatory influences based on the driver’s internal goals, strategies and current intentions. Additionally, driving is a highly over-learned task for experienced drivers, such that they are able to drive with high levels of automaticity especially when driving under low demand conditions. Under such conditions, drivers are able to engage in internally-directed self-generated mental activity while simultaneously monitoring the external environment and maintaining control of the vehicle, all with relative ease.
The present results further showed that participants are more likely to decouple their attention to sensory information during the pre-stimulus time period in the environment under relatively lower task demand conditions, apparently even when sensory information is highly salient. The participants exhibited significantly more causal outflow from the MCC (node of task-positive network) versus PCC (node of default mode network) node during driving while deprived of salient sensory information (K− condition in this study). Removing vehicle motion feedback during simulated driving deprives the driver of salient sensory information and, therefore, should impose relatively greater perceptual and executive demands on the driver to maintain vehicle control. Conversely, drivers succumbed to greater levels of inattention when the task is less demanding (K+ condition), as evidenced by more causal outflow from the PCC versus MCC node when vehicle motion feedback was provided.
In both K+ and K− conditions, the out-degree of MCC has an inverted U-shaped trend (Fig. 4). Previous studies have verified that compensatory brain resources25 are required to maintain performance, particularly in a task with high cognitive demand. Increased causal outflow from MCC to bilateral SMC observed at the intermediate level of task performance (see Supplementary Fig. 6) corroborates these findings and suggests that the subjects might raise their attentional efforts to maintain vehicle control26 while fighting off waves of boredom or fatigue. MCC is dominant when the participants were relatively more engaged in the task and attempting to stay engaged in the task. Additionally, in the tail end of the distribution of RTs (RT ≥ 5 s), the subjects were nearly non-responsive and MCC outflow markedly reduced below or comparable to the outflows of PCC in both K+ and K− conditions, which also supports the perceptual decoupling hypothesis2,24. It is worth noting that the effects of vehicle motion feedback (K+ vs. K−) on the brain and behavior might not be limited to the allocation of attentional resources. The results of this study cannot rule out the possibility that the differences between K+ and K− were associated with the involvement of different sensory modalities as well as the subjective sensation of movement.
Our previous studies17,27 have shown that EEG spectral changes are associated with task performance (see Supplementary Fig. 7). Theta power (4–7 Hz) increases as performance declines and the driver’s attention deteriorates. Consistent with these findings, in the present study the knee-point of the spectrum-vs.-RT curve occurred at 1.8 s where the spectral augmentation reached a plateau under K+ condition, matching the result of network analysis where the out-degrees of MCC reduced to the level comparable to those of PCC. On the other hand, the spectrum-vs-RT curve reached a plateau at 4 s, matching the result of network analysis where the out-degrees of MCC reduced to the level comparable to those of PCC at ~4 s. In the RT range of 1-4 s, the participants exhibited higher theta power in the MCC under the K+ versus the K− condition. Association between lower out-degree and higher theta band power of MCC in the K+ condition suggests that alertness is relatively low when the vehicle motion feedback is available. Additionally, in the K+ condition, accompanying the continuously monotonic theta augmentation is the alpha suppression (see Supplementary Fig. 7c,d). This opposite trend of theta and alpha activities is a neural marker of low alertness during mind wandering28.
Based on the evidence provided in this study, neural oscillatory activities of decreased alertness become active when the perceptual demand decreases. A number of advanced driver assistance systems have created new opportunities in facilitating the driving task and enhancing road safety. Many of them utilize warning signals presented in different sensory modalities to alert drivers to potential hazards. There are valid concerns that over-reliance on in-vehicle technologies may result in reduced situational awareness and low task engagement, rather than enhancing road safety. Hence, potential hazards caused by reduced perceptual demand should be considered in developing advanced driver assistance systems in modern cars.
Previously, we examined brain dynamics of participants during simulated driving with and without kinesthetic feedback using an event-related lane-departure paradigm17. Specifically, we derived brain sources in frontal, central, motor, parietal and occipital cortical regions using independent component analysis19 and examined variations in component spectra between kinesthetic feedback conditions across different levels of performance (optimal, sub-optimal and poor), as determined by the distribution of reaction times (RT) to random lane departure events. We observed a significant interaction, such that RTs in the optimal range of the distribution were faster in the kinesthetic feedback condition versus the no-kinesthetic feedback condition, but for the tail of the distribution of RTs (i.e., sub-optimal and poor ranges) RTs were slower in the kinesthetic feedback condition. In contrast to the no-kinesthetic feedback environment with visual input only, kinesthetic feedback reduced theta-power augmentation in the central and frontal components when preparing for action and error monitoring. The event-related theta activity typically is associated with the level of cognitive demand18,29 and the amount of attentional resources30 for planning the required motor action31 and integrating the sensorimotor function32, showing that the drivers succumbed to greater levels of inattention when kinesthetic feedback was provided, as evidenced by both RTs and brain network dynamics.
Overall, these findings suggest that kinesthetic feedback functioned to facilitate performance when the drivers were optimally alert (operationally defined as the fastest RTs), but when their alertness levels deteriorated (defined as intermediate and slow RTs) the kinesthetic feedback actually functioned to worsen performance. These findings might be correlated with the perceptual decoupling account of mind-wandering, which posits that participants are more likely to decouple their attention to sensory information in the environment under relatively lower task demand conditions, even when sensory information is highly salient.
Hence, in the present simulated driving study, we manipulated sensory inputs provided to drivers and investigated the differences of brain network dynamics, derived from EEG signals, between different sensory feedback conditions (K+, K−). In addition, we analyzed single-trial brain network dynamics and compared RTs between trials dominated by different brain regions. Further, to search for converging evidence, we sorted trials by RTs within each feedback condition and examined changes in network dynamics as a function of transient changes in performance. The following are the details of materials and methods.
This study was carried out in strict accordance with the recommendations in the Guide for Committee of Laboratory Care and Use of the National Chiao Tung University. The Institutional Review Board of the Taipei Veterans General Hospital approved the protocol. Each participant read and signed an informed consent form before the experiment began.
Participants were instructed to maintain an alcohol- and caffeine-restricted diet for one day before each experiment. Each session was performed in the mid-afternoon when subjects were likely to experience somnolence and lasted for approximately 1.5 hr. The monetary compensation for the two sessions was NT$1,200 (approximately US$ 40).
Virtual-reality (VR) driving environment
Since 2005, we (Brain Research Center, National Chiao Tung University, Taiwan), have conducted a series of fundamental explorations related to simulated driving (such as behavioral lapse27,33,34,35,36, dual-task37,38, navigation39, motion sickness40,41, auditory42,43 and kinesthetic17 feedback) and neuroimaging technology44,45 in a virtual-reality driving environment46. The driving simulator allows repeated simulation of emergent situations, such as a sudden stop of the lead vehicle, abrupt lane departure and simulated crashes, without risking the safety of the driver. Additionally, the repeated-trials approach helps to systematically establish the line between driving performance and changes in EEG activity during continuous driving under a controlled experimental condition.
The VR-based high-fidelity driving environment was established using six identical projectors and PCs that ran the same VR program and were synchronized over local area network. The traffic scenario was projected at viewing angles of 0°, 42°, 84°, 180°, 276° and 318° to provide a 360° visual field. The dimensions of each directional scene were 300 × 225 (width × height) cm, 290 × 225 cm, 260 × 195 cm, 520 × 195 cm, 260 × 195 cm and 290 × 225 cm, respectively. In this study, the experimental scenario involved a visually monotonous and unexciting nighttime driving on a straight four-lane highway without any other traffic. The refresh rate of the scenario frame was set to emulate cruising at a speed of 100 km/hr. The distance from the left side to the right side of the road was quantized into values of 0–255; the width of each lane was 60 units and that of the car was 28 units, reflecting the ratio of the width of a real lane (3.75 m) to that of a real car (1.8 m). A real vehicle frame (Make: Ford; Model: Probe) that included no unnecessary weight such as an engine, wheels and other components, was mounted on a six degree-of-freedom Stewart motion platform. In each K+ session, the platform actively delivered to the subject the sensation of motion in sync with the driving scene. The platform was inactive during the K− session.
The event-related lane-departure paradigm, designed by Huang15, was implemented in the dynamic driving simulator (see Supplementary Fig. 1). It was designed to mimic a non-ideal road surface that caused the car to drift, with equal probability, to the right or left of the third lane. Following each perturbation (deviation onset), the subject was required to steer the car (response onset) back to the center of the original lane (response offset) as quickly as possible. The sequence between the deviation onset and the response offset constitute one trial. The inter-trial interval (time between response offset and subsequent deviation onset) was selected uniformly at random to be within the range 5–10 s. The driving task continued for 1 hr. with no intervention. The driver’s activities were monitored from the scene control room via a surveillance video camera mounted on the dashboard. Hundreds of lane-departure trials were collected in each of the experiments (see Supplementary Table 1).
Subjects and sessions
Ten undergraduate and graduate students from National Chiao Tung University, Hsinchu, Taiwan, were recruited to participate in the virtual driving study. All students had valid driving licenses. At the beginning of the experiment, a five-minute pre-test was performed to ensure that every subject understood the instructions and to confirm that they did not suffer from simulator-induced nausea. Each subject was required to complete a questionnaire about his or her sleeping habits. The participants therefore had normal work and rest, normal sleep (around 8hrs of sleep each night) and had not stayed up late (no later than 11:00 pm) at any time in the week before the experiment.
Each subject was asked to participate in one K− session and one K+ session on different days. Each session lasted for about 60 min. The order of the K− session and the K+ session was counterbalanced across subjects, i.e., half of the participants performed the K− session first followed by the K+ session and the other half of participants performed the K+ session first followed by the K− session.
EEG data acquisition
The Synamps2 system (Neuroscan, Inc.) and Ag/AgCl electrodes were used to record 30-channel EEG signals (see Supplementary Fig. 2) with two reference channels placed on the right and left mastoids with a 16-bit quantization level at a sampling rate of 500 Hz. These electrodes were arranged on the quick-cap according to a modified international 10–20 system. The impedance of all of electrodes was kept to less than 5 kΩ.
Behavioral data collection and task performance measurement
Subjects were instructed to put their best effort to stay alert and respond to the lane-deviation events as soon as possible. The response time (RT), which was the period between the deviation onset and the response onset, was determined as a measure of the subjects’ task performance in the simulated driving task. A highly vigilant subject should respond promptly to lane perturbations (short RTs), while a subject with a low level of vigilance would respond slowly (long RTs). In the absence of any subject response, the vehicle would come into contact with the right or left limits of the roadside within 1.5 and 2.5 s, respectively. The vehicle would then continue to move forward along the roadside until the subject regained consciousness and/or responded to correct the error. The vehicle trajectory and the RT were recorded throughout the experiment (see Supplementary Fig. 3). The mean RTs were calculated for all sessions (see Supplementary Table 1).
EEG data preprocessing
As shown in Supplementary Fig. 4, the raw EEG data were bandpass-filtered from 1 to 50 Hz using a zero-phase FIR filter (the eegfilt.m routine from the EEGLAB toolbox) to remove high-frequency electrical artifacts (such as line noise) and low-frequency drift, before being downsampled to 250 Hz for data reduction. Data were preprocessed using the EEGLAB toolbox47 in MATLAB (Mathworks Inc., Natick, MA).
EEG source information flow analysis
First, infomax independent component analysis19 (EEGLAB’s runica.m function) was performed on EEG recordings to separate instantaneously quasi-independent brain processes from artificial and physiological noise48. Then, all quasi-independent brain processes were spatially localized in the brain using a single equivalent current dipole model49 based on an assumption that the field dynamics of a small region of homogeneously oriented and spatiotemporally coherent cortical pyramidal cells can be modeled as an equivalent current dipole49. For the quasi-independent brain process with a bilaterally symmetric component map (i.e., occipital component map, the rightmost subplot of Supplementary Fig. 5a), a symmetric dual-dipole model was used as suggested by Makeig, et al.50. ICA has been demonstrated to be effective in identifying sources. The 3D-equivalent brain dipole was obtained by applying the DIPFIT function (using a four-shell spherical model) of the EEGLAB toolbox to the topography of each ICA component (see Supplementary Fig. 5)47.
The task-negative or default mode network (DMN) consists of a set of multiple interacting subsystems including the medial prefrontal cortex, medial temporal lobe, posterior cingulate cortex and retrosplenial cortex11,12,51,52,53 with the posterior cingulate cortex functioning as a major hub. The DMN is predominantly activated and functionally coherent when one is in a resting state and no explicit task is being performed, when attention is directed toward internal states, thought processes, memories, or feelings and during performance of a highly over-learned or low-demand task (e.g., driving down a highway under low traffic conditions in a familiar or monotonous environment). The task-positive12 or frontal-parietal attention network13,14 consists of a set of multiple interacting subsystems including a ventral system associated with bottom-up attention processes (temporoparietal cortex and inferior frontal cortex) and a dorsal system associated with top-down attention processes (intraparietal cortex, superior frontal cortex, middle temporal complex, extrastriate cortex) with the middle cingulate cortex functioning as a major hub54,55. The frontal-parietal attention network is predominantly activated and functionally coherent during performance of tasks requiring attention to sensory-perceptual information from the external environment, especially during performance of a novel or high-demand task (e.g., driving under high traffic conditions in an unfamiliar environment). These two neural systems have been observed to be anti-correlated12; however they have also been observed to exhibit flexible coupling between nodes of each system during task performance56. Thus, the brain’s large-scale networks may interrelate in a dynamic, flexible and adaptive manner to function either cooperatively or competitively depending on circumstances or context8,9,10.
Independent brain sources obtained from all of the subjects were semi-automatically grouped into distinct clusters with a high intra-cluster similarity47. We clustered independent sources using EEGLAB routines implementing k-means clustering on vectors comprised of scalp topographies, equivalent dipole source locations and time-frequency properties47, followed by a manual adjustment to remove outliers. In this study, the processes of independent sources whose spatial coordinates were in or close to the above-mentioned cortical areas were selected as the independent brain sources of interest. For group analysis, six brain sources (see Supplementary Fig. 5) consistently observed across 20 experiment sessions (10 subjects × 2 conditions) were selected for further analysis. These sources were labeled as anterior cingulate cortex (ACC), midcingulate cortex (MCC), left sensorimotor cortex (lSMC), right sensorimotor cortex (rSMC), posterior cingulate cortex (PCC) and extrastriate cortex (ESC) according to the mean locations in Talairach space.
Granger causality refers to the fact that signal X1 can cause another signal X2 if the information in the past of X1 helps predict the future of X2. We can represent the multivariate process at time t as a stationary autoregressive process of order p as follows. Consider, for example, n = 3.
where is the current time point and T is the length (in samples) of the signal. The model order p was estimated by applying the Bayesian information criterion (BIC). Parameters A and are respectively the model coefficient matrix and prediction error, which are obtained using ordinary least squares approach57.
In this study, the multivariate linear dynamical (autoregressive) model was fit to the process activation time series in a 1-s window before the lane departure (i.e., pre-perturbation period). Before the model fitting, detrending and centering (subtraction of the temporal mean) were performed to remove linear drift present in the data.
Following the model fitting, the model is validated by 1) the whiteness of the residuals, 2) the percentage of the consistency and 3) the stationarity of the model. The validation results of all experimental sessions are shown in Supplementary Table 2. Then, the fitted model was used to infer effective connectivity by means of time-domain conditional multivariate Granger causality analysis20,58.
To determine the causal effect of X2 on X1, the prediction error was re-estimated using a submodel (restricted) that excluded the signal X2; the value thus obtained was compared with that obtained using the full (unrestricted) model.
The strength of the effect of X2 to X1 (i.e., causal magnitude), conditioned on X3, was determined as follows.
where and are the variance of and , respectively.
In this study, the Granger causality of X2 on X1 is tested in the context of multiple additional variables .
Finally, statistical significance with respect to a null hypothesis of zero connectivity was assessed for each pair of regions using a nonparametric surrogate statistical method58 by the following procedure.
Construct a distribution, , satisfying the null distribution of no connectivity using a phase-randomization approach. The sample size of surrogate data is 2000.
Compare the observed connectivity magnitude, , with the quantiles of the null distribution to obtain the p-value:
Adjust -values using the false discovery rate (FDR)-controlling multiple testing procedure59 (the fdr.m routine from the EEGLAB toolbox47). The FDR-adjusted -values < 0.01 are marked in grey (see Supplementary Table 3), indicating the connectivity magnitude is significantly different from zero.
Calculate the number of significant outgoing edges (i.e., out-degree) between brain regions.
Obtain the proportion of subjects for the edge which has a significantly non-zero information flow, P(edge)(see Supplementary Table 3).
High agreement across participants in terms of significantly non-zero connectivity (i.e., P(edge) ≥ 0.9) was visualized in an anatomically-coregistered 3D space.
Perform McNemar’s test followed by the FDR correction to determine whether kinesthetic feedback has an effect on the connectivity (i.e., the proportion of individuals whose connectivity differed when driving with kinesthetic feedback as opposed to driving without kinesthetic feedback). The results of all edges were shown in 2 × 2 contingency tables (see Supplementary Table 4).
MATLAB toolboxes, including EEGLAB47, the source information flow toolbox (SIFT, an EEGLAB-compatible toolbox)60 and Granger causal connectivity analysis (GCCA toolbox)61, were used to analyze and visualize multivariate causality and the flow of information between sources of electrophysiological activity.
Network-sorted RT comparison
Single-trial Granger causality analysis was also performed to characterize the network dynamics (measured by out-degree) directly correlated with behavioral variability during tasks. All trials were sorted by the causal hub, i.e., the region with the highest out-degree. The trials were discarded in case of a tie. Then, the percentage of these classified trials was calculated followed by a two-way repeated measures ANOVA (2 × 2 design) to analyze the influence of sensory feedback and brain region factors on the percentages. The RT of trials dominated by the different causal hub was compared as shown in Supplementary Table 5.
RT-sorted out-degree dynamics
The performance-sorted out-degree was also introduced to observe the continuous changes of out-degree from fast to slow RT. For each trial, all the out-degrees were normalized by dividing the sum of significant outflow links of all brain regions. Then, the normalized out-degrees are horizontally stacked according to the RT from fast to slow and smoothed with a central moving average filter (window size: 10% of trials; window step: 1 trial).
RT-sorted spectral dynamics
Each of the 1-s (250-points) pre-stimulus MCC and PCC activations was transformed into a time-frequency representation by applying the fast Fourier transform (FFT) with Welch’s method and Hanning window. All of the 250-point data were first divided into overlapping 128-point segments, windowed with Hanning window. Then, all segments were zero-padded to 256 points for a 256-point FFT, resulting in an estimate of the power spectral density with 30 frequency bins from 0.98 to 30.3 Hz. The log power spectra were sorted in order of ascending RT and then concatenated into a 2D image (x-axis: frequency and y-axis: RT). The mean log power spectrum (in dB) of the trials with an RT below the tenth percentile of RTs, was used as the reference value and subtracted from each estimated spectrum.
How to cite this article: Lin, C.-T. et al. Mind-Wandering Tends to Occur under Low Perceptual Demands during Driving. Sci. Rep. 6, 21353; doi: 10.1038/srep21353 (2016).
Weinschenk, S. 100 Things: Every Designer Needs to Know About People. (New Riders, 2011).
Schooler, J. W. et al. Meta-awareness, perceptual decoupling and the wandering mind. Trends Cogn. Sci. 15, 319–326, 10.1016/j.tics.2011.05.006 (2011).
Mason, M. F. et al. Wandering minds: the default network and stimulus-independent thought. Science 315, 393–395, 10.1126/science.1131295 (2007).
Yanko, M. R. & Spalek, T. M. Driving with the wandering mind: the effect that mind-wandering has on driving performance. Hum. Factors 56, 260–269 (2014).
He, J., Becic, E., Lee, Y. C. & McCarley, J. S. Mind wandering behind the wheel: performance and oculomotor correlates. Hum. Factors 53, 13–21 (2011).
Cédric, G. et al. Mind wandering and driving: responsibility case-control study. The BMJ 345, 1–7 (2012).
Baars, B. J. A Cognitive Theory of Consciousness. (Cambridge University Press, 1988).
Smallwood, J., Brown, K., Baird, B. & Schooler, J. W. Cooperation between the default mode network and the frontal-parietal network in the production of an internal train of thought. Brain Res. 1428, 60–70, 10.1016/j.brainres.2011.03.072 (2012).
Christoff, K. Undirected thought: neural determinants and correlates. Brain Res. 1428, 51–59, 10.1016/j.brainres.2011.09.060 (2012).
Sonuga-Barke, E. J. & Castellanos, F. X. Spontaneous attentional fluctuations in impaired states and pathological conditions: a neurobiological hypothesis. Neurosci. Biobehav. Rev. 31, 977–986, 10.1016/j.neubiorev.2007.02.005 (2007).
Buckner, R. L., Andrews-Hanna, J. R. & Schacter, D. L. The brain’s default network: anatomy, function and relevance to disease. Ann. N.Y. Acad. Sci. 1124, 1–38, 10.1196/annals.1440.011 (2008).
Fox, M. D. et al. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Natl. Acad. Sci. USA 102, 9673–9678, 10.1073/pnas.0504136102 (2005).
Corbetta, M., Patel, G. & Shulman, G. L. The reorienting system of the human brain: from environment to theory of mind. Neuron 58, 306–324, 10.1016/j.neuron.2008.04.017 (2008).
Corbetta, M. & Shulman, G. L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215, 10.1038/nrn755 (2002).
Huang, R. S., Jung, T. P. & Makeig, S. Tonic changes in EEG power spectra during simulated driving. Lect. Notes Comput. Sci. 5638, 394–403 (2009).
MacAdam, C. C. Understanding and modeling the human driver. Vehicle Syst. Dyn. 40, 101–134, 10.1076/vesd.22.214.171.12475 (2003).
Chuang, C. H., Ko, L. W., Jung, T. P. & Lin, C. T. Kinesthesia in a sustained-attention driving task. Neuroimage 91, 187–202, 10.1016/j.neuroimage.2014.01.015 (2014).
Klimesch, W. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Rev. 29, 169–195 (1999).
Hyvarinen, A. & Oja, E. Independent component analysis: algorithms and applications. Neural networks 13, 411–430 (2000).
Granger, C. W. J. Investigating Causal Relations by Econometric Models and Cross-spectral Methods. Econometrica 37, 424–438, citeulike-article-id:1303897 10.2307/1912791 (1969).
Friston, K. J. Functional and effective connectivity: a review. Brain Connect. 1, 13–36, 10.1089/brain.2011.0008 (2011).
Yu, C. et al. Functional segregation of the human cingulate cortex is confirmed by functional connectivity based neuroanatomical parcellation. Neuroimage 54, 2571–2581, 10.1016/j.neuroimage.2010.11.018 (2011).
Taylor, K. S., Seminowicz, D. A. & Davis, K. D. Two systems of resting state connectivity between the insula and cingulate cortex. Hum. Brain Mapp. 30, 2731–2745, 10.1002/hbm.20705 (2009).
Smallwood, J. & Schooler, J. W. The restless mind. Psychol. Bull. 132, 946–958, 10.1037/0033-2909.132.6.946 (2006).
Drummond, S. P., Brown, G. G., Salamat, J. S. & Gillin, J. C. Increasing task difficulty facilitates the cerebral compensatory response to total sleep deprivation. Sleep 27, 445–451 (2004).
Hoffstaedter, F. et al. The role of anterior midcingulate cortex in cognitive motor control: evidence from functional connectivity analyses. Hum Brain Mapp 35, 2741–2753, 10.1002/hbm.22363 (2014).
Chuang, S. W. et al. Co-modulatory spectral changes in independent brain processes are correlated with task performance. Neuroimage 62, 1469–1477, 10.1016/j.neuroimage.2012.05.035 (2012).
Braboszcz, C. & Delorme, A. Lost in thoughts: neural markers of low alertness during mind wandering. NeuroImage 54, 3040–3047, 10.1016/j.neuroimage.2010.10.008 (2011).
Onton, J., Delorme, A. & Makeig, S. Frontal midline EEG dynamics during working memory. NeuroImage 27, 341–356, 10.1016/j.neuroimage.2005.04.014 (2005).
Gomarus, H. K., Althaus, M., Wijers, A. A. & Minderaa, R. B. The effects of memory load and stimulus relevance on the EEG during a visual selective memory search task: an ERP and ERD/ERS study. Clin. Neurophysiol. 117, 871–884, 10.1016/j.clinph.2005.12.008 (2006).
Perfetti, B. et al. Temporal evolution of oscillatory activity predicts performance in a choice-reaction time reaching task. J. Neurophysiol. 105, 18–27, 10.1152/jn.00778.2010 (2011).
Cruikshank, L. C., Singhal, A., Hueppelsheuser, M. & Caplan, J. B. Theta oscillations reflect a putative neural mechanism for human sensorimotor integration. J. Neurophysiol. 107, 65–77, 10.1152/jn.00893.2010 (2012).
Lin, F. C., Ko, L. W., Chuang, C. H., Su, T. P. & Lin, C. T. Generalized EEG-based drowsiness prediction system by using a self-organizing neural fuzzy system. IEEE Trans. Circuits Syst. I, Reg. Papers 59, 2044–2055 (2012).
Lin, C. T., Ko, L. W. & Shen, T. K. Computational intelligent brain computer interaction and its applications on driving cognition. IEEE Comput. Intell. Mag. 4, 32–46 (2009).
Lin, C.-T. et al. EEG-Based assessment of driver cognitive responses in a dynamic virtual-reality driving environment. IEEE Trans. Biomed. Eng. 54, 1349–1352 (2007).
Lin, C. T., Wu, R. C., Jung, T. P., Liang, S. F. & Huang, T. Y. Estimating driving performance based on EEG spectrum analysis. EURASIP J. Adv. Sig. Pr. 19, 3165–3174 (2005).
Lin, C. T., Chen, S. A., Chiu, T. T., Lin, H. Z. & Ko, L. W. Spatial and temporal EEG dynamics of dual-task driving performance. J. Neuroeng. Rehabil. 8, 1–13, 10.1186/1743-0003-8-11 (2011).
Wang, Y.-K., Chen, S.-A. & Lin, C.-T. An EEG-based brain–computer interface for dual task driving detection. Neurocomputing 129, 85–93 (2014).
Chiu, T.-C. et al. Alpha modulation in parietal and retrosplenial cortex correlates with navigation performance. Psychophysiology 49, 43–55, 10.1111/j.1469-8986.2011.01270.x (2012).
Lin, C. T., Tsai, S. F. & Ko, L. W. EEG-based learning system for online motion sickness level estimation in a dynamic vehicle environment. IEEE Trans. Neural Netw. Learn Syst. 24, 1689–1700, 10.1109/TNNLS.2013.2275003 (2013).
Chen, Y. C. et al. Spatial and temporal EEG dynamics of motion sickness. NeuroImage 49, 2862–2870, 10.1016/j.neuroimage.2009.10.005 (2010).
Lin, C. T., Huang, K. C., Chuang, C. H., Ko, L. W. & Jung, T. P. Can arousing feedback rectify lapses in driving?prediction from EEG power spectra. J. Neural Eng. 10, 1–10, 10.1088/1741-2560/10/5/056024 (2013).
Lin, C.-T. et al. Tonic and phasic EEG and behavioral changes induced by arousing feedback. NeuroImage 52, 633–642, 10.1016/j.neuroimage.2010.04.250 (2010).
McDowell, K. et al. Real-world neuroimaging technologies. IEEE Access 1, 131–149, 10.1109/ACCESS.2013.2260791 (2013).
Liao, L.-D. et al. Biosensor technologies for augmented brain-computer interfaces in the next decades. Proc. IEEE 100, 1553–1566, 10.1109/jproc.2012.2184829 (2012).
Lin, C.-T. et al. Noninvasive neural prostheses using mobile and wireless EEG. Proc. IEEE 96, 1167–1183 (2008).
Delorme, A. & Makeig, S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).
Lee, T.-W., Girolami, M. & Sejnowski., T. J. Independent component analysis using an extended infomax algorithm for mixed sub-Gaussian and super-Gaussian sources. Neural Comput. 11, 417–441 (1999).
Delorme, A., Palmer, J., Onton, J., Oostenveld, R. & Makeig, S. Independent EEG sources are dipolar. PLoS ONE 7, 1–14, 10.1371/journal.pone.0030135 (2012).
Makeig, S. et al. Electroencephalographic Brain Dynamics Following Manually Responded Visual Targets. PLoS biology 2, 747–762, 10.1371/journal.pbio.0020176 (2004).
Shulman, G. L. et al. Common blood flow changes across visual tasks: II. decreases in cerebral cortex. J. Cogn. Neurosci. 9, 648–663, 10.1162/jocn.19126.96.36.1998 (1997).
Raichle, M. E. et al. A default mode of brain function. Proc. Natl. Acad. Sci. USA 98, 676–682, 10.1073/pnas.98.2.676 (2001).
Greicius, M. D., Krasnow, B., Reiss, A. L. & Menon, V. Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc. Natl. Acad. Sci. USA 100, 253–258, 10.1073/pnas.0135058100 (2003).
Shackman, A. J. et al. The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat. Rev. Neurosci. 12, 154–167, 10.1038/nrn2994 (2011).
Legrain, V. et al. A neurocognitive model of attention to pain: behavioral and neuroimaging evidence. Pain 144, 230–232, 10.1016/j.pain.2009.03.020 (2009).
Spreng, R. N., Stevens, W. D., Chamberlain, J. P., Gilmore, A. W. & Schacter, D. L. Default network activity, coupled with the frontoparietal control network, supports goal-directed cognition. Neuroimage 53, 303–317, 10.1016/j.neuroimage.2010.06.016 (2010).
Lütkepohl, H. New Introduction to Multiple Time Series Analysis. (New York: Springer, 2005).
Kamiński, M., Ding, M., Truccolo, W. A. & Bressler, S. L. Evaluating causal relations in neural systems: granger causality, directed transfer function and statistical assessment of significance. Biol. Cybern. 85, 145–157, citeulike-article-id:1176035 (2001).
Benjamini, Y. & Yekutieli, D. The Control of the False Discovery Rate in Multiple Testing under Dependency. The Annals of Statistics 29, 1165–1188, 10.2307/2674075 (2001).
Delorme, A. et al. EEGLAB, SIFT, NFT, BCILAB and ERICA: new tools for advanced EEG processing. Comput. Intell. Neurosci. 2011, 1–12, 10.1155/2011/130714 (2011).
Seth, A. K. A MATLAB toolbox for Granger causal connectivity analysis. J. Neurosci. Methods 186, 262–273, 10.1016/j.jneumeth.2009.11.020 (2010).
This work was supported in part by the UST-UCSD International Center of Excellence in Advanced Bio-engineering sponsored by the Taiwan Ministry of Science and Technology I-RiCE Program under Grant Number MOST 103-2911-I-009-101, in part by the Aiming for the Top University Plan of National Chiao Tung University, the Ministry of Education, Taiwan, under Contract 104W963. Research was also sponsored in part by the Army Research Laboratory and was accomplished under Cooperative Agreement Number W911NF-10-2-0022. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation heron.
The authors declare no competing financial interests.
Electronic supplementary material
About this article
Cite this article
Lin, CT., Chuang, CH., Kerick, S. et al. Mind-Wandering Tends to Occur under Low Perceptual Demands during Driving. Sci Rep 6, 21353 (2016). https://doi.org/10.1038/srep21353
Neuroscience experiment applied to investigate decision-maker behavior in the tradeoff elicitation procedure
Annals of Operations Research (2020)
Posterior cingulate cortex can be a regulatory modulator of the default mode network in task-negative state
Scientific Reports (2019)
Scientific Data (2019)