The capacity to regulate one’s attention in accordance with fluctuating task demands and environmental contexts is an essential feature of adaptive behavior. Although the electrophysiological correlates of attentional processing have been extensively studied in the laboratory, relatively little is known about the way they unfold under more variable, ecologically-valid conditions. Accordingly, this study employed a ‘real-world’ EEG design to investigate how attentional processing varies under increasing cognitive, motor, and environmental demands. Forty-four participants were exposed to an auditory oddball task while (1) sitting in a quiet room inside the lab, (2) walking around a sports field, and (3) wayfinding across a university campus. In each condition, participants were instructed to either count or ignore oddball stimuli. While behavioral performance was similar across the lab and field conditions, oddball count accuracy was significantly reduced in the campus condition. Moreover, event-related potential components (mismatch negativity and P3) elicited in both ‘real-world’ settings differed significantly from those obtained under laboratory conditions. These findings demonstrate the impact of environmental factors on attentional processing during simultaneously-performed motor and cognitive tasks, highlighting the value of incorporating dynamic and unpredictable contexts within naturalistic designs.
Attention is a finite resource that must be strategically managed throughout daily life. The hyper-connected nature of the modern world—and in particular, the ubiquitous devices, apps, and media that constantly vie for our attention—expose us to a torrent of information that must be selectively sampled, navigated, and at times, held in abeyance. Arguably, it has never been more important to understand the impact of competing attentional demands on cognitive function and motor action. The present study builds on recent developments in mobile electroencephalography (EEG) to investigate the effects of cognitive task load, motor demands, and environmental complexity on attention in real-world scenarios.
A great deal of knowledge about the nature of attention and the influence of distracting stimuli has been derived from carefully controlled laboratory studies1. By contrast, much less is known about the characteristics of attention under real-world situations. However, recent technological developments in neurophysiological measures (e.g., EEG and eye-tracking) have enabled researchers to address such topics outside the laboratory (e.g., while driving)2. The present study exploits this technical progress to examine how event-related potentials (ERPs) relating to sensory and attentional processing differ across laboratory and more ecologically-valid situations. Here, we focus on the P3 component, which has been most frequently investigated in previous real-world studies3, and the mismatch negativity (MMN), which constitutes an index of early sensory processing4.
The P3 constitutes the third positive deflection after stimulus presentation, typically occurring at a latency ranging 250 to 500 ms, and presenting most dominantly over centro-parietal scalp regions5,6. This component has been related to updating and categorization processes7, the intensity of performance8,9, as well as the amount of resources dedicated to task performance10,11. Furthermore, the P3 can serve as an index of the distribution of attention in competing concurrent tasks12 and has been shown to be sensitive to alterations in task difficulty (e.g., assessing mental workload)13.
The MMN is elicited in the presence of any discriminable change in some repetitive aspect of stimulation. Peaking within 100 to 250 ms from change onset, the MMN exhibits the strongest intensity in temporal and frontal areas of topographic scalp maps, and can be detected even when the participant pays no attention to the task14,15,16. Although the MMN has been most intensively studied in the auditory modality17, previous studies have also identified the component in visual settings18.
Traditionally, the P3 and MMN components are most frequently studied using the oddball paradigm. Within this paradigm, participants are typically presented with an infrequently occurring target stimulus (e.g., a high-pitch tone) embedded within sequences of frequently presented distractor stimuli (e.g., low-pitch tones). While both the P3 and the MMN are elicited by such target stimuli, the MMN can also be detected when the individual is not actively attending to the tone sequence19.
From pioneers to contemporary studies, the oddball paradigm has also been frequently used to investigate the influence of motor demands (e.g., varying gait parameters) on ERPs. For instance, one study compared how ERP responses changed during treadmill walking as a function of gait velocity20. Here, findings suggest that the amplitude, latency and topography of event-related potentials (N1, N2, P3) vary depending on the difficulty of both the motor task (e.g., slow walking vs. fast walking vs. running) and the cognitive task (e.g., non-counting vs. counting vs. responding)20,21. When occurring in parallel with a cognitive task, motor demands (e.g., during walking) can thus be viewed as inducing a dual-task setting that calls for appropriate allocation of attention between cognitive and motor systems22.
In recent years, studies have begun to measure ERPs during dual-task scenarios performed under more naturalistic conditions, such as cycling23,24, skateboarding25, or walking26 outside the lab (e.g., on empty corridors, parking places, or the lawn on the outside premises). Such findings demonstrate a relation between attentional processing and the cognitive load induced by each situation. For example, cognitive task performance, parietal P3 amplitude, and frontal midline theta power have been found to decrease with progressively increased situational load (i.e., standing vs. walking on a treadmill vs. walking along a hallway)27. Furthermore, these findings reveal a greater impact of environmental factors on electrophysiological markers of attention compared to motor demands (i.e., being wheeled along a hallway vs. walking on a treadmill). To date, however, most real-world studies on walking involve fairly undemanding environmental settings, such as an empty straight corridor27 or the lawn of an institute's grounds3.
Within a more naturalistic context, Aspinall and colleagues described EEG changes in terms of increased engagement and arousal in more busy environmental settings (i.e., urban shopping street and busy commercial district compared to green spaces28). However, the interpretation of these findings is complicated by the authors’ reliance on proprietary EEG metrics that are not commonly reported in the scientific literature. More recently, Pizzamiglio and colleagues reported increased theta and beta power when participants were walking across a campus while conversing, as compared to standing still29. However, studies that have analyzed attention-related ERP responses under such ecologically valid conditions are rare and often limited to virtual reality within a dedicated room22.
In sum, previous studies on walking in naturalistic environments have either focused on the effect of motor demands (e.g., different walking speeds, obstacle courses)3, used relatively monotonous scenarios (e.g., empty corridors)27, or did not analyze attention-related ERPs29,30,31. Here, we sought to fill an important gap in this literature by investigating the effects of motor demands, environmental complexity, and cognitive task load on such ERPs. We report findings from an auditory oddball paradigm in which participants either attended to or ignored experimental stimuli while engaging in three situational contexts: (1) ordinary laboratory conditions, (2) walking around a sports field, and (3) navigating a route through a university campus. Behavioral data and ERPs pertaining to the MMN and P3 were analyzed to investigate the effect of each experimental manipulation on task performance and attentional processing.
Based on previous findings from traditional laboratory studies and more naturalistic environments, we hypothesized a decrease in P3 and MMN amplitude, as well as task-performance, as environmental and motor complexity increased, due to the reduction in attentional resources available for cognitive task performance. In addition, we predicted that P3 and MMN effects would be more pronounced when participants were instructed to actively attend to the cognitive task, compared to when the tone stimuli were ignored.
Healthy, right-handed, native English-speaking adults aged 18–40 years were eligible to participate in this study. Of the 44 recruited participants, one was excluded due to left-handedness, and a further two were excluded due to missing EEG data. The remaining sample consisted of 26 females and 15 males aged 18–39 years (M = 23.1 years, SD = 4.8). All participants reported normal (or corrected-to-normal) vision and audition, no history of neurological or psychological disorders, and no diagnosed intellectual or language disorder.
The study was performed in accordance with the ethical standards laid down in the Declaration of Helsinki and approved by the local ethics committee at the University of South Australia (ID: 0,000,034,991). All participants provided written informed consent prior to the experiment and were informed that they could end participation at any time without reprisal.
The auditory oddball task comprised two distinct tones, one presented frequently (standard) and the other infrequently (deviant). These stimuli were a French horn tone (Dominant frequency of 1046.502 Hz, High C or C6) and a piano tone (Dominant frequency of 523.251 Hz, Middle C or C5). We used complex tones because they constitute more naturalistic stimuli than pure tones32.
Tones were presented binaurally via conventional in-ear headphones (Anko) for 150 ms, with an interstimulus interval of 350 ms. One-hundred and fifty stimuli were presented per block, of which 13–30% were deviants (M = 20%). Tones were randomly assigned as the standard/deviant. Stimulus presentation was driven by OpenSesame v3.0.733 running on a commercial compact laptop in conjunction with BrainVision StimTrak (Gain = 10, Trigger Level = 1 V). The volume of the oddball stimuli was kept the same for all participants and conditions (approximately 60 dB).
After providing written, informed consent, participants completed a demographic questionnaire and the Edinburgh Handedness Inventory34, followed by the EEG setup. Before starting the task, the two tones were presented to familiarize participants with the stimuli. Participants performed 5 blocks of the oddball task in each of the three environments (Lab, Field, Campus) while counting the number of deviant stimuli (Count), and again in each of the three environments while ignoring task stimuli (Ignore). The order of the task manipulation was randomized, as was the order of environmental conditions nested within either task condition. We chose counting rather than button press responses as our measure of attentional engagement because previous studies have reported that P3 topography is confounded by motor-evoked potentials35.
In the Lab condition, participants performed the oddball task while sitting alone in an interview room. The room was sparsely furnished with a large table, six chairs and a sideboard, surrounded by three white walls without pictures, and one frosted glass wall. Participants sat on a chair with armrests, with the laptop in front of them (supported by a harness strapped to their torso). The participant’s gaze was directed towards a white wall. The glass wall, which separated the interview room from a corridor, was on their right.
The Field condition involved walking around a grass sports field at the Magill campus of the University of South Australia, Adelaide. The sports field is surrounded by a grandstand, a car park for members of the university, trees and fencing (see Fig. 1a). The Campus condition involved navigating a pre-defined route through the university campus adjacent to the sports field. Participants were provided a map with a cross-marked destination (red dot; Fig. 1b) to which they should navigate via several waypoints (yellow dots; Fig. 1b). The route included both outdoor and indoor sections. Participants had to use stairs, open doors, and interact with other people on the campus.
During both walking conditions, participants carried the laptop in front of them (supported by the harness) while carrying the StimTrak in a plastic pocket (attached with a lanyard) over one shoulder as they made their way along the route. Participants were permitted to walk at a comfortable, self-determined pace. The entire testing session lasted between 2.5 and 3 h, with sufficient breaks between conditions to avoid fatigue. Data collection occurred during the summer months, with temperatures typically ranging between 25 and 30 °C. Sessions were not performed when it was raining or in extreme temperatures.
EEG acquisition and preprocessing
The EEG was continuously recorded from 32 Ag/AgCl actiCAP-mounted active electrodes using a Brain Vision LiveAmp 32 amplifier (Brain Products GmbH, Gilching, Germany). Electrode positions conformed to the extended 10–20 system: Fp1, Fz, F3, F7, FT9, FC5, FC1, C3, T7, TP9, CP5, CP1, Pz, P3, P7, O1, Oz, O2, P4, P8, TP10, CP6, CP2, Cz, C4, T8, FT10, FC6, FC2, F4, F8, Fp2. All channels were digitized at a sampling rate of 500 Hz. AFz served as the ground and FCz as the online reference. Electrode impedances were below 20 kΩ at the beginning of the experiment. EEG data were stored on a micro SD card inside the amplifier; the amplifier was kept inside a mesh pocket on the back of the EEG cap during the experiment. After the experiment, the data were transferred from the SD card to a hard drive for offline processing and analysis.
EEG data were preprocessed in MATLAB R2019b (v22.214.171.1249299; The MathWorks, Natick, MA) using custom-built scripts incorporating functions from the EEGLAB (v2019.136) and ERPLAB (v8.1037) toolboxes. Marker files were first manually edited to remove artefactual triggers caused by feedback from the auditory equipment. Edited data were then imported into EEGLAB and downsampled to 250 Hz. Accelerometer channels and non-experimental recording segments were excluded. The online reference was then reintroduced into the dataset, and the data re-referenced to the average of TP9 and TP10 to approximate linked mastoids. The data were then high-pass filtered (passband edge = 0.5 Hz, transition width = 0.5 Hz) using a zero-phase, hamming-windowed, finite impulse response (FIR) sinc filter (implemented in the pop_eegfiltnew function from the firfilt plugin; v2.4).
Filtered data were processed with artifact subspace reconstruction (implemented with the pop_clean_artifacts function from the clean_rawdata plugin; v2.3). This routine was used to remove flat or noisy channels (flatline criterion = 5 s; channel correlation criterion = 0.80; line noise criterion = 4), and to correct for large amplitude artifacts (burst criterion = 1038,39). Data were then low-pass FIR filtered (passband edge = 40 Hz, transition width = 10 Hz) prior to independent component analysis (binica implementation of the extended logistic infomax ICA algorithm40,41). Resultant decompositions were automatically classified using the ICLabel plugin (v1.342). Components classed as either ocular or cardiac in origin with > 90% probability were subtracted (median = 2, range = 1–3).
Missing channels (median = 1, range = 0–4) were interpolated for the purposes of ERP visualization but excluded from statistical analysis. All EEG event markers were systematically shifted − 200 ms relative to their recorded latencies (pop_erplabShiftEventCodes) to account for the lag in signal transmission introduced by the StimTrak. The EEG was then epoched [− 200, 800 ms] relative to the corrected event markers. Extracted epochs were mean-centered and subjected to a moving window artefact rejection routine (pop_artmwppth; voltage threshold = 125 µV, time period = [− 200, 600 ms]; window size = 100 ms, window step = 50 ms). Grand average ERP waveforms and difference waves, along with their accompanying standard error estimates, were computed using the pop_gaverager function (weighted averages based on number of available trials per participant). Finally, mean voltages were extracted from three time-windows per trial epoch (Prestimulus = [− 200, 0 ms]; MMN = [100, 250 ms]; P3 = [250, 500 ms]) and exported for statistical analysis.
In addition to the EEG, the LiveAmp also captures motion data via its in-built 3-axis accelerometer. Following the procedure described by43 we used data obtained from the vertical acceleration axis to estimate the timing of successive heel-strikes during the Field and Campus conditions.
Accelerometry data were imported into MATLAB via EEGLAB and low-pass FIR filtered (passband edge = 4 Hz, transition width = 2 Hz). The filtered timeseries was then divided into four non-overlapping segments corresponding to the Count and Ignore tasks in both the Field and Campus conditions. Segments were defined beginning 1 s before the first stimulus trigger of the task block, and ending 1 s after the final stimulus trigger of the task block.
Candidate heel-strikes were identified using the findpeaks function from the MATLAB Signal Processing Toolbox. The ‘MinPeakDistance’ parameter was set to 300 ms, to ensure that heel-strike events were not erroneously inferred from secondary peaks arising from toe-off events or measurement noise. Any remaining small amplitude peaks (peak prominence > 5 median average deviations below median prominence for the recording segment) were also excluded as measurement error.
All statistical analysis was conducted in R (v3.6.244) using the RStudio Desktop IDE (v1.2.503345). Behavioral, EEG, and gait parameter data were analyzed using linear mixed-effects models fit using the lmer() function from lme4 (v1.1–2346). All mixed-effects models included a by-participant random intercept term to account for non-independence of (within-subject) observations. All categorical independent variables were entered as unordered factors using sum-to-zero contrast coding (reference category coded -1).
For the behavioral model, deviant counts for each block of the Count task were included as the dependent variable, while number of deviant stimuli and environmental condition were included as independent variables. Note that including the number of presented deviants as a covariate controlled for differences in the ground truth count across blocks, enabling us to implicitly model count accuracy as a function of environmental condition.
Separate EEG models were fitted for the MMN and P3 time-windows, with single-trial mean voltage estimates serving as the dependent variable. Environmental condition, stimulus type, and task manipulation were entered as independent variables and permitted to interact with one another. Models additionally included mean prestimulus voltage as a scaled covariate in order to address trial-by-trial variation in prestimulus activity (essentially functioning as a form of baseline correction; see47), and by-channel random intercepts to account for topographic differences in voltage estimates (see supplementary materials for models that specify midline channel location as a fixed effect). By-participant random slopes of environment were included in the MMN model; by-participant random slopes of environment and stimulus were included in the P3 model (more complex random effects structures failed to converge).
Finally, mean step-time and step-time variability estimates were derived from the heel-strike timeseries and modelled as a function of task manipulation, environmental condition, and their interaction. The mean step-time model included a by-participant random slope of environment. Random slopes produced singular fits in the variability data and were therefore omitted from the model.
Main effects and interaction terms were assessed using Wald tests from Type-II ANOVA tables obtained from the car package (v3.0–1048). Model summary tables were produced using sjPlot (v2.8.749). P-values for model terms were derived using Satterthwaite’s method for approximating degrees of freedom. Post-hoc contrasts were obtained via the emmeans package (v1.5.150). Pairwise contrasts were corrected using the Tukey method; interaction contrasts were corrected using the Sidak method. Plotted model predictions are estimated marginal means (also obtained from the emmeans package) and visualised with the aid of tidyverse (v1.3.051). Model predictions are plotted with 84% confidence intervals, where non-overlapping intervals indicate a significant difference at α = 0.0552.
Data availability statement
Raw and preprocessed datasets, along with all code necessary to reproduce the analysis pipeline reported in this paper, are openly available from the OpenNeuro database (https://openneuro.org/datasets/ds003620/versions/1.1.053). Data were archived in accordance with the Brain Imaging Data Structure (BIDS) standard for EEG54 with the assistance of functions from the bids-matlab-tools plugin (v5.2; https://github.com/sccn/bids-matlab-tools).
Two participants were excluded from analysis due to numerous highly inaccurate count estimates (more than double the number of presented deviants on the majority of blocks). Due to a programming error, count estimates from the final block of trials were missing for 21 participants. A further 16 count estimates were excluded as outliers (> 3 SD from the sample mean after estimates had been normalized by the number of presented deviants). The included 39 participants contributed a median 14 counts to the model.
Numerically, mean count estimates were similar across Lab and Field conditions, but reduced in the Campus condition. Linear mixed-effects modelling revealed a significant effect of Environment (χ2(2) = 12.08, p = 0.002) after controlling for the number of presented deviants (see also Fig. 2). Post-hoc contrasts revealed that count estimates were significantly reduced during the Campus condition compared to both the Lab (padj = 0.005) and Field (padj = 0.014) conditions. No significant difference was found between Lab and Field conditions (padj = 0.930).
Event related potentials
A further three participants were excluded from the ERP analysis due to excessively noisy recordings (> 50% epochs rejected due to artifact). Epoch rejection rates for the remaining 36 participants ranged from 0 to 38.6% (M = 7.2, SD = 9.9).
Grand average ERPs and difference waveforms from electrodes Fz and Cz are displayed in Fig. 3 (see supplementary materials for additional ERP plots). In the Lab condition, both channels revealed a marked negative-going waveform in the early time-window for deviant stimuli, consistent with a MMN component. This effect was evident irrespective of task manipulation, although scalp topographies displaying the mean voltage difference between stimuli indicate that the effect was more pronounced over centro-parietal sensors during the Count task (see Fig. 3). Conversely, deviants elicited a strong positive deflection in the first half of the later time-window, consistent with a P3 response. This effect was also strongest over centro-parietal channels in the Count task.
Field and Campus conditions rendered qualitatively similar ERP waveforms. Deflections in the MMN time-window were positive-going for standard tones, and negative-going for deviants, rendering a negative difference wave that was most pronounced over central electrode sites. This pattern of activity was again reversed in the P3 time-window, resulting in a centrally distributed positivity that peaked approximately 300 ms post stimulus onset. This effect was less pronounced in the Campus compared to the Field condition. Comparing across task manipulations, the difference between deviant and standard waveforms in the MMN time-window was slightly accentuated, and more frontally distributed, in the Ignore task, while the P3 window revealed slight accentuation over centro-parietal regions in the Count task.
Taken together, the qualitative pattern of both the early and late ERP components elicited during the walking conditions was generally similar to those elicited in the Lab condition, but of reduced magnitude.
Type II Wald tests revealed a significant three-way interaction between stimulus, task, and environmental condition for the MMN model (χ2 (2) = 7.67, p = 0.022; see Table 1 for full decomposition). This interaction is resolved in Fig. 4 (see Table 2 for the full model summary). This plot reveals that mean voltage was significantly more negative for all pairwise contrasts of stimulus type within each factorial combination of Task and Environment (all padj < 0.001), consistent with the elicitation of the MMN. In line with the ERP waveforms depicted in Fig. 3, the magnitude of this difference was greatest in the Lab condition, and reduced in the other two conditions. This diminution was predominantly driven by the modulation of cortical responses to standard stimuli, which were less positive-going in the Field and Campus conditions compared to the corresponding Lab condition, irrespective of task instructions (all padj < 0.001).
The difference between stimulus responses across environmental conditions was qualitatively similar irrespective of whether participants counted or ignored task stimuli. Nonetheless, sequential interaction contrasts revealed that counting accentuated the difference between standard and deviant responses in the Lab condition relative to the Field condition (padj = 0.028). A similar effect was noted for the Campus relative to the Field condition, on account of the increased difference between stimulus responses when participants counted deviants (padj = 0.038).
Type II Wald tests revealed a significant three-way interaction between stimulus, task, and environment for the P3 model (χ2 (2) = 33.40, p < 0.001; see Table 1 for full decomposition). This interaction is resolved in Fig. 4 (see Table 2 for the full model summary).
Pairwise comparisons of the difference in responses to standards and deviants were significant across all factorial combinations of Task and Environment (all padj < 0.038), with the exception of the Ignore task in the Campus condition (padj = 0.588). Sequential interaction contrasts revealed that the difference between stimulus responses became progressively smaller from Lab, to Field, to Campus conditions in both task manipulations (all padj < 0.001). Counting served to increase the difference between stimulus responses (i.e. amplify the magnitude of the P3 effect) in each environmental condition (all padj < 0.001).
In contrast to our analysis of the MMN time-window, differences between the Count and Ignore tasks in the P3 time-window were primarily driven by modulations of deviant tone processing. Deviant stimuli elicited significantly stronger positivities in both the Lab and Field conditions when being counted as opposed to being ignored (all padj < 0.001). Counted and ignored deviants did not significantly differ from one another in the Campus condition (padj = 0.999).
Type II Wald tests revealed a significant main effect of environmental condition on both mean step-time and step-time variability (see Table 3). On average, step time was 18 ms faster, and evinced greater variability, in the Campus condition (see Table 4). Conversely, there was no significant effect of task instruction on these gait parameters. The effect of environmental condition on step-time was not modulated by task instruction.
The present study addressed the extent to which attentional processing is influenced by the situational context and its associated task demands. This involved comparing electrophysiological correlates of attentional processing between a traditional lab-based setting and two more naturalistic, dynamic scenarios involving walking and navigation. The manipulation of task instructions (i.e., count or ignore oddball stimuli) across these three conditions enabled us to further compare the interaction of different levels of motor and environmental demands on top-down attentional engagement with task stimuli.
While participants were generally able to perform the oddball counting task with a high degree of accuracy across all three environmental conditions, linear mixed-effects regression analysis revealed that oddball counts were significantly less accurate in the Campus condition. This suggests the additional complexity entailed by this condition – both in terms of the more variable and unpredictable sensory stimuli it availed, and the more varied patterns of motor activity it solicited (cf. step-time variability) – were sufficiently distracting to degrade attentional focus on this simple cognitive task. By contrast, the additional motor demands and sensory complexity induced by walking around a sports field did not significantly affect task performance compared to sitting in a quiet room.
By contrast, the main findings from our ERP analyses revealed substantial differences in both the MMN and P3 components under ‘real-world’ versus laboratory conditions. This finding suggests that more ecologically-valid conditions involving motor co-ordination may modulate attentional processing despite ostensibly good behavioral task performance. Differences in ERPs between the Field and the Campus condition were more subtle, which is perhaps surprising given the superior behavioural performance and relative simplicity of the Field condition. These differences were largely confined to the Count task (despite the notable absence of task-specific effects in our analysis of gait parameters), and were more pronounced for the P3 response than the MMN.
With respect to previous studies of MMN and P3 components, findings from our Lab condition confirm the validity of the present results17,55,56. Specifically, the pre-dominant distribution of activity across fronto-central and centro-parietal regions of the scalp, respectively, was in accordance with findings from dual-task walking studies57,58, as well as basic studies of the MMN14,59 and P360.
Increasing evidence from previous laboratory as well as real-world studies point to the fact that attention on a given task depends on aspects such as task-difficulty, concurrent motor demands, as well as environmental conditions27. However, especially in real-world scenarios findings are rare and partly controversial. The present findings tap into this gap—for example—by identifying distinctions in the effects of different real-world scenarios on attentional resources allocated to cognitive task-performance, and by varying cognitive task difficulty. In contrast, previous studies with similar cognitive tasks reported no differences in P3 amplitude between different real-world scenarios3. This apparent discrepancy can be explained by the varied characteristics of the real-world scenarios included within these studies. While simple conditions are comparable to the present sports field condition (e.g., walking on a circuit on the lawn in front of the university), more complex scenarios differ significantly from walking across the campus (e.g., obstacle course on an empty area or corridor).
Together with previous findings, we suggest that commonly-encountered everyday situations (e.g., wayfinding, interacting with other people, etc.) may place attentional resources under higher demand than physically-demanding situations (e.g., obstacle course) within a controlled, unchanging environment. In accordance with previous real-world EEG findings23,25,27, evidence from laboratory studies, which used similar cognitive tasks, also identified no significant effects of increased motor demands (e.g., slow walking vs. fast walking on a treadmill)20. However, studies with more difficult cognitive tasks (higher number of target-stimuli and increased complexity) report differences in amplitude, latency, and topography of ERP components with increasing motor demands21. It follows that the amount of attention deployed during a given cognitive task is influenced by the complexity of real-world situations, but more importantly, that the influence of environmental complexity is also modulated by cognitive task difficulty.
In contrast to previous studies, the present findings revealed significant interactions between stimulus, task, and condition for both ERP time-windows3. The difference between standard and deviant stimulus responses diminished from lab to ‘real-world’ conditions. For the MMN, this effect was predominantly driven by a reduction in the positivity evoked by standard stimuli while walking; deviants, by contrast, evoked similar voltage levels irrespective of environmental or task condition. Analogously, standard stimuli evoked less-negative potentials in the P3 time-window during the walking conditions compared to the lab.
This pattern of results is broadly consistent with a predictive coding-style account of perceptual learning61,62 and its attentional modulation via the mechanism of synaptic gain-control63,64. Under the assumption that frequent, regular presentations of the standard tone enable the brain to construct a precise model of stimulus features (e.g., pitch, duration), the sensory signals generated by repeated stimuli are efficiently cancelled-out (or ‘silenced’) by descending model predictions16,65. The present findings suggest this ability may be reduced when moving through (and actively engaging with) more complex, dynamic environments. A possible explanation for this is that the additional, competing demands imposed on attention by more naturalistic scenarios may limit the brain’s capacity to accurately and precisely model recurrent stimuli, such that they are subject to more elaborate cortical processing than they would ordinarily be afforded under laboratory conditions. The functional upshot of this account is that standard stimuli may essentially be treated more like deviants when occasioned in the context of more complex, variable, and uncertain conditions than those typically encountered in the lab.
Currently, we do not fully understand the extent to which environmental stimulation and movement-related information recruit attention resources. However, based on the findings presented here and in other recently published naturalistic studies3,27, it is becoming increasingly evident that factors such as gross motor activity (as opposed to sitting or standing), cognitive task difficulty, and the degree of experimental control over ambient conditions (i.e. laboratory vs. real-world settings), constitute highly relevant determinants of attention and cognitive resource allocation. Such results highlight potential limitations in the generalizability of standard laboratory experiments to the more complex, dynamic conditions encountered in everyday life. However, it is also important to note some of the limitations and ongoing challenges faced by real-world designs, which we consider below.
The present study focused on EEG signals in order to avoid potential complications or confounds introduced by encumbering participants with multiple measurement devices. One consequence of this decision was that it restricted our ability to quantify motor activity. While our analysis of gait parameters was therefore rather limited, it bore out the intuition that campus navigation engenders more complex patterns of locomotion than walking around the sports field (as evidenced by greater step-time variability). Moreover, differences in cognitive task load did not significantly affect step-time parameters, lending credence to the notion that differences in ERP responses across Count and Ignore tasks stem from differences in cognitive processing rather than physical activity. However, we must reiterate the preliminary nature of this finding, and urge more sophisticated analyses of the relation between motor and cognitive activity in future work.
Although advancing technological innovations are revolutionizing the study of cognition under ecologically-valid conditions, mobile EEG designs still face a number of challenges. In addition to the concern that performing tasks and activities while wearing/carrying recording devices may perturb normal functioning, the amount and quality of the data collected under such conditions is often reduced compared to standard laboratory conditions. Although we attempted to mitigate this potential issue through the application of sophisticated artifact rejection techniques, epoch rejection rates varied considerably amongst individuals. The problem of noisy data collection might also have been compounded by the measurement imprecision introduced by the delayed (and in some cases, repeated) transmission of event markers. While we took care to correct these errors without introducing bias (i.e., applying a uniform adjustment designed to ameliorate event marker lag across all conditions prior to statistical analysis), the additional variance introduced into the data may have limited our sensitivity to fine-grained differences between conditions.
Despite these cautionary remarks, the rapid development of mobile EEG systems and software solutions suggests that many of the challenges mentioned above can be overcome in future studies. Methodological innovations such as the development of ear-EEG systems promise to enable the acquisition of high-quality data while participants move about freely66,67. Sophisticated algorithms for capturing and characterizing gait-related artefacts are also being developed (see, e.g.,68). Such advancements will prove critical for enhancing the quality and robustness of mobile EEG data collected under complex and variable environmental conditions.
Existing findings from naturalistic EEG studies provide valuable insights concerning the nature of well-established markers of cognitive processing such as the MMN and P3 components. The present results align well with recently published mobile EEG studies and fill an important gap in this literature about the effects of environmental complexity, motor demands, and cognitive task load on attention within naturalistic scenarios. Furthermore, our findings highlight the necessity of extending future cognitive research programs beyond the confines of the laboratory. Ideally, such studies will combine complementary measurement devices as they become increasingly portable (e.g., ear-EEG & eye-tracking), and address a greater variety of everyday situations.
Schröger, E. & Wolff, C. Behavioral and electrophysiological effects of task-irrelevant sound change: A new distraction paradigm. Cogn. Brain Res. 7, 71–87 (1998).
Di Flumeri, G. et al. EEG-based mental workload neurometric to evaluate the impact of different traffic and road conditions in real driving settings. Front. Hum. Neurosci. 12, 509 (2018).
Reiser, J. E., Wascher, E. & Arnau, S. Recording mobile EEG in an outdoor environment reveals cognitive-motor interference dependent on movement complexity. Sci. Rep. 9, 1–14 (2019).
Näätänen, R. & Alho, K. Mismatch negativity-a unique measure of sensory processing in audition. Int. J. Neurosci. 80, 317–337 (1995).
Polich, J. et al. P300 topography of amplitude/latency correlations. Brain Topogr. 9, 275–282 (1997).
Smith, M. E. et al. The intracranial topography of the P3 event-related potential elicited during auditory oddball. Electroencephalogr. Clin. Neurophysiol. 76, 235–248 (1990).
Polich, J. Updating P300: An integrative theory of P3a and P3b. Clin. Neurophys. 118, 2128–2148 (2007).
Kok, A. Internal and external control: A two-factor model of amplitude change of event-related potentials. Acta Psychol. (Amst) 74, 213–236 (1990).
Polich, J. & Kok, A. Cognitive and biological determinants of P300: An integrative review. Biol. Psychol. 41, 103–146 (1995).
Kramer, A. F. & Strayer, D. L. Assessing the development of automatic processing: An application of dual-task and event-related brain potential methodologies. Biol. Psychol. 26, 231–267 (1988).
Wickens, C., Kramer, A., Vanasse, L. & Donchin, E. Performance of concurrent tasks: A psychophysiological analysis of the reciprocity of information-processing resources. Science 221, 1080–1082 (1983).
Nash, A. J. & Fernandez, M. P300 and allocation of attention in dual-tasks. Int. J. Psychophysiol. 23, 171–180 (1996).
Allison, B. Z. & Polich, J. Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biol. Psychol. 77, 277–283 (2008).
Duncan, C. C. et al. Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400. Clin. Neurophysiol. 120, 1883–1908 (2009).
Näätänen, R., Kujala, T. & Winkler, I. Auditory processing that leads to conscious perception: A unique window to central auditory processing opened by the mismatch negativity and related responses. Psychophysiology 48, 4–22 (2011).
Garrido, M. I., Kilner, J. M., Stephan, K. E. & Friston, K. J. The mismatch negativity: A review of underlying mechanisms. Clin. Neurophysiol. 120, 453–463 (2009).
Näätänen, R., Paavilainen, P., Rinne, T. & Alho, K. The mismatch negativity (MMN) in basic research of central auditory processing: A review. Clin. Neurophysiol. 118, 2544–2590 (2007).
Pazo-Alvarez, P., Cadaveira, F. & Amenedo, E. MMN in the visual modality: A review. Biol. Psychol. 63, 199–236 (2003).
Näätänen, R., Gaillard, A. W. K. & Mäntysalo, S. Early selective-attention effect on evoked potential reinterpreted. Acta Psychol. (Amst) 42, 313–329 (1978).
Gramann, K., Gwin, J. T., Bigdely-Shamlo, N., Ferris, D. P. & Makeig, S. Visual evoked responses during standing and walking. Front. Hum. Neurosci. 4, 202 (2010).
De Sanctis, P., Butler, J. S., Malcolm, B. R. & Foxe, J. J. Recalibration of inhibitory control systems during walking-related dual-task interference: A mobile brain-body imaging (MOBI) study. Neuroimage 94, 55–64 (2014).
Nenna, F., Do, C. T., Protzak, J. & Gramann, K. Alteration of brain dynamics during dual-task overground walking. Eur. J. Neurosci. 00, 1–17 (2020).
Zink, R., Hunyadi, B., Van Huffel, S. & De Vos, M. Mobile EEG on the bike: Disentangling attentional and physical contributions to auditory attention tasks. J. Neural Eng. 13, 46017 (2016).
Scanlon, J. E. M., Townsend, K. A., Cormier, D. L., Kuziek, J. W. P. & Mathewson, K. E. Taking off the training wheels: Measuring auditory P3 during outdoor cycling using an active wet EEG system. Brain Res. 1716, 50–61 (2019).
Robles, D. et al. EEG in motion: Using an oddball task to explore motor interference in active skateboarding. Eur. J. Neurosci. (2021).
De Vos, M., Gandras, K. & Debener, S. Towards a truly mobile auditory brain–computer interface: Exploring the P300 to take away. Int. J. Psychophysiol. 91, 46–53 (2014).
Ladouce, S., Donaldson, D. I., Dudchenko, P. A. & Ietswaart, M. Mobile EEG identifies the re-allocation of attention during real-world activity. Sci. Rep. 9, 1–10 (2019).
Aspinall, P., Mavros, P., Coyne, R. & Roe, J. The urban brain: Analysing outdoor physical activity with mobile EEG. Br J Sport. Med 49, 272–276 (2015).
Pizzamiglio, S., Naeem, U., Abdalla, H. & Turner, D. L. Neural correlates of single-and dual-task walking in the real world. Front. Hum. Neurosci. 11, 460 (2017).
Park, J. L. & Donaldson, D. I. Detecting the neural correlates of episodic memory with mobile EEG: Recollecting objects in the real world. Neuroimage 193, 1–9 (2019).
Piñeyro Salvidegoitia, M. et al. Out and about: Subsequent memory effect captured in a natural outdoor environment with smartphone EEG. Psychophysiology 56, 13331 (2019).
Brilmayer, I., Sassenhagen, J., Bornkessel-Schlesewsky, I. & Schlesewsky, M. Domain-general neural correlates of dependency formation: Using complex tones to simulate language. Cortex 93, 50–67 (2017).
Mathôt, S., Schreij, D. & Theeuwes, J. OpenSesame: An open-source, graphical experiment builder for the social sciences. Behav. Res. Methods 44, 314–324 (2012).
Oldfield, R. C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9, 97–113 (1971).
Salisbury, D. F., Rutherford, B., Shenton, M. E. & McCarley, R. W. Button-pressing affects P300 amplitude and scalp topography. Clin. Neurophysiol. 112, 1676–1684 (2001).
Delorme, A. & Makeig, S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).
Lopez-Calderon, J. & Luck, S. J. ERPLAB: An open-source toolbox for the analysis of event-related potentials. Front. Hum. Neurosci. 8, 213 (2014).
Chang, C.-Y., Hsu, S.-H., Pion-Tonachini, L. & Jung, T.-P. Evaluation of artifact subspace reconstruction for automatic EEG artifact removal. in 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 1242–1245 (IEEE, 2018).
Mullen, T. R. et al. Real-time neuroimaging and cognitive monitoring using wearable dry EEG. IEEE Trans. Biomed. Eng. 62, 2553–2567 (2015).
Bell, A. J. & Sejnowski, T. J. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129–1159 (1995).
Lee, T.-W., Girolami, M. & Sejnowski, T. J. Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Comput. 11, 417–441 (1999).
Pion-Tonachini, L., Kreutz-Delgado, K. & Makeig, S. ICLabel: An automated electroencephalographic independent component classifier, dataset, and website. Neuroimage 198, 181–197 (2019).
Hwang, T.-H., Reh, J., Effenberg, A. O. & Blume, H. Real-time gait analysis using a single head-worn inertial measurement unit. IEEE Trans. Consum. Electron. 64, 240–248 (2018).
R Core Team. A language and environment for statistical computing. https://www.r-project.org/ (2019).
R Studio Team. RStudio: Integrated Development for R. RStudio. http://www.rstudio.com/ (2015).
Bates, D. et al. Package ‘lme4’. Convergence 12, 2 (2015).
Alday, P. M. How much baseline correction do we need in ERP research? Extended GLM model can replace baseline correction while lifting its limits. Psychophysiology 56, e13451 (2019).
Fox, J. & Weisberg, S. An R companion to applied regression. (Sage publications, 2018).
Lüdecke, D. sjPlot: Data Visualization for Statistics in Social Science. https://doi.org/10.5281/zenodo.1308157 (2020).
Lenth, R. emmeans: Estimated marginal means, aka least-squares means (Version 1.3.0)[R package]. (2020).
Wickham, H. et al. Welcome to the Tidyverse. J. Open Source Softw. 4, 1686 (2019).
MacGregor-Fors, I. & Payton, M. E. Contrasting diversity values: Statistical inferences based on overlapping confidence intervals. PLoS ONE 8, e56794 (2013).
Liebherr, M. et al. Runabout: A mobile EEG study of auditory oddball processing in laboratory and real-world conditions. OpenNeuro, 1.1.0, ds003620 (2021).
Pernet, C. R. et al. EEG-BIDS, an extension to the brain imaging data structure for electroencephalography. Sci. Data 6, 1–5 (2019).
Dariusz, A. et al. The response relevance of visual stimuli modulates the P3 component and the underlying sensorimotor network. Sci. Rep. 10, (2020).
Näätänen, R. Mismatch negativity (MMN): Perspectives for application. Int. J. Psychophysiol. 37, 3–10 (2000).
Holtzer, R. et al. Online fronto-cortical control of simple and attention-demanding locomotion in humans. Neuroimage 112, 152–159 (2015).
Mirelman, A. et al. Increased frontal brain activation during walking while dual tasking: An fNIRS study in healthy young adults. J. Neuroeng. Rehabil. 11, 85 (2014).
Näätänen, R., Pakarinen, S., Rinne, T. & Takegata, R. The mismatch negativity (MMN): towards the optimal paradigm. Clin. Neurophysiol. 115, 140–144 (2004).
Debener, S., Makeig, S., Delorme, A. & Engel, A. K. What is novel in the novelty oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis. Cogn. Brain Res. 22, 309–321 (2005).
Friston, K. A theory of cortical responses. Philos. Trans. R. Soc. B Biol. Sci. 360, 815–836 (2005).
Rao, R. P. N. & Ballard, D. H. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79–87 (1999).
Feldman, H. & Friston, K. Attention, uncertainty, and free-energy. Front. Hum. Neurosci. 4, 215 (2010).
Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C. & De Lange, F. P. Attention reverses the effect of prediction in silencing sensory signals. Cereb. Cortex 22, 2197–2206 (2012).
Todd, J., Finch, B., Smith, E., Budd, T. W. & Schall, U. Temporal processing ability is related to ear-asymmetry for detecting time cues in sound: A mismatch negativity (MMN) study. Neuropsychologia 49, 69–82 (2011).
Bleichner, M. G. & Debener, S. Concealed, unobtrusive ear-centered EEG acquisition: cEEGrids for transparent EEG. Front. Hum. Neurosci. 11, 163 (2017).
Hölle, D., Meekes, J. & Bleichner, M. G. Mobile ear-EEG to study auditory attention in everyday life. Behav. Res. Methods 1–12 (2021).
Jacobsen, N. S. J., Blum, S., Witt, K. & Debener, S. A walk in the park? Characterizing gait‐related artifacts in mobile EEG recordings. Eur. J. Neurosci. (2020).
AWC and CAH are supported by Australian Government Research Training Program (RTP) scholarships. IBS acknowledges the support of an Australian Research Council Future Fellowship (FT160100437). This research was funded by the University of South Australia under the Research Themes Investment Scheme. We would also like to thank the undergraduate students in course BEHL 3021 (“Cognitive Neuroscience”) at the University of South Australia who participated in this study and helped with data collection as part of their class project.
Open Access funding enabled and organized by Projekt DEAL.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Liebherr, M., Corcoran, A.W., Alday, P.M. et al. EEG and behavioral correlates of attentional processing while walking and navigating naturalistic environments. Sci Rep 11, 22325 (2021). https://doi.org/10.1038/s41598-021-01772-8